-- Logs begin at Wed 2022-05-25 13:54:22 UTC, end at Wed 2022-05-25 15:23:58 UTC. -- May 25 14:41:24.938130 dv-cinder-803823-9-smb systemd[1]: Starting Devstack devstack@keystone.service... May 25 14:41:24.945518 dv-cinder-803823-9-smb devstack@keystone.service[101878]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini May 25 14:41:24.947510 dv-cinder-803823-9-smb devstack@keystone.service[101878]: *** Starting uWSGI 2.0.18-debian (64bit) on [Wed May 25 14:41:24 2022] *** May 25 14:41:24.947510 dv-cinder-803823-9-smb devstack@keystone.service[101878]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 May 25 14:41:24.947510 dv-cinder-803823-9-smb devstack@keystone.service[101878]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 May 25 14:41:24.947510 dv-cinder-803823-9-smb devstack@keystone.service[101878]: nodename: dv-cinder-803823-9-smb May 25 14:41:24.947510 dv-cinder-803823-9-smb devstack@keystone.service[101878]: machine: x86_64 May 25 14:41:24.947510 dv-cinder-803823-9-smb devstack@keystone.service[101878]: clock source: unix May 25 14:41:24.947510 dv-cinder-803823-9-smb devstack@keystone.service[101878]: pcre jit disabled May 25 14:41:24.947510 dv-cinder-803823-9-smb devstack@keystone.service[101878]: detected number of CPU cores: 4 May 25 14:41:24.947510 dv-cinder-803823-9-smb devstack@keystone.service[101878]: current working directory: / May 25 14:41:24.948036 dv-cinder-803823-9-smb devstack@keystone.service[101878]: detected binary path: /usr/bin/uwsgi-core May 25 14:41:24.948036 dv-cinder-803823-9-smb devstack@keystone.service[101878]: your processes number limit is 47680 May 25 14:41:24.948036 dv-cinder-803823-9-smb devstack@keystone.service[101878]: your memory page size is 4096 bytes May 25 14:41:24.948036 dv-cinder-803823-9-smb devstack@keystone.service[101878]: detected max file descriptor number: 2048 May 25 14:41:24.948036 dv-cinder-803823-9-smb devstack@keystone.service[101878]: lock engine: pthread robust mutexes May 25 14:41:24.948744 dv-cinder-803823-9-smb devstack@keystone.service[101878]: thunder lock: enabled May 25 14:41:24.950418 dv-cinder-803823-9-smb devstack@keystone.service[101878]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 May 25 14:41:24.950418 dv-cinder-803823-9-smb devstack@keystone.service[101878]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] May 25 14:41:24.993928 dv-cinder-803823-9-smb devstack@keystone.service[101878]: Python main interpreter initialized at 0x55fd15c769c0 May 25 14:41:24.993928 dv-cinder-803823-9-smb devstack@keystone.service[101878]: python threads support enabled May 25 14:41:24.993928 dv-cinder-803823-9-smb devstack@keystone.service[101878]: your server socket listen backlog is limited to 100 connections May 25 14:41:24.993928 dv-cinder-803823-9-smb devstack@keystone.service[101878]: your mercy for graceful operations on workers is 90 seconds May 25 14:41:24.994295 dv-cinder-803823-9-smb devstack@keystone.service[101878]: mapped 403077 bytes (393 KB) for 2 cores May 25 14:41:24.994378 dv-cinder-803823-9-smb devstack@keystone.service[101878]: *** Operational MODE: preforking *** May 25 14:41:24.994631 dv-cinder-803823-9-smb devstack@keystone.service[101878]: *** uWSGI is running in multiple interpreter mode *** May 25 14:41:24.994631 dv-cinder-803823-9-smb devstack@keystone.service[101878]: spawned uWSGI master process (pid: 101878) May 25 14:41:24.994839 dv-cinder-803823-9-smb systemd[1]: Started Devstack devstack@keystone.service. May 25 14:41:24.997529 dv-cinder-803823-9-smb devstack@keystone.service[101878]: spawned uWSGI worker 1 (pid: 101892, cores: 1) May 25 14:41:24.997529 dv-cinder-803823-9-smb devstack@keystone.service[101878]: spawned uWSGI worker 2 (pid: 101893, cores: 1) May 25 14:41:24.997529 dv-cinder-803823-9-smb devstack@keystone.service[101878]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... May 25 14:41:30.726554 dv-cinder-803823-9-smb devstack@keystone.service[101893]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 25 14:41:30.726554 dv-cinder-803823-9-smb devstack@keystone.service[101893]: from cryptography.utils import int_from_bytes May 25 14:41:30.727356 dv-cinder-803823-9-smb devstack@keystone.service[101893]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 25 14:41:30.727356 dv-cinder-803823-9-smb devstack@keystone.service[101893]: from cryptography.utils import int_from_bytes May 25 14:41:30.727802 dv-cinder-803823-9-smb devstack@keystone.service[101892]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 25 14:41:30.727802 dv-cinder-803823-9-smb devstack@keystone.service[101892]: from cryptography.utils import int_from_bytes May 25 14:41:30.728269 dv-cinder-803823-9-smb devstack@keystone.service[101892]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 25 14:41:30.728269 dv-cinder-803823-9-smb devstack@keystone.service[101892]: from cryptography.utils import int_from_bytes May 25 14:41:30.776700 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=101893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} May 25 14:41:30.776874 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=101893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} May 25 14:41:30.777064 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG uwsgi [-] command line args: [] {{(pid=101893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} May 25 14:41:30.777230 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=101892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} May 25 14:41:30.777319 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=101893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} May 25 14:41:30.777426 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=101892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} May 25 14:41:30.777520 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG uwsgi [-] ================================================================================ {{(pid=101893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} May 25 14:41:30.777646 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG uwsgi [-] command line args: [] {{(pid=101892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} May 25 14:41:30.777758 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG uwsgi [-] admin_token = **** {{(pid=101893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:41:30.777918 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=101892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} May 25 14:41:30.778005 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG uwsgi [-] config_dir = [] {{(pid=101893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:41:30.778090 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG uwsgi [-] ================================================================================ {{(pid=101892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} May 25 14:41:30.778164 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=101893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:41:30.778336 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG uwsgi [-] admin_token = **** {{(pid=101892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:41:30.778422 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG uwsgi [-] config_source = [] {{(pid=101893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:41:30.778495 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG uwsgi [-] debug = True {{(pid=101893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:41:30.778565 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG uwsgi [-] config_dir = [] {{(pid=101892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:41:30.778707 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=101893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:41:30.778949 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=101892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:41:30.778949 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG uwsgi [-] config_source = [] {{(pid=101892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:41:30.779074 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=101893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:41:30.779138 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG uwsgi [-] debug = True {{(pid=101892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:41:30.779206 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG uwsgi [-] insecure_debug = False {{(pid=101893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:41:30.779271 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=101892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:41:30.779466 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=101893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:41:30.779601 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=101892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:41:30.779705 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG uwsgi [-] insecure_debug = False {{(pid=101892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:41:30.779819 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=101893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:41:30.779928 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=101892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:41:30.780032 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG uwsgi [-] list_limit = None {{(pid=101893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:41:30.780130 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG uwsgi [-] log_config_append = None {{(pid=101893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:41:30.780232 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=101892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:41:30.780334 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=101893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:41:30.780443 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG uwsgi [-] list_limit = None {{(pid=101892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:41:30.780541 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG uwsgi [-] log_dir = None {{(pid=101893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:41:30.780642 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG uwsgi [-] log_config_append = None {{(pid=101892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:41:30.780739 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG uwsgi [-] log_file = None {{(pid=101893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:41:30.780841 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=101892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:41:30.780939 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=101893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:41:30.781068 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG uwsgi [-] log_dir = None {{(pid=101892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:41:30.781068 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG uwsgi [-] log_file = None {{(pid=101892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:41:30.781257 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=101893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:41:30.781333 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=101892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:41:30.781455 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=101893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:41:30.781539 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=101892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:41:30.781620 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=101893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:41:30.781741 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=101893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:41:30.781816 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=101892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:41:30.781938 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=101893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:41:30.782022 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=101892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:41:30.782103 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=101893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:41:30.782227 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=101892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:41:30.782311 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=101893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:41:30.782390 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=101892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:41:30.782515 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=101893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:41:30.782592 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=101892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:41:30.782760 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=101893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:41:30.782885 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=101892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:41:30.782968 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=101893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:41:30.783041 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=101892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:41:30.783157 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=101893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:41:30.783239 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=101892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:41:30.783358 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=101893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:41:30.783439 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=101892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:41:30.783618 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG uwsgi [-] notification_format = cadf {{(pid=101893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:41:30.783722 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=101892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:41:30.783867 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=101892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:41:30.783946 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=101893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:41:30.784114 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG uwsgi [-] notification_format = cadf {{(pid=101892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:41:30.784362 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.84/identity {{(pid=101893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:41:30.784486 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=101892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:41:30.784565 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG uwsgi [-] publish_errors = False {{(pid=101893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:41:30.784767 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=101893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:41:30.784849 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.84/identity {{(pid=101892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:41:30.784997 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=101893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:41:30.785076 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG uwsgi [-] publish_errors = False {{(pid=101892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:41:30.785159 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=101893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:41:30.785238 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=101892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:41:30.785406 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=101893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:41:30.785491 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=101892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:41:30.785632 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=101892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:41:30.785733 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=101893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:41:30.785878 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG uwsgi [-] standard_threads = False {{(pid=101893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:41:30.785952 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=101892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:41:30.786080 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG uwsgi [-] strict_password_check = False {{(pid=101893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:41:30.786208 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=101892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:41:30.786320 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=101893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:41:30.786402 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG uwsgi [-] standard_threads = False {{(pid=101892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:41:30.786500 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG uwsgi [-] use_eventlog = False {{(pid=101893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:41:30.786585 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG uwsgi [-] strict_password_check = False {{(pid=101892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:41:30.786658 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG uwsgi [-] use_journal = False {{(pid=101893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:41:30.786779 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=101892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:41:30.786866 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG uwsgi [-] use_json = False {{(pid=101893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:41:30.786940 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG uwsgi [-] use_eventlog = False {{(pid=101892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:41:30.787010 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG uwsgi [-] use_stderr = False {{(pid=101893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:41:30.787119 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG uwsgi [-] use_journal = False {{(pid=101892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:41:30.787204 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG uwsgi [-] use_syslog = False {{(pid=101893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:41:30.787324 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG uwsgi [-] use_json = False {{(pid=101892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:41:30.787412 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG uwsgi [-] watch_log_file = False {{(pid=101893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:41:30.787485 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG uwsgi [-] use_stderr = False {{(pid=101892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:41:30.787635 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=101893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:41:30.787728 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG uwsgi [-] use_syslog = False {{(pid=101892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:41:30.787869 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG uwsgi [-] watch_log_file = False {{(pid=101892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:41:30.787948 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=101893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:41:30.788121 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=101893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:41:30.788207 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=101892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:41:30.788357 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=101893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:41:30.788443 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=101892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:41:30.788603 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=101893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:41:30.788683 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=101892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:41:30.788837 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=101893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:41:30.788917 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=101892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:41:30.789079 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=101893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:41:30.789158 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=101892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:41:30.789312 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=101893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:41:30.789397 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=101892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:41:30.789554 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=101893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:41:30.789635 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=101892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:41:30.789789 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=101892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:41:30.789867 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=101893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:41:30.790034 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=101893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:41:30.790118 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=101892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:41:30.790265 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=101893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:41:30.790346 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=101892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:41:30.790506 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=101893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:41:30.790592 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=101892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:41:30.790739 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=101893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:41:30.790818 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=101892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:41:30.790974 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=101892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:41:30.791058 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=101893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:41:30.791205 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=101892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:41:30.791291 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=101893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:41:30.791434 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=101893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:41:30.791519 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=101892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:41:30.791711 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=101892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:41:30.791788 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=101893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:41:30.791932 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=101892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:41:30.792018 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=101893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:41:30.792176 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=101893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:41:30.792263 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=101892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:41:30.792409 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=101893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:41:30.792488 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=101892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:41:30.792658 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=101892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:41:30.792744 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=101893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:41:30.792897 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=101892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:41:30.792987 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=101893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:41:30.793176 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=101892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:41:30.793255 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=101893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:41:30.793440 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=101892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:41:30.793693 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=101893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:41:30.793791 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=101892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:41:30.793865 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=101893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:41:30.793931 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=101892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:41:30.794072 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=101893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:41:30.794148 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=101892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:41:30.794301 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=101893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:41:30.794369 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=101892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:41:30.794536 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=101893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:41:30.794607 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=101892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:41:30.795038 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=101892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:41:30.795134 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=101893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:41:30.795197 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=101892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:41:30.795256 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=101893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:41:30.795383 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=101892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:41:30.795459 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=101893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:41:30.795857 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=101892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:41:30.795857 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=101892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:41:30.796103 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=101892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:41:30.796356 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=101892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:41:30.796799 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=101892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:41:30.797001 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=101893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:41:30.797217 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=101892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:41:30.797217 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=101892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:41:30.797405 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=101892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:41:30.797502 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=101892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:41:30.797736 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=101892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:41:30.797966 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=101892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:41:30.798197 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=101892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:41:30.798428 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=101892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:41:30.798552 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=101893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:41:30.798653 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=101892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:41:30.798803 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=101893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:41:30.798936 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=101892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:41:30.799103 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=101893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:41:30.799270 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=101892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:41:30.799444 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=101893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:41:30.799597 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=101892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:41:30.799597 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=101892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:41:30.799918 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=101892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:41:30.800100 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=101892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:41:30.800361 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=101892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:41:30.800588 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=101892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:41:30.800773 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=101893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:41:30.800966 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=101892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:41:30.801070 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=101893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:41:30.801202 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=101892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:41:30.801368 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=101893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:41:30.801457 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=101892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:41:30.801585 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=101893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:41:30.801664 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=101892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:41:30.801792 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=101893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:41:30.801874 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=101892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:41:30.802052 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=101893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:41:30.802136 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=101892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:41:30.802263 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=101893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:41:30.802345 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=101892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:41:30.802509 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=101893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:41:30.802759 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=101892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:41:30.802897 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=101893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:41:30.803029 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=101892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:41:30.803156 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=101893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:41:30.803281 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=101892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:41:30.803417 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=101893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:41:30.803553 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=101892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:41:30.803736 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=101893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:41:30.803860 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=101892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:41:30.803998 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=101893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:41:30.804136 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=101892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:41:30.804273 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=101893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:41:30.804398 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=101892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:41:30.804525 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=101893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:41:30.804652 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=101892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:41:30.804779 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=101893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:41:30.804907 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=101892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:41:30.805043 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=101893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:41:30.805177 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=101892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:41:30.805311 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=101893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:41:30.805477 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=101892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:41:30.805612 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=101893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:41:30.805756 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=101892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:41:30.805961 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=101893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:41:30.806092 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=101892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:41:30.806220 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=101893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:41:30.806346 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=101892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:41:30.806474 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=101893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:41:30.806600 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=101892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:41:30.806739 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=101893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:41:30.806867 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG uwsgi [-] cache.enabled = True {{(pid=101892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:41:30.806994 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=101893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:41:30.807122 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=101892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:41:30.807249 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=101893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:41:30.807249 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=101893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:41:30.807516 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=101892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:41:30.807516 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=101892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:41:30.807786 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=101893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:41:30.807921 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=101892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:41:30.808050 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=101893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:41:30.808178 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=101892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:41:30.808316 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=101893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:41:30.808447 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=101892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:41:30.808575 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=101893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:41:30.808703 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=101892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:41:30.809317 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=101893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:41:30.809456 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=101892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:41:30.809589 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=101893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:41:30.809722 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=101892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:41:30.809861 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=101893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:41:30.809990 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=101892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:41:30.810118 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=101893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:41:30.810241 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=101892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:41:30.810365 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=101893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:41:30.810496 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=101892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:41:30.810620 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=101893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:41:30.810747 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=101892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:41:30.810880 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=101893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:41:30.811008 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=101892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:41:30.811141 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=101893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:41:30.811277 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=101892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:41:30.811361 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG uwsgi [-] cache.enabled = True {{(pid=101893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:41:30.811424 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=101892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:41:30.811684 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=101893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:41:30.811810 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=101892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:41:30.811945 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=101893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:41:30.812082 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=101892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:41:30.812210 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=101893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:41:30.812338 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=101892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:41:30.812819 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=101893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:41:30.812956 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=101892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:41:30.813085 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=101893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:41:30.813085 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=101893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:41:30.813335 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=101892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:41:30.813463 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=101893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:41:30.813602 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=101892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:41:30.813748 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=101893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:41:30.813876 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=101892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:41:30.814011 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=101893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:41:30.814148 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=101892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:41:30.814148 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=101892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:41:30.814395 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=101893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:41:30.814395 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=101893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:41:30.814635 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=101892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:41:30.814770 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=101893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:41:30.814899 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=101892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:41:30.815026 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=101893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:41:30.815153 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=101892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:41:30.815302 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=101893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:41:30.815432 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG uwsgi [-] auth.external = None {{(pid=101892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:41:30.815592 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=101893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:41:30.815717 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG uwsgi [-] auth.mapped = None {{(pid=101892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:41:30.815846 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=101893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:41:30.815846 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=101893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:41:30.816085 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=101892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:41:30.816221 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=101893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:41:30.816357 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=101892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:41:30.816493 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=101893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:41:30.816621 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG uwsgi [-] auth.password = None {{(pid=101892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:41:30.816748 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=101893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:41:30.816876 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG uwsgi [-] auth.token = None {{(pid=101892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:41:30.817004 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=101893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:41:30.817138 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=101892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:41:30.817282 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=101893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:41:30.817410 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG uwsgi [-] catalog.caching = True {{(pid=101892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:41:30.817537 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=101893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:41:30.817664 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=101892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:41:30.817791 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=101893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:41:30.817948 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=101892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:41:30.818092 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=101893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:41:30.818223 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=101892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:41:30.818346 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=101893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:41:30.818474 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=101892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:41:30.818601 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=101893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:41:30.818730 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=101892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:41:30.818857 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=101893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:41:30.818996 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG uwsgi [-] credential.caching = True {{(pid=101892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:41:30.819132 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG uwsgi [-] auth.external = None {{(pid=101893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:41:30.819261 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG uwsgi [-] credential.driver = sql {{(pid=101892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:41:30.819389 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG uwsgi [-] auth.mapped = None {{(pid=101893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:41:30.819516 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=101892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:41:30.819678 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=101893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:41:30.819819 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=101892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:41:30.819949 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=101893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:41:30.820077 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=101892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:41:30.820205 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG uwsgi [-] auth.password = None {{(pid=101893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:41:30.820333 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=101892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:41:30.820461 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG uwsgi [-] auth.token = None {{(pid=101893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:41:30.820597 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=101892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:41:30.820732 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=101893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:41:30.820871 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=101892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:41:30.820999 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG uwsgi [-] catalog.caching = True {{(pid=101893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:41:30.821134 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=101892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:41:30.821262 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=101893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:41:30.821461 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=101892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:41:30.821591 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=101893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:41:30.821719 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=101892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:41:30.821846 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=101893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:41:30.821980 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=101892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:41:30.822121 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=101893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:41:30.822249 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=101892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:41:30.822376 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=101893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:41:30.822376 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG uwsgi [-] credential.caching = True {{(pid=101893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:41:30.822626 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=101892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:41:30.822753 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG uwsgi [-] credential.driver = sql {{(pid=101893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:41:30.822888 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=101892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:41:30.823018 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=101893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:41:30.823146 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=101892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:41:30.823273 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=101893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:41:30.823401 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG uwsgi [-] federation.caching = True {{(pid=101892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:41:30.823534 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=101893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:41:30.823690 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=101892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:41:30.823819 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=101893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:41:30.823947 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG uwsgi [-] federation.driver = sql {{(pid=101892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:41:30.824074 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=101893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:41:30.824202 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=101892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:41:30.824336 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=101893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:41:30.824512 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=101892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:41:30.825154 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=101893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:41:30.825280 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=101892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:41:30.825409 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=101893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:41:30.825537 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=101892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:41:30.825667 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=101893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:41:30.825803 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=101892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:41:30.825803 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=101892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:41:30.826045 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=101893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:41:30.826172 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=101892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:41:30.826300 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=101893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:41:30.826436 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=101892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:41:30.826573 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=101893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:41:30.826720 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=101892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:41:30.826849 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=101893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:41:30.826977 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG uwsgi [-] identity.caching = True {{(pid=101892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:41:30.827104 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=101893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:41:30.827232 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=101892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:41:30.827363 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG uwsgi [-] federation.caching = True {{(pid=101893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:41:30.827493 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=101892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:41:30.827656 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=101893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:41:30.827781 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=101892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:41:30.827905 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG uwsgi [-] federation.driver = sql {{(pid=101893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:41:30.828029 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=101892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:41:30.828167 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=101893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:41:30.828292 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG uwsgi [-] identity.driver = sql {{(pid=101892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:41:30.828417 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=101893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:41:30.828550 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=101892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:41:30.828674 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=101893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:41:30.828798 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=101892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:41:30.828929 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=101893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:41:30.829059 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=101892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:41:30.829182 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=101893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:41:30.829182 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=101893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:41:30.829415 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=101892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:41:30.829539 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=101893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:41:30.829670 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=101892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:41:30.829796 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=101893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:41:30.829919 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=101892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:41:30.830042 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=101893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:41:30.830175 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=101892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:41:30.830299 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG uwsgi [-] identity.caching = True {{(pid=101893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:41:30.830431 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=101892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:41:30.830557 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=101893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:41:30.830681 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=101892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:41:30.830804 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=101893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:41:30.830928 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=101892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:41:30.831051 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=101893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:41:30.831183 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=101892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:41:30.831308 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=101893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:41:30.831431 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=101892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:41:30.831555 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG uwsgi [-] identity.driver = sql {{(pid=101893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:41:30.831709 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=101892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:41:30.831857 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=101893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:41:30.831986 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=101892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:41:30.832114 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=101893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:41:30.832241 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=101892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:41:30.832368 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=101893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:41:30.832495 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=101892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:41:30.832630 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=101893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:41:30.832759 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=101892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:41:30.832887 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=101893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:41:30.833019 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=101892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:41:30.833147 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=101893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:41:30.833274 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=101892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:41:30.833410 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=101893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:41:30.833538 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=101892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:41:30.833682 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=101893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:41:30.833810 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=101892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:41:30.833939 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=101893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:41:30.834066 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=101892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:41:30.834201 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=101893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:41:30.834330 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=101892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:41:30.834457 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=101893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:41:30.834585 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=101892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:41:30.834713 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=101893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:41:30.834841 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=101892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:41:30.834977 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=101893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:41:30.835106 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=101892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:41:30.835233 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=101893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:41:30.835371 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=101892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:41:30.835498 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=101893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:41:30.835651 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=101892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:41:30.835787 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=101893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:41:30.835916 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=101892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:41:30.836045 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=101893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:41:30.836172 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=101892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:41:30.836299 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=101893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:41:30.836427 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG uwsgi [-] ldap.password = **** {{(pid=101892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:41:30.836562 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=101893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:41:30.836691 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=101892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:41:30.836819 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=101893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:41:30.836946 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=101892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:41:30.837077 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=101893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:41:30.837213 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=101892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:41:30.837345 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=101893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:41:30.837469 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=101892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:41:30.837592 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=101893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:41:30.837716 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=101892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:41:30.837840 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=101893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:41:30.837962 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=101892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:41:30.838102 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=101893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:41:30.838226 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=101892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:41:30.838349 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=101893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:41:30.838472 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=101892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:41:30.838595 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=101893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:41:30.838718 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=101892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:41:30.838849 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=101893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:41:30.838982 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=101892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:41:30.839107 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=101893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:41:30.839230 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=101892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:41:30.839353 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=101893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:41:30.839475 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=101892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:41:30.839652 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG uwsgi [-] ldap.password = **** {{(pid=101893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:41:30.839779 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=101892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:41:30.839907 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=101893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:41:30.840035 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=101892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:41:30.840163 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=101893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:41:30.840290 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG uwsgi [-] ldap.user = None {{(pid=101892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:41:30.840425 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=101893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:41:30.840553 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=101892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:41:30.840691 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=101893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:41:30.840691 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=101893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:41:30.840931 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=101892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:41:30.840931 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=101892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:41:30.841179 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=101893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:41:30.841179 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=101893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:41:30.841419 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=101892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:41:30.841547 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=101893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:41:30.841675 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=101892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:41:30.841801 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=101893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:41:30.841937 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=101892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:41:30.842072 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=101893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:41:30.842201 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=101892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:41:30.842328 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=101893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:41:30.842464 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=101892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:41:30.842591 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=101893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:41:30.842730 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=101892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:41:30.842859 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=101893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:41:30.842986 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=101892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:41:30.843114 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=101893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:41:30.843242 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=101892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:41:30.843376 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG uwsgi [-] ldap.user = None {{(pid=101893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:41:30.843503 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=101892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:41:30.843643 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=101893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:41:30.843768 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=101892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:41:30.843892 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=101893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:41:30.844016 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=101892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:41:30.844158 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=101893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:41:30.844284 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=101892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:41:30.844284 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=101892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:41:30.844516 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=101893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:41:30.844640 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=101892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:41:30.844763 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=101893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:41:30.844894 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=101892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:41:30.845018 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=101893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:41:30.845142 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=101892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:41:30.845266 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=101893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:41:30.845266 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=101893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:41:30.845497 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=101892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:41:30.845627 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=101893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:41:30.845752 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=101892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:41:30.845885 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=101893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:41:30.846010 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=101892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:41:30.846132 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=101893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:41:30.846257 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=101892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:41:30.846458 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=101893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:41:30.846585 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=101892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:41:30.846709 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=101893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:41:30.846832 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=101892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:41:30.846956 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=101893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:41:30.847079 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=101892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:41:30.847210 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=101893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:41:30.847336 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG uwsgi [-] policy.driver = sql {{(pid=101892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:41:30.847459 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=101893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:41:30.847613 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=101892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:41:30.847738 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=101893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:41:30.847862 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=101892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:41:30.847995 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=101893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:41:30.848127 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=101892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:41:30.848127 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG uwsgi [-] receipt.caching = True {{(pid=101892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:41:30.848361 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=101893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:41:30.848484 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=101892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:41:30.848607 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=101893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:41:30.848607 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=101893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:41:30.848847 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=101892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:41:30.848970 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=101893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:41:30.849093 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=101892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:41:30.849216 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=101893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:41:30.849353 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=101892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:41:30.849485 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=101893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:41:30.849610 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=101892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:41:30.849734 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=101893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:41:30.849857 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG uwsgi [-] resource.caching = True {{(pid=101892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:41:30.849980 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=101893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:41:30.850103 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=101892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:41:30.850234 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG uwsgi [-] policy.driver = sql {{(pid=101893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:41:30.850359 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG uwsgi [-] resource.driver = sql {{(pid=101892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:41:30.850483 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=101893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:41:30.850606 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=101892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:41:30.850729 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=101893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:41:30.850852 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=101892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:41:30.850986 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=101893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:41:30.851124 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=101892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:41:30.851248 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG uwsgi [-] receipt.caching = True {{(pid=101893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:41:30.851373 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG uwsgi [-] revoke.caching = True {{(pid=101892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:41:30.851497 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=101893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:41:30.851684 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=101892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:41:30.851823 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=101893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:41:30.851952 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=101892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:41:30.852080 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=101893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:41:30.852208 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG uwsgi [-] role.cache_time = None {{(pid=101892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:41:30.852335 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=101893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:41:30.852464 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG uwsgi [-] role.caching = True {{(pid=101892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:41:30.852601 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=101893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:41:30.852730 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG uwsgi [-] role.driver = sql {{(pid=101892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:41:30.852867 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG uwsgi [-] resource.caching = True {{(pid=101893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:41:30.852995 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG uwsgi [-] role.list_limit = None {{(pid=101892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:41:30.853123 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=101893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:41:30.853250 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=101892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:41:30.853386 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG uwsgi [-] resource.driver = sql {{(pid=101893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:41:30.853515 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=101892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:41:30.853643 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=101893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:41:30.853771 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=101892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:41:30.853898 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=101893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:41:30.854025 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=101892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:41:30.854160 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=101893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:41:30.854289 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=101892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:41:30.854417 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG uwsgi [-] revoke.caching = True {{(pid=101893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:41:30.854545 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=101892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:41:30.854683 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=101893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:41:30.854811 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=101892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:41:30.854946 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=101893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:41:30.855075 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=101892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:41:30.855202 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG uwsgi [-] role.cache_time = None {{(pid=101893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:41:30.855329 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=101892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:41:30.855455 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG uwsgi [-] role.caching = True {{(pid=101893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:41:30.855597 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=101892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:41:30.855731 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG uwsgi [-] role.driver = sql {{(pid=101893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:41:30.855860 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=101892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:41:30.855987 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG uwsgi [-] role.list_limit = None {{(pid=101893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:41:30.856063 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=101892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:41:30.856126 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=101893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:41:30.856324 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=101892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:41:30.856450 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=101893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:41:30.856450 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=101893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:41:30.856683 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=101892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:41:30.856807 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=101893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:41:30.856930 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=101892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:41:30.857061 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=101893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:41:30.857186 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=101892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:41:30.857310 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=101893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:41:30.857433 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=101892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:41:30.857555 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=101893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:41:30.857679 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=101892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:41:30.857811 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=101893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:41:30.857945 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=101892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:41:30.858074 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=101893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:41:30.858196 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=101892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:41:30.858319 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=101893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:41:30.858443 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=101892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:41:30.858573 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=101893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:41:30.858698 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=101892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:41:30.858824 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=101893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:41:30.858948 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=101892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:41:30.859091 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=101893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:41:30.859213 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=101892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:41:30.859213 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=101892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:41:30.859452 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=101893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:41:30.859614 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=101892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:41:30.859739 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=101893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:41:30.859868 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=101892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:41:30.859994 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=101893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:41:30.860133 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=101892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:41:30.860262 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=101893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:41:30.860390 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=101892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:41:30.860517 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=101893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:41:30.860645 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=101892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:41:30.860772 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=101893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:41:30.860910 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=101892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:41:30.861038 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=101893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:41:30.861166 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG uwsgi [-] token.cache_time = None {{(pid=101892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:41:30.861302 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=101893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:41:30.861429 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG uwsgi [-] token.caching = True {{(pid=101892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:41:30.861564 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=101893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:41:30.861692 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=101892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:41:30.861819 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=101893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:41:30.861948 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG uwsgi [-] token.provider = fernet {{(pid=101892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:41:30.862075 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=101893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:41:30.862202 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=101892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:41:30.862338 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=101893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:41:30.862472 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=101892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:41:30.862600 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=101893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:41:30.862728 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=101892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:41:30.862855 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=101893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:41:30.862984 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=101892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:41:30.863128 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=101893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:41:30.863257 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=101892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:41:30.863384 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=101893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:41:30.863512 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=101892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:41:30.863651 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=101893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:41:30.863775 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG uwsgi [-] trust.driver = sql {{(pid=101892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:41:30.863908 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=101893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:41:30.864034 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=101892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:41:30.864157 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG uwsgi [-] token.cache_time = None {{(pid=101893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:41:30.864280 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=101892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:41:30.864404 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG uwsgi [-] token.caching = True {{(pid=101893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:41:30.864527 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=101892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:41:30.864658 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=101893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:41:30.864782 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=101892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:41:30.864915 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG uwsgi [-] token.provider = fernet {{(pid=101893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:41:30.865039 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=101892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:41:30.865163 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=101893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:41:30.865287 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=101892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:41:30.865422 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=101893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:41:30.865547 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=101892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:41:30.865670 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=101893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:41:30.865793 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=101892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:41:30.865917 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=101893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:41:30.866041 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG uwsgi [-] database.connection = **** {{(pid=101892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:41:30.866177 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=101893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:41:30.866310 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=101892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:41:30.866442 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=101893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:41:30.866575 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=101892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:41:30.866699 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG uwsgi [-] trust.driver = sql {{(pid=101893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:41:30.866822 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=101892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:41:30.866945 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=101893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:41:30.867069 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=101892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:41:30.867200 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=101893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:41:30.867325 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=101892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:41:30.867448 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=101893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:41:30.867625 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=101892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:41:30.867749 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=101893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:41:30.867876 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=101892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:41:30.868019 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=101893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:41:30.868148 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=101892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:41:30.868277 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=101893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:41:30.868415 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=101892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:41:30.868543 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=101893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:41:30.868745 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=101892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:41:30.868875 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=101893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:41:30.869003 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=101892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:41:30.869131 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG uwsgi [-] database.connection = **** {{(pid=101893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:41:30.869270 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=101892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:41:30.869407 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=101893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:41:30.869538 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=101892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:41:30.869665 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=101893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:41:30.869801 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=101892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:41:30.869930 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=101893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:41:30.870057 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=101892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:41:30.870194 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=101893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:41:30.870324 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=101892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:41:30.870451 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=101893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:41:30.870587 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=101892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:41:30.870716 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=101893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:41:30.870843 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=101892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:41:30.870971 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=101893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:41:30.871098 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=101892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} May 25 14:41:30.871226 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=101893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:41:30.871226 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=101893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:41:30.871226 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=101893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:41:30.871226 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=101893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:41:30.871226 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=101893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:41:30.871226 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=101893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:41:30.871226 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=101893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:41:30.871226 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=101893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:41:30.871226 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=101893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:41:30.872755 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=101893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:41:30.872755 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=101893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:41:30.872755 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=101893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} May 25 14:41:30.895004 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=101892) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 25 14:41:30.895218 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=101892) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 25 14:41:30.895444 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=101892) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 25 14:41:30.896348 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=101893) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 25 14:41:30.896582 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=101893) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 25 14:41:30.896808 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=101893) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 25 14:41:30.904125 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=101892) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 25 14:41:30.905341 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=101893) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 25 14:41:30.932238 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=101892) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 25 14:41:30.932465 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=101892) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 25 14:41:30.932950 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=101893) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 25 14:41:30.933180 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=101893) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 25 14:41:30.986246 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=101892) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 25 14:41:30.986420 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=101893) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 25 14:41:31.037879 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=101892) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 25 14:41:31.038117 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=101892) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 25 14:41:31.038980 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=101893) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 25 14:41:31.039214 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=101893) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 25 14:41:31.103994 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=101893) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 25 14:41:31.104222 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=101893) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 25 14:41:31.104424 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=101892) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 25 14:41:31.104576 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=101893) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 25 14:41:31.104715 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=101893) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 25 14:41:31.104848 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=101892) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 25 14:41:31.104984 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=101893) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 25 14:41:31.105112 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=101892) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 25 14:41:31.105252 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=101893) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 25 14:41:31.105394 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=101892) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 25 14:41:31.105394 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=101892) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 25 14:41:31.106206 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=101892) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 25 14:41:31.144697 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=101892) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 25 14:41:31.144908 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=101893) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 25 14:41:31.145067 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=101892) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 25 14:41:31.145211 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=101893) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 25 14:41:31.145349 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=101892) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 25 14:41:31.145485 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=101893) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 25 14:41:31.145619 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=101892) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 25 14:41:31.145775 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=101893) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 25 14:41:31.145905 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=101892) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 25 14:41:31.146032 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=101893) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 25 14:41:31.146184 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=101892) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 25 14:41:31.146312 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=101893) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 25 14:41:31.146449 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=101892) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 25 14:41:31.146578 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=101893) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 25 14:41:31.157287 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=101892) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 25 14:41:31.157605 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=101893) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 25 14:41:31.170537 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=101893) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 25 14:41:31.170766 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=101893) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 25 14:41:31.170990 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=101893) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 25 14:41:31.171212 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=101893) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 25 14:41:31.171430 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=101893) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 25 14:41:31.171668 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=101893) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 25 14:41:31.171882 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=101893) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 25 14:41:31.172120 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=101892) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 25 14:41:31.172362 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=101892) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 25 14:41:31.172590 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=101892) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 25 14:41:31.172817 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=101892) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 25 14:41:31.173039 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=101892) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 25 14:41:31.173256 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=101892) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 25 14:41:31.173471 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=101892) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 25 14:41:31.191128 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=101892) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 14:41:31.191340 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=101892) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} May 25 14:41:31.191472 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=101893) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 14:41:31.191671 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=101893) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} May 25 14:41:31.191815 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=101892) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 14:41:31.191949 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=101892) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} May 25 14:41:31.192079 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=101893) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 14:41:31.192210 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=101892) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 14:41:31.192343 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=101893) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} May 25 14:41:31.192496 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=101892) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 14:41:31.192630 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=101893) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 14:41:31.192801 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=101892) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 14:41:31.193012 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=101893) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 14:41:31.193141 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=101892) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 14:41:31.193273 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=101893) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 14:41:31.193273 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=101893) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 14:41:31.203950 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=101892) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 14:41:31.204130 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=101893) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 14:41:31.204263 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=101892) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 14:41:31.204391 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=101893) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 14:41:31.204531 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=101892) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 14:41:31.204673 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=101893) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 14:41:31.204803 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=101892) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 14:41:31.204932 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=101893) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 14:41:31.212853 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=101892) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 25 14:41:31.213010 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=101893) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 25 14:41:31.216186 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=101892) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 25 14:41:31.216343 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=101893) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 25 14:41:31.216464 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=101893) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 14:41:31.216549 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=101892) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 14:41:31.216741 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=101893) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 14:41:31.216840 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=101892) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 14:41:31.217020 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=101892) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 14:41:31.217105 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=101893) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 14:41:31.217302 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=101892) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 14:41:31.217387 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=101893) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 14:41:31.217581 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=101893) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 14:41:31.217666 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=101892) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 14:41:31.217845 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=101893) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 14:41:31.217930 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=101892) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 14:41:31.218191 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=101892) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 14:41:31.218282 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=101893) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 14:41:31.218466 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=101892) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 14:41:31.218549 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=101893) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 14:41:31.218733 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=101893) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 14:41:31.218815 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=101892) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 14:41:31.218998 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=101893) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 14:41:31.219090 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=101892) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 14:41:31.247020 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=101892) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 14:41:31.247161 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=101893) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 14:41:31.248767 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=101892) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 25 14:41:31.248856 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=101893) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 25 14:41:31.249050 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=101892) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 14:41:31.249136 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=101893) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 14:41:31.254582 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=101892) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 25 14:41:31.254675 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=101893) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 25 14:41:31.254862 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=101892) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 14:41:31.254960 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=101893) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 14:41:31.255160 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=101893) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 14:41:31.255245 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=101892) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 14:41:31.262376 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=101893) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 25 14:41:31.262469 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=101892) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 25 14:41:31.262656 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=101893) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 14:41:31.262754 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=101892) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 14:41:31.267123 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=101893) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 25 14:41:31.267218 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=101892) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 25 14:41:31.267405 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=101893) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 14:41:31.267615 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=101892) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 14:41:31.267784 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=101893) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 14:41:31.267902 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=101892) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 14:41:31.268087 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=101893) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 14:41:31.268171 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=101892) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 14:41:31.268363 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=101893) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 14:41:31.268457 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=101892) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 14:41:31.268635 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=101893) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 14:41:31.268721 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=101892) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 14:41:31.268903 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=101893) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 14:41:31.268986 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=101892) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 14:41:31.269174 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=101893) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 14:41:31.269267 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=101892) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 14:41:31.287671 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=101893) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 14:41:31.287934 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=101892) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 14:41:31.288019 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=101893) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 14:41:31.288211 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=101892) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 14:41:31.292597 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=101893) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 25 14:41:31.292886 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=101892) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 25 14:41:31.296758 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=101893) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 14:41:31.297047 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=101893) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 14:41:31.297138 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=101892) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 14:41:31.297354 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=101892) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 14:41:31.302121 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=101893) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 25 14:41:31.302480 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=101892) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 25 14:41:31.305709 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=101893) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 25 14:41:31.306098 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=101892) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 25 14:41:31.310091 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=101893) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 14:41:31.310380 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=101893) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 14:41:31.310466 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=101892) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 14:41:31.310765 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=101892) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 14:41:31.310850 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=101893) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 14:41:31.311043 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=101893) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 14:41:31.311138 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=101892) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 14:41:31.311323 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=101893) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 14:41:31.311419 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=101892) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 14:41:31.311616 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=101893) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 14:41:31.311705 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=101892) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 14:41:31.311902 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=101892) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 14:41:31.330446 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=101893) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 25 14:41:31.330723 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=101893) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 14:41:31.330823 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=101892) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 25 14:41:31.330985 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=101893) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 14:41:31.331094 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=101892) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 14:41:31.331242 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=101893) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 14:41:31.331359 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=101892) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 14:41:31.331653 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=101892) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 14:41:31.339221 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=101893) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 14:41:31.339683 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=101892) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 14:41:31.341494 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=101893) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 14:41:31.341765 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=101893) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 14:41:31.341924 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=101892) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 14:41:31.342200 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=101892) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 14:41:31.344813 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=101893) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 25 14:41:31.345092 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=101893) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 14:41:31.345271 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=101892) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 25 14:41:31.345356 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=101893) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 14:41:31.345553 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=101892) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 14:41:31.345649 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=101893) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 14:41:31.345836 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=101892) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 14:41:31.345922 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=101893) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 14:41:31.346118 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=101892) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 14:41:31.346393 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=101892) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 14:41:31.359762 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=101893) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 25 14:41:31.359984 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=101893) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 14:41:31.360264 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=101893) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 14:41:31.360351 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=101892) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 25 14:41:31.360540 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=101893) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 14:41:31.360638 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=101892) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 14:41:31.360815 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=101893) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 14:41:31.360901 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=101892) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 14:41:31.361082 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=101893) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 14:41:31.361167 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=101892) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 14:41:31.361355 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=101893) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 14:41:31.361441 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=101892) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 14:41:31.361676 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=101892) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 14:41:31.361974 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=101892) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 14:41:31.379646 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=101893) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 25 14:41:31.380435 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=101892) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 25 14:41:31.382987 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=101893) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 25 14:41:31.383734 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=101892) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 25 14:41:31.386314 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=101893) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 14:41:31.387093 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=101892) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 14:41:31.387963 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=101893) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 14:41:31.388726 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=101892) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 14:41:31.389570 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=101893) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 25 14:41:31.389854 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=101893) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 14:41:31.390138 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=101893) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 14:41:31.390377 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=101892) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 25 14:41:31.390662 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=101892) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 14:41:31.390945 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=101892) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 14:41:31.397469 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=101893) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 14:41:31.398405 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=101892) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 14:41:31.399062 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=101893) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 25 14:41:31.400063 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=101892) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 25 14:41:31.402354 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=101893) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 14:41:31.403164 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=101893) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 14:41:31.403443 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=101893) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 14:41:31.403733 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=101893) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 14:41:31.403884 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=101892) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 14:41:31.404172 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=101892) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 14:41:31.404458 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=101892) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 14:41:31.404730 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=101892) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 14:41:31.412742 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=101893) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 25 14:41:31.413027 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=101893) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 14:41:31.413300 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=101893) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 14:41:31.413828 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=101892) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 25 14:41:31.414117 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=101892) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 14:41:31.414506 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=101892) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 14:41:31.421890 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=101893) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 25 14:41:31.422167 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=101893) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 14:41:31.422444 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=101893) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 14:41:31.422714 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=101893) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 14:41:31.422979 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=101893) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 14:41:31.423064 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=101892) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 25 14:41:31.423268 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=101893) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 14:41:31.423357 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=101892) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 14:41:31.423528 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=101892) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 14:41:31.423668 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=101893) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 14:41:31.423827 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=101892) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 14:41:31.423920 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=101893) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 14:41:31.424098 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=101892) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 14:41:31.424191 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=101893) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 14:41:31.424366 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=101892) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 14:41:31.424458 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=101893) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 14:41:31.424658 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=101892) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 14:41:31.424750 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=101893) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 14:41:31.425101 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=101893) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 14:41:31.425292 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=101892) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 14:41:31.425506 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=101893) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 14:41:31.425607 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=101892) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 14:41:31.425750 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=101893) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 14:41:31.425833 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=101892) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 14:41:31.425993 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=101892) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 14:41:31.426264 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=101892) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 14:41:31.426541 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=101892) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 14:41:31.426810 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=101892) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 14:41:31.464002 dv-cinder-803823-9-smb devstack@keystone.service[101893]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55fd15c769c0 pid: 101893 (default app) May 25 14:41:31.466015 dv-cinder-803823-9-smb devstack@keystone.service[101892]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55fd15c769c0 pid: 101892 (default app) May 25 14:41:31.467881 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ebf5903-3452-46b7-9a6f-7c0945c97352 None None] REQUEST_METHOD: `GET` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:41:31.468170 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ebf5903-3452-46b7-9a6f-7c0945c97352 None None] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:41:31.468441 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ebf5903-3452-46b7-9a6f-7c0945c97352 None None] PATH_INFO: `/v3` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:41:31.472700 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 1/1] 10.222.0.84 () {50 vars in 791 bytes} [Wed May 25 14:41:31 2022] GET /identity/v3/ => generated 255 bytes in 8 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:41:40.634761 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ff1d45-f2aa-4dc2-b936-94795a322543 None None] REQUEST_METHOD: `GET` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:41:40.635289 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ff1d45-f2aa-4dc2-b936-94795a322543 None None] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:41:40.635381 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ff1d45-f2aa-4dc2-b936-94795a322543 None None] PATH_INFO: `/` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:41:40.639769 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 1/2] 10.222.0.84 () {54 vars in 926 bytes} [Wed May 25 14:41:40 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 25 14:41:40.644872 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8d7457-be00-407f-9c0a-e648286c540f None None] REQUEST_METHOD: `POST` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:41:40.645273 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8d7457-be00-407f-9c0a-e648286c540f None None] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:41:40.645425 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8d7457-be00-407f-9c0a-e648286c540f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:41:40.715999 dv-cinder-803823-9-smb devstack@keystone.service[101893]: INFO dbcounter [None req-ba8d7457-be00-407f-9c0a-e648286c540f None None] Registered counter for database keystone May 25 14:41:40.737404 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG oslo_db.sqlalchemy.engines [None req-ba8d7457-be00-407f-9c0a-e648286c540f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=101893) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 25 14:41:40.743736 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG dbcounter [-] [101893] Writer thread running {{(pid=101893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 25 14:41:40.923158 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG passlib.handlers.bcrypt [None req-ba8d7457-be00-407f-9c0a-e648286c540f None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=101893) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} May 25 14:41:40.923609 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG passlib.handlers.bcrypt [None req-ba8d7457-be00-407f-9c0a-e648286c540f None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=101893) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} May 25 14:41:40.978557 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.auth.core [None req-ba8d7457-be00-407f-9c0a-e648286c540f None None] MFA Rules not processed for user `05d87e87798e429aa1c10b24391f915e`. Rule list: `[]` (Enabled: `True`). {{(pid=101893) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:41:40.980182 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.fernet_utils [None req-ba8d7457-be00-407f-9c0a-e648286c540f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=101893) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:41:41.103644 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 2/3] 10.222.0.84 () {58 vars in 1023 bytes} [Wed May 25 14:41:40 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 460 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) May 25 14:41:41.221328 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23ff1d45-f2aa-4dc2-b936-94795a322543 None None] Authenticating user token {{(pid=101892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:41:41.290729 dv-cinder-803823-9-smb devstack@keystone.service[101892]: INFO dbcounter [None req-23ff1d45-f2aa-4dc2-b936-94795a322543 None None] Registered counter for database keystone May 25 14:41:41.310236 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG oslo_db.sqlalchemy.engines [None req-23ff1d45-f2aa-4dc2-b936-94795a322543 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=101892) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 25 14:41:41.316512 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG dbcounter [-] [101892] Writer thread running {{(pid=101892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 25 14:41:41.436032 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23ff1d45-f2aa-4dc2-b936-94795a322543 None None] Validating token access rules against request {{(pid=101892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:41:41.440283 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38787331-ceaa-470e-b0c4-7304fce2fbe2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cec56f74b2fa4826a506dc7b919465be', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:41:41.440961 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38787331-ceaa-470e-b0c4-7304fce2fbe2 admin admin] REQUEST_METHOD: `GET` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:41:41.441251 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38787331-ceaa-470e-b0c4-7304fce2fbe2 admin admin] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:41:41.441533 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38787331-ceaa-470e-b0c4-7304fce2fbe2 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:41:41.450116 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38787331-ceaa-470e-b0c4-7304fce2fbe2 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:41:41.501612 dv-cinder-803823-9-smb devstack@keystone.service[101892]: WARNING keystone.common.rbac_enforcer.enforcer [None req-38787331-ceaa-470e-b0c4-7304fce2fbe2 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. May 25 14:41:41.501910 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38787331-ceaa-470e-b0c4-7304fce2fbe2 admin admin] RBAC: Authorization granted {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:41:41.511782 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 2/4] 10.222.0.84 () {58 vars in 1324 bytes} [Wed May 25 14:41:41 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 291 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 25 14:41:41.517706 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba8d7457-be00-407f-9c0a-e648286c540f None None] Authenticating user token {{(pid=101893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:41:41.532592 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba8d7457-be00-407f-9c0a-e648286c540f None None] Validating token access rules against request {{(pid=101893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:41:41.536968 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ddf6ab-42d9-45e7-8330-d2e5f3f69f64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cec56f74b2fa4826a506dc7b919465be', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:41:41.538084 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ddf6ab-42d9-45e7-8330-d2e5f3f69f64 admin admin] REQUEST_METHOD: `GET` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:41:41.538368 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ddf6ab-42d9-45e7-8330-d2e5f3f69f64 admin admin] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:41:41.538650 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ddf6ab-42d9-45e7-8330-d2e5f3f69f64 admin admin] PATH_INFO: `/v3/projects/cec56f74b2fa4826a506dc7b919465be` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:41:41.540198 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5ddf6ab-42d9-45e7-8330-d2e5f3f69f64 admin admin] RBAC: Authorizing `identity:get_project(project_id=cec56f74b2fa4826a506dc7b919465be)` {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:41:41.700984 dv-cinder-803823-9-smb devstack@keystone.service[101893]: WARNING keystone.common.rbac_enforcer.enforcer [None req-c5ddf6ab-42d9-45e7-8330-d2e5f3f69f64 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. May 25 14:41:41.701664 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5ddf6ab-42d9-45e7-8330-d2e5f3f69f64 admin admin] RBAC: Authorization granted {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:41:41.705986 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 3/5] 10.222.0.84 () {56 vars in 1207 bytes} [Wed May 25 14:41:41 2022] GET /identity/v3/projects/cec56f74b2fa4826a506dc7b919465be => generated 344 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:41:43.889550 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215ec69f-fe5b-41af-888f-c1c415dbaae6 None None] REQUEST_METHOD: `GET` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:41:43.890069 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215ec69f-fe5b-41af-888f-c1c415dbaae6 None None] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:41:43.890215 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215ec69f-fe5b-41af-888f-c1c415dbaae6 None None] PATH_INFO: `/` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:41:43.894170 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 3/6] 10.222.0.84 () {54 vars in 926 bytes} [Wed May 25 14:41:43 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 25 14:41:43.899670 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b794d1d5-b307-4246-bf90-9ce4e346bc7d None None] REQUEST_METHOD: `POST` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:41:43.900096 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b794d1d5-b307-4246-bf90-9ce4e346bc7d None None] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:41:43.900235 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b794d1d5-b307-4246-bf90-9ce4e346bc7d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:41:43.919278 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.auth.core [None req-b794d1d5-b307-4246-bf90-9ce4e346bc7d None None] MFA Rules not processed for user `05d87e87798e429aa1c10b24391f915e`. Rule list: `[]` (Enabled: `True`). {{(pid=101893) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:41:43.920821 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.fernet_utils [None req-b794d1d5-b307-4246-bf90-9ce4e346bc7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=101893) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:41:43.928570 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 4/7] 10.222.0.84 () {58 vars in 1023 bytes} [Wed May 25 14:41:43 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) May 25 14:41:43.951004 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-215ec69f-fe5b-41af-888f-c1c415dbaae6 None None] Authenticating user token {{(pid=101892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:41:43.963080 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-215ec69f-fe5b-41af-888f-c1c415dbaae6 None None] Validating token access rules against request {{(pid=101892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:41:43.967915 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-851b940b-3e10-48e3-b8b2-651020daa6b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cec56f74b2fa4826a506dc7b919465be', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:41:43.968550 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851b940b-3e10-48e3-b8b2-651020daa6b9 admin admin] REQUEST_METHOD: `GET` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:41:43.968838 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851b940b-3e10-48e3-b8b2-651020daa6b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:41:43.969118 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851b940b-3e10-48e3-b8b2-651020daa6b9 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:41:43.976787 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-851b940b-3e10-48e3-b8b2-651020daa6b9 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:41:43.978559 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-851b940b-3e10-48e3-b8b2-651020daa6b9 admin admin] RBAC: Authorization granted {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:41:43.987266 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 4/8] 10.222.0.84 () {58 vars in 1324 bytes} [Wed May 25 14:41:43 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 25 14:41:43.992473 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b794d1d5-b307-4246-bf90-9ce4e346bc7d None None] Authenticating user token {{(pid=101893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:41:44.001335 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b794d1d5-b307-4246-bf90-9ce4e346bc7d None None] Validating token access rules against request {{(pid=101893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:41:44.005935 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-158b9d86-ee66-4655-86c6-2e12d19a422f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cec56f74b2fa4826a506dc7b919465be', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:41:44.006781 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158b9d86-ee66-4655-86c6-2e12d19a422f admin admin] REQUEST_METHOD: `GET` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:41:44.007063 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158b9d86-ee66-4655-86c6-2e12d19a422f admin admin] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:41:44.007333 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158b9d86-ee66-4655-86c6-2e12d19a422f admin admin] PATH_INFO: `/v3/users/05d87e87798e429aa1c10b24391f915e` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:41:44.008737 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-158b9d86-ee66-4655-86c6-2e12d19a422f admin admin] RBAC: Authorizing `identity:get_user(user_id=05d87e87798e429aa1c10b24391f915e)` {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:41:44.010540 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-158b9d86-ee66-4655-86c6-2e12d19a422f admin admin] RBAC: Authorization granted {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:41:44.012606 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 5/9] 10.222.0.84 () {56 vars in 1198 bytes} [Wed May 25 14:41:43 2022] GET /identity/v3/users/05d87e87798e429aa1c10b24391f915e => generated 247 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 14:41:46.247739 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7777437-54d2-4f92-a0fe-a3e208576abe None None] REQUEST_METHOD: `GET` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:41:46.248254 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7777437-54d2-4f92-a0fe-a3e208576abe None None] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:41:46.248360 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7777437-54d2-4f92-a0fe-a3e208576abe None None] PATH_INFO: `/` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:41:46.249626 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 5/10] 10.222.0.84 () {54 vars in 926 bytes} [Wed May 25 14:41:46 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 14:41:46.255101 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f5b241-6265-4ad9-a0e8-6c518a8ba1a9 None None] REQUEST_METHOD: `POST` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:41:46.255501 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f5b241-6265-4ad9-a0e8-6c518a8ba1a9 None None] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:41:46.255816 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f5b241-6265-4ad9-a0e8-6c518a8ba1a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:41:46.272313 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.auth.core [None req-f8f5b241-6265-4ad9-a0e8-6c518a8ba1a9 None None] MFA Rules not processed for user `05d87e87798e429aa1c10b24391f915e`. Rule list: `[]` (Enabled: `True`). {{(pid=101893) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:41:46.273503 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.fernet_utils [None req-f8f5b241-6265-4ad9-a0e8-6c518a8ba1a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=101893) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:41:46.279440 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067f3859-faf0-4086-a6d5-9f25d7576583 None None] REQUEST_METHOD: `GET` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:41:46.279795 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067f3859-faf0-4086-a6d5-9f25d7576583 None None] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:41:46.280076 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067f3859-faf0-4086-a6d5-9f25d7576583 None None] PATH_INFO: `/` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:41:46.281409 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 6/11] 10.222.0.84 () {54 vars in 926 bytes} [Wed May 25 14:41:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 25 14:41:46.286565 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52f1601-f32b-4bb6-b07c-0fb6798aaf1d None None] REQUEST_METHOD: `POST` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:41:46.286853 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52f1601-f32b-4bb6-b07c-0fb6798aaf1d None None] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:41:46.287137 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52f1601-f32b-4bb6-b07c-0fb6798aaf1d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:41:46.327060 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG passlib.handlers.bcrypt [None req-d52f1601-f32b-4bb6-b07c-0fb6798aaf1d None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=101892) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} May 25 14:41:46.327511 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG passlib.handlers.bcrypt [None req-d52f1601-f32b-4bb6-b07c-0fb6798aaf1d None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=101892) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} May 25 14:41:46.353815 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 6/12] 10.222.0.84 () {58 vars in 1023 bytes} [Wed May 25 14:41:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 25 14:41:46.374474 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.auth.core [None req-d52f1601-f32b-4bb6-b07c-0fb6798aaf1d None None] MFA Rules not processed for user `05d87e87798e429aa1c10b24391f915e`. Rule list: `[]` (Enabled: `True`). {{(pid=101892) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:41:46.376091 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.fernet_utils [None req-d52f1601-f32b-4bb6-b07c-0fb6798aaf1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=101892) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:41:46.377376 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8f5b241-6265-4ad9-a0e8-6c518a8ba1a9 None None] Authenticating user token {{(pid=101893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:41:46.400298 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG dbcounter [-] [101893] Writing DB stats keystone:SELECT=100 {{(pid=101893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:41:46.476178 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 7/13] 10.222.0.84 () {58 vars in 1023 bytes} [Wed May 25 14:41:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 25 14:41:46.482753 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8f5b241-6265-4ad9-a0e8-6c518a8ba1a9 None None] Validating token access rules against request {{(pid=101893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:41:46.498663 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d52f1601-f32b-4bb6-b07c-0fb6798aaf1d None None] Authenticating user token {{(pid=101892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:41:46.517304 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31262198-57f0-4409-9022-2b2cac03f417 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:41:46.518132 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31262198-57f0-4409-9022-2b2cac03f417 None admin] REQUEST_METHOD: `GET` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:41:46.518414 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31262198-57f0-4409-9022-2b2cac03f417 None admin] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:41:46.518691 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31262198-57f0-4409-9022-2b2cac03f417 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:41:46.532160 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31262198-57f0-4409-9022-2b2cac03f417 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 14:41:46.544849 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application [None req-31262198-57f0-4409-9022-2b2cac03f417 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 25 14:41:46.544849 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:41:46.544849 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 14:41:46.544849 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 14:41:46.544849 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 14:41:46.544849 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 14:41:46.544849 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 14:41:46.544849 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 14:41:46.544849 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 14:41:46.544849 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 14:41:46.544849 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 14:41:46.544849 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 14:41:46.544849 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 14:41:46.544849 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 14:41:46.544849 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 14:41:46.544849 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 14:41:46.545863 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 14:41:46.545863 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 14:41:46.545863 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 14:41:46.545863 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 14:41:46.545863 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 14:41:46.545863 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 14:41:46.545863 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 14:41:46.545863 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 14:41:46.545863 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 14:41:46.545863 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return self.get_or_create( May 25 14:41:46.545863 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 14:41:46.545863 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application with Lock( May 25 14:41:46.545863 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 14:41:46.545863 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return self._enter() May 25 14:41:46.545863 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 14:41:46.545863 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 14:41:46.546741 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 14:41:46.546741 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return self.creator() May 25 14:41:46.546741 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 14:41:46.546741 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application created_value = creator( May 25 14:41:46.546741 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 14:41:46.546741 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 14:41:46.546741 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 14:41:46.546741 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 14:41:46.546741 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 14:41:46.546741 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 14:41:46.546741 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 25 14:41:46.546741 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application May 25 14:41:46.547760 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 7/14] 10.222.0.84 () {56 vars in 1096 bytes} [Wed May 25 14:41:46 2022] GET /identity/v3/roles/admin => generated 83 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 25 14:41:46.553993 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31262198-57f0-4409-9022-2b2cac03f417 None admin] Authenticating user token {{(pid=101893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:41:46.639448 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG dbcounter [-] [101893] Writing DB stats keystone:SELECT=100 {{(pid=101893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:41:46.657462 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31262198-57f0-4409-9022-2b2cac03f417 None admin] Validating token access rules against request {{(pid=101893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:41:46.690512 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4abce06d-c736-4828-8c34-521e43052c8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:41:46.691179 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4abce06d-c736-4828-8c34-521e43052c8f None admin] REQUEST_METHOD: `GET` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:41:46.691467 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4abce06d-c736-4828-8c34-521e43052c8f None admin] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:41:46.691781 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4abce06d-c736-4828-8c34-521e43052c8f None admin] PATH_INFO: `/v3/roles` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:41:46.692534 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4abce06d-c736-4828-8c34-521e43052c8f None admin] RBAC: Adding query filter params (name=admin) {{(pid=101893) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:41:46.692852 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4abce06d-c736-4828-8c34-521e43052c8f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:41:46.694252 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4abce06d-c736-4828-8c34-521e43052c8f None admin] RBAC: Authorization granted {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:41:46.706356 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 8/15] 10.222.0.84 () {56 vars in 1099 bytes} [Wed May 25 14:41:46 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:41:46.709170 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d52f1601-f32b-4bb6-b07c-0fb6798aaf1d None None] Validating token access rules against request {{(pid=101892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:41:46.711516 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG dbcounter [-] [101892] Writing DB stats keystone:SELECT=100 {{(pid=101892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:41:46.712774 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4abce06d-c736-4828-8c34-521e43052c8f None admin] Authenticating user token {{(pid=101893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:41:46.746489 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aea2a5e-d903-4633-8101-e61744e18551 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:41:46.747392 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aea2a5e-d903-4633-8101-e61744e18551 None admin] REQUEST_METHOD: `GET` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:41:46.747713 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aea2a5e-d903-4633-8101-e61744e18551 None admin] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:41:46.747990 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aea2a5e-d903-4633-8101-e61744e18551 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:41:46.810587 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4abce06d-c736-4828-8c34-521e43052c8f None admin] Validating token access rules against request {{(pid=101893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:41:46.815220 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aea2a5e-d903-4633-8101-e61744e18551 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:41:46.816772 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aea2a5e-d903-4633-8101-e61744e18551 None admin] RBAC: Authorization granted {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:41:46.844162 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b50e46b-5e6c-4c3f-a31d-ac81b15d5a4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:41:46.845034 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b50e46b-5e6c-4c3f-a31d-ac81b15d5a4f None admin] REQUEST_METHOD: `GET` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:41:46.845316 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b50e46b-5e6c-4c3f-a31d-ac81b15d5a4f None admin] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:41:46.845592 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b50e46b-5e6c-4c3f-a31d-ac81b15d5a4f None admin] PATH_INFO: `/v3/users/05d87e87798e429aa1c10b24391f915e` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:41:46.846787 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b50e46b-5e6c-4c3f-a31d-ac81b15d5a4f None admin] RBAC: Authorizing `identity:get_user(user_id=05d87e87798e429aa1c10b24391f915e)` {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:41:46.848260 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b50e46b-5e6c-4c3f-a31d-ac81b15d5a4f None admin] RBAC: Authorization granted {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:41:46.849854 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 9/16] 10.222.0.84 () {56 vars in 1177 bytes} [Wed May 25 14:41:46 2022] GET /identity/v3/users/05d87e87798e429aa1c10b24391f915e => generated 247 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 14:41:46.855180 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b50e46b-5e6c-4c3f-a31d-ac81b15d5a4f None admin] Authenticating user token {{(pid=101893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:41:46.868831 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG dbcounter [-] [101893] Writing DB stats keystone:SELECT=100 {{(pid=101893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:41:46.915913 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 8/17] 10.222.0.84 () {58 vars in 1282 bytes} [Wed May 25 14:41:46 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 418 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 25 14:41:46.921522 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aea2a5e-d903-4633-8101-e61744e18551 None admin] Authenticating user token {{(pid=101892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:41:46.924173 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG dbcounter [-] [101892] Writing DB stats keystone:SELECT=100 {{(pid=101892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:41:46.958084 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b50e46b-5e6c-4c3f-a31d-ac81b15d5a4f None admin] Validating token access rules against request {{(pid=101893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:41:46.992694 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f996d633-ba4a-495c-b6d1-0bf70b52aaed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:41:46.993485 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f996d633-ba4a-495c-b6d1-0bf70b52aaed None admin] REQUEST_METHOD: `GET` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:41:46.993768 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f996d633-ba4a-495c-b6d1-0bf70b52aaed None admin] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:41:46.994038 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f996d633-ba4a-495c-b6d1-0bf70b52aaed None admin] PATH_INFO: `/v3/domains/default` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:41:46.995215 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f996d633-ba4a-495c-b6d1-0bf70b52aaed None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:41:46.996734 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f996d633-ba4a-495c-b6d1-0bf70b52aaed None admin] RBAC: Authorization granted {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:41:46.998622 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 10/18] 10.222.0.84 () {56 vars in 1108 bytes} [Wed May 25 14:41:46 2022] GET /identity/v3/domains/default => generated 199 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 14:41:47.004377 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f996d633-ba4a-495c-b6d1-0bf70b52aaed None admin] Authenticating user token {{(pid=101893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:41:47.024558 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aea2a5e-d903-4633-8101-e61744e18551 None admin] Validating token access rules against request {{(pid=101892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:41:47.057871 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8da99148-708d-4b8e-be7f-66fd9e54b2ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:41:47.059496 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da99148-708d-4b8e-be7f-66fd9e54b2ef None admin] REQUEST_METHOD: `GET` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:41:47.059887 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da99148-708d-4b8e-be7f-66fd9e54b2ef None admin] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:41:47.060160 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da99148-708d-4b8e-be7f-66fd9e54b2ef None admin] PATH_INFO: `/v3/domains/Default` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:41:47.079685 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8da99148-708d-4b8e-be7f-66fd9e54b2ef None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:41:47.081100 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8da99148-708d-4b8e-be7f-66fd9e54b2ef None admin] RBAC: Authorization granted {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:41:47.084370 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG dbcounter [-] [101893] Writing DB stats keystone:SELECT=100 {{(pid=101893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:41:47.101615 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application [None req-8da99148-708d-4b8e-be7f-66fd9e54b2ef None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 25 14:41:47.101615 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:41:47.101615 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 14:41:47.101615 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 14:41:47.101615 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 14:41:47.101615 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 14:41:47.101615 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 14:41:47.101615 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 14:41:47.101615 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 14:41:47.101615 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 14:41:47.101615 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 14:41:47.101615 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 14:41:47.101615 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 25 14:41:47.101615 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 25 14:41:47.101615 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 25 14:41:47.102729 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 25 14:41:47.102729 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 14:41:47.102729 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 14:41:47.102729 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 14:41:47.102729 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 14:41:47.102729 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 14:41:47.102729 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application return self.get_or_create( May 25 14:41:47.102729 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 14:41:47.102729 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application with Lock( May 25 14:41:47.102729 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 14:41:47.102729 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application return self._enter() May 25 14:41:47.102729 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 14:41:47.102729 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 14:41:47.102729 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 14:41:47.102729 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application return self.creator() May 25 14:41:47.102729 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 14:41:47.102729 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application created_value = creator( May 25 14:41:47.103858 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 25 14:41:47.103858 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 25 14:41:47.103858 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 25 14:41:47.103858 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application May 25 14:41:47.104179 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f996d633-ba4a-495c-b6d1-0bf70b52aaed None admin] Validating token access rules against request {{(pid=101893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:41:47.104266 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 9/19] 10.222.0.84 () {56 vars in 1108 bytes} [Wed May 25 14:41:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 25 14:41:47.108770 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8da99148-708d-4b8e-be7f-66fd9e54b2ef None admin] Authenticating user token {{(pid=101892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:41:47.138788 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2a05366-d153-4400-823e-6800d72c21c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:41:47.139485 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a05366-d153-4400-823e-6800d72c21c4 None admin] REQUEST_METHOD: `GET` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:41:47.139801 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a05366-d153-4400-823e-6800d72c21c4 None admin] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:41:47.140081 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a05366-d153-4400-823e-6800d72c21c4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:41:47.140904 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2a05366-d153-4400-823e-6800d72c21c4 None admin] RBAC: Adding query filter params (role.id=a3b78e7d547d4d2d998b4c99a4396bba, scope.domain.id=default, user.id=05d87e87798e429aa1c10b24391f915e) {{(pid=101893) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:41:47.141214 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2a05366-d153-4400-823e-6800d72c21c4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:41:47.142659 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2a05366-d153-4400-823e-6800d72c21c4 None admin] RBAC: Authorization granted {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:41:47.149249 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 11/20] 10.222.0.84 () {56 vars in 1322 bytes} [Wed May 25 14:41:47 2022] GET /identity/v3/role_assignments?user.id=05d87e87798e429aa1c10b24391f915e&scope.domain.id=default&role.id=a3b78e7d547d4d2d998b4c99a4396bba => generated 233 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 14:41:47.167549 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG dbcounter [-] [101892] Writing DB stats keystone:SELECT=100 {{(pid=101892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:41:47.213950 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8da99148-708d-4b8e-be7f-66fd9e54b2ef None admin] Validating token access rules against request {{(pid=101892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:41:47.249724 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f95513a-d9c1-41a4-a166-9b0dd2dd6944 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:41:47.250423 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f95513a-d9c1-41a4-a166-9b0dd2dd6944 None admin] REQUEST_METHOD: `GET` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:41:47.250708 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f95513a-d9c1-41a4-a166-9b0dd2dd6944 None admin] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:41:47.250987 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f95513a-d9c1-41a4-a166-9b0dd2dd6944 None admin] PATH_INFO: `/v3/domains` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:41:47.251755 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f95513a-d9c1-41a4-a166-9b0dd2dd6944 None admin] RBAC: Adding query filter params (name=Default) {{(pid=101892) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:41:47.252326 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f95513a-d9c1-41a4-a166-9b0dd2dd6944 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:41:47.253736 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f95513a-d9c1-41a4-a166-9b0dd2dd6944 None admin] RBAC: Authorization granted {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:41:47.273139 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 10/21] 10.222.0.84 () {56 vars in 1109 bytes} [Wed May 25 14:41:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 14:41:49.673214 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d796e1-ed42-4ad3-b283-3bff4bc8d728 None None] REQUEST_METHOD: `GET` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:41:49.673739 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d796e1-ed42-4ad3-b283-3bff4bc8d728 None None] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:41:49.673814 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d796e1-ed42-4ad3-b283-3bff4bc8d728 None None] PATH_INFO: `/` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:41:49.675284 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 12/22] 10.222.0.84 () {54 vars in 926 bytes} [Wed May 25 14:41:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 14:41:49.680586 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab085f6-1079-4299-b332-dc51ed150fce None None] REQUEST_METHOD: `POST` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:41:49.681445 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab085f6-1079-4299-b332-dc51ed150fce None None] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:41:49.681932 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab085f6-1079-4299-b332-dc51ed150fce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:41:49.707459 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.auth.core [None req-aab085f6-1079-4299-b332-dc51ed150fce None None] MFA Rules not processed for user `05d87e87798e429aa1c10b24391f915e`. Rule list: `[]` (Enabled: `True`). {{(pid=101892) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:41:49.709042 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.fernet_utils [None req-aab085f6-1079-4299-b332-dc51ed150fce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=101892) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:41:49.788106 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 11/23] 10.222.0.84 () {58 vars in 1023 bytes} [Wed May 25 14:41:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 25 14:41:49.789648 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5eb3d01-4134-40ec-b63a-6593d0ddb881 None None] REQUEST_METHOD: `GET` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:41:49.790152 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5eb3d01-4134-40ec-b63a-6593d0ddb881 None None] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:41:49.790622 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5eb3d01-4134-40ec-b63a-6593d0ddb881 None None] PATH_INFO: `/` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:41:49.792189 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 13/24] 10.222.0.84 () {54 vars in 926 bytes} [Wed May 25 14:41:49 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 14:41:49.804851 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c418448-f567-43f4-9713-c071bd618b77 None None] REQUEST_METHOD: `POST` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:41:49.805149 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c418448-f567-43f4-9713-c071bd618b77 None None] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:41:49.805439 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c418448-f567-43f4-9713-c071bd618b77 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:41:49.815911 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5eb3d01-4134-40ec-b63a-6593d0ddb881 None None] Authenticating user token {{(pid=101893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:41:49.836777 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.auth.core [None req-7c418448-f567-43f4-9713-c071bd618b77 None None] MFA Rules not processed for user `05d87e87798e429aa1c10b24391f915e`. Rule list: `[]` (Enabled: `True`). {{(pid=101892) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:41:49.838104 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.fernet_utils [None req-7c418448-f567-43f4-9713-c071bd618b77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=101892) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:41:49.927928 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG dbcounter [-] [101892] Writing DB stats keystone:SELECT=100 {{(pid=101892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:41:49.977222 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 12/25] 10.222.0.84 () {58 vars in 1023 bytes} [Wed May 25 14:41:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 25 14:41:50.017896 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c418448-f567-43f4-9713-c071bd618b77 None None] Authenticating user token {{(pid=101892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:41:50.041193 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5eb3d01-4134-40ec-b63a-6593d0ddb881 None None] Validating token access rules against request {{(pid=101893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:41:50.102839 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e9da1ff-5098-4025-af30-05fa6badd1ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:41:50.104025 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e9da1ff-5098-4025-af30-05fa6badd1ef None admin] REQUEST_METHOD: `GET` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:41:50.104532 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e9da1ff-5098-4025-af30-05fa6badd1ef None admin] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:41:50.105045 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e9da1ff-5098-4025-af30-05fa6badd1ef None admin] PATH_INFO: `/v3/roles/admin` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:41:50.129019 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e9da1ff-5098-4025-af30-05fa6badd1ef None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 14:41:50.143583 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application [None req-5e9da1ff-5098-4025-af30-05fa6badd1ef None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 25 14:41:50.143583 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:41:50.143583 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 14:41:50.143583 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 14:41:50.143583 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 14:41:50.143583 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 14:41:50.143583 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 14:41:50.143583 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 14:41:50.143583 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 14:41:50.143583 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 14:41:50.143583 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 14:41:50.143583 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 14:41:50.143583 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 14:41:50.143583 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 14:41:50.143583 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 14:41:50.143583 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 14:41:50.144468 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 14:41:50.144468 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 14:41:50.144468 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 14:41:50.144468 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 14:41:50.144468 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 14:41:50.144468 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 14:41:50.144468 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 14:41:50.144468 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 14:41:50.144468 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 14:41:50.144468 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return self.get_or_create( May 25 14:41:50.144468 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 14:41:50.144468 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application with Lock( May 25 14:41:50.144468 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 14:41:50.144468 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return self._enter() May 25 14:41:50.144468 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 14:41:50.144468 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 14:41:50.145219 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 14:41:50.145219 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return self.creator() May 25 14:41:50.145219 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 14:41:50.145219 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application created_value = creator( May 25 14:41:50.145219 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 14:41:50.145219 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 14:41:50.145219 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 14:41:50.145219 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 14:41:50.145219 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 14:41:50.145219 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 14:41:50.145219 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 25 14:41:50.145219 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application May 25 14:41:50.148045 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 14/26] 10.222.0.84 () {56 vars in 1096 bytes} [Wed May 25 14:41:49 2022] GET /identity/v3/roles/admin => generated 83 bytes in 333 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 25 14:41:50.154275 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e9da1ff-5098-4025-af30-05fa6badd1ef None admin] Authenticating user token {{(pid=101893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:41:50.161443 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG dbcounter [-] [101893] Writing DB stats keystone:SELECT=100 {{(pid=101893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:41:50.272239 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c418448-f567-43f4-9713-c071bd618b77 None None] Validating token access rules against request {{(pid=101892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:41:50.351351 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e9da1ff-5098-4025-af30-05fa6badd1ef None admin] Validating token access rules against request {{(pid=101893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:41:50.353425 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c7c708-cbcc-45ba-92a3-34604e9c273d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:41:50.354060 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c7c708-cbcc-45ba-92a3-34604e9c273d None admin] REQUEST_METHOD: `POST` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:41:50.354356 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c7c708-cbcc-45ba-92a3-34604e9c273d None admin] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:41:50.354640 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c7c708-cbcc-45ba-92a3-34604e9c273d None admin] PATH_INFO: `/v3/roles` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:41:50.355463 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9c7c708-cbcc-45ba-92a3-34604e9c273d None admin] RBAC: Authorizing `identity:create_role()` {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:41:50.357026 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9c7c708-cbcc-45ba-92a3-34604e9c273d None admin] RBAC: Authorization granted {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:41:50.411235 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9836918e-767b-4b0c-bdd6-2ca9886d1b4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:41:50.411946 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9836918e-767b-4b0c-bdd6-2ca9886d1b4e None admin] REQUEST_METHOD: `GET` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:41:50.412235 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9836918e-767b-4b0c-bdd6-2ca9886d1b4e None admin] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:41:50.412514 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9836918e-767b-4b0c-bdd6-2ca9886d1b4e None admin] PATH_INFO: `/v3/roles` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:41:50.413273 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9836918e-767b-4b0c-bdd6-2ca9886d1b4e None admin] RBAC: Adding query filter params (name=admin) {{(pid=101893) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:41:50.413584 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9836918e-767b-4b0c-bdd6-2ca9886d1b4e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:41:50.414987 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9836918e-767b-4b0c-bdd6-2ca9886d1b4e None admin] RBAC: Authorization granted {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:41:50.424045 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 15/27] 10.222.0.84 () {56 vars in 1099 bytes} [Wed May 25 14:41:50 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 270 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 14:41:50.430038 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9836918e-767b-4b0c-bdd6-2ca9886d1b4e None admin] Authenticating user token {{(pid=101893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:41:50.518803 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG dbcounter [-] [101893] Writing DB stats keystone:SELECT=100 {{(pid=101893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:41:50.554410 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9836918e-767b-4b0c-bdd6-2ca9886d1b4e None admin] Validating token access rules against request {{(pid=101893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:41:50.590440 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d90e3d-e3d7-4ccf-a3a2-cd62429901dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:41:50.590890 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 13/28] 10.222.0.84 () {60 vars in 1131 bytes} [Wed May 25 14:41:50 2022] POST /identity/v3/roles => generated 219 bytes in 574 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 14:41:50.592700 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af821bc9-a12e-418b-9839-7bd627b54b59 None None] REQUEST_METHOD: `GET` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:41:50.593172 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af821bc9-a12e-418b-9839-7bd627b54b59 None None] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:41:50.593626 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af821bc9-a12e-418b-9839-7bd627b54b59 None None] PATH_INFO: `/` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:41:50.595112 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 14/29] 10.222.0.84 () {54 vars in 926 bytes} [Wed May 25 14:41:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 14:41:50.596013 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d90e3d-e3d7-4ccf-a3a2-cd62429901dc None admin] REQUEST_METHOD: `GET` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:41:50.596605 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d90e3d-e3d7-4ccf-a3a2-cd62429901dc None admin] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:41:50.597106 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d90e3d-e3d7-4ccf-a3a2-cd62429901dc None admin] PATH_INFO: `/v3/users/05d87e87798e429aa1c10b24391f915e` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:41:50.597407 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020da1f3-7469-4fab-9fc2-102c49e56c4d None None] REQUEST_METHOD: `GET` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:41:50.597863 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020da1f3-7469-4fab-9fc2-102c49e56c4d None None] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:41:50.598391 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020da1f3-7469-4fab-9fc2-102c49e56c4d None None] PATH_INFO: `/` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:41:50.598834 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2d90e3d-e3d7-4ccf-a3a2-cd62429901dc None admin] RBAC: Authorizing `identity:get_user(user_id=05d87e87798e429aa1c10b24391f915e)` {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:41:50.600095 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 15/30] 10.222.0.84 () {54 vars in 926 bytes} [Wed May 25 14:41:50 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 14:41:50.608321 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2d90e3d-e3d7-4ccf-a3a2-cd62429901dc None admin] RBAC: Authorization granted {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:41:50.610539 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 16/31] 10.222.0.84 () {56 vars in 1177 bytes} [Wed May 25 14:41:50 2022] GET /identity/v3/users/05d87e87798e429aa1c10b24391f915e => generated 247 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 14:41:50.614147 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60cea42e-123b-42ee-bb95-0eb87ef3b56d None None] REQUEST_METHOD: `POST` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:41:50.614666 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60cea42e-123b-42ee-bb95-0eb87ef3b56d None None] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:41:50.615122 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60cea42e-123b-42ee-bb95-0eb87ef3b56d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:41:50.615854 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d90e3d-e3d7-4ccf-a3a2-cd62429901dc None admin] Authenticating user token {{(pid=101893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:41:50.653451 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.auth.core [None req-60cea42e-123b-42ee-bb95-0eb87ef3b56d None None] MFA Rules not processed for user `05d87e87798e429aa1c10b24391f915e`. Rule list: `[]` (Enabled: `True`). {{(pid=101892) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:41:50.655369 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.fernet_utils [None req-60cea42e-123b-42ee-bb95-0eb87ef3b56d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=101892) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:41:50.703987 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG dbcounter [-] [101892] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=101892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:41:50.728019 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d90e3d-e3d7-4ccf-a3a2-cd62429901dc None admin] Validating token access rules against request {{(pid=101893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:41:50.765830 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d401210-6a21-46fe-8d42-feb16ec497ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:41:50.766654 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d401210-6a21-46fe-8d42-feb16ec497ef None admin] REQUEST_METHOD: `GET` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:41:50.766946 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d401210-6a21-46fe-8d42-feb16ec497ef None admin] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:41:50.767235 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d401210-6a21-46fe-8d42-feb16ec497ef None admin] PATH_INFO: `/v3/domains/default` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:41:50.768507 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d401210-6a21-46fe-8d42-feb16ec497ef None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:41:50.770010 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d401210-6a21-46fe-8d42-feb16ec497ef None admin] RBAC: Authorization granted {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:41:50.772085 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 17/32] 10.222.0.84 () {56 vars in 1108 bytes} [Wed May 25 14:41:50 2022] GET /identity/v3/domains/default => generated 199 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:41:50.773409 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cbdff39-1da4-40e2-b3f4-947d560ec6e7 None None] REQUEST_METHOD: `POST` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:41:50.779075 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cbdff39-1da4-40e2-b3f4-947d560ec6e7 None None] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:41:50.779427 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cbdff39-1da4-40e2-b3f4-947d560ec6e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:41:50.784926 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG dbcounter [-] [101893] Writing DB stats keystone:SELECT=100 {{(pid=101893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:41:50.787013 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 16/33] 10.222.0.84 () {58 vars in 1023 bytes} [Wed May 25 14:41:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 25 14:41:50.787991 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60cea42e-123b-42ee-bb95-0eb87ef3b56d None None] Authenticating user token {{(pid=101892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:41:50.797942 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.auth.core [None req-0cbdff39-1da4-40e2-b3f4-947d560ec6e7 None None] MFA Rules not processed for user `05d87e87798e429aa1c10b24391f915e`. Rule list: `[]` (Enabled: `True`). {{(pid=101893) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:41:50.799165 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.fernet_utils [None req-0cbdff39-1da4-40e2-b3f4-947d560ec6e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=101893) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:41:50.919712 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 18/34] 10.222.0.84 () {58 vars in 1023 bytes} [Wed May 25 14:41:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 25 14:41:50.920494 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cbdff39-1da4-40e2-b3f4-947d560ec6e7 None None] Authenticating user token {{(pid=101893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:41:50.967538 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60cea42e-123b-42ee-bb95-0eb87ef3b56d None None] Validating token access rules against request {{(pid=101892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:41:51.022756 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f3ce1f8-d2e0-4870-af8b-838842c2a485 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:41:51.023680 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3ce1f8-d2e0-4870-af8b-838842c2a485 None admin] REQUEST_METHOD: `PUT` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:41:51.023970 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3ce1f8-d2e0-4870-af8b-838842c2a485 None admin] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:41:51.024251 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3ce1f8-d2e0-4870-af8b-838842c2a485 None admin] PATH_INFO: `/v3/domains/default/users/05d87e87798e429aa1c10b24391f915e/roles/a3b78e7d547d4d2d998b4c99a4396bba` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:41:51.026869 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f3ce1f8-d2e0-4870-af8b-838842c2a485 None admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=05d87e87798e429aa1c10b24391f915e, role_id=a3b78e7d547d4d2d998b4c99a4396bba)` {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:41:51.028512 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f3ce1f8-d2e0-4870-af8b-838842c2a485 None admin] RBAC: Authorization granted {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:41:51.068262 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cbdff39-1da4-40e2-b3f4-947d560ec6e7 None None] Validating token access rules against request {{(pid=101893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:41:51.101649 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG dbcounter [-] [101893] Writing DB stats keystone:SELECT=100 {{(pid=101893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:41:51.106846 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4bd330d-9d4f-4c56-99f0-0349bfdf2e2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:41:51.107517 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4bd330d-9d4f-4c56-99f0-0349bfdf2e2f None admin] REQUEST_METHOD: `POST` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:41:51.107834 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4bd330d-9d4f-4c56-99f0-0349bfdf2e2f None admin] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:41:51.108153 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4bd330d-9d4f-4c56-99f0-0349bfdf2e2f None admin] PATH_INFO: `/v3/roles` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:41:51.108859 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4bd330d-9d4f-4c56-99f0-0349bfdf2e2f None admin] RBAC: Authorizing `identity:create_role()` {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:41:51.110257 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4bd330d-9d4f-4c56-99f0-0349bfdf2e2f None admin] RBAC: Authorization granted {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:41:51.137204 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 17/35] 10.222.0.84 () {58 vars in 1361 bytes} [Wed May 25 14:41:50 2022] PUT /identity/v3/domains/default/users/05d87e87798e429aa1c10b24391f915e/roles/a3b78e7d547d4d2d998b4c99a4396bba => generated 0 bytes in 349 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 14:41:51.138293 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f3ce1f8-d2e0-4870-af8b-838842c2a485 None admin] Authenticating user token {{(pid=101892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:41:51.177574 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG dbcounter [-] [101892] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=101892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:41:51.316307 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f3ce1f8-d2e0-4870-af8b-838842c2a485 None admin] Validating token access rules against request {{(pid=101892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:41:51.354430 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee8d1a42-19ed-4de1-89d1-deece24c18f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:41:51.356163 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8d1a42-19ed-4de1-89d1-deece24c18f7 None admin] REQUEST_METHOD: `GET` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:41:51.356824 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8d1a42-19ed-4de1-89d1-deece24c18f7 None admin] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:41:51.357318 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8d1a42-19ed-4de1-89d1-deece24c18f7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:41:51.373198 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee8d1a42-19ed-4de1-89d1-deece24c18f7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:41:51.374057 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 19/36] 10.222.0.84 () {60 vars in 1131 bytes} [Wed May 25 14:41:50 2022] POST /identity/v3/roles => generated 225 bytes in 454 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 14:41:51.374316 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee8d1a42-19ed-4de1-89d1-deece24c18f7 None admin] RBAC: Authorization granted {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:41:51.375548 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc23de3-8aff-4854-ba6f-0a678f7fbe62 None None] REQUEST_METHOD: `GET` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:41:51.375886 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc23de3-8aff-4854-ba6f-0a678f7fbe62 None None] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:41:51.376173 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc23de3-8aff-4854-ba6f-0a678f7fbe62 None None] PATH_INFO: `/` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:41:51.378172 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 20/37] 10.222.0.84 () {54 vars in 926 bytes} [Wed May 25 14:41:51 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 14:41:51.387340 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6ca636-8827-4d67-83db-ea6861e502f5 None None] REQUEST_METHOD: `POST` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:41:51.387716 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6ca636-8827-4d67-83db-ea6861e502f5 None None] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:41:51.387959 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6ca636-8827-4d67-83db-ea6861e502f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:41:51.401642 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application [None req-ee8d1a42-19ed-4de1-89d1-deece24c18f7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 25 14:41:51.401642 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:41:51.401642 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 14:41:51.401642 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 14:41:51.401642 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 14:41:51.401642 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 14:41:51.401642 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 14:41:51.401642 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 14:41:51.401642 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 14:41:51.401642 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 14:41:51.401642 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 14:41:51.401642 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 14:41:51.401642 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 25 14:41:51.401642 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 25 14:41:51.401642 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 25 14:41:51.403066 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 25 14:41:51.403066 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 14:41:51.403066 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 14:41:51.403066 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 14:41:51.403066 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 14:41:51.403066 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 14:41:51.403066 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application return self.get_or_create( May 25 14:41:51.403066 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 14:41:51.403066 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application with Lock( May 25 14:41:51.403066 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 14:41:51.403066 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application return self._enter() May 25 14:41:51.403066 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 14:41:51.403066 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 14:41:51.403066 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 14:41:51.403066 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application return self.creator() May 25 14:41:51.403066 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 14:41:51.403066 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application created_value = creator( May 25 14:41:51.403923 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 25 14:41:51.403923 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 25 14:41:51.403923 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 25 14:41:51.403923 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application May 25 14:41:51.406921 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 18/38] 10.222.0.84 () {56 vars in 1108 bytes} [Wed May 25 14:41:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 269 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 14:41:51.416670 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.auth.core [None req-cb6ca636-8827-4d67-83db-ea6861e502f5 None None] MFA Rules not processed for user `05d87e87798e429aa1c10b24391f915e`. Rule list: `[]` (Enabled: `True`). {{(pid=101893) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:41:51.417182 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee8d1a42-19ed-4de1-89d1-deece24c18f7 None admin] Authenticating user token {{(pid=101892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:41:51.418291 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.fernet_utils [None req-cb6ca636-8827-4d67-83db-ea6861e502f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=101893) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:41:51.559005 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 21/39] 10.222.0.84 () {58 vars in 1023 bytes} [Wed May 25 14:41:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 25 14:41:51.572919 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05246d4-5b93-4cd9-9acd-ddc53bb83fa9 None None] REQUEST_METHOD: `GET` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:41:51.573235 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05246d4-5b93-4cd9-9acd-ddc53bb83fa9 None None] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:41:51.573515 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05246d4-5b93-4cd9-9acd-ddc53bb83fa9 None None] PATH_INFO: `/` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:41:51.575691 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 22/40] 10.222.0.84 () {54 vars in 926 bytes} [Wed May 25 14:41:51 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 25 14:41:51.579335 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG dbcounter [-] [101892] Writing DB stats keystone:SELECT=100 {{(pid=101892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:41:51.581389 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ab0774-5a48-4b6a-b67f-3d7b1a96f718 None None] REQUEST_METHOD: `POST` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:41:51.581678 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ab0774-5a48-4b6a-b67f-3d7b1a96f718 None None] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:41:51.582018 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ab0774-5a48-4b6a-b67f-3d7b1a96f718 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:41:51.601487 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.auth.core [None req-c8ab0774-5a48-4b6a-b67f-3d7b1a96f718 None None] MFA Rules not processed for user `05d87e87798e429aa1c10b24391f915e`. Rule list: `[]` (Enabled: `True`). {{(pid=101893) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:41:51.602703 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.fernet_utils [None req-c8ab0774-5a48-4b6a-b67f-3d7b1a96f718 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=101893) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:41:51.614340 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee8d1a42-19ed-4de1-89d1-deece24c18f7 None admin] Validating token access rules against request {{(pid=101892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:41:51.662570 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3a6d942-e001-42a8-ab51-dd86c33f2d28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:41:51.663591 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a6d942-e001-42a8-ab51-dd86c33f2d28 None admin] REQUEST_METHOD: `GET` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:41:51.664034 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a6d942-e001-42a8-ab51-dd86c33f2d28 None admin] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:41:51.664330 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a6d942-e001-42a8-ab51-dd86c33f2d28 None admin] PATH_INFO: `/v3/domains` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:41:51.665091 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3a6d942-e001-42a8-ab51-dd86c33f2d28 None admin] RBAC: Adding query filter params (name=Default) {{(pid=101892) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:41:51.665408 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3a6d942-e001-42a8-ab51-dd86c33f2d28 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:41:51.667301 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3a6d942-e001-42a8-ab51-dd86c33f2d28 None admin] RBAC: Authorization granted {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:41:51.683890 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 19/41] 10.222.0.84 () {56 vars in 1109 bytes} [Wed May 25 14:41:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 268 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:41:51.684739 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3a6d942-e001-42a8-ab51-dd86c33f2d28 None admin] Authenticating user token {{(pid=101892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:41:51.686226 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 23/42] 10.222.0.84 () {58 vars in 1023 bytes} [Wed May 25 14:41:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 25 14:41:51.689309 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ab0774-5a48-4b6a-b67f-3d7b1a96f718 None None] Authenticating user token {{(pid=101893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:41:51.746674 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG dbcounter [-] [101893] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=101893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:41:51.792681 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3a6d942-e001-42a8-ab51-dd86c33f2d28 None admin] Validating token access rules against request {{(pid=101892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:41:51.803428 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ab0774-5a48-4b6a-b67f-3d7b1a96f718 None None] Validating token access rules against request {{(pid=101893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:41:51.830125 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fccce8a3-a5cb-4eba-9876-2b770e004865 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:41:51.830858 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fccce8a3-a5cb-4eba-9876-2b770e004865 None admin] REQUEST_METHOD: `GET` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:41:51.831147 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fccce8a3-a5cb-4eba-9876-2b770e004865 None admin] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:41:51.831430 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fccce8a3-a5cb-4eba-9876-2b770e004865 None admin] PATH_INFO: `/v3/domains/default` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:41:51.832657 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fccce8a3-a5cb-4eba-9876-2b770e004865 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:41:51.834123 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fccce8a3-a5cb-4eba-9876-2b770e004865 None admin] RBAC: Authorization granted {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:41:51.835996 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 20/43] 10.222.0.84 () {56 vars in 1108 bytes} [Wed May 25 14:41:51 2022] GET /identity/v3/domains/default => generated 199 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:41:51.836528 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fccce8a3-a5cb-4eba-9876-2b770e004865 None admin] Authenticating user token {{(pid=101892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:41:51.839388 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b871ba4-b068-4edb-be37-0f88e2cbdc50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:41:51.840097 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b871ba4-b068-4edb-be37-0f88e2cbdc50 None admin] REQUEST_METHOD: `POST` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:41:51.840384 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b871ba4-b068-4edb-be37-0f88e2cbdc50 None admin] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:41:51.840670 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b871ba4-b068-4edb-be37-0f88e2cbdc50 None admin] PATH_INFO: `/v3/projects` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:41:51.841393 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b871ba4-b068-4edb-be37-0f88e2cbdc50 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:41:51.842986 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b871ba4-b068-4edb-be37-0f88e2cbdc50 None admin] RBAC: Authorization granted {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:41:51.845761 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG dbcounter [-] [101892] Writing DB stats keystone:SELECT=100 {{(pid=101892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:41:51.937549 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fccce8a3-a5cb-4eba-9876-2b770e004865 None admin] Validating token access rules against request {{(pid=101892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:41:51.943860 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 24/44] 10.222.0.84 () {60 vars in 1141 bytes} [Wed May 25 14:41:51 2022] POST /identity/v3/projects => generated 301 bytes in 255 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 25 14:41:51.944919 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b871ba4-b068-4edb-be37-0f88e2cbdc50 None admin] Authenticating user token {{(pid=101893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:41:51.992276 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6f2964b-5095-4ef5-8eca-60231eac8547 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:41:51.993235 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f2964b-5095-4ef5-8eca-60231eac8547 None admin] REQUEST_METHOD: `POST` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:41:51.993712 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f2964b-5095-4ef5-8eca-60231eac8547 None admin] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:41:51.995089 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f2964b-5095-4ef5-8eca-60231eac8547 None admin] PATH_INFO: `/v3/roles` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:41:51.996966 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6f2964b-5095-4ef5-8eca-60231eac8547 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:41:51.999666 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6f2964b-5095-4ef5-8eca-60231eac8547 None admin] RBAC: Authorization granted {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:41:52.063461 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b871ba4-b068-4edb-be37-0f88e2cbdc50 None admin] Validating token access rules against request {{(pid=101893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:41:52.066051 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG dbcounter [-] [101893] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=101893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:41:52.099815 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 21/45] 10.222.0.84 () {60 vars in 1131 bytes} [Wed May 25 14:41:51 2022] POST /identity/v3/roles => generated 223 bytes in 263 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 14:41:52.111875 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f6c9061-4412-4512-bbb4-c202e59ba9b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:41:52.111875 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6c9061-4412-4512-bbb4-c202e59ba9b1 None admin] REQUEST_METHOD: `POST` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:41:52.111875 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6c9061-4412-4512-bbb4-c202e59ba9b1 None admin] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:41:52.111875 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6c9061-4412-4512-bbb4-c202e59ba9b1 None admin] PATH_INFO: `/v3/projects` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:41:52.112474 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f6c9061-4412-4512-bbb4-c202e59ba9b1 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:41:52.114098 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f6c9061-4412-4512-bbb4-c202e59ba9b1 None admin] RBAC: Authorization granted {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:41:52.233122 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 25/46] 10.222.0.84 () {60 vars in 1141 bytes} [Wed May 25 14:41:51 2022] POST /identity/v3/projects => generated 312 bytes in 289 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 14:41:53.494435 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e19911a6-0558-4d5f-af30-b2d59c70267e None None] REQUEST_METHOD: `GET` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:41:53.494947 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e19911a6-0558-4d5f-af30-b2d59c70267e None None] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:41:53.495060 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e19911a6-0558-4d5f-af30-b2d59c70267e None None] PATH_INFO: `/` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:41:53.497034 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 22/47] 10.222.0.84 () {54 vars in 926 bytes} [Wed May 25 14:41:53 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 14:41:53.502630 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2f6da6-5536-44a4-a369-b025dcfbc04e None None] REQUEST_METHOD: `POST` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:41:53.503005 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2f6da6-5536-44a4-a369-b025dcfbc04e None None] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:41:53.503201 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2f6da6-5536-44a4-a369-b025dcfbc04e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:41:53.520304 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.auth.core [None req-5b2f6da6-5536-44a4-a369-b025dcfbc04e None None] MFA Rules not processed for user `05d87e87798e429aa1c10b24391f915e`. Rule list: `[]` (Enabled: `True`). {{(pid=101893) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:41:53.521516 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.fernet_utils [None req-5b2f6da6-5536-44a4-a369-b025dcfbc04e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=101893) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:41:53.591433 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 26/48] 10.222.0.84 () {58 vars in 1023 bytes} [Wed May 25 14:41:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 25 14:41:53.615990 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e19911a6-0558-4d5f-af30-b2d59c70267e None None] Authenticating user token {{(pid=101892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:41:53.680209 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG dbcounter [-] [101892] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=101892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:41:53.714920 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e19911a6-0558-4d5f-af30-b2d59c70267e None None] Validating token access rules against request {{(pid=101892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:41:53.749214 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9d1bbcb-b347-4ac1-89ee-5ce7eae0ce16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:41:53.749934 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d1bbcb-b347-4ac1-89ee-5ce7eae0ce16 None admin] REQUEST_METHOD: `GET` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:41:53.750221 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d1bbcb-b347-4ac1-89ee-5ce7eae0ce16 None admin] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:41:53.750498 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d1bbcb-b347-4ac1-89ee-5ce7eae0ce16 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:41:53.762067 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9d1bbcb-b347-4ac1-89ee-5ce7eae0ce16 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 14:41:53.770947 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application [None req-f9d1bbcb-b347-4ac1-89ee-5ce7eae0ce16 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 25 14:41:53.770947 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:41:53.770947 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 14:41:53.770947 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 14:41:53.770947 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 14:41:53.770947 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 14:41:53.770947 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 14:41:53.770947 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 14:41:53.770947 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 14:41:53.770947 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 14:41:53.770947 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 14:41:53.770947 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 14:41:53.770947 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 14:41:53.770947 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 14:41:53.770947 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 14:41:53.770947 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 14:41:53.771820 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 14:41:53.771820 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 14:41:53.771820 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 14:41:53.771820 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 14:41:53.771820 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 14:41:53.771820 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 14:41:53.771820 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 14:41:53.771820 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 14:41:53.771820 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 14:41:53.771820 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application return self.get_or_create( May 25 14:41:53.771820 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 14:41:53.771820 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application with Lock( May 25 14:41:53.771820 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 14:41:53.771820 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application return self._enter() May 25 14:41:53.771820 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 14:41:53.771820 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 14:41:53.772613 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 14:41:53.772613 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application return self.creator() May 25 14:41:53.772613 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 14:41:53.772613 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application created_value = creator( May 25 14:41:53.772613 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 14:41:53.772613 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 14:41:53.772613 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 14:41:53.772613 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 14:41:53.772613 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 14:41:53.772613 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 14:41:53.772613 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 25 14:41:53.772613 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application May 25 14:41:53.772613 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 23/49] 10.222.0.84 () {56 vars in 1096 bytes} [Wed May 25 14:41:53 2022] GET /identity/v3/roles/admin => generated 83 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 14:41:53.778050 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b2f6da6-5536-44a4-a369-b025dcfbc04e None None] Authenticating user token {{(pid=101893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:41:53.861565 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG dbcounter [-] [101893] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=101893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:41:53.876069 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b2f6da6-5536-44a4-a369-b025dcfbc04e None None] Validating token access rules against request {{(pid=101893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:41:53.910045 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a55d59b9-debe-492e-b5ff-b39b2f02df07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:41:53.910718 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55d59b9-debe-492e-b5ff-b39b2f02df07 None admin] REQUEST_METHOD: `GET` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:41:53.911002 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55d59b9-debe-492e-b5ff-b39b2f02df07 None admin] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:41:53.911286 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55d59b9-debe-492e-b5ff-b39b2f02df07 None admin] PATH_INFO: `/v3/roles` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:41:53.912084 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a55d59b9-debe-492e-b5ff-b39b2f02df07 None admin] RBAC: Adding query filter params (name=admin) {{(pid=101893) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:41:53.912398 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a55d59b9-debe-492e-b5ff-b39b2f02df07 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:41:53.913783 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a55d59b9-debe-492e-b5ff-b39b2f02df07 None admin] RBAC: Authorization granted {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:41:53.922821 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 27/50] 10.222.0.84 () {56 vars in 1099 bytes} [Wed May 25 14:41:53 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:41:53.928362 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9d1bbcb-b347-4ac1-89ee-5ce7eae0ce16 None admin] Authenticating user token {{(pid=101892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:41:54.027038 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9d1bbcb-b347-4ac1-89ee-5ce7eae0ce16 None admin] Validating token access rules against request {{(pid=101892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:41:54.052551 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG dbcounter [-] [101892] Writing DB stats keystone:SELECT=100 {{(pid=101892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:41:54.061007 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd20949b-0e5c-4a2a-acae-c5b9d78debc7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:41:54.061885 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd20949b-0e5c-4a2a-acae-c5b9d78debc7 None admin] REQUEST_METHOD: `GET` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:41:54.062172 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd20949b-0e5c-4a2a-acae-c5b9d78debc7 None admin] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:41:54.068555 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd20949b-0e5c-4a2a-acae-c5b9d78debc7 None admin] PATH_INFO: `/v3/users/05d87e87798e429aa1c10b24391f915e` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:41:54.068555 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd20949b-0e5c-4a2a-acae-c5b9d78debc7 None admin] RBAC: Authorizing `identity:get_user(user_id=05d87e87798e429aa1c10b24391f915e)` {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:41:54.068555 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd20949b-0e5c-4a2a-acae-c5b9d78debc7 None admin] RBAC: Authorization granted {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:41:54.068555 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 24/51] 10.222.0.84 () {56 vars in 1177 bytes} [Wed May 25 14:41:53 2022] GET /identity/v3/users/05d87e87798e429aa1c10b24391f915e => generated 247 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:41:54.072299 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a55d59b9-debe-492e-b5ff-b39b2f02df07 None admin] Authenticating user token {{(pid=101893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:41:54.170806 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a55d59b9-debe-492e-b5ff-b39b2f02df07 None admin] Validating token access rules against request {{(pid=101893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:41:54.203833 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d09ee55-ca8e-4e29-9551-473089e351cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:41:54.204624 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d09ee55-ca8e-4e29-9551-473089e351cd None admin] REQUEST_METHOD: `GET` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:41:54.204907 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d09ee55-ca8e-4e29-9551-473089e351cd None admin] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:41:54.205182 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d09ee55-ca8e-4e29-9551-473089e351cd None admin] PATH_INFO: `/v3/domains/default` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:41:54.206352 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d09ee55-ca8e-4e29-9551-473089e351cd None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:41:54.207835 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d09ee55-ca8e-4e29-9551-473089e351cd None admin] RBAC: Authorization granted {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:41:54.209445 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 28/52] 10.222.0.84 () {56 vars in 1108 bytes} [Wed May 25 14:41:54 2022] GET /identity/v3/domains/default => generated 199 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:41:54.215653 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd20949b-0e5c-4a2a-acae-c5b9d78debc7 None admin] Authenticating user token {{(pid=101892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:41:54.327420 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd20949b-0e5c-4a2a-acae-c5b9d78debc7 None admin] Validating token access rules against request {{(pid=101892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:41:54.360119 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3b46e1f-2f82-4d87-8881-629d9d580837 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:41:54.360776 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b46e1f-2f82-4d87-8881-629d9d580837 None admin] REQUEST_METHOD: `GET` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:41:54.361062 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b46e1f-2f82-4d87-8881-629d9d580837 None admin] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:41:54.361342 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b46e1f-2f82-4d87-8881-629d9d580837 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:41:54.362176 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3b46e1f-2f82-4d87-8881-629d9d580837 None admin] RBAC: Adding query filter params (role.id=a3b78e7d547d4d2d998b4c99a4396bba, scope.domain.id=default, user.id=05d87e87798e429aa1c10b24391f915e) {{(pid=101892) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:41:54.362479 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3b46e1f-2f82-4d87-8881-629d9d580837 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:41:54.363947 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3b46e1f-2f82-4d87-8881-629d9d580837 None admin] RBAC: Authorization granted {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:41:54.379656 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 25/53] 10.222.0.84 () {56 vars in 1322 bytes} [Wed May 25 14:41:54 2022] GET /identity/v3/role_assignments?user.id=05d87e87798e429aa1c10b24391f915e&scope.domain.id=default&role.id=a3b78e7d547d4d2d998b4c99a4396bba => generated 530 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:41:54.458278 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a75153-664e-4beb-ba9e-49541f1a7088 None None] REQUEST_METHOD: `GET` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:41:54.458570 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a75153-664e-4beb-ba9e-49541f1a7088 None None] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:41:54.458866 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a75153-664e-4beb-ba9e-49541f1a7088 None None] PATH_INFO: `/` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:41:54.460287 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 29/54] 10.222.0.84 () {54 vars in 926 bytes} [Wed May 25 14:41:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 14:41:54.466588 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f75b707-8539-4aad-9c6f-625d585b7f43 None None] REQUEST_METHOD: `POST` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:41:54.466888 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f75b707-8539-4aad-9c6f-625d585b7f43 None None] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:41:54.467174 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f75b707-8539-4aad-9c6f-625d585b7f43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:41:54.485644 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.auth.core [None req-0f75b707-8539-4aad-9c6f-625d585b7f43 None None] MFA Rules not processed for user `05d87e87798e429aa1c10b24391f915e`. Rule list: `[]` (Enabled: `True`). {{(pid=101892) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:41:54.486884 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.fernet_utils [None req-0f75b707-8539-4aad-9c6f-625d585b7f43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=101892) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:41:54.543202 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG dbcounter [-] [101892] Writing DB stats keystone:SELECT=100 {{(pid=101892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:41:54.557587 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 26/55] 10.222.0.84 () {58 vars in 1023 bytes} [Wed May 25 14:41:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 25 14:41:54.582016 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29a75153-664e-4beb-ba9e-49541f1a7088 None None] Authenticating user token {{(pid=101893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:41:54.601715 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG dbcounter [-] [101893] Writing DB stats keystone:SELECT=100 {{(pid=101893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:41:54.683993 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29a75153-664e-4beb-ba9e-49541f1a7088 None None] Validating token access rules against request {{(pid=101893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:41:54.716838 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14ed910c-3c5d-47c9-a952-aacc64897008 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:41:54.717624 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ed910c-3c5d-47c9-a952-aacc64897008 None admin] REQUEST_METHOD: `GET` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:41:54.717917 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ed910c-3c5d-47c9-a952-aacc64897008 None admin] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:41:54.718203 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ed910c-3c5d-47c9-a952-aacc64897008 None admin] PATH_INFO: `/v3/domains/default` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:41:54.719381 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14ed910c-3c5d-47c9-a952-aacc64897008 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:41:54.720874 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14ed910c-3c5d-47c9-a952-aacc64897008 None admin] RBAC: Authorization granted {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:41:54.722480 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 30/56] 10.222.0.84 () {56 vars in 1108 bytes} [Wed May 25 14:41:54 2022] GET /identity/v3/domains/default => generated 199 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:41:54.728100 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f75b707-8539-4aad-9c6f-625d585b7f43 None None] Authenticating user token {{(pid=101892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:41:54.822823 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f75b707-8539-4aad-9c6f-625d585b7f43 None None] Validating token access rules against request {{(pid=101892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:41:54.856008 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3871b76a-1ab6-4d17-a8d5-0aea23e02bed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:41:54.856661 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3871b76a-1ab6-4d17-a8d5-0aea23e02bed None admin] REQUEST_METHOD: `POST` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:41:54.856947 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3871b76a-1ab6-4d17-a8d5-0aea23e02bed None admin] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:41:54.857229 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3871b76a-1ab6-4d17-a8d5-0aea23e02bed None admin] PATH_INFO: `/v3/projects` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:41:54.857936 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3871b76a-1ab6-4d17-a8d5-0aea23e02bed None admin] RBAC: Authorizing `identity:create_project()` {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:41:54.859382 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3871b76a-1ab6-4d17-a8d5-0aea23e02bed None admin] RBAC: Authorization granted {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:41:54.943858 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 27/57] 10.222.0.84 () {60 vars in 1140 bytes} [Wed May 25 14:41:54 2022] POST /identity/v3/projects => generated 298 bytes in 216 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 25 14:41:57.133599 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f4e86a-ca26-44f8-9173-7d9fd6707c09 None None] REQUEST_METHOD: `GET` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:41:57.134160 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f4e86a-ca26-44f8-9173-7d9fd6707c09 None None] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:41:57.134160 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f4e86a-ca26-44f8-9173-7d9fd6707c09 None None] PATH_INFO: `/` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:41:57.135500 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 31/58] 10.222.0.84 () {54 vars in 926 bytes} [Wed May 25 14:41:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 14:41:57.141394 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a22d2d-8e06-4f21-b787-8f6465e39d24 None None] REQUEST_METHOD: `POST` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:41:57.141788 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a22d2d-8e06-4f21-b787-8f6465e39d24 None None] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:41:57.141961 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a22d2d-8e06-4f21-b787-8f6465e39d24 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:41:57.158365 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.auth.core [None req-16a22d2d-8e06-4f21-b787-8f6465e39d24 None None] MFA Rules not processed for user `05d87e87798e429aa1c10b24391f915e`. Rule list: `[]` (Enabled: `True`). {{(pid=101892) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:41:57.159655 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.fernet_utils [None req-16a22d2d-8e06-4f21-b787-8f6465e39d24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=101892) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:41:57.192674 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG dbcounter [-] [101892] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=101892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:41:57.224050 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 28/59] 10.222.0.84 () {58 vars in 1023 bytes} [Wed May 25 14:41:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 25 14:41:57.249495 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f4e86a-ca26-44f8-9173-7d9fd6707c09 None None] Authenticating user token {{(pid=101893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:41:57.335511 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG dbcounter [-] [101893] Writing DB stats keystone:SELECT=100 {{(pid=101893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:41:57.351754 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f4e86a-ca26-44f8-9173-7d9fd6707c09 None None] Validating token access rules against request {{(pid=101893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:41:57.385640 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53487c0b-cc43-4404-9114-ddfb8e7fdc15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:41:57.386374 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53487c0b-cc43-4404-9114-ddfb8e7fdc15 None admin] REQUEST_METHOD: `GET` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:41:57.386661 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53487c0b-cc43-4404-9114-ddfb8e7fdc15 None admin] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:41:57.386936 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53487c0b-cc43-4404-9114-ddfb8e7fdc15 None admin] PATH_INFO: `/v3/domains/default` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:41:57.388149 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53487c0b-cc43-4404-9114-ddfb8e7fdc15 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:41:57.389620 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53487c0b-cc43-4404-9114-ddfb8e7fdc15 None admin] RBAC: Authorization granted {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:41:57.391236 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 32/60] 10.222.0.84 () {56 vars in 1108 bytes} [Wed May 25 14:41:57 2022] GET /identity/v3/domains/default => generated 199 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:41:57.396873 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16a22d2d-8e06-4f21-b787-8f6465e39d24 None None] Authenticating user token {{(pid=101892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:41:57.493747 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16a22d2d-8e06-4f21-b787-8f6465e39d24 None None] Validating token access rules against request {{(pid=101892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:41:57.526683 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a7144e-003d-4bfd-8e6a-b535f1588dd2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:41:57.527340 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a7144e-003d-4bfd-8e6a-b535f1588dd2 None admin] REQUEST_METHOD: `POST` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:41:57.527651 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a7144e-003d-4bfd-8e6a-b535f1588dd2 None admin] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:41:57.528054 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a7144e-003d-4bfd-8e6a-b535f1588dd2 None admin] PATH_INFO: `/v3/users` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:41:57.528758 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3a7144e-003d-4bfd-8e6a-b535f1588dd2 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:41:57.530196 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3a7144e-003d-4bfd-8e6a-b535f1588dd2 None admin] RBAC: Authorization granted {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:41:57.641179 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 29/61] 10.222.0.84 () {60 vars in 1132 bytes} [Wed May 25 14:41:57 2022] POST /identity/v3/users => generated 275 bytes in 245 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 14:42:00.953173 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96448cd7-2df4-4c0a-8b78-7673715b8c1f None None] REQUEST_METHOD: `GET` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:42:00.954113 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96448cd7-2df4-4c0a-8b78-7673715b8c1f None None] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:42:00.954590 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96448cd7-2df4-4c0a-8b78-7673715b8c1f None None] PATH_INFO: `/` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:42:00.956808 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 33/62] 10.222.0.84 () {54 vars in 926 bytes} [Wed May 25 14:42:00 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 14:42:00.962551 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0fd842a-435a-4ca5-af84-43dde6cae470 None None] REQUEST_METHOD: `POST` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:42:00.963520 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0fd842a-435a-4ca5-af84-43dde6cae470 None None] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:42:00.964589 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0fd842a-435a-4ca5-af84-43dde6cae470 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:42:00.988649 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.auth.core [None req-a0fd842a-435a-4ca5-af84-43dde6cae470 None None] MFA Rules not processed for user `05d87e87798e429aa1c10b24391f915e`. Rule list: `[]` (Enabled: `True`). {{(pid=101892) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:42:00.990214 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.fernet_utils [None req-a0fd842a-435a-4ca5-af84-43dde6cae470 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=101892) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:42:01.015608 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG dbcounter [-] [101892] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=101892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:42:01.079797 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 30/63] 10.222.0.84 () {58 vars in 1023 bytes} [Wed May 25 14:42:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 25 14:42:01.121161 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96448cd7-2df4-4c0a-8b78-7673715b8c1f None None] Authenticating user token {{(pid=101893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:42:01.185559 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5158fc7e-eeba-4338-888e-cde128a8f5ce None None] REQUEST_METHOD: `GET` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:42:01.186190 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5158fc7e-eeba-4338-888e-cde128a8f5ce None None] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:42:01.186689 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5158fc7e-eeba-4338-888e-cde128a8f5ce None None] PATH_INFO: `/` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:42:01.188311 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 31/64] 10.222.0.84 () {54 vars in 926 bytes} [Wed May 25 14:42:01 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 25 14:42:01.194656 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cfa04d0-8623-4e2a-8c88-91829077f412 None None] REQUEST_METHOD: `POST` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:42:01.195203 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cfa04d0-8623-4e2a-8c88-91829077f412 None None] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:42:01.195732 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cfa04d0-8623-4e2a-8c88-91829077f412 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:42:01.233945 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.auth.core [None req-5cfa04d0-8623-4e2a-8c88-91829077f412 None None] MFA Rules not processed for user `05d87e87798e429aa1c10b24391f915e`. Rule list: `[]` (Enabled: `True`). {{(pid=101892) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:42:01.235443 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.fernet_utils [None req-5cfa04d0-8623-4e2a-8c88-91829077f412 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=101892) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:42:01.251624 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96448cd7-2df4-4c0a-8b78-7673715b8c1f None None] Validating token access rules against request {{(pid=101893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:42:01.323658 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a17f0dae-3132-47bc-981a-470f156e2766 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:42:01.324964 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17f0dae-3132-47bc-981a-470f156e2766 None admin] REQUEST_METHOD: `GET` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:42:01.325443 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17f0dae-3132-47bc-981a-470f156e2766 None admin] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:42:01.325912 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17f0dae-3132-47bc-981a-470f156e2766 None admin] PATH_INFO: `/v3/roles/member` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:42:01.338830 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a17f0dae-3132-47bc-981a-470f156e2766 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 14:42:01.347681 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application [None req-a17f0dae-3132-47bc-981a-470f156e2766 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 25 14:42:01.347681 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:42:01.347681 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 14:42:01.347681 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 14:42:01.347681 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 14:42:01.347681 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 14:42:01.347681 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 14:42:01.347681 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 14:42:01.347681 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 14:42:01.347681 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 14:42:01.347681 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 14:42:01.347681 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 14:42:01.347681 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 14:42:01.347681 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 14:42:01.347681 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 14:42:01.347681 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 14:42:01.348584 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 14:42:01.348584 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 14:42:01.348584 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 14:42:01.348584 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 14:42:01.348584 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 14:42:01.348584 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 14:42:01.348584 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 14:42:01.348584 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 14:42:01.348584 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 14:42:01.348584 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return self.get_or_create( May 25 14:42:01.348584 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 14:42:01.348584 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application with Lock( May 25 14:42:01.348584 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 14:42:01.348584 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return self._enter() May 25 14:42:01.348584 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 14:42:01.348584 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 14:42:01.349337 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 14:42:01.349337 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return self.creator() May 25 14:42:01.349337 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 14:42:01.349337 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application created_value = creator( May 25 14:42:01.349337 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 14:42:01.349337 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 14:42:01.349337 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 14:42:01.349337 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 14:42:01.349337 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 14:42:01.349337 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 14:42:01.349337 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 25 14:42:01.349337 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application May 25 14:42:01.351792 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 34/65] 10.222.0.84 () {56 vars in 1099 bytes} [Wed May 25 14:42:01 2022] GET /identity/v3/roles/member => generated 84 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 14:42:01.353277 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be23372-f7d5-4d2a-9810-00148f77e936 None None] REQUEST_METHOD: `GET` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:42:01.353725 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be23372-f7d5-4d2a-9810-00148f77e936 None None] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:42:01.354145 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be23372-f7d5-4d2a-9810-00148f77e936 None None] PATH_INFO: `/` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:42:01.360134 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 35/66] 10.222.0.84 () {54 vars in 926 bytes} [Wed May 25 14:42:01 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 14:42:01.360134 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1be23372-f7d5-4d2a-9810-00148f77e936 None None] Authenticating user token {{(pid=101893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:42:01.361268 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 32/67] 10.222.0.84 () {58 vars in 1023 bytes} [Wed May 25 14:42:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 25 14:42:01.364937 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc0a562-0a21-4fdb-a1af-0e550b1c6e64 None None] REQUEST_METHOD: `POST` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:42:01.365227 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc0a562-0a21-4fdb-a1af-0e550b1c6e64 None None] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:42:01.365517 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc0a562-0a21-4fdb-a1af-0e550b1c6e64 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:42:01.392770 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG dbcounter [-] [101893] Writing DB stats keystone:SELECT=100 {{(pid=101893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:42:01.397803 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.auth.core [None req-2cc0a562-0a21-4fdb-a1af-0e550b1c6e64 None None] MFA Rules not processed for user `05d87e87798e429aa1c10b24391f915e`. Rule list: `[]` (Enabled: `True`). {{(pid=101892) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:42:01.399649 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.fernet_utils [None req-2cc0a562-0a21-4fdb-a1af-0e550b1c6e64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=101892) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:42:01.491469 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1be23372-f7d5-4d2a-9810-00148f77e936 None None] Validating token access rules against request {{(pid=101893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:42:01.493426 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 33/68] 10.222.0.84 () {58 vars in 1023 bytes} [Wed May 25 14:42:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 25 14:42:01.494565 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc0a562-0a21-4fdb-a1af-0e550b1c6e64 None None] Authenticating user token {{(pid=101892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:42:01.522615 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG dbcounter [-] [101892] Writing DB stats keystone:SELECT=100 {{(pid=101892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:42:01.544275 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21678f32-948a-446d-a8a9-65a182ebc3a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:42:01.545310 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21678f32-948a-446d-a8a9-65a182ebc3a3 None admin] REQUEST_METHOD: `GET` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:42:01.545792 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21678f32-948a-446d-a8a9-65a182ebc3a3 None admin] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:42:01.546263 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21678f32-948a-446d-a8a9-65a182ebc3a3 None admin] PATH_INFO: `/v3/roles` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:42:01.547238 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21678f32-948a-446d-a8a9-65a182ebc3a3 None admin] RBAC: Adding query filter params (name=member) {{(pid=101893) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:42:01.547653 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21678f32-948a-446d-a8a9-65a182ebc3a3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:42:01.549276 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21678f32-948a-446d-a8a9-65a182ebc3a3 None admin] RBAC: Authorization granted {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:42:01.561883 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 36/69] 10.222.0.84 () {56 vars in 1101 bytes} [Wed May 25 14:42:01 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:42:01.563208 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436fad94-d689-4e9d-97ce-5a36dcd3b9b0 None None] REQUEST_METHOD: `GET` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:42:01.563491 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436fad94-d689-4e9d-97ce-5a36dcd3b9b0 None None] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:42:01.563974 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436fad94-d689-4e9d-97ce-5a36dcd3b9b0 None None] PATH_INFO: `/` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:42:01.565225 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 37/70] 10.222.0.84 () {54 vars in 926 bytes} [Wed May 25 14:42:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 14:42:01.565909 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-436fad94-d689-4e9d-97ce-5a36dcd3b9b0 None None] Authenticating user token {{(pid=101893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:42:01.611795 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc0a562-0a21-4fdb-a1af-0e550b1c6e64 None None] Validating token access rules against request {{(pid=101892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:42:01.640122 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG dbcounter [-] [101893] Writing DB stats keystone:SELECT=100 {{(pid=101893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:42:01.644797 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db3576e8-ac37-483b-98d6-7467fa3a3f68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:42:01.645592 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3576e8-ac37-483b-98d6-7467fa3a3f68 None admin] REQUEST_METHOD: `GET` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:42:01.645881 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3576e8-ac37-483b-98d6-7467fa3a3f68 None admin] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:42:01.646163 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3576e8-ac37-483b-98d6-7467fa3a3f68 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:42:01.656664 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db3576e8-ac37-483b-98d6-7467fa3a3f68 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 14:42:01.665647 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application [None req-db3576e8-ac37-483b-98d6-7467fa3a3f68 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 25 14:42:01.665647 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:42:01.665647 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 14:42:01.665647 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 14:42:01.665647 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 14:42:01.665647 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 14:42:01.665647 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 14:42:01.665647 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 14:42:01.665647 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 14:42:01.665647 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 14:42:01.665647 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 14:42:01.665647 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 14:42:01.665647 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 14:42:01.665647 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 14:42:01.665647 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 14:42:01.665647 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 14:42:01.666777 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 14:42:01.666777 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 14:42:01.666777 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 14:42:01.666777 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 14:42:01.666777 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 14:42:01.666777 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 14:42:01.666777 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 14:42:01.666777 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 14:42:01.666777 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 14:42:01.666777 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application return self.get_or_create( May 25 14:42:01.666777 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 14:42:01.666777 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application with Lock( May 25 14:42:01.666777 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 14:42:01.666777 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application return self._enter() May 25 14:42:01.666777 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 14:42:01.666777 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 14:42:01.668265 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 14:42:01.668265 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application return self.creator() May 25 14:42:01.668265 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 14:42:01.668265 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application created_value = creator( May 25 14:42:01.668265 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 14:42:01.668265 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 14:42:01.668265 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 14:42:01.668265 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 14:42:01.668265 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 14:42:01.668265 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 14:42:01.668265 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 25 14:42:01.668265 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application May 25 14:42:01.668265 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 34/71] 10.222.0.84 () {56 vars in 1096 bytes} [Wed May 25 14:42:01 2022] GET /identity/v3/roles/admin => generated 83 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 14:42:01.669304 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c75f5a-170b-401a-850e-c114471bed5c None None] REQUEST_METHOD: `GET` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:42:01.669304 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c75f5a-170b-401a-850e-c114471bed5c None None] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:42:01.669304 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c75f5a-170b-401a-850e-c114471bed5c None None] PATH_INFO: `/` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:42:01.670422 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 35/72] 10.222.0.84 () {54 vars in 926 bytes} [Wed May 25 14:42:01 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 14:42:01.672264 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-436fad94-d689-4e9d-97ce-5a36dcd3b9b0 None None] Validating token access rules against request {{(pid=101893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:42:01.672528 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c75f5a-170b-401a-850e-c114471bed5c None None] Authenticating user token {{(pid=101892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:42:01.708025 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c4c929c-cdc4-4386-924f-85ffeab5ecb0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:42:01.708838 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c4c929c-cdc4-4386-924f-85ffeab5ecb0 None admin] REQUEST_METHOD: `GET` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:42:01.709124 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c4c929c-cdc4-4386-924f-85ffeab5ecb0 None admin] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:42:01.709401 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c4c929c-cdc4-4386-924f-85ffeab5ecb0 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:42:01.719983 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c4c929c-cdc4-4386-924f-85ffeab5ecb0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 14:42:01.728075 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application [None req-2c4c929c-cdc4-4386-924f-85ffeab5ecb0 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 25 14:42:01.728075 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:42:01.728075 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 14:42:01.728075 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 14:42:01.728075 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 14:42:01.728075 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 14:42:01.728075 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 14:42:01.728075 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 14:42:01.728075 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 14:42:01.728075 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 14:42:01.728075 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 14:42:01.728075 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 14:42:01.728075 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 14:42:01.728075 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 14:42:01.728075 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 14:42:01.728075 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 14:42:01.728922 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 14:42:01.728922 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 14:42:01.728922 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 14:42:01.728922 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 14:42:01.728922 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 14:42:01.728922 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 14:42:01.728922 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 14:42:01.728922 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 14:42:01.728922 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 14:42:01.728922 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return self.get_or_create( May 25 14:42:01.728922 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 14:42:01.728922 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application with Lock( May 25 14:42:01.728922 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 14:42:01.728922 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return self._enter() May 25 14:42:01.728922 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 14:42:01.728922 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 14:42:01.729739 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 14:42:01.729739 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return self.creator() May 25 14:42:01.729739 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 14:42:01.729739 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application created_value = creator( May 25 14:42:01.729739 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 14:42:01.729739 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 14:42:01.729739 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 14:42:01.729739 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 14:42:01.729739 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 14:42:01.729739 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 14:42:01.729739 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 25 14:42:01.729739 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application May 25 14:42:01.729739 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 38/73] 10.222.0.84 () {56 vars in 1114 bytes} [Wed May 25 14:42:01 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 14:42:01.730898 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b56a7a-c485-4724-8855-ac35ba0297ed None None] REQUEST_METHOD: `POST` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:42:01.730898 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b56a7a-c485-4724-8855-ac35ba0297ed None None] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:42:01.731044 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b56a7a-c485-4724-8855-ac35ba0297ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:42:01.747237 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.auth.core [None req-23b56a7a-c485-4724-8855-ac35ba0297ed None None] MFA Rules not processed for user `05d87e87798e429aa1c10b24391f915e`. Rule list: `[]` (Enabled: `True`). {{(pid=101893) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:42:01.748382 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.fernet_utils [None req-23b56a7a-c485-4724-8855-ac35ba0297ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=101893) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:42:01.752510 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG dbcounter [-] [101892] Writing DB stats keystone:SELECT=100 {{(pid=101892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:42:01.775963 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c75f5a-170b-401a-850e-c114471bed5c None None] Validating token access rules against request {{(pid=101892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:42:01.810264 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c53d8750-0192-4c0e-91d8-9286210b4f8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:42:01.811130 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53d8750-0192-4c0e-91d8-9286210b4f8c None admin] REQUEST_METHOD: `GET` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:42:01.811425 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53d8750-0192-4c0e-91d8-9286210b4f8c None admin] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:42:01.811740 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53d8750-0192-4c0e-91d8-9286210b4f8c None admin] PATH_INFO: `/v3/users/376a0503e64e47c795f924714268e715` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:42:01.813185 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 39/74] 10.222.0.84 () {58 vars in 1023 bytes} [Wed May 25 14:42:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 25 14:42:01.814008 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23b56a7a-c485-4724-8855-ac35ba0297ed None None] Authenticating user token {{(pid=101893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:42:01.827172 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c53d8750-0192-4c0e-91d8-9286210b4f8c None admin] RBAC: Authorizing `identity:get_user(user_id=376a0503e64e47c795f924714268e715)` {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:42:01.828697 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c53d8750-0192-4c0e-91d8-9286210b4f8c None admin] RBAC: Authorization granted {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:42:01.830636 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 36/75] 10.222.0.84 () {56 vars in 1177 bytes} [Wed May 25 14:42:01 2022] GET /identity/v3/users/376a0503e64e47c795f924714268e715 => generated 275 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:42:01.831838 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f562c4-51c4-4cd2-9964-39c223672ccf None None] REQUEST_METHOD: `POST` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:42:01.832121 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f562c4-51c4-4cd2-9964-39c223672ccf None None] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:42:01.832389 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f562c4-51c4-4cd2-9964-39c223672ccf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:42:01.849188 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.auth.core [None req-d3f562c4-51c4-4cd2-9964-39c223672ccf None None] MFA Rules not processed for user `05d87e87798e429aa1c10b24391f915e`. Rule list: `[]` (Enabled: `True`). {{(pid=101892) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:42:01.850468 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.fernet_utils [None req-d3f562c4-51c4-4cd2-9964-39c223672ccf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=101892) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:42:01.876919 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG dbcounter [-] [101893] Writing DB stats keystone:SELECT=100 {{(pid=101893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:42:01.913499 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23b56a7a-c485-4724-8855-ac35ba0297ed None None] Validating token access rules against request {{(pid=101893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:42:01.917942 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 37/76] 10.222.0.84 () {58 vars in 1023 bytes} [Wed May 25 14:42:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 25 14:42:01.918609 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3f562c4-51c4-4cd2-9964-39c223672ccf None None] Authenticating user token {{(pid=101892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:42:01.953995 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed9d320-e8c0-4a4e-bea3-c9d441d30538 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:42:01.954669 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed9d320-e8c0-4a4e-bea3-c9d441d30538 None admin] REQUEST_METHOD: `GET` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:42:01.954956 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed9d320-e8c0-4a4e-bea3-c9d441d30538 None admin] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:42:01.955238 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed9d320-e8c0-4a4e-bea3-c9d441d30538 None admin] PATH_INFO: `/v3/roles` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:42:01.956019 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ed9d320-e8c0-4a4e-bea3-c9d441d30538 None admin] RBAC: Adding query filter params (name=admin) {{(pid=101893) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:42:01.956333 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ed9d320-e8c0-4a4e-bea3-c9d441d30538 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:42:01.957729 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ed9d320-e8c0-4a4e-bea3-c9d441d30538 None admin] RBAC: Authorization granted {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:42:01.965849 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 40/77] 10.222.0.84 () {56 vars in 1099 bytes} [Wed May 25 14:42:01 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:42:01.966911 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed9d320-e8c0-4a4e-bea3-c9d441d30538 None admin] Authenticating user token {{(pid=101893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:42:01.978670 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG dbcounter [-] [101892] Writing DB stats keystone:SELECT=100 {{(pid=101892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:42:02.017557 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3f562c4-51c4-4cd2-9964-39c223672ccf None None] Validating token access rules against request {{(pid=101892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:42:02.050818 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1708b266-3d85-4247-9a17-8a6f086fe953 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:42:02.051485 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1708b266-3d85-4247-9a17-8a6f086fe953 None admin] REQUEST_METHOD: `GET` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:42:02.051810 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1708b266-3d85-4247-9a17-8a6f086fe953 None admin] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:42:02.052098 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1708b266-3d85-4247-9a17-8a6f086fe953 None admin] PATH_INFO: `/v3/roles` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:42:02.052849 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1708b266-3d85-4247-9a17-8a6f086fe953 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=101892) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:42:02.053164 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1708b266-3d85-4247-9a17-8a6f086fe953 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:42:02.054553 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1708b266-3d85-4247-9a17-8a6f086fe953 None admin] RBAC: Authorization granted {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:42:02.066530 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 38/78] 10.222.0.84 () {56 vars in 1111 bytes} [Wed May 25 14:42:01 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:42:02.067372 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed9d320-e8c0-4a4e-bea3-c9d441d30538 None admin] Validating token access rules against request {{(pid=101893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:42:02.067493 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1708b266-3d85-4247-9a17-8a6f086fe953 None admin] Authenticating user token {{(pid=101892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:42:02.095387 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG dbcounter [-] [101893] Writing DB stats keystone:SELECT=100 {{(pid=101893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:42:02.103596 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b56c883b-8e54-4e89-97ad-04bd09972f2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:42:02.104249 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56c883b-8e54-4e89-97ad-04bd09972f2c None admin] REQUEST_METHOD: `GET` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:42:02.108494 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56c883b-8e54-4e89-97ad-04bd09972f2c None admin] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:42:02.108494 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56c883b-8e54-4e89-97ad-04bd09972f2c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:42:02.167663 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1708b266-3d85-4247-9a17-8a6f086fe953 None admin] Validating token access rules against request {{(pid=101892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:42:02.171795 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b56c883b-8e54-4e89-97ad-04bd09972f2c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:42:02.173276 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b56c883b-8e54-4e89-97ad-04bd09972f2c None admin] RBAC: Authorization granted {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:42:02.192345 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG dbcounter [-] [101892] Writing DB stats keystone:SELECT=100 {{(pid=101892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:42:02.201258 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-539c6b9a-d51b-41b4-a022-f12ddb2d8350 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:42:02.202056 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539c6b9a-d51b-41b4-a022-f12ddb2d8350 None admin] REQUEST_METHOD: `GET` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:42:02.202338 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539c6b9a-d51b-41b4-a022-f12ddb2d8350 None admin] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:42:02.202620 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539c6b9a-d51b-41b4-a022-f12ddb2d8350 None admin] PATH_INFO: `/v3/roles/member` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:42:02.212701 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-539c6b9a-d51b-41b4-a022-f12ddb2d8350 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 14:42:02.220460 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application [None req-539c6b9a-d51b-41b4-a022-f12ddb2d8350 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 25 14:42:02.220460 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:42:02.220460 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 14:42:02.220460 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 14:42:02.220460 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 14:42:02.220460 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 14:42:02.220460 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 14:42:02.220460 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 14:42:02.220460 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 14:42:02.220460 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 14:42:02.220460 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 14:42:02.220460 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 14:42:02.220460 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 14:42:02.220460 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 14:42:02.220460 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 14:42:02.220460 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 14:42:02.221491 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 14:42:02.221491 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 14:42:02.221491 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 14:42:02.221491 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 14:42:02.221491 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 14:42:02.221491 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 14:42:02.221491 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 14:42:02.221491 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 14:42:02.221491 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 14:42:02.221491 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application return self.get_or_create( May 25 14:42:02.221491 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 14:42:02.221491 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application with Lock( May 25 14:42:02.221491 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 14:42:02.221491 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application return self._enter() May 25 14:42:02.221491 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 14:42:02.221491 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 14:42:02.222363 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 14:42:02.222363 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application return self.creator() May 25 14:42:02.222363 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 14:42:02.222363 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application created_value = creator( May 25 14:42:02.222363 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 14:42:02.222363 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 14:42:02.222363 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 14:42:02.222363 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 14:42:02.222363 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 14:42:02.222363 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 14:42:02.222363 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 25 14:42:02.222363 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application May 25 14:42:02.222363 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 39/79] 10.222.0.84 () {56 vars in 1099 bytes} [Wed May 25 14:42:02 2022] GET /identity/v3/roles/member => generated 84 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 14:42:02.222363 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-539c6b9a-d51b-41b4-a022-f12ddb2d8350 None admin] Authenticating user token {{(pid=101892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:42:02.275495 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 41/80] 10.222.0.84 () {58 vars in 1282 bytes} [Wed May 25 14:42:01 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 25 14:42:02.280502 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b56c883b-8e54-4e89-97ad-04bd09972f2c None admin] Authenticating user token {{(pid=101893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:42:02.306055 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG dbcounter [-] [101893] Writing DB stats keystone:SELECT=100 {{(pid=101893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:42:02.319876 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-539c6b9a-d51b-41b4-a022-f12ddb2d8350 None admin] Validating token access rules against request {{(pid=101892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:42:02.353238 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eaeafb5-864b-4707-82ee-5869fff77e7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:42:02.354029 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eaeafb5-864b-4707-82ee-5869fff77e7e None admin] REQUEST_METHOD: `GET` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:42:02.354869 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eaeafb5-864b-4707-82ee-5869fff77e7e None admin] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:42:02.355154 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eaeafb5-864b-4707-82ee-5869fff77e7e None admin] PATH_INFO: `/v3/domains/default` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:42:02.356404 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eaeafb5-864b-4707-82ee-5869fff77e7e None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:42:02.357869 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eaeafb5-864b-4707-82ee-5869fff77e7e None admin] RBAC: Authorization granted {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:42:02.363854 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 40/81] 10.222.0.84 () {56 vars in 1108 bytes} [Wed May 25 14:42:02 2022] GET /identity/v3/domains/default => generated 199 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:42:02.363854 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eaeafb5-864b-4707-82ee-5869fff77e7e None admin] Authenticating user token {{(pid=101892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:42:02.380569 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b56c883b-8e54-4e89-97ad-04bd09972f2c None admin] Validating token access rules against request {{(pid=101893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:42:02.414243 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG dbcounter [-] [101892] Writing DB stats keystone:SELECT=100 {{(pid=101892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:42:02.415745 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53916854-3f84-4198-893c-7c72166538f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:42:02.416509 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53916854-3f84-4198-893c-7c72166538f7 None admin] REQUEST_METHOD: `GET` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:42:02.416862 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53916854-3f84-4198-893c-7c72166538f7 None admin] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:42:02.417651 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53916854-3f84-4198-893c-7c72166538f7 None admin] PATH_INFO: `/v3/users/05d87e87798e429aa1c10b24391f915e` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:42:02.418866 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53916854-3f84-4198-893c-7c72166538f7 None admin] RBAC: Authorizing `identity:get_user(user_id=05d87e87798e429aa1c10b24391f915e)` {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:42:02.420369 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53916854-3f84-4198-893c-7c72166538f7 None admin] RBAC: Authorization granted {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:42:02.426692 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 42/82] 10.222.0.84 () {56 vars in 1177 bytes} [Wed May 25 14:42:02 2022] GET /identity/v3/users/05d87e87798e429aa1c10b24391f915e => generated 247 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:42:02.426692 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53916854-3f84-4198-893c-7c72166538f7 None admin] Authenticating user token {{(pid=101893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:42:02.459859 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eaeafb5-864b-4707-82ee-5869fff77e7e None admin] Validating token access rules against request {{(pid=101892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:42:02.493300 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3d1625c-441b-400a-8d57-f17e71c178d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:42:02.494186 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d1625c-441b-400a-8d57-f17e71c178d7 None admin] REQUEST_METHOD: `GET` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:42:02.494473 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d1625c-441b-400a-8d57-f17e71c178d7 None admin] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:42:02.494750 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d1625c-441b-400a-8d57-f17e71c178d7 None admin] PATH_INFO: `/v3/users/376a0503e64e47c795f924714268e715` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:42:02.496586 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3d1625c-441b-400a-8d57-f17e71c178d7 None admin] RBAC: Authorizing `identity:get_user(user_id=376a0503e64e47c795f924714268e715)` {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:42:02.498043 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3d1625c-441b-400a-8d57-f17e71c178d7 None admin] RBAC: Authorization granted {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:42:02.499738 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 41/83] 10.222.0.84 () {56 vars in 1177 bytes} [Wed May 25 14:42:02 2022] GET /identity/v3/users/376a0503e64e47c795f924714268e715 => generated 275 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:42:02.500502 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3d1625c-441b-400a-8d57-f17e71c178d7 None admin] Authenticating user token {{(pid=101892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:42:02.517478 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG dbcounter [-] [101893] Writing DB stats keystone:SELECT=100 {{(pid=101893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:42:02.523632 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53916854-3f84-4198-893c-7c72166538f7 None admin] Validating token access rules against request {{(pid=101893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:42:02.560534 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caf15ea3-50f9-4e08-9d7a-50ddce0f86ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:42:02.561216 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf15ea3-50f9-4e08-9d7a-50ddce0f86ea None admin] REQUEST_METHOD: `GET` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:42:02.561509 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf15ea3-50f9-4e08-9d7a-50ddce0f86ea None admin] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:42:02.561792 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf15ea3-50f9-4e08-9d7a-50ddce0f86ea None admin] PATH_INFO: `/v3/roles` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:42:02.562551 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caf15ea3-50f9-4e08-9d7a-50ddce0f86ea None admin] RBAC: Adding query filter params (name=member) {{(pid=101893) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:42:02.562864 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caf15ea3-50f9-4e08-9d7a-50ddce0f86ea None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:42:02.564308 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caf15ea3-50f9-4e08-9d7a-50ddce0f86ea None admin] RBAC: Authorization granted {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:42:02.572384 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 43/84] 10.222.0.84 () {56 vars in 1101 bytes} [Wed May 25 14:42:02 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:42:02.573161 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caf15ea3-50f9-4e08-9d7a-50ddce0f86ea None admin] Authenticating user token {{(pid=101893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:42:02.603688 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3d1625c-441b-400a-8d57-f17e71c178d7 None admin] Validating token access rules against request {{(pid=101892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:42:02.626839 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG dbcounter [-] [101892] Writing DB stats keystone:SELECT=100 {{(pid=101892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:42:02.637971 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6524f84b-c0b2-462c-99f0-ce44e8ed8705 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:42:02.640342 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6524f84b-c0b2-462c-99f0-ce44e8ed8705 None admin] REQUEST_METHOD: `GET` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:42:02.640342 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6524f84b-c0b2-462c-99f0-ce44e8ed8705 None admin] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:42:02.640342 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6524f84b-c0b2-462c-99f0-ce44e8ed8705 None admin] PATH_INFO: `/v3/projects/42293c5d76254690ab29c96f76687d9c` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:42:02.640574 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6524f84b-c0b2-462c-99f0-ce44e8ed8705 None admin] RBAC: Authorizing `identity:get_project(project_id=42293c5d76254690ab29c96f76687d9c)` {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:42:02.642036 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6524f84b-c0b2-462c-99f0-ce44e8ed8705 None admin] RBAC: Authorization granted {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:42:02.643782 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 42/85] 10.222.0.84 () {56 vars in 1186 bytes} [Wed May 25 14:42:02 2022] GET /identity/v3/projects/42293c5d76254690ab29c96f76687d9c => generated 298 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:42:02.644549 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6524f84b-c0b2-462c-99f0-ce44e8ed8705 None admin] Authenticating user token {{(pid=101892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:42:02.672908 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caf15ea3-50f9-4e08-9d7a-50ddce0f86ea None admin] Validating token access rules against request {{(pid=101893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:42:02.705936 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b64471d-c31e-4dfb-9ae4-9833a764c7fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:42:02.706602 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b64471d-c31e-4dfb-9ae4-9833a764c7fb None admin] REQUEST_METHOD: `POST` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:42:02.706884 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b64471d-c31e-4dfb-9ae4-9833a764c7fb None admin] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:42:02.707180 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b64471d-c31e-4dfb-9ae4-9833a764c7fb None admin] PATH_INFO: `/v3/users` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:42:02.707938 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b64471d-c31e-4dfb-9ae4-9833a764c7fb None admin] RBAC: Authorizing `identity:create_user()` {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:42:02.709405 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b64471d-c31e-4dfb-9ae4-9833a764c7fb None admin] RBAC: Authorization granted {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:42:02.747053 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6524f84b-c0b2-462c-99f0-ce44e8ed8705 None admin] Validating token access rules against request {{(pid=101892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:42:02.779233 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6a29539-cb95-491d-b1c1-1ba19b2a5914 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:42:02.779916 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a29539-cb95-491d-b1c1-1ba19b2a5914 None admin] REQUEST_METHOD: `GET` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:42:02.780205 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a29539-cb95-491d-b1c1-1ba19b2a5914 None admin] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:42:02.780484 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a29539-cb95-491d-b1c1-1ba19b2a5914 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:42:02.799962 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 44/86] 10.222.0.84 () {60 vars in 1132 bytes} [Wed May 25 14:42:02 2022] POST /identity/v3/users => generated 289 bytes in 227 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 14:42:02.811816 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b64471d-c31e-4dfb-9ae4-9833a764c7fb None admin] Authenticating user token {{(pid=101893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:42:02.827590 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG dbcounter [-] [101893] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=101893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:42:02.847916 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG dbcounter [-] [101892] Writing DB stats keystone:SELECT=100 {{(pid=101892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:42:02.864623 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6a29539-cb95-491d-b1c1-1ba19b2a5914 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:42:02.867040 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6a29539-cb95-491d-b1c1-1ba19b2a5914 None admin] RBAC: Authorization granted {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:42:02.932190 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b64471d-c31e-4dfb-9ae4-9833a764c7fb None admin] Validating token access rules against request {{(pid=101893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:42:02.971708 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87be22e9-2fe6-4c78-9242-b0bfe5cfd63e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:42:02.972361 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87be22e9-2fe6-4c78-9242-b0bfe5cfd63e None admin] REQUEST_METHOD: `GET` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:42:02.972660 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87be22e9-2fe6-4c78-9242-b0bfe5cfd63e None admin] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:42:02.972968 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87be22e9-2fe6-4c78-9242-b0bfe5cfd63e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:42:02.984947 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 43/87] 10.222.0.84 () {58 vars in 1282 bytes} [Wed May 25 14:42:02 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 341 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 25 14:42:02.985805 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6a29539-cb95-491d-b1c1-1ba19b2a5914 None admin] Authenticating user token {{(pid=101892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:42:03.063238 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87be22e9-2fe6-4c78-9242-b0bfe5cfd63e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:42:03.064771 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87be22e9-2fe6-4c78-9242-b0bfe5cfd63e None admin] RBAC: Authorization granted {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:42:03.081955 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG dbcounter [-] [101893] Writing DB stats keystone:SELECT=100 {{(pid=101893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:42:03.098231 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG dbcounter [-] [101892] Writing DB stats keystone:SELECT=100 {{(pid=101892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:42:03.109832 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6a29539-cb95-491d-b1c1-1ba19b2a5914 None admin] Validating token access rules against request {{(pid=101892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:42:03.161401 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e6055f7-9297-4eea-a267-adc6eb6b2ea8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:42:03.162296 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6055f7-9297-4eea-a267-adc6eb6b2ea8 None admin] REQUEST_METHOD: `GET` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:42:03.162585 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6055f7-9297-4eea-a267-adc6eb6b2ea8 None admin] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:42:03.162866 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6055f7-9297-4eea-a267-adc6eb6b2ea8 None admin] PATH_INFO: `/v3/users/376a0503e64e47c795f924714268e715` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:42:03.164119 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e6055f7-9297-4eea-a267-adc6eb6b2ea8 None admin] RBAC: Authorizing `identity:get_user(user_id=376a0503e64e47c795f924714268e715)` {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:42:03.165595 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e6055f7-9297-4eea-a267-adc6eb6b2ea8 None admin] RBAC: Authorization granted {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:42:03.170940 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 44/88] 10.222.0.84 () {56 vars in 1177 bytes} [Wed May 25 14:42:02 2022] GET /identity/v3/users/376a0503e64e47c795f924714268e715 => generated 275 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:42:03.170940 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e6055f7-9297-4eea-a267-adc6eb6b2ea8 None admin] Authenticating user token {{(pid=101892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:42:03.195803 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 45/89] 10.222.0.84 () {58 vars in 1282 bytes} [Wed May 25 14:42:02 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 395 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 25 14:42:03.196620 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87be22e9-2fe6-4c78-9242-b0bfe5cfd63e None admin] Authenticating user token {{(pid=101893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:42:03.290249 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e6055f7-9297-4eea-a267-adc6eb6b2ea8 None admin] Validating token access rules against request {{(pid=101892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:42:03.320198 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87be22e9-2fe6-4c78-9242-b0bfe5cfd63e None admin] Validating token access rules against request {{(pid=101893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:42:03.328345 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0383940b-3a4d-4033-9a18-12811b029e9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:42:03.329010 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0383940b-3a4d-4033-9a18-12811b029e9b None admin] REQUEST_METHOD: `GET` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:42:03.329387 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0383940b-3a4d-4033-9a18-12811b029e9b None admin] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:42:03.329786 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0383940b-3a4d-4033-9a18-12811b029e9b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:42:03.330630 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0383940b-3a4d-4033-9a18-12811b029e9b None admin] RBAC: Adding query filter params (role.id=ff664fa0db7e4262a5accde96c3df4c3, scope.project.id=42293c5d76254690ab29c96f76687d9c, user.id=376a0503e64e47c795f924714268e715) {{(pid=101892) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:42:03.330949 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0383940b-3a4d-4033-9a18-12811b029e9b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:42:03.332414 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0383940b-3a4d-4033-9a18-12811b029e9b None admin] RBAC: Authorization granted {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:42:03.337979 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG dbcounter [-] [101893] Writing DB stats keystone:SELECT=100 {{(pid=101893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:42:03.338238 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 45/90] 10.222.0.84 () {56 vars in 1374 bytes} [Wed May 25 14:42:03 2022] GET /identity/v3/role_assignments?user.id=376a0503e64e47c795f924714268e715&scope.project.id=42293c5d76254690ab29c96f76687d9c&role.id=ff664fa0db7e4262a5accde96c3df4c3 => generated 259 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:42:03.339654 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0383940b-3a4d-4033-9a18-12811b029e9b None admin] Authenticating user token {{(pid=101892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:42:03.363193 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23228441-9b67-4841-a743-3eae00de5eb3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:42:03.364191 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23228441-9b67-4841-a743-3eae00de5eb3 None admin] REQUEST_METHOD: `GET` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:42:03.364510 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23228441-9b67-4841-a743-3eae00de5eb3 None admin] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:42:03.365001 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23228441-9b67-4841-a743-3eae00de5eb3 None admin] PATH_INFO: `/v3/projects/42293c5d76254690ab29c96f76687d9c` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:42:03.366061 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23228441-9b67-4841-a743-3eae00de5eb3 None admin] RBAC: Authorizing `identity:get_project(project_id=42293c5d76254690ab29c96f76687d9c)` {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:42:03.367523 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23228441-9b67-4841-a743-3eae00de5eb3 None admin] RBAC: Authorization granted {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:42:03.375725 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 46/91] 10.222.0.84 () {56 vars in 1186 bytes} [Wed May 25 14:42:03 2022] GET /identity/v3/projects/42293c5d76254690ab29c96f76687d9c => generated 298 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:42:03.375725 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23228441-9b67-4841-a743-3eae00de5eb3 None admin] Authenticating user token {{(pid=101893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:42:03.377541 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG dbcounter [-] [101892] Writing DB stats keystone:SELECT=100 {{(pid=101892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:42:03.468617 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0383940b-3a4d-4033-9a18-12811b029e9b None admin] Validating token access rules against request {{(pid=101892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:42:03.544349 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c970b5d6-5fce-4df7-b281-ef9df58c04e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:42:03.545032 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c970b5d6-5fce-4df7-b281-ef9df58c04e0 None admin] REQUEST_METHOD: `GET` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:42:03.545322 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c970b5d6-5fce-4df7-b281-ef9df58c04e0 None admin] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:42:03.545605 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c970b5d6-5fce-4df7-b281-ef9df58c04e0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:42:03.564587 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23228441-9b67-4841-a743-3eae00de5eb3 None admin] Validating token access rules against request {{(pid=101893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:42:03.602592 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a24a74a8-c276-4aa2-b320-72e4d561413f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:42:03.604249 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24a74a8-c276-4aa2-b320-72e4d561413f None admin] REQUEST_METHOD: `GET` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:42:03.604746 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24a74a8-c276-4aa2-b320-72e4d561413f None admin] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:42:03.605528 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24a74a8-c276-4aa2-b320-72e4d561413f None admin] PATH_INFO: `/v3/projects/42293c5d76254690ab29c96f76687d9c` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:42:03.607294 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a24a74a8-c276-4aa2-b320-72e4d561413f None admin] RBAC: Authorizing `identity:get_project(project_id=42293c5d76254690ab29c96f76687d9c)` {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:42:03.609116 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a24a74a8-c276-4aa2-b320-72e4d561413f None admin] RBAC: Authorization granted {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:42:03.611052 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 47/92] 10.222.0.84 () {56 vars in 1186 bytes} [Wed May 25 14:42:03 2022] GET /identity/v3/projects/42293c5d76254690ab29c96f76687d9c => generated 298 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:42:03.612047 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a24a74a8-c276-4aa2-b320-72e4d561413f None admin] Authenticating user token {{(pid=101893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:42:03.657460 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c970b5d6-5fce-4df7-b281-ef9df58c04e0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:42:03.659412 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c970b5d6-5fce-4df7-b281-ef9df58c04e0 None admin] RBAC: Authorization granted {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:42:03.704929 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG dbcounter [-] [101892] Writing DB stats keystone:SELECT=100 {{(pid=101892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:42:03.711134 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG dbcounter [-] [101893] Writing DB stats keystone:SELECT=100 {{(pid=101893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:42:03.768921 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a24a74a8-c276-4aa2-b320-72e4d561413f None admin] Validating token access rules against request {{(pid=101893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:42:03.827035 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f366ad84-3811-412a-ba6d-715427c56e74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:42:03.830103 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f366ad84-3811-412a-ba6d-715427c56e74 None admin] REQUEST_METHOD: `GET` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:42:03.830611 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f366ad84-3811-412a-ba6d-715427c56e74 None admin] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:42:03.831082 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f366ad84-3811-412a-ba6d-715427c56e74 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:42:03.832140 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f366ad84-3811-412a-ba6d-715427c56e74 None admin] RBAC: Adding query filter params (role.id=a3b78e7d547d4d2d998b4c99a4396bba, scope.project.id=42293c5d76254690ab29c96f76687d9c, user.id=05d87e87798e429aa1c10b24391f915e) {{(pid=101893) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:42:03.834093 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f366ad84-3811-412a-ba6d-715427c56e74 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:42:03.835804 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f366ad84-3811-412a-ba6d-715427c56e74 None admin] RBAC: Authorization granted {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:42:03.846975 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 48/93] 10.222.0.84 () {56 vars in 1374 bytes} [Wed May 25 14:42:03 2022] GET /identity/v3/role_assignments?user.id=05d87e87798e429aa1c10b24391f915e&scope.project.id=42293c5d76254690ab29c96f76687d9c&role.id=a3b78e7d547d4d2d998b4c99a4396bba => generated 259 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:42:03.848249 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f366ad84-3811-412a-ba6d-715427c56e74 None admin] Authenticating user token {{(pid=101893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:42:03.902946 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 46/94] 10.222.0.84 () {58 vars in 1282 bytes} [Wed May 25 14:42:03 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 564 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 25 14:42:03.912664 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c970b5d6-5fce-4df7-b281-ef9df58c04e0 None admin] Authenticating user token {{(pid=101892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:42:04.041869 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c970b5d6-5fce-4df7-b281-ef9df58c04e0 None admin] Validating token access rules against request {{(pid=101892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:42:04.069249 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG dbcounter [-] [101892] Writing DB stats keystone:SELECT=100 {{(pid=101892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:42:04.093903 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d64aa6df-d65e-4b96-91d1-03210c210eb8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:42:04.096013 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64aa6df-d65e-4b96-91d1-03210c210eb8 None admin] REQUEST_METHOD: `GET` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:42:04.096013 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64aa6df-d65e-4b96-91d1-03210c210eb8 None admin] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:42:04.096013 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64aa6df-d65e-4b96-91d1-03210c210eb8 None admin] PATH_INFO: `/v3/projects/eb97bb0dd11f4c10a9d2a2416a15a938` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:42:04.097199 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d64aa6df-d65e-4b96-91d1-03210c210eb8 None admin] RBAC: Authorizing `identity:get_project(project_id=eb97bb0dd11f4c10a9d2a2416a15a938)` {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:42:04.098708 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d64aa6df-d65e-4b96-91d1-03210c210eb8 None admin] RBAC: Authorization granted {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:42:04.100537 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 47/95] 10.222.0.84 () {56 vars in 1186 bytes} [Wed May 25 14:42:03 2022] GET /identity/v3/projects/eb97bb0dd11f4c10a9d2a2416a15a938 => generated 312 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:42:04.107574 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d64aa6df-d65e-4b96-91d1-03210c210eb8 None admin] Authenticating user token {{(pid=101892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:42:04.113678 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f366ad84-3811-412a-ba6d-715427c56e74 None admin] Validating token access rules against request {{(pid=101893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:42:04.154360 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG dbcounter [-] [101893] Writing DB stats keystone:SELECT=100 {{(pid=101893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:42:04.212280 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bef2b49-921e-410e-862e-ea0a56aad4a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:42:04.212952 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bef2b49-921e-410e-862e-ea0a56aad4a2 None admin] REQUEST_METHOD: `GET` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:42:04.213243 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bef2b49-921e-410e-862e-ea0a56aad4a2 None admin] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:42:04.214089 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bef2b49-921e-410e-862e-ea0a56aad4a2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:42:04.214941 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bef2b49-921e-410e-862e-ea0a56aad4a2 None admin] RBAC: Adding query filter params (role.id=d3defd94f93b4e76af116df691240185, scope.project.id=42293c5d76254690ab29c96f76687d9c, user.id=376a0503e64e47c795f924714268e715) {{(pid=101893) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:42:04.215259 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bef2b49-921e-410e-862e-ea0a56aad4a2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:42:04.216774 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bef2b49-921e-410e-862e-ea0a56aad4a2 None admin] RBAC: Authorization granted {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:42:04.229771 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 49/96] 10.222.0.84 () {56 vars in 1374 bytes} [Wed May 25 14:42:03 2022] GET /identity/v3/role_assignments?user.id=376a0503e64e47c795f924714268e715&scope.project.id=42293c5d76254690ab29c96f76687d9c&role.id=d3defd94f93b4e76af116df691240185 => generated 259 bytes in 382 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:42:04.344177 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d64aa6df-d65e-4b96-91d1-03210c210eb8 None admin] Validating token access rules against request {{(pid=101892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:42:04.393404 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2664621-8b32-4800-a389-c03c392c7007 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:42:04.394472 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2664621-8b32-4800-a389-c03c392c7007 None admin] REQUEST_METHOD: `GET` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:42:04.394971 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2664621-8b32-4800-a389-c03c392c7007 None admin] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:42:04.395443 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2664621-8b32-4800-a389-c03c392c7007 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:42:04.396523 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2664621-8b32-4800-a389-c03c392c7007 None admin] RBAC: Adding query filter params (role.id=ff664fa0db7e4262a5accde96c3df4c3, scope.project.id=eb97bb0dd11f4c10a9d2a2416a15a938, user.id=376a0503e64e47c795f924714268e715) {{(pid=101892) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:42:04.397063 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2664621-8b32-4800-a389-c03c392c7007 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:42:04.398730 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2664621-8b32-4800-a389-c03c392c7007 None admin] RBAC: Authorization granted {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:42:04.408289 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 48/97] 10.222.0.84 () {56 vars in 1374 bytes} [Wed May 25 14:42:04 2022] GET /identity/v3/role_assignments?user.id=376a0503e64e47c795f924714268e715&scope.project.id=eb97bb0dd11f4c10a9d2a2416a15a938&role.id=ff664fa0db7e4262a5accde96c3df4c3 => generated 259 bytes in 301 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:42:05.815071 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbfbed30-8664-4121-83a0-ca5c81c22e9a None None] REQUEST_METHOD: `GET` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:42:05.815629 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbfbed30-8664-4121-83a0-ca5c81c22e9a None None] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:42:05.815629 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbfbed30-8664-4121-83a0-ca5c81c22e9a None None] PATH_INFO: `/` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:42:05.817234 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 50/98] 10.222.0.84 () {54 vars in 926 bytes} [Wed May 25 14:42:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 14:42:05.822197 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f89022d-a9ad-42e4-bc80-4e53b62cd00f None None] REQUEST_METHOD: `POST` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:42:05.823539 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f89022d-a9ad-42e4-bc80-4e53b62cd00f None None] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:42:05.824049 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f89022d-a9ad-42e4-bc80-4e53b62cd00f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:42:05.845139 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329cfa3e-4578-471f-b93c-b08813ef266e None None] REQUEST_METHOD: `GET` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:42:05.845738 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329cfa3e-4578-471f-b93c-b08813ef266e None None] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:42:05.846206 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329cfa3e-4578-471f-b93c-b08813ef266e None None] PATH_INFO: `/` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:42:05.847808 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 51/99] 10.222.0.84 () {54 vars in 926 bytes} [Wed May 25 14:42:05 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 25 14:42:05.848196 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.auth.core [None req-7f89022d-a9ad-42e4-bc80-4e53b62cd00f None None] MFA Rules not processed for user `05d87e87798e429aa1c10b24391f915e`. Rule list: `[]` (Enabled: `True`). {{(pid=101892) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:42:05.849599 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.fernet_utils [None req-7f89022d-a9ad-42e4-bc80-4e53b62cd00f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=101892) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:42:05.852637 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c293ff98-1a9d-4d11-bc3d-b5a05a436f6d None None] REQUEST_METHOD: `POST` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:42:05.853137 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c293ff98-1a9d-4d11-bc3d-b5a05a436f6d None None] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:42:05.853605 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c293ff98-1a9d-4d11-bc3d-b5a05a436f6d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:42:05.879095 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.auth.core [None req-c293ff98-1a9d-4d11-bc3d-b5a05a436f6d None None] MFA Rules not processed for user `05d87e87798e429aa1c10b24391f915e`. Rule list: `[]` (Enabled: `True`). {{(pid=101893) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:42:05.881339 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.fernet_utils [None req-c293ff98-1a9d-4d11-bc3d-b5a05a436f6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=101893) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:42:05.976018 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG dbcounter [-] [101892] Writing DB stats keystone:SELECT=100 {{(pid=101892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:42:06.019302 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 49/100] 10.222.0.84 () {58 vars in 1023 bytes} [Wed May 25 14:42:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 25 14:42:06.037882 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 52/101] 10.222.0.84 () {58 vars in 1023 bytes} [Wed May 25 14:42:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 25 14:42:06.062488 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f89022d-a9ad-42e4-bc80-4e53b62cd00f None None] Authenticating user token {{(pid=101892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:42:06.074796 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c293ff98-1a9d-4d11-bc3d-b5a05a436f6d None None] Authenticating user token {{(pid=101893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:42:06.219674 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c293ff98-1a9d-4d11-bc3d-b5a05a436f6d None None] Validating token access rules against request {{(pid=101893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:42:06.236011 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG dbcounter [-] [101893] Writing DB stats keystone:SELECT=100 {{(pid=101893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:42:06.269368 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01c6e5a4-690c-42fa-b57f-7dfba7d42745 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:42:06.270192 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c6e5a4-690c-42fa-b57f-7dfba7d42745 None admin] REQUEST_METHOD: `GET` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:42:06.270479 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c6e5a4-690c-42fa-b57f-7dfba7d42745 None admin] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:42:06.270757 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c6e5a4-690c-42fa-b57f-7dfba7d42745 None admin] PATH_INFO: `/v3/domains/default` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:42:06.273745 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01c6e5a4-690c-42fa-b57f-7dfba7d42745 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:42:06.275225 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01c6e5a4-690c-42fa-b57f-7dfba7d42745 None admin] RBAC: Authorization granted {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:42:06.277938 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 53/102] 10.222.0.84 () {56 vars in 1108 bytes} [Wed May 25 14:42:06 2022] GET /identity/v3/domains/default => generated 199 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 14:42:06.282698 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01c6e5a4-690c-42fa-b57f-7dfba7d42745 None admin] Authenticating user token {{(pid=101893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:42:06.334590 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f89022d-a9ad-42e4-bc80-4e53b62cd00f None None] Validating token access rules against request {{(pid=101892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:42:06.395524 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-706fe53b-5d4b-4b91-a6cc-425c990dc2ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:42:06.404473 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706fe53b-5d4b-4b91-a6cc-425c990dc2ca None admin] REQUEST_METHOD: `GET` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:42:06.404769 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706fe53b-5d4b-4b91-a6cc-425c990dc2ca None admin] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:42:06.405058 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706fe53b-5d4b-4b91-a6cc-425c990dc2ca None admin] PATH_INFO: `/v3/roles/reader` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:42:06.423313 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-706fe53b-5d4b-4b91-a6cc-425c990dc2ca None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 14:42:06.439440 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application [None req-706fe53b-5d4b-4b91-a6cc-425c990dc2ca None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 25 14:42:06.439440 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:42:06.439440 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 14:42:06.439440 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 14:42:06.439440 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 14:42:06.439440 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 14:42:06.439440 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 14:42:06.439440 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 14:42:06.439440 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 14:42:06.439440 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 14:42:06.439440 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 14:42:06.439440 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 14:42:06.439440 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 14:42:06.439440 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 14:42:06.439440 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 14:42:06.439440 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 14:42:06.440519 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 14:42:06.440519 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 14:42:06.440519 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 14:42:06.440519 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 14:42:06.440519 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 14:42:06.440519 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 14:42:06.440519 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 14:42:06.440519 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 14:42:06.440519 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 14:42:06.440519 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application return self.get_or_create( May 25 14:42:06.440519 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 14:42:06.440519 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application with Lock( May 25 14:42:06.440519 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 14:42:06.440519 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application return self._enter() May 25 14:42:06.440519 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 14:42:06.440519 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 14:42:06.441305 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 14:42:06.441305 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application return self.creator() May 25 14:42:06.441305 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 14:42:06.441305 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application created_value = creator( May 25 14:42:06.441305 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 14:42:06.441305 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 14:42:06.441305 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 14:42:06.441305 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 14:42:06.441305 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 14:42:06.441305 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 14:42:06.441305 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 25 14:42:06.441305 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application May 25 14:42:06.441305 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 50/103] 10.222.0.84 () {56 vars in 1099 bytes} [Wed May 25 14:42:06 2022] GET /identity/v3/roles/reader => generated 84 bytes in 379 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 14:42:06.449186 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-706fe53b-5d4b-4b91-a6cc-425c990dc2ca None admin] Authenticating user token {{(pid=101892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:42:06.468499 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01c6e5a4-690c-42fa-b57f-7dfba7d42745 None admin] Validating token access rules against request {{(pid=101893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:42:06.546203 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1141db41-d151-4c73-b2cc-f378867711c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:42:06.546883 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1141db41-d151-4c73-b2cc-f378867711c4 None admin] REQUEST_METHOD: `POST` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:42:06.547164 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1141db41-d151-4c73-b2cc-f378867711c4 None admin] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:42:06.547441 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1141db41-d151-4c73-b2cc-f378867711c4 None admin] PATH_INFO: `/v3/projects` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:42:06.548199 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1141db41-d151-4c73-b2cc-f378867711c4 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:42:06.549677 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1141db41-d151-4c73-b2cc-f378867711c4 None admin] RBAC: Authorization granted {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:42:06.557946 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG dbcounter [-] [101892] Writing DB stats keystone:SELECT=100 {{(pid=101892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:42:06.646352 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-706fe53b-5d4b-4b91-a6cc-425c990dc2ca None admin] Validating token access rules against request {{(pid=101892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:42:06.667689 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 54/104] 10.222.0.84 () {60 vars in 1141 bytes} [Wed May 25 14:42:06 2022] POST /identity/v3/projects => generated 302 bytes in 382 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 14:42:06.670100 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd2ef83-db7b-4406-97b2-829e83d0c537 None None] REQUEST_METHOD: `GET` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:42:06.670712 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd2ef83-db7b-4406-97b2-829e83d0c537 None None] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:42:06.671211 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd2ef83-db7b-4406-97b2-829e83d0c537 None None] PATH_INFO: `/` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:42:06.672905 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 55/105] 10.222.0.84 () {54 vars in 926 bytes} [Wed May 25 14:42:06 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 25 14:42:06.678787 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85cf904-6942-4480-8af2-17b57630aa62 None None] REQUEST_METHOD: `POST` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:42:06.679399 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85cf904-6942-4480-8af2-17b57630aa62 None None] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:42:06.679902 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85cf904-6942-4480-8af2-17b57630aa62 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:42:06.699268 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.auth.core [None req-a85cf904-6942-4480-8af2-17b57630aa62 None None] MFA Rules not processed for user `05d87e87798e429aa1c10b24391f915e`. Rule list: `[]` (Enabled: `True`). {{(pid=101893) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:42:06.700979 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.fernet_utils [None req-a85cf904-6942-4480-8af2-17b57630aa62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=101893) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:42:06.728024 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG dbcounter [-] [101893] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=101893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:42:06.740928 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88ac8172-75b8-401c-8683-fac01ae0c666 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:42:06.741625 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ac8172-75b8-401c-8683-fac01ae0c666 None admin] REQUEST_METHOD: `GET` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:42:06.741914 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ac8172-75b8-401c-8683-fac01ae0c666 None admin] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:42:06.742197 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ac8172-75b8-401c-8683-fac01ae0c666 None admin] PATH_INFO: `/v3/roles` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:42:06.742958 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88ac8172-75b8-401c-8683-fac01ae0c666 None admin] RBAC: Adding query filter params (name=reader) {{(pid=101892) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:42:06.743272 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88ac8172-75b8-401c-8683-fac01ae0c666 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:42:06.745051 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88ac8172-75b8-401c-8683-fac01ae0c666 None admin] RBAC: Authorization granted {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:42:06.763508 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 51/106] 10.222.0.84 () {56 vars in 1101 bytes} [Wed May 25 14:42:06 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 315 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:42:06.769445 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88ac8172-75b8-401c-8683-fac01ae0c666 None admin] Authenticating user token {{(pid=101892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:42:06.802249 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 56/107] 10.222.0.84 () {58 vars in 1023 bytes} [Wed May 25 14:42:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 25 14:42:06.825694 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a85cf904-6942-4480-8af2-17b57630aa62 None None] Authenticating user token {{(pid=101893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:42:06.991945 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88ac8172-75b8-401c-8683-fac01ae0c666 None admin] Validating token access rules against request {{(pid=101892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:42:07.000259 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG dbcounter [-] [101892] Writing DB stats keystone:SELECT=100 {{(pid=101892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:42:07.005112 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a85cf904-6942-4480-8af2-17b57630aa62 None None] Validating token access rules against request {{(pid=101893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:42:07.028807 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6db27c24-0eb3-4dbc-b528-7e156a038b62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:42:07.029696 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db27c24-0eb3-4dbc-b528-7e156a038b62 None admin] REQUEST_METHOD: `GET` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:42:07.029979 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db27c24-0eb3-4dbc-b528-7e156a038b62 None admin] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:42:07.030255 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db27c24-0eb3-4dbc-b528-7e156a038b62 None admin] PATH_INFO: `/v3/users/769e12fb3925457a822476ecd804439a` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:42:07.041766 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a50668-c280-4674-8b8d-e20d5574d535 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:42:07.042577 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a50668-c280-4674-8b8d-e20d5574d535 None admin] REQUEST_METHOD: `GET` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:42:07.042867 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a50668-c280-4674-8b8d-e20d5574d535 None admin] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:42:07.043151 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a50668-c280-4674-8b8d-e20d5574d535 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:42:07.045364 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6db27c24-0eb3-4dbc-b528-7e156a038b62 None admin] RBAC: Authorizing `identity:get_user(user_id=769e12fb3925457a822476ecd804439a)` {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:42:07.046027 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6db27c24-0eb3-4dbc-b528-7e156a038b62 None admin] RBAC: Authorization granted {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:42:07.050279 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 52/108] 10.222.0.84 () {56 vars in 1177 bytes} [Wed May 25 14:42:06 2022] GET /identity/v3/users/769e12fb3925457a822476ecd804439a => generated 289 bytes in 279 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 14:42:07.050279 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2bdb15b-da6b-41ec-b675-f59b0b247710 None None] REQUEST_METHOD: `GET` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:42:07.050279 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2bdb15b-da6b-41ec-b675-f59b0b247710 None None] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:42:07.050279 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2bdb15b-da6b-41ec-b675-f59b0b247710 None None] PATH_INFO: `/` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:42:07.050707 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 53/109] 10.222.0.84 () {54 vars in 926 bytes} [Wed May 25 14:42:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 14:42:07.056110 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9e4d5e-4de3-42c5-a4e7-4584448ea2db None None] REQUEST_METHOD: `POST` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:42:07.056402 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9e4d5e-4de3-42c5-a4e7-4584448ea2db None None] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:42:07.056689 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9e4d5e-4de3-42c5-a4e7-4584448ea2db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:42:07.063548 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05a50668-c280-4674-8b8d-e20d5574d535 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 14:42:07.073398 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application [None req-05a50668-c280-4674-8b8d-e20d5574d535 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 25 14:42:07.073398 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:42:07.073398 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 14:42:07.073398 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 14:42:07.073398 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 14:42:07.073398 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 14:42:07.073398 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 14:42:07.073398 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 14:42:07.073398 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 14:42:07.073398 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 14:42:07.073398 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 14:42:07.073398 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 14:42:07.073398 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 14:42:07.073398 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 14:42:07.073398 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 14:42:07.073398 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 14:42:07.074313 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 14:42:07.074313 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 14:42:07.074313 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 14:42:07.074313 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 14:42:07.074313 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 14:42:07.074313 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 14:42:07.074313 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 14:42:07.074313 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 14:42:07.074313 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 14:42:07.074313 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return self.get_or_create( May 25 14:42:07.074313 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 14:42:07.074313 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application with Lock( May 25 14:42:07.074313 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 14:42:07.074313 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return self._enter() May 25 14:42:07.074313 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 14:42:07.074313 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 14:42:07.075069 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 14:42:07.075069 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return self.creator() May 25 14:42:07.075069 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 14:42:07.075069 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application created_value = creator( May 25 14:42:07.075069 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 14:42:07.075069 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 14:42:07.075069 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 14:42:07.075069 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 14:42:07.075069 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 14:42:07.075069 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 14:42:07.075069 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 25 14:42:07.075069 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application May 25 14:42:07.075069 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 57/110] 10.222.0.84 () {56 vars in 1096 bytes} [Wed May 25 14:42:06 2022] GET /identity/v3/roles/admin => generated 83 bytes in 250 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 25 14:42:07.075834 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a50668-c280-4674-8b8d-e20d5574d535 None admin] Authenticating user token {{(pid=101893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:42:07.079823 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.auth.core [None req-2b9e4d5e-4de3-42c5-a4e7-4584448ea2db None None] MFA Rules not processed for user `05d87e87798e429aa1c10b24391f915e`. Rule list: `[]` (Enabled: `True`). {{(pid=101892) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:42:07.080998 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.fernet_utils [None req-2b9e4d5e-4de3-42c5-a4e7-4584448ea2db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=101892) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:42:07.096564 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG dbcounter [-] [101893] Writing DB stats keystone:SELECT=100 {{(pid=101893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:42:07.150814 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 54/111] 10.222.0.84 () {58 vars in 1023 bytes} [Wed May 25 14:42:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 25 14:42:07.152216 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b9e4d5e-4de3-42c5-a4e7-4584448ea2db None None] Authenticating user token {{(pid=101892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:42:07.194494 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a50668-c280-4674-8b8d-e20d5574d535 None admin] Validating token access rules against request {{(pid=101893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:42:07.238506 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10b1c67f-1fe8-4916-b17b-e0c778c7a6d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:42:07.239182 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b1c67f-1fe8-4916-b17b-e0c778c7a6d2 None admin] REQUEST_METHOD: `GET` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:42:07.239497 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b1c67f-1fe8-4916-b17b-e0c778c7a6d2 None admin] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:42:07.239793 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b1c67f-1fe8-4916-b17b-e0c778c7a6d2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:42:07.286860 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG dbcounter [-] [101892] Writing DB stats keystone:SELECT=100 {{(pid=101892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:42:07.293770 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b9e4d5e-4de3-42c5-a4e7-4584448ea2db None None] Validating token access rules against request {{(pid=101892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:42:07.321915 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10b1c67f-1fe8-4916-b17b-e0c778c7a6d2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:42:07.324477 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10b1c67f-1fe8-4916-b17b-e0c778c7a6d2 None admin] RBAC: Authorization granted {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:42:07.331978 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7d860d9-1a9c-4399-8b23-ca2bfae43a57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:42:07.332706 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d860d9-1a9c-4399-8b23-ca2bfae43a57 None admin] REQUEST_METHOD: `GET` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:42:07.333029 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d860d9-1a9c-4399-8b23-ca2bfae43a57 None admin] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:42:07.333306 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d860d9-1a9c-4399-8b23-ca2bfae43a57 None admin] PATH_INFO: `/v3/roles` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:42:07.334088 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7d860d9-1a9c-4399-8b23-ca2bfae43a57 None admin] RBAC: Adding query filter params (name=admin) {{(pid=101892) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:42:07.334728 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7d860d9-1a9c-4399-8b23-ca2bfae43a57 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:42:07.335788 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7d860d9-1a9c-4399-8b23-ca2bfae43a57 None admin] RBAC: Authorization granted {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:42:07.344897 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 55/112] 10.222.0.84 () {56 vars in 1099 bytes} [Wed May 25 14:42:07 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:42:07.345537 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7d860d9-1a9c-4399-8b23-ca2bfae43a57 None admin] Authenticating user token {{(pid=101892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:42:07.355999 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG dbcounter [-] [101893] Writing DB stats keystone:SELECT=100 {{(pid=101893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:42:07.444179 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 58/113] 10.222.0.84 () {58 vars in 1282 bytes} [Wed May 25 14:42:07 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 363 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 25 14:42:07.445478 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10b1c67f-1fe8-4916-b17b-e0c778c7a6d2 None admin] Authenticating user token {{(pid=101893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:42:07.455910 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7d860d9-1a9c-4399-8b23-ca2bfae43a57 None admin] Validating token access rules against request {{(pid=101892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:42:07.495064 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d386838b-d897-43cd-8b96-4d40d603aced None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:42:07.495997 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d386838b-d897-43cd-8b96-4d40d603aced None admin] REQUEST_METHOD: `GET` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:42:07.496611 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d386838b-d897-43cd-8b96-4d40d603aced None admin] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:42:07.496902 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d386838b-d897-43cd-8b96-4d40d603aced None admin] PATH_INFO: `/v3/roles/member` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:42:07.512112 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d386838b-d897-43cd-8b96-4d40d603aced None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 14:42:07.522776 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application [None req-d386838b-d897-43cd-8b96-4d40d603aced None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 25 14:42:07.522776 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:42:07.522776 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 14:42:07.522776 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 14:42:07.522776 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 14:42:07.522776 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 14:42:07.522776 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 14:42:07.522776 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 14:42:07.522776 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 14:42:07.522776 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 14:42:07.522776 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 14:42:07.522776 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 14:42:07.522776 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 14:42:07.522776 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 14:42:07.522776 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 14:42:07.522776 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 14:42:07.524013 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 14:42:07.524013 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 14:42:07.524013 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 14:42:07.524013 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 14:42:07.524013 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 14:42:07.524013 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 14:42:07.524013 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 14:42:07.524013 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 14:42:07.524013 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 14:42:07.524013 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application return self.get_or_create( May 25 14:42:07.524013 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 14:42:07.524013 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application with Lock( May 25 14:42:07.524013 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 14:42:07.524013 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application return self._enter() May 25 14:42:07.524013 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 14:42:07.524013 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 14:42:07.525000 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 14:42:07.525000 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application return self.creator() May 25 14:42:07.525000 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 14:42:07.525000 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application created_value = creator( May 25 14:42:07.525000 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 14:42:07.525000 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 14:42:07.525000 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 14:42:07.525000 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 14:42:07.525000 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 14:42:07.525000 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 14:42:07.525000 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 25 14:42:07.525000 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application May 25 14:42:07.525000 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 56/114] 10.222.0.84 () {56 vars in 1099 bytes} [Wed May 25 14:42:07 2022] GET /identity/v3/roles/member => generated 84 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 14:42:07.525000 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d386838b-d897-43cd-8b96-4d40d603aced None admin] Authenticating user token {{(pid=101892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:42:07.553984 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG dbcounter [-] [101892] Writing DB stats keystone:SELECT=100 {{(pid=101892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:42:07.563892 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10b1c67f-1fe8-4916-b17b-e0c778c7a6d2 None admin] Validating token access rules against request {{(pid=101893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:42:07.592101 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG dbcounter [-] [101893] Writing DB stats keystone:SELECT=100 {{(pid=101893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:42:07.604988 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea40d914-b0f3-41b2-b27a-719b66f0c21c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:42:07.606515 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea40d914-b0f3-41b2-b27a-719b66f0c21c None admin] REQUEST_METHOD: `GET` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:42:07.607002 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea40d914-b0f3-41b2-b27a-719b66f0c21c None admin] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:42:07.607476 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea40d914-b0f3-41b2-b27a-719b66f0c21c None admin] PATH_INFO: `/v3/users/05d87e87798e429aa1c10b24391f915e` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:42:07.609310 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea40d914-b0f3-41b2-b27a-719b66f0c21c None admin] RBAC: Authorizing `identity:get_user(user_id=05d87e87798e429aa1c10b24391f915e)` {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:42:07.613572 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea40d914-b0f3-41b2-b27a-719b66f0c21c None admin] RBAC: Authorization granted {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:42:07.613572 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 59/115] 10.222.0.84 () {56 vars in 1177 bytes} [Wed May 25 14:42:07 2022] GET /identity/v3/users/05d87e87798e429aa1c10b24391f915e => generated 247 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:42:07.614593 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea40d914-b0f3-41b2-b27a-719b66f0c21c None admin] Authenticating user token {{(pid=101893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:42:07.663893 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d386838b-d897-43cd-8b96-4d40d603aced None admin] Validating token access rules against request {{(pid=101892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:42:07.710403 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f761a5a7-b0d3-42e5-af73-9bbf959ec181 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:42:07.711631 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f761a5a7-b0d3-42e5-af73-9bbf959ec181 None admin] REQUEST_METHOD: `GET` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:42:07.711979 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f761a5a7-b0d3-42e5-af73-9bbf959ec181 None admin] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:42:07.712261 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f761a5a7-b0d3-42e5-af73-9bbf959ec181 None admin] PATH_INFO: `/v3/projects/42293c5d76254690ab29c96f76687d9c` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:42:07.714130 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f761a5a7-b0d3-42e5-af73-9bbf959ec181 None admin] RBAC: Authorizing `identity:get_project(project_id=42293c5d76254690ab29c96f76687d9c)` {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:42:07.716143 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f761a5a7-b0d3-42e5-af73-9bbf959ec181 None admin] RBAC: Authorization granted {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:42:07.717880 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 57/116] 10.222.0.84 () {56 vars in 1186 bytes} [Wed May 25 14:42:07 2022] GET /identity/v3/projects/42293c5d76254690ab29c96f76687d9c => generated 298 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:42:07.723092 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5645933-5a34-4bae-8859-783dabee2f75 None None] REQUEST_METHOD: `GET` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:42:07.723092 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5645933-5a34-4bae-8859-783dabee2f75 None None] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:42:07.723092 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5645933-5a34-4bae-8859-783dabee2f75 None None] PATH_INFO: `/` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:42:07.723092 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 58/117] 10.222.0.84 () {54 vars in 926 bytes} [Wed May 25 14:42:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 14:42:07.723092 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5645933-5a34-4bae-8859-783dabee2f75 None None] Authenticating user token {{(pid=101892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:42:07.743092 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea40d914-b0f3-41b2-b27a-719b66f0c21c None admin] Validating token access rules against request {{(pid=101893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:42:07.797438 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b375116-8dfa-40f9-9b7c-5b29c2cf820b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:42:07.798122 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b375116-8dfa-40f9-9b7c-5b29c2cf820b None admin] REQUEST_METHOD: `GET` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:42:07.798421 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b375116-8dfa-40f9-9b7c-5b29c2cf820b None admin] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:42:07.798802 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b375116-8dfa-40f9-9b7c-5b29c2cf820b None admin] PATH_INFO: `/v3/roles` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:42:07.800940 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b375116-8dfa-40f9-9b7c-5b29c2cf820b None admin] RBAC: Adding query filter params (name=member) {{(pid=101893) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:42:07.800940 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b375116-8dfa-40f9-9b7c-5b29c2cf820b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:42:07.803222 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b375116-8dfa-40f9-9b7c-5b29c2cf820b None admin] RBAC: Authorization granted {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:42:07.815905 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 60/118] 10.222.0.84 () {56 vars in 1101 bytes} [Wed May 25 14:42:07 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:42:07.816679 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b375116-8dfa-40f9-9b7c-5b29c2cf820b None admin] Authenticating user token {{(pid=101893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:42:07.850325 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG dbcounter [-] [101892] Writing DB stats keystone:SELECT=100 {{(pid=101892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:42:07.874564 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG dbcounter [-] [101893] Writing DB stats keystone:SELECT=100 {{(pid=101893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:42:07.877391 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5645933-5a34-4bae-8859-783dabee2f75 None None] Validating token access rules against request {{(pid=101892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:42:07.919298 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0cc10de-c154-442f-812f-15d4eab3da28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:42:07.920530 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0cc10de-c154-442f-812f-15d4eab3da28 None admin] REQUEST_METHOD: `GET` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:42:07.920986 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0cc10de-c154-442f-812f-15d4eab3da28 None admin] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:42:07.921402 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0cc10de-c154-442f-812f-15d4eab3da28 None admin] PATH_INFO: `/v3/projects/42293c5d76254690ab29c96f76687d9c` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:42:07.922731 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0cc10de-c154-442f-812f-15d4eab3da28 None admin] RBAC: Authorizing `identity:get_project(project_id=42293c5d76254690ab29c96f76687d9c)` {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:42:07.924552 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0cc10de-c154-442f-812f-15d4eab3da28 None admin] RBAC: Authorization granted {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:42:07.926516 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 59/119] 10.222.0.84 () {56 vars in 1186 bytes} [Wed May 25 14:42:07 2022] GET /identity/v3/projects/42293c5d76254690ab29c96f76687d9c => generated 298 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:42:07.928227 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daee90f8-da6f-4c5c-ae4e-410049e6df0d None None] REQUEST_METHOD: `POST` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:42:07.928661 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daee90f8-da6f-4c5c-ae4e-410049e6df0d None None] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:42:07.929219 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daee90f8-da6f-4c5c-ae4e-410049e6df0d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:42:07.939335 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b375116-8dfa-40f9-9b7c-5b29c2cf820b None admin] Validating token access rules against request {{(pid=101893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:42:07.948999 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.auth.core [None req-daee90f8-da6f-4c5c-ae4e-410049e6df0d None None] MFA Rules not processed for user `05d87e87798e429aa1c10b24391f915e`. Rule list: `[]` (Enabled: `True`). {{(pid=101892) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:42:07.950771 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.fernet_utils [None req-daee90f8-da6f-4c5c-ae4e-410049e6df0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=101892) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:42:07.980119 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93a01f6f-6f85-4ccd-9a47-5d905673aba4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:42:07.980793 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a01f6f-6f85-4ccd-9a47-5d905673aba4 None admin] REQUEST_METHOD: `GET` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:42:07.981082 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a01f6f-6f85-4ccd-9a47-5d905673aba4 None admin] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:42:07.981388 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a01f6f-6f85-4ccd-9a47-5d905673aba4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:42:07.982303 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93a01f6f-6f85-4ccd-9a47-5d905673aba4 None admin] RBAC: Adding query filter params (role.id=d289ba5202044f90baf900bb40b116b8, scope.project.id=42293c5d76254690ab29c96f76687d9c, user.id=769e12fb3925457a822476ecd804439a) {{(pid=101893) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:42:07.982649 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93a01f6f-6f85-4ccd-9a47-5d905673aba4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:42:07.984144 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93a01f6f-6f85-4ccd-9a47-5d905673aba4 None admin] RBAC: Authorization granted {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:42:07.991730 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 61/120] 10.222.0.84 () {56 vars in 1374 bytes} [Wed May 25 14:42:07 2022] GET /identity/v3/role_assignments?user.id=769e12fb3925457a822476ecd804439a&scope.project.id=42293c5d76254690ab29c96f76687d9c&role.id=d289ba5202044f90baf900bb40b116b8 => generated 259 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:42:07.991730 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93a01f6f-6f85-4ccd-9a47-5d905673aba4 None admin] Authenticating user token {{(pid=101893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:42:08.032116 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 60/121] 10.222.0.84 () {58 vars in 1023 bytes} [Wed May 25 14:42:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 25 14:42:08.033609 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daee90f8-da6f-4c5c-ae4e-410049e6df0d None None] Authenticating user token {{(pid=101892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:42:08.120835 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93a01f6f-6f85-4ccd-9a47-5d905673aba4 None admin] Validating token access rules against request {{(pid=101893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:42:08.133168 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG dbcounter [-] [101893] Writing DB stats keystone:SELECT=100 {{(pid=101893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:42:08.134365 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG dbcounter [-] [101892] Writing DB stats keystone:SELECT=100 {{(pid=101892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:42:08.155699 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daee90f8-da6f-4c5c-ae4e-410049e6df0d None None] Validating token access rules against request {{(pid=101892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:42:08.161068 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6eafeef-217b-4c4b-a677-7edc773aacee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:42:08.161970 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6eafeef-217b-4c4b-a677-7edc773aacee None admin] REQUEST_METHOD: `GET` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:42:08.162260 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6eafeef-217b-4c4b-a677-7edc773aacee None admin] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:42:08.162543 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6eafeef-217b-4c4b-a677-7edc773aacee None admin] PATH_INFO: `/v3/users/376a0503e64e47c795f924714268e715` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:42:08.163905 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6eafeef-217b-4c4b-a677-7edc773aacee None admin] RBAC: Authorizing `identity:get_user(user_id=376a0503e64e47c795f924714268e715)` {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:42:08.165422 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6eafeef-217b-4c4b-a677-7edc773aacee None admin] RBAC: Authorization granted {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:42:08.168790 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 62/122] 10.222.0.84 () {56 vars in 1177 bytes} [Wed May 25 14:42:07 2022] GET /identity/v3/users/376a0503e64e47c795f924714268e715 => generated 275 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:42:08.173334 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f0895f-f7b2-4acf-8440-4332d4a8f447 None None] REQUEST_METHOD: `GET` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:42:08.173334 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f0895f-f7b2-4acf-8440-4332d4a8f447 None None] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:42:08.173334 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f0895f-f7b2-4acf-8440-4332d4a8f447 None None] PATH_INFO: `/` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:42:08.174386 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 63/123] 10.222.0.84 () {54 vars in 926 bytes} [Wed May 25 14:42:08 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 14:42:08.175230 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6f0895f-f7b2-4acf-8440-4332d4a8f447 None None] Authenticating user token {{(pid=101893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:42:08.203828 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-286b6661-9126-46ff-803a-a06c4b430f96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:42:08.205074 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286b6661-9126-46ff-803a-a06c4b430f96 None admin] REQUEST_METHOD: `PUT` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:42:08.205362 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286b6661-9126-46ff-803a-a06c4b430f96 None admin] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:42:08.205640 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286b6661-9126-46ff-803a-a06c4b430f96 None admin] PATH_INFO: `/v3/projects/42293c5d76254690ab29c96f76687d9c/users/05d87e87798e429aa1c10b24391f915e/roles/a3b78e7d547d4d2d998b4c99a4396bba` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:42:08.207627 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-286b6661-9126-46ff-803a-a06c4b430f96 None admin] RBAC: Authorizing `identity:create_grant(project_id=42293c5d76254690ab29c96f76687d9c, user_id=05d87e87798e429aa1c10b24391f915e, role_id=a3b78e7d547d4d2d998b4c99a4396bba)` {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:42:08.209079 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-286b6661-9126-46ff-803a-a06c4b430f96 None admin] RBAC: Authorization granted {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:42:08.274288 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 61/124] 10.222.0.84 () {58 vars in 1439 bytes} [Wed May 25 14:42:08 2022] PUT /identity/v3/projects/42293c5d76254690ab29c96f76687d9c/users/05d87e87798e429aa1c10b24391f915e/roles/a3b78e7d547d4d2d998b4c99a4396bba => generated 0 bytes in 241 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 14:42:08.275186 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-286b6661-9126-46ff-803a-a06c4b430f96 None admin] Authenticating user token {{(pid=101892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:42:08.301143 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6f0895f-f7b2-4acf-8440-4332d4a8f447 None None] Validating token access rules against request {{(pid=101893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:42:08.354814 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47943962-c48c-4cc5-ad5b-f5817e28c9a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:42:08.359269 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47943962-c48c-4cc5-ad5b-f5817e28c9a4 None admin] REQUEST_METHOD: `GET` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:42:08.359269 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47943962-c48c-4cc5-ad5b-f5817e28c9a4 None admin] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:42:08.359269 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47943962-c48c-4cc5-ad5b-f5817e28c9a4 None admin] PATH_INFO: `/v3/roles/member` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:42:08.377482 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47943962-c48c-4cc5-ad5b-f5817e28c9a4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 14:42:08.388943 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application [None req-47943962-c48c-4cc5-ad5b-f5817e28c9a4 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 25 14:42:08.388943 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:42:08.388943 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 14:42:08.388943 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 14:42:08.388943 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 14:42:08.388943 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 14:42:08.388943 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 14:42:08.388943 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 14:42:08.388943 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 14:42:08.388943 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 14:42:08.388943 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 14:42:08.388943 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 14:42:08.388943 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 14:42:08.388943 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 14:42:08.388943 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 14:42:08.388943 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 14:42:08.389878 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 14:42:08.389878 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 14:42:08.389878 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 14:42:08.389878 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 14:42:08.389878 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 14:42:08.389878 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 14:42:08.389878 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 14:42:08.389878 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 14:42:08.389878 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 14:42:08.389878 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return self.get_or_create( May 25 14:42:08.389878 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 14:42:08.389878 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application with Lock( May 25 14:42:08.389878 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 14:42:08.389878 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return self._enter() May 25 14:42:08.389878 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 14:42:08.389878 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 14:42:08.390682 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 14:42:08.390682 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return self.creator() May 25 14:42:08.390682 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 14:42:08.390682 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application created_value = creator( May 25 14:42:08.390682 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 14:42:08.390682 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 14:42:08.390682 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 14:42:08.390682 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 14:42:08.390682 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 14:42:08.390682 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 14:42:08.390682 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 25 14:42:08.390682 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application May 25 14:42:08.393633 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 64/125] 10.222.0.84 () {56 vars in 1099 bytes} [Wed May 25 14:42:08 2022] GET /identity/v3/roles/member => generated 84 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 14:42:08.395699 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d9ef4b-4522-4075-9ac4-7a80166e0a98 None None] REQUEST_METHOD: `POST` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:42:08.396791 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d9ef4b-4522-4075-9ac4-7a80166e0a98 None None] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:42:08.397232 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d9ef4b-4522-4075-9ac4-7a80166e0a98 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:42:08.405299 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-286b6661-9126-46ff-803a-a06c4b430f96 None admin] Validating token access rules against request {{(pid=101892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:42:08.420549 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.auth.core [None req-f7d9ef4b-4522-4075-9ac4-7a80166e0a98 None None] MFA Rules not processed for user `05d87e87798e429aa1c10b24391f915e`. Rule list: `[]` (Enabled: `True`). {{(pid=101893) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:42:08.422061 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.fernet_utils [None req-f7d9ef4b-4522-4075-9ac4-7a80166e0a98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=101893) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:42:08.449037 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b09bc8ce-e6ea-46f5-9c77-5a2b9f8d354f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:42:08.450450 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09bc8ce-e6ea-46f5-9c77-5a2b9f8d354f None admin] REQUEST_METHOD: `GET` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:42:08.450728 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09bc8ce-e6ea-46f5-9c77-5a2b9f8d354f None admin] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:42:08.451104 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09bc8ce-e6ea-46f5-9c77-5a2b9f8d354f None admin] PATH_INFO: `/v3/projects/42293c5d76254690ab29c96f76687d9c` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:42:08.452729 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b09bc8ce-e6ea-46f5-9c77-5a2b9f8d354f None admin] RBAC: Authorizing `identity:get_project(project_id=42293c5d76254690ab29c96f76687d9c)` {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:42:08.454277 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b09bc8ce-e6ea-46f5-9c77-5a2b9f8d354f None admin] RBAC: Authorization granted {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:42:08.456364 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 62/126] 10.222.0.84 () {56 vars in 1186 bytes} [Wed May 25 14:42:08 2022] GET /identity/v3/projects/42293c5d76254690ab29c96f76687d9c => generated 298 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:42:08.457251 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b09bc8ce-e6ea-46f5-9c77-5a2b9f8d354f None admin] Authenticating user token {{(pid=101892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:42:08.467733 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG dbcounter [-] [101893] Writing DB stats keystone:SELECT=100 {{(pid=101893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:42:08.480994 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG dbcounter [-] [101892] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=101892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:42:08.520448 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 65/127] 10.222.0.84 () {58 vars in 1023 bytes} [Wed May 25 14:42:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 25 14:42:08.522028 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7d9ef4b-4522-4075-9ac4-7a80166e0a98 None None] Authenticating user token {{(pid=101893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:42:08.614537 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b09bc8ce-e6ea-46f5-9c77-5a2b9f8d354f None admin] Validating token access rules against request {{(pid=101892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:42:08.636794 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7d9ef4b-4522-4075-9ac4-7a80166e0a98 None None] Validating token access rules against request {{(pid=101893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:42:08.655741 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c4cb6f5-18ee-4886-829b-5d99189ebc62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:42:08.656424 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c4cb6f5-18ee-4886-829b-5d99189ebc62 None admin] REQUEST_METHOD: `GET` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:42:08.656841 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c4cb6f5-18ee-4886-829b-5d99189ebc62 None admin] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:42:08.656998 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c4cb6f5-18ee-4886-829b-5d99189ebc62 None admin] PATH_INFO: `/v3/roles` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:42:08.657763 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c4cb6f5-18ee-4886-829b-5d99189ebc62 None admin] RBAC: Adding query filter params (name=member) {{(pid=101892) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:42:08.658081 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c4cb6f5-18ee-4886-829b-5d99189ebc62 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:42:08.659482 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c4cb6f5-18ee-4886-829b-5d99189ebc62 None admin] RBAC: Authorization granted {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:42:08.668460 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 63/128] 10.222.0.84 () {56 vars in 1101 bytes} [Wed May 25 14:42:08 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:42:08.674658 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c4cb6f5-18ee-4886-829b-5d99189ebc62 None admin] Authenticating user token {{(pid=101892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:42:08.676822 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c633f69d-1847-41ae-a6aa-8e6131054cc7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:42:08.678941 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c633f69d-1847-41ae-a6aa-8e6131054cc7 None admin] REQUEST_METHOD: `PUT` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:42:08.679395 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c633f69d-1847-41ae-a6aa-8e6131054cc7 None admin] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:42:08.679853 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c633f69d-1847-41ae-a6aa-8e6131054cc7 None admin] PATH_INFO: `/v3/projects/42293c5d76254690ab29c96f76687d9c/users/376a0503e64e47c795f924714268e715/roles/ff664fa0db7e4262a5accde96c3df4c3` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:42:08.682095 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c633f69d-1847-41ae-a6aa-8e6131054cc7 None admin] RBAC: Authorizing `identity:create_grant(project_id=42293c5d76254690ab29c96f76687d9c, user_id=376a0503e64e47c795f924714268e715, role_id=ff664fa0db7e4262a5accde96c3df4c3)` {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:42:08.684218 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c633f69d-1847-41ae-a6aa-8e6131054cc7 None admin] RBAC: Authorization granted {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:42:08.753673 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG dbcounter [-] [101892] Writing DB stats keystone:SELECT=100 {{(pid=101892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:42:08.785290 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c4cb6f5-18ee-4886-829b-5d99189ebc62 None admin] Validating token access rules against request {{(pid=101892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:42:08.791749 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 66/129] 10.222.0.84 () {58 vars in 1439 bytes} [Wed May 25 14:42:08 2022] PUT /identity/v3/projects/42293c5d76254690ab29c96f76687d9c/users/376a0503e64e47c795f924714268e715/roles/ff664fa0db7e4262a5accde96c3df4c3 => generated 0 bytes in 265 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 14:42:08.793131 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c633f69d-1847-41ae-a6aa-8e6131054cc7 None admin] Authenticating user token {{(pid=101893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:42:08.824664 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdbb6205-7195-465b-baf9-5b5c36c0d3fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:42:08.825541 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdbb6205-7195-465b-baf9-5b5c36c0d3fa None admin] REQUEST_METHOD: `GET` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:42:08.825831 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdbb6205-7195-465b-baf9-5b5c36c0d3fa None admin] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:42:08.826115 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdbb6205-7195-465b-baf9-5b5c36c0d3fa None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:42:08.839032 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdbb6205-7195-465b-baf9-5b5c36c0d3fa None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 14:42:08.847471 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application [None req-fdbb6205-7195-465b-baf9-5b5c36c0d3fa None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 25 14:42:08.847471 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:42:08.847471 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 14:42:08.847471 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 14:42:08.847471 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 14:42:08.847471 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 14:42:08.847471 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 14:42:08.847471 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 14:42:08.847471 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 14:42:08.847471 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 14:42:08.847471 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 14:42:08.847471 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 14:42:08.847471 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 14:42:08.847471 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 14:42:08.847471 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 14:42:08.847471 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 14:42:08.848664 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 14:42:08.848664 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 14:42:08.848664 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 14:42:08.848664 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 14:42:08.848664 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 14:42:08.848664 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 14:42:08.848664 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 14:42:08.848664 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 14:42:08.848664 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 14:42:08.848664 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application return self.get_or_create( May 25 14:42:08.848664 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 14:42:08.848664 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application with Lock( May 25 14:42:08.848664 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 14:42:08.848664 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application return self._enter() May 25 14:42:08.848664 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 14:42:08.848664 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 14:42:08.849435 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 14:42:08.849435 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application return self.creator() May 25 14:42:08.849435 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 14:42:08.849435 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application created_value = creator( May 25 14:42:08.849435 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 14:42:08.849435 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 14:42:08.849435 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 14:42:08.849435 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 14:42:08.849435 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 14:42:08.849435 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 14:42:08.849435 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 25 14:42:08.849435 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application May 25 14:42:08.849435 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 64/130] 10.222.0.84 () {56 vars in 1114 bytes} [Wed May 25 14:42:08 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 14:42:08.859613 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdbb6205-7195-465b-baf9-5b5c36c0d3fa None admin] Authenticating user token {{(pid=101892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:42:08.861964 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG dbcounter [-] [101893] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=101893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:42:09.020769 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c633f69d-1847-41ae-a6aa-8e6131054cc7 None admin] Validating token access rules against request {{(pid=101893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:42:09.075271 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdbb6205-7195-465b-baf9-5b5c36c0d3fa None admin] Validating token access rules against request {{(pid=101892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:42:09.096918 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8764fb9-4469-4cbd-b996-a5d77b707d27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:42:09.097829 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8764fb9-4469-4cbd-b996-a5d77b707d27 None admin] REQUEST_METHOD: `GET` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:42:09.098127 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8764fb9-4469-4cbd-b996-a5d77b707d27 None admin] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:42:09.098409 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8764fb9-4469-4cbd-b996-a5d77b707d27 None admin] PATH_INFO: `/v3/users/376a0503e64e47c795f924714268e715` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:42:09.104399 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8764fb9-4469-4cbd-b996-a5d77b707d27 None admin] RBAC: Authorizing `identity:get_user(user_id=376a0503e64e47c795f924714268e715)` {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:42:09.105889 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8764fb9-4469-4cbd-b996-a5d77b707d27 None admin] RBAC: Authorization granted {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:42:09.107595 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 67/131] 10.222.0.84 () {56 vars in 1177 bytes} [Wed May 25 14:42:08 2022] GET /identity/v3/users/376a0503e64e47c795f924714268e715 => generated 275 bytes in 315 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:42:09.110548 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG dbcounter [-] [101892] Writing DB stats keystone:SELECT=100 {{(pid=101892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:42:09.113244 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8764fb9-4469-4cbd-b996-a5d77b707d27 None admin] Authenticating user token {{(pid=101893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:42:09.116428 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-524acaeb-945e-4add-9d8c-1136cf8c1366 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:42:09.117134 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524acaeb-945e-4add-9d8c-1136cf8c1366 None admin] REQUEST_METHOD: `GET` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:42:09.117422 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524acaeb-945e-4add-9d8c-1136cf8c1366 None admin] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:42:09.117708 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524acaeb-945e-4add-9d8c-1136cf8c1366 None admin] PATH_INFO: `/v3/roles` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:42:09.118479 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-524acaeb-945e-4add-9d8c-1136cf8c1366 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=101892) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:42:09.118794 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-524acaeb-945e-4add-9d8c-1136cf8c1366 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:42:09.120845 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-524acaeb-945e-4add-9d8c-1136cf8c1366 None admin] RBAC: Authorization granted {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:42:09.131704 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 65/132] 10.222.0.84 () {56 vars in 1111 bytes} [Wed May 25 14:42:08 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 275 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 14:42:09.141076 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-524acaeb-945e-4add-9d8c-1136cf8c1366 None admin] Authenticating user token {{(pid=101892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:42:09.272802 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG dbcounter [-] [101893] Writing DB stats keystone:SELECT=100 {{(pid=101893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:42:09.279752 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8764fb9-4469-4cbd-b996-a5d77b707d27 None admin] Validating token access rules against request {{(pid=101893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:42:09.334344 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca2f414-4baa-4087-bd24-0d721ddce981 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:42:09.335228 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca2f414-4baa-4087-bd24-0d721ddce981 None admin] REQUEST_METHOD: `GET` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:42:09.335517 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca2f414-4baa-4087-bd24-0d721ddce981 None admin] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:42:09.335826 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca2f414-4baa-4087-bd24-0d721ddce981 None admin] PATH_INFO: `/v3/projects/eb97bb0dd11f4c10a9d2a2416a15a938` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:42:09.338043 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ca2f414-4baa-4087-bd24-0d721ddce981 None admin] RBAC: Authorizing `identity:get_project(project_id=eb97bb0dd11f4c10a9d2a2416a15a938)` {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:42:09.344356 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ca2f414-4baa-4087-bd24-0d721ddce981 None admin] RBAC: Authorization granted {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:42:09.346697 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 68/133] 10.222.0.84 () {56 vars in 1186 bytes} [Wed May 25 14:42:09 2022] GET /identity/v3/projects/eb97bb0dd11f4c10a9d2a2416a15a938 => generated 312 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 14:42:09.351980 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca2f414-4baa-4087-bd24-0d721ddce981 None admin] Authenticating user token {{(pid=101893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:42:09.421438 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-524acaeb-945e-4add-9d8c-1136cf8c1366 None admin] Validating token access rules against request {{(pid=101892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:42:09.520301 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2ef5c10-6efb-4402-a636-31353e74113a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:42:09.521203 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ef5c10-6efb-4402-a636-31353e74113a None admin] REQUEST_METHOD: `GET` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:42:09.521562 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ef5c10-6efb-4402-a636-31353e74113a None admin] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:42:09.521782 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ef5c10-6efb-4402-a636-31353e74113a None admin] PATH_INFO: `/v3/users/376a0503e64e47c795f924714268e715` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:42:09.523101 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2ef5c10-6efb-4402-a636-31353e74113a None admin] RBAC: Authorizing `identity:get_user(user_id=376a0503e64e47c795f924714268e715)` {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:42:09.524536 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2ef5c10-6efb-4402-a636-31353e74113a None admin] RBAC: Authorization granted {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:42:09.526229 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 66/134] 10.222.0.84 () {56 vars in 1177 bytes} [Wed May 25 14:42:09 2022] GET /identity/v3/users/376a0503e64e47c795f924714268e715 => generated 275 bytes in 386 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 14:42:09.531493 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2ef5c10-6efb-4402-a636-31353e74113a None admin] Authenticating user token {{(pid=101892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:42:09.536593 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca2f414-4baa-4087-bd24-0d721ddce981 None admin] Validating token access rules against request {{(pid=101893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:42:09.597501 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2d85587-06fe-41b9-96e9-65e6078c0db3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:42:09.598409 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d85587-06fe-41b9-96e9-65e6078c0db3 None admin] REQUEST_METHOD: `PUT` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:42:09.598701 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d85587-06fe-41b9-96e9-65e6078c0db3 None admin] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:42:09.598986 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d85587-06fe-41b9-96e9-65e6078c0db3 None admin] PATH_INFO: `/v3/projects/eb97bb0dd11f4c10a9d2a2416a15a938/users/376a0503e64e47c795f924714268e715/roles/ff664fa0db7e4262a5accde96c3df4c3` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:42:09.605528 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2d85587-06fe-41b9-96e9-65e6078c0db3 None admin] RBAC: Authorizing `identity:create_grant(project_id=eb97bb0dd11f4c10a9d2a2416a15a938, user_id=376a0503e64e47c795f924714268e715, role_id=ff664fa0db7e4262a5accde96c3df4c3)` {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:42:09.607018 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2d85587-06fe-41b9-96e9-65e6078c0db3 None admin] RBAC: Authorization granted {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:42:09.664697 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG dbcounter [-] [101892] Writing DB stats keystone:SELECT=100 {{(pid=101892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:42:09.717856 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 69/135] 10.222.0.84 () {58 vars in 1439 bytes} [Wed May 25 14:42:09 2022] PUT /identity/v3/projects/eb97bb0dd11f4c10a9d2a2416a15a938/users/376a0503e64e47c795f924714268e715/roles/ff664fa0db7e4262a5accde96c3df4c3 => generated 0 bytes in 366 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 25 14:42:09.723647 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2ef5c10-6efb-4402-a636-31353e74113a None admin] Validating token access rules against request {{(pid=101892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:42:09.780543 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb25752-a658-4364-9c92-a44cc1be0bc6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:42:09.781355 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb25752-a658-4364-9c92-a44cc1be0bc6 None admin] REQUEST_METHOD: `GET` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:42:09.781647 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb25752-a658-4364-9c92-a44cc1be0bc6 None admin] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:42:09.781931 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb25752-a658-4364-9c92-a44cc1be0bc6 None admin] PATH_INFO: `/v3/projects/42293c5d76254690ab29c96f76687d9c` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:42:09.783265 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eb25752-a658-4364-9c92-a44cc1be0bc6 None admin] RBAC: Authorizing `identity:get_project(project_id=42293c5d76254690ab29c96f76687d9c)` {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:42:09.784777 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eb25752-a658-4364-9c92-a44cc1be0bc6 None admin] RBAC: Authorization granted {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:42:09.786658 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 67/136] 10.222.0.84 () {56 vars in 1186 bytes} [Wed May 25 14:42:09 2022] GET /identity/v3/projects/42293c5d76254690ab29c96f76687d9c => generated 298 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 14:42:09.793439 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2d85587-06fe-41b9-96e9-65e6078c0db3 None admin] Authenticating user token {{(pid=101893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:42:09.837895 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG dbcounter [-] [101893] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=101893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:42:09.930246 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2d85587-06fe-41b9-96e9-65e6078c0db3 None admin] Validating token access rules against request {{(pid=101893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:42:09.967729 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14f3fa58-10b7-40fe-bf11-da38020e9a65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:42:09.968639 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f3fa58-10b7-40fe-bf11-da38020e9a65 None admin] REQUEST_METHOD: `PUT` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:42:09.968926 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f3fa58-10b7-40fe-bf11-da38020e9a65 None admin] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:42:09.969211 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f3fa58-10b7-40fe-bf11-da38020e9a65 None admin] PATH_INFO: `/v3/projects/42293c5d76254690ab29c96f76687d9c/users/376a0503e64e47c795f924714268e715/roles/d3defd94f93b4e76af116df691240185` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:42:09.971484 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14f3fa58-10b7-40fe-bf11-da38020e9a65 None admin] RBAC: Authorizing `identity:create_grant(project_id=42293c5d76254690ab29c96f76687d9c, user_id=376a0503e64e47c795f924714268e715, role_id=d3defd94f93b4e76af116df691240185)` {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:42:09.972974 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14f3fa58-10b7-40fe-bf11-da38020e9a65 None admin] RBAC: Authorization granted {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:42:10.052399 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 70/137] 10.222.0.84 () {58 vars in 1439 bytes} [Wed May 25 14:42:09 2022] PUT /identity/v3/projects/42293c5d76254690ab29c96f76687d9c/users/376a0503e64e47c795f924714268e715/roles/d3defd94f93b4e76af116df691240185 => generated 0 bytes in 259 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 14:42:10.201340 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400b15c6-aab7-4506-9c78-c3b72016b8db None None] REQUEST_METHOD: `GET` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:42:10.201872 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400b15c6-aab7-4506-9c78-c3b72016b8db None None] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:42:10.201965 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400b15c6-aab7-4506-9c78-c3b72016b8db None None] PATH_INFO: `/` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:42:10.203296 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 68/138] 10.222.0.84 () {54 vars in 926 bytes} [Wed May 25 14:42:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 14:42:10.208950 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eebf211-2f02-4896-9a97-0ebe6905918c None None] REQUEST_METHOD: `POST` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:42:10.209245 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eebf211-2f02-4896-9a97-0ebe6905918c None None] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:42:10.209533 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eebf211-2f02-4896-9a97-0ebe6905918c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:42:10.238409 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.auth.core [None req-3eebf211-2f02-4896-9a97-0ebe6905918c None None] MFA Rules not processed for user `05d87e87798e429aa1c10b24391f915e`. Rule list: `[]` (Enabled: `True`). {{(pid=101893) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:42:10.239680 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.fernet_utils [None req-3eebf211-2f02-4896-9a97-0ebe6905918c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=101893) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:42:10.318665 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 71/139] 10.222.0.84 () {58 vars in 1023 bytes} [Wed May 25 14:42:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 25 14:42:10.344723 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-400b15c6-aab7-4506-9c78-c3b72016b8db None None] Authenticating user token {{(pid=101892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:42:10.455489 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-400b15c6-aab7-4506-9c78-c3b72016b8db None None] Validating token access rules against request {{(pid=101892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:42:10.486834 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG dbcounter [-] [101892] Writing DB stats keystone:SELECT=100 {{(pid=101892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:42:10.493348 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc412052-22d6-4238-9536-84d2b17d5cba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:42:10.494501 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc412052-22d6-4238-9536-84d2b17d5cba None admin] REQUEST_METHOD: `GET` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:42:10.495053 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc412052-22d6-4238-9536-84d2b17d5cba None admin] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:42:10.495535 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc412052-22d6-4238-9536-84d2b17d5cba None admin] PATH_INFO: `/v3/domains/default` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:42:10.497078 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc412052-22d6-4238-9536-84d2b17d5cba None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:42:10.498874 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc412052-22d6-4238-9536-84d2b17d5cba None admin] RBAC: Authorization granted {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:42:10.501606 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 69/140] 10.222.0.84 () {56 vars in 1108 bytes} [Wed May 25 14:42:10 2022] GET /identity/v3/domains/default => generated 199 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:42:10.507572 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eebf211-2f02-4896-9a97-0ebe6905918c None None] Authenticating user token {{(pid=101893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:42:10.528476 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG dbcounter [-] [101893] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=101893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:42:10.653900 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eebf211-2f02-4896-9a97-0ebe6905918c None None] Validating token access rules against request {{(pid=101893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:42:10.709025 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94c22618-22ac-432c-ba2f-8e6d35c34423 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:42:10.709905 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c22618-22ac-432c-ba2f-8e6d35c34423 None admin] REQUEST_METHOD: `POST` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:42:10.710335 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c22618-22ac-432c-ba2f-8e6d35c34423 None admin] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:42:10.710715 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c22618-22ac-432c-ba2f-8e6d35c34423 None admin] PATH_INFO: `/v3/users` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:42:10.711539 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94c22618-22ac-432c-ba2f-8e6d35c34423 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:42:10.713147 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94c22618-22ac-432c-ba2f-8e6d35c34423 None admin] RBAC: Authorization granted {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:42:10.751131 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b6be3a-c22f-4725-8a0c-78804ad956b5 None None] REQUEST_METHOD: `GET` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:42:10.751443 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b6be3a-c22f-4725-8a0c-78804ad956b5 None None] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:42:10.751738 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b6be3a-c22f-4725-8a0c-78804ad956b5 None None] PATH_INFO: `/` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:42:10.753259 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 70/141] 10.222.0.84 () {54 vars in 926 bytes} [Wed May 25 14:42:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 25 14:42:10.758401 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db38996-7c7b-489d-83d5-703d1b905fbe None None] REQUEST_METHOD: `POST` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:42:10.758693 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db38996-7c7b-489d-83d5-703d1b905fbe None None] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:42:10.758978 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db38996-7c7b-489d-83d5-703d1b905fbe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:42:10.786222 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.auth.core [None req-2db38996-7c7b-489d-83d5-703d1b905fbe None None] MFA Rules not processed for user `05d87e87798e429aa1c10b24391f915e`. Rule list: `[]` (Enabled: `True`). {{(pid=101892) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:42:10.787427 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.fernet_utils [None req-2db38996-7c7b-489d-83d5-703d1b905fbe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=101892) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:42:10.828096 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 72/142] 10.222.0.84 () {60 vars in 1132 bytes} [Wed May 25 14:42:10 2022] POST /identity/v3/users => generated 283 bytes in 321 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 14:42:10.875018 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 71/143] 10.222.0.84 () {58 vars in 1023 bytes} [Wed May 25 14:42:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 25 14:42:10.917806 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94c22618-22ac-432c-ba2f-8e6d35c34423 None admin] Authenticating user token {{(pid=101893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:42:11.010837 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG dbcounter [-] [101893] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=101893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:42:11.044517 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94c22618-22ac-432c-ba2f-8e6d35c34423 None admin] Validating token access rules against request {{(pid=101893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:42:11.099023 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbeb02f3-5193-477e-a233-6a9fececa4d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:42:11.099868 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbeb02f3-5193-477e-a233-6a9fececa4d8 None admin] REQUEST_METHOD: `GET` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:42:11.100161 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbeb02f3-5193-477e-a233-6a9fececa4d8 None admin] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:42:11.100440 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbeb02f3-5193-477e-a233-6a9fececa4d8 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:42:11.111980 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbeb02f3-5193-477e-a233-6a9fececa4d8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 14:42:11.119860 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application [None req-bbeb02f3-5193-477e-a233-6a9fececa4d8 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 25 14:42:11.119860 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:42:11.119860 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 14:42:11.119860 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 14:42:11.119860 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 14:42:11.119860 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 14:42:11.119860 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 14:42:11.119860 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 14:42:11.119860 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 14:42:11.119860 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 14:42:11.119860 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 14:42:11.119860 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 14:42:11.119860 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 14:42:11.119860 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 14:42:11.119860 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 14:42:11.119860 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 14:42:11.120767 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 14:42:11.120767 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 14:42:11.120767 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 14:42:11.120767 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 14:42:11.120767 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 14:42:11.120767 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 14:42:11.120767 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 14:42:11.120767 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 14:42:11.120767 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 14:42:11.120767 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return self.get_or_create( May 25 14:42:11.120767 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 14:42:11.120767 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application with Lock( May 25 14:42:11.120767 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 14:42:11.120767 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return self._enter() May 25 14:42:11.120767 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 14:42:11.120767 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 14:42:11.121640 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 14:42:11.121640 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return self.creator() May 25 14:42:11.121640 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 14:42:11.121640 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application created_value = creator( May 25 14:42:11.121640 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 14:42:11.121640 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 14:42:11.121640 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 14:42:11.121640 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 14:42:11.121640 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 14:42:11.121640 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 14:42:11.121640 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 25 14:42:11.121640 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application May 25 14:42:11.124326 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 73/144] 10.222.0.84 () {56 vars in 1099 bytes} [Wed May 25 14:42:10 2022] GET /identity/v3/roles/reader => generated 84 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 14:42:11.127572 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db38996-7c7b-489d-83d5-703d1b905fbe None None] Authenticating user token {{(pid=101892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:42:11.255664 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db38996-7c7b-489d-83d5-703d1b905fbe None None] Validating token access rules against request {{(pid=101892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:42:11.287957 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG dbcounter [-] [101892] Writing DB stats keystone:SELECT=100 {{(pid=101892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:42:11.295900 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7da21fa4-013f-4cbc-a3e9-a532fd6d25bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:42:11.296601 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da21fa4-013f-4cbc-a3e9-a532fd6d25bb None admin] REQUEST_METHOD: `GET` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:42:11.296893 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da21fa4-013f-4cbc-a3e9-a532fd6d25bb None admin] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:42:11.297179 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da21fa4-013f-4cbc-a3e9-a532fd6d25bb None admin] PATH_INFO: `/v3/roles` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:42:11.297939 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7da21fa4-013f-4cbc-a3e9-a532fd6d25bb None admin] RBAC: Adding query filter params (name=reader) {{(pid=101892) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:42:11.298252 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7da21fa4-013f-4cbc-a3e9-a532fd6d25bb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:42:11.299663 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7da21fa4-013f-4cbc-a3e9-a532fd6d25bb None admin] RBAC: Authorization granted {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:42:11.308716 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 72/145] 10.222.0.84 () {56 vars in 1101 bytes} [Wed May 25 14:42:11 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:42:11.313985 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbeb02f3-5193-477e-a233-6a9fececa4d8 None admin] Authenticating user token {{(pid=101893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:42:11.460931 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbeb02f3-5193-477e-a233-6a9fececa4d8 None admin] Validating token access rules against request {{(pid=101893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:42:11.495274 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG dbcounter [-] [101893] Writing DB stats keystone:SELECT=100 {{(pid=101893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:42:11.505618 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83c03dc1-e3c3-468c-b039-fb99a1d9d25d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:42:11.506562 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c03dc1-e3c3-468c-b039-fb99a1d9d25d None admin] REQUEST_METHOD: `GET` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:42:11.506792 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c03dc1-e3c3-468c-b039-fb99a1d9d25d None admin] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:42:11.507072 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c03dc1-e3c3-468c-b039-fb99a1d9d25d None admin] PATH_INFO: `/v3/users/769e12fb3925457a822476ecd804439a` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:42:11.508315 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83c03dc1-e3c3-468c-b039-fb99a1d9d25d None admin] RBAC: Authorizing `identity:get_user(user_id=769e12fb3925457a822476ecd804439a)` {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:42:11.509795 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83c03dc1-e3c3-468c-b039-fb99a1d9d25d None admin] RBAC: Authorization granted {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:42:11.511993 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 74/146] 10.222.0.84 () {56 vars in 1177 bytes} [Wed May 25 14:42:11 2022] GET /identity/v3/users/769e12fb3925457a822476ecd804439a => generated 289 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:42:11.517458 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7da21fa4-013f-4cbc-a3e9-a532fd6d25bb None admin] Authenticating user token {{(pid=101892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:42:11.670928 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7da21fa4-013f-4cbc-a3e9-a532fd6d25bb None admin] Validating token access rules against request {{(pid=101892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:42:11.707841 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0727bcc2-7089-45ab-8fe0-41b51cd7b7df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:42:11.708718 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0727bcc2-7089-45ab-8fe0-41b51cd7b7df None admin] REQUEST_METHOD: `GET` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:42:11.709002 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0727bcc2-7089-45ab-8fe0-41b51cd7b7df None admin] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:42:11.709279 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0727bcc2-7089-45ab-8fe0-41b51cd7b7df None admin] PATH_INFO: `/v3/projects/42293c5d76254690ab29c96f76687d9c` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:42:11.710479 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0727bcc2-7089-45ab-8fe0-41b51cd7b7df None admin] RBAC: Authorizing `identity:get_project(project_id=42293c5d76254690ab29c96f76687d9c)` {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:42:11.711982 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0727bcc2-7089-45ab-8fe0-41b51cd7b7df None admin] RBAC: Authorization granted {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:42:11.714637 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 73/147] 10.222.0.84 () {56 vars in 1186 bytes} [Wed May 25 14:42:11 2022] GET /identity/v3/projects/42293c5d76254690ab29c96f76687d9c => generated 298 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:42:11.722308 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83c03dc1-e3c3-468c-b039-fb99a1d9d25d None admin] Authenticating user token {{(pid=101893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:42:11.872140 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83c03dc1-e3c3-468c-b039-fb99a1d9d25d None admin] Validating token access rules against request {{(pid=101893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:42:11.908110 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7f202c2-9e61-4937-a9e6-f804106b3967 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:42:11.909240 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f202c2-9e61-4937-a9e6-f804106b3967 None admin] REQUEST_METHOD: `PUT` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:42:11.909688 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f202c2-9e61-4937-a9e6-f804106b3967 None admin] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:42:11.910109 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f202c2-9e61-4937-a9e6-f804106b3967 None admin] PATH_INFO: `/v3/projects/42293c5d76254690ab29c96f76687d9c/users/769e12fb3925457a822476ecd804439a/roles/d289ba5202044f90baf900bb40b116b8` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:42:11.912297 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7f202c2-9e61-4937-a9e6-f804106b3967 None admin] RBAC: Authorizing `identity:create_grant(project_id=42293c5d76254690ab29c96f76687d9c, user_id=769e12fb3925457a822476ecd804439a, role_id=d289ba5202044f90baf900bb40b116b8)` {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:42:11.914013 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7f202c2-9e61-4937-a9e6-f804106b3967 None admin] RBAC: Authorization granted {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:42:11.973034 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21f2aaa-5e0c-4be2-bb94-8f7b3f1d0da7 None None] REQUEST_METHOD: `GET` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:42:11.973327 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21f2aaa-5e0c-4be2-bb94-8f7b3f1d0da7 None None] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:42:11.973616 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21f2aaa-5e0c-4be2-bb94-8f7b3f1d0da7 None None] PATH_INFO: `/` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:42:11.975425 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 74/148] 10.222.0.84 () {54 vars in 926 bytes} [Wed May 25 14:42:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 14:42:11.981652 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36186c92-6f56-401e-80cc-1142e258daa6 None None] REQUEST_METHOD: `POST` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:42:11.981955 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36186c92-6f56-401e-80cc-1142e258daa6 None None] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:42:11.982239 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36186c92-6f56-401e-80cc-1142e258daa6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:42:12.005856 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 75/149] 10.222.0.84 () {58 vars in 1439 bytes} [Wed May 25 14:42:11 2022] PUT /identity/v3/projects/42293c5d76254690ab29c96f76687d9c/users/769e12fb3925457a822476ecd804439a/roles/d289ba5202044f90baf900bb40b116b8 => generated 0 bytes in 284 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 14:42:12.011976 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.auth.core [None req-36186c92-6f56-401e-80cc-1142e258daa6 None None] MFA Rules not processed for user `05d87e87798e429aa1c10b24391f915e`. Rule list: `[]` (Enabled: `True`). {{(pid=101892) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:42:12.011976 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.fernet_utils [None req-36186c92-6f56-401e-80cc-1142e258daa6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=101892) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:42:12.087524 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG dbcounter [-] [101892] Writing DB stats keystone:SELECT=100 {{(pid=101892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:42:12.107032 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 75/150] 10.222.0.84 () {58 vars in 1023 bytes} [Wed May 25 14:42:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 25 14:42:12.146457 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7f202c2-9e61-4937-a9e6-f804106b3967 None admin] Authenticating user token {{(pid=101893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:42:12.222675 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG dbcounter [-] [101893] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=101893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:42:12.274956 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7f202c2-9e61-4937-a9e6-f804106b3967 None admin] Validating token access rules against request {{(pid=101893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:42:12.312237 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e9b65d0-f6bb-4731-abfb-0250b0dd0fdb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:42:12.313067 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e9b65d0-f6bb-4731-abfb-0250b0dd0fdb None admin] REQUEST_METHOD: `GET` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:42:12.313355 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e9b65d0-f6bb-4731-abfb-0250b0dd0fdb None admin] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:42:12.313638 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e9b65d0-f6bb-4731-abfb-0250b0dd0fdb None admin] PATH_INFO: `/v3/roles/admin` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:42:12.329424 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e9b65d0-f6bb-4731-abfb-0250b0dd0fdb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 14:42:12.337453 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application [None req-5e9b65d0-f6bb-4731-abfb-0250b0dd0fdb None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 25 14:42:12.337453 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:42:12.337453 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 14:42:12.337453 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 14:42:12.337453 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 14:42:12.337453 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 14:42:12.337453 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 14:42:12.337453 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 14:42:12.337453 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 14:42:12.337453 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 14:42:12.337453 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 14:42:12.337453 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 14:42:12.337453 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 14:42:12.337453 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 14:42:12.337453 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 14:42:12.337453 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 14:42:12.338420 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 14:42:12.338420 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 14:42:12.338420 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 14:42:12.338420 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 14:42:12.338420 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 14:42:12.338420 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 14:42:12.338420 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 14:42:12.338420 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 14:42:12.338420 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 14:42:12.338420 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return self.get_or_create( May 25 14:42:12.338420 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 14:42:12.338420 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application with Lock( May 25 14:42:12.338420 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 14:42:12.338420 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return self._enter() May 25 14:42:12.338420 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 14:42:12.338420 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 14:42:12.339701 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 14:42:12.339701 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return self.creator() May 25 14:42:12.339701 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 14:42:12.339701 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application created_value = creator( May 25 14:42:12.339701 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 14:42:12.339701 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 14:42:12.339701 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 14:42:12.339701 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 14:42:12.339701 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 14:42:12.339701 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 14:42:12.339701 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 25 14:42:12.339701 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application May 25 14:42:12.339701 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 76/151] 10.222.0.84 () {56 vars in 1096 bytes} [Wed May 25 14:42:12 2022] GET /identity/v3/roles/admin => generated 83 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 14:42:12.344959 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36186c92-6f56-401e-80cc-1142e258daa6 None None] Authenticating user token {{(pid=101892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:42:12.358280 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ca7e0f-e2a6-4a78-a41b-91fcffe23650 None None] REQUEST_METHOD: `GET` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:42:12.358584 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ca7e0f-e2a6-4a78-a41b-91fcffe23650 None None] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:42:12.358844 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ca7e0f-e2a6-4a78-a41b-91fcffe23650 None None] PATH_INFO: `/` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:42:12.362349 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 77/152] 10.222.0.84 () {54 vars in 926 bytes} [Wed May 25 14:42:12 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 14:42:12.365911 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d673421a-b107-4324-bc45-d7ed2251f123 None None] REQUEST_METHOD: `POST` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:42:12.366204 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d673421a-b107-4324-bc45-d7ed2251f123 None None] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:42:12.366484 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d673421a-b107-4324-bc45-d7ed2251f123 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:42:12.395548 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.auth.core [None req-d673421a-b107-4324-bc45-d7ed2251f123 None None] MFA Rules not processed for user `05d87e87798e429aa1c10b24391f915e`. Rule list: `[]` (Enabled: `True`). {{(pid=101893) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:42:12.396954 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.fernet_utils [None req-d673421a-b107-4324-bc45-d7ed2251f123 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=101893) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:42:12.485077 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 78/153] 10.222.0.84 () {58 vars in 1023 bytes} [Wed May 25 14:42:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 25 14:42:12.516034 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d673421a-b107-4324-bc45-d7ed2251f123 None None] Authenticating user token {{(pid=101893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:42:12.542168 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36186c92-6f56-401e-80cc-1142e258daa6 None None] Validating token access rules against request {{(pid=101892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:42:12.588493 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG dbcounter [-] [101893] Writing DB stats keystone:SELECT=100 {{(pid=101893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:42:12.636307 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22d285d4-2e18-45cb-ba8d-35338e858f21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:42:12.636999 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d285d4-2e18-45cb-ba8d-35338e858f21 None admin] REQUEST_METHOD: `GET` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:42:12.637291 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d285d4-2e18-45cb-ba8d-35338e858f21 None admin] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:42:12.637563 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d285d4-2e18-45cb-ba8d-35338e858f21 None admin] PATH_INFO: `/v3/roles` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:42:12.638337 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22d285d4-2e18-45cb-ba8d-35338e858f21 None admin] RBAC: Adding query filter params (name=admin) {{(pid=101892) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:42:12.638650 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22d285d4-2e18-45cb-ba8d-35338e858f21 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:42:12.640087 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22d285d4-2e18-45cb-ba8d-35338e858f21 None admin] RBAC: Authorization granted {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:42:12.651869 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d673421a-b107-4324-bc45-d7ed2251f123 None None] Validating token access rules against request {{(pid=101893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:42:12.653139 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 76/154] 10.222.0.84 () {56 vars in 1099 bytes} [Wed May 25 14:42:12 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 309 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:42:12.658569 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22d285d4-2e18-45cb-ba8d-35338e858f21 None admin] Authenticating user token {{(pid=101892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:42:12.711281 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0214f0d9-1453-4655-ad52-a423b433c65d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:42:12.713822 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0214f0d9-1453-4655-ad52-a423b433c65d None admin] REQUEST_METHOD: `GET` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:42:12.716758 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0214f0d9-1453-4655-ad52-a423b433c65d None admin] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:42:12.717217 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0214f0d9-1453-4655-ad52-a423b433c65d None admin] PATH_INFO: `/v3/roles/member` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:42:12.745063 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0214f0d9-1453-4655-ad52-a423b433c65d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 14:42:12.752446 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG dbcounter [-] [101892] Writing DB stats keystone:SELECT=100 {{(pid=101892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:42:12.753498 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application [None req-0214f0d9-1453-4655-ad52-a423b433c65d None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 25 14:42:12.753498 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:42:12.753498 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 14:42:12.753498 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 14:42:12.753498 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 14:42:12.753498 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 14:42:12.753498 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 14:42:12.753498 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 14:42:12.753498 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 14:42:12.753498 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 14:42:12.753498 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 14:42:12.753498 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 14:42:12.753498 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 14:42:12.753498 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 14:42:12.753498 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 14:42:12.753498 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 14:42:12.754437 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 14:42:12.754437 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 14:42:12.754437 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 14:42:12.754437 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 14:42:12.754437 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 14:42:12.754437 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 14:42:12.754437 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 14:42:12.754437 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 14:42:12.754437 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 14:42:12.754437 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return self.get_or_create( May 25 14:42:12.754437 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 14:42:12.754437 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application with Lock( May 25 14:42:12.754437 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 14:42:12.754437 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return self._enter() May 25 14:42:12.754437 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 14:42:12.754437 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 14:42:12.755210 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 14:42:12.755210 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return self.creator() May 25 14:42:12.755210 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 14:42:12.755210 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application created_value = creator( May 25 14:42:12.755210 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 14:42:12.755210 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 14:42:12.755210 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 14:42:12.755210 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 14:42:12.755210 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 14:42:12.755210 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 14:42:12.755210 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 25 14:42:12.755210 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application May 25 14:42:12.755210 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 79/155] 10.222.0.84 () {56 vars in 1099 bytes} [Wed May 25 14:42:12 2022] GET /identity/v3/roles/member => generated 84 bytes in 240 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 25 14:42:12.780627 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0214f0d9-1453-4655-ad52-a423b433c65d None admin] Authenticating user token {{(pid=101893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:42:12.816001 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22d285d4-2e18-45cb-ba8d-35338e858f21 None admin] Validating token access rules against request {{(pid=101892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:42:12.852877 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef586d47-3de3-427f-87b0-a5017d793001 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:42:12.854726 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef586d47-3de3-427f-87b0-a5017d793001 None admin] REQUEST_METHOD: `GET` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:42:12.855148 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef586d47-3de3-427f-87b0-a5017d793001 None admin] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:42:12.855611 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef586d47-3de3-427f-87b0-a5017d793001 None admin] PATH_INFO: `/v3/users/05d87e87798e429aa1c10b24391f915e` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:42:12.856966 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef586d47-3de3-427f-87b0-a5017d793001 None admin] RBAC: Authorizing `identity:get_user(user_id=05d87e87798e429aa1c10b24391f915e)` {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:42:12.858551 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef586d47-3de3-427f-87b0-a5017d793001 None admin] RBAC: Authorization granted {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:42:12.860396 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 77/156] 10.222.0.84 () {56 vars in 1177 bytes} [Wed May 25 14:42:12 2022] GET /identity/v3/users/05d87e87798e429aa1c10b24391f915e => generated 247 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:42:12.868554 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef586d47-3de3-427f-87b0-a5017d793001 None admin] Authenticating user token {{(pid=101892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:42:13.007144 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef586d47-3de3-427f-87b0-a5017d793001 None admin] Validating token access rules against request {{(pid=101892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:42:13.019440 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0214f0d9-1453-4655-ad52-a423b433c65d None admin] Validating token access rules against request {{(pid=101893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:42:13.034996 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG dbcounter [-] [101892] Writing DB stats keystone:SELECT=100 {{(pid=101892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:42:13.037335 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG dbcounter [-] [101893] Writing DB stats keystone:SELECT=100 {{(pid=101893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:42:13.058830 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9abcc9cb-9f62-4b7e-b0cd-900de58006a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:42:13.059490 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9abcc9cb-9f62-4b7e-b0cd-900de58006a3 None admin] REQUEST_METHOD: `GET` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:42:13.062128 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9abcc9cb-9f62-4b7e-b0cd-900de58006a3 None admin] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:42:13.062128 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9abcc9cb-9f62-4b7e-b0cd-900de58006a3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:42:13.108456 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5135eef-3885-4a47-a609-0051287cf9eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:42:13.109556 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5135eef-3885-4a47-a609-0051287cf9eb None admin] REQUEST_METHOD: `GET` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:42:13.110056 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5135eef-3885-4a47-a609-0051287cf9eb None admin] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:42:13.110597 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5135eef-3885-4a47-a609-0051287cf9eb None admin] PATH_INFO: `/v3/roles` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:42:13.111592 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5135eef-3885-4a47-a609-0051287cf9eb None admin] RBAC: Adding query filter params (name=member) {{(pid=101893) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:42:13.112107 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5135eef-3885-4a47-a609-0051287cf9eb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:42:13.113722 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5135eef-3885-4a47-a609-0051287cf9eb None admin] RBAC: Authorization granted {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:42:13.130881 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 80/157] 10.222.0.84 () {56 vars in 1101 bytes} [Wed May 25 14:42:12 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 351 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:42:13.143260 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5135eef-3885-4a47-a609-0051287cf9eb None admin] Authenticating user token {{(pid=101893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:42:13.162782 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9abcc9cb-9f62-4b7e-b0cd-900de58006a3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:42:13.164364 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9abcc9cb-9f62-4b7e-b0cd-900de58006a3 None admin] RBAC: Authorization granted {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:42:13.285375 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 78/158] 10.222.0.84 () {58 vars in 1282 bytes} [Wed May 25 14:42:12 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 417 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 25 14:42:13.290771 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9abcc9cb-9f62-4b7e-b0cd-900de58006a3 None admin] Authenticating user token {{(pid=101892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:42:13.310555 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG dbcounter [-] [101892] Writing DB stats keystone:SELECT=100 {{(pid=101892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:42:13.396142 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9abcc9cb-9f62-4b7e-b0cd-900de58006a3 None admin] Validating token access rules against request {{(pid=101892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:42:13.401461 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5135eef-3885-4a47-a609-0051287cf9eb None admin] Validating token access rules against request {{(pid=101893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:42:13.435345 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7ab8dd4-8bf5-4d0a-a99f-ae16db8b8d95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:42:13.436276 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ab8dd4-8bf5-4d0a-a99f-ae16db8b8d95 None admin] REQUEST_METHOD: `GET` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:42:13.436548 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ab8dd4-8bf5-4d0a-a99f-ae16db8b8d95 None admin] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:42:13.436824 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ab8dd4-8bf5-4d0a-a99f-ae16db8b8d95 None admin] PATH_INFO: `/v3/projects/42293c5d76254690ab29c96f76687d9c` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:42:13.438290 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7ab8dd4-8bf5-4d0a-a99f-ae16db8b8d95 None admin] RBAC: Authorizing `identity:get_project(project_id=42293c5d76254690ab29c96f76687d9c)` {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:42:13.439708 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7ab8dd4-8bf5-4d0a-a99f-ae16db8b8d95 None admin] RBAC: Authorization granted {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:42:13.441719 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 79/159] 10.222.0.84 () {56 vars in 1186 bytes} [Wed May 25 14:42:13 2022] GET /identity/v3/projects/42293c5d76254690ab29c96f76687d9c => generated 298 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 14:42:13.447551 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7ab8dd4-8bf5-4d0a-a99f-ae16db8b8d95 None admin] Authenticating user token {{(pid=101892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:42:13.500377 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d9f366c-5803-45de-a222-6d0025f41dbd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:42:13.501895 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9f366c-5803-45de-a222-6d0025f41dbd None admin] REQUEST_METHOD: `GET` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:42:13.502432 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9f366c-5803-45de-a222-6d0025f41dbd None admin] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:42:13.502926 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9f366c-5803-45de-a222-6d0025f41dbd None admin] PATH_INFO: `/v3/users/376a0503e64e47c795f924714268e715` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:42:13.504563 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d9f366c-5803-45de-a222-6d0025f41dbd None admin] RBAC: Authorizing `identity:get_user(user_id=376a0503e64e47c795f924714268e715)` {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:42:13.506268 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d9f366c-5803-45de-a222-6d0025f41dbd None admin] RBAC: Authorization granted {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:42:13.508175 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 81/160] 10.222.0.84 () {56 vars in 1177 bytes} [Wed May 25 14:42:13 2022] GET /identity/v3/users/376a0503e64e47c795f924714268e715 => generated 275 bytes in 366 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 14:42:13.533393 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d9f366c-5803-45de-a222-6d0025f41dbd None admin] Authenticating user token {{(pid=101893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:42:13.548402 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG dbcounter [-] [101892] Writing DB stats keystone:SELECT=100 {{(pid=101892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:42:13.568667 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7ab8dd4-8bf5-4d0a-a99f-ae16db8b8d95 None admin] Validating token access rules against request {{(pid=101892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:42:13.604891 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11204a2e-77d0-4ddf-84f7-9561d41205be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:42:13.605550 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11204a2e-77d0-4ddf-84f7-9561d41205be None admin] REQUEST_METHOD: `GET` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:42:13.605833 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11204a2e-77d0-4ddf-84f7-9561d41205be None admin] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:42:13.606111 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11204a2e-77d0-4ddf-84f7-9561d41205be None admin] PATH_INFO: `/v3/role_assignments` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:42:13.606945 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11204a2e-77d0-4ddf-84f7-9561d41205be None admin] RBAC: Adding query filter params (role.id=a3b78e7d547d4d2d998b4c99a4396bba, scope.project.id=42293c5d76254690ab29c96f76687d9c, user.id=05d87e87798e429aa1c10b24391f915e) {{(pid=101892) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:42:13.607259 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11204a2e-77d0-4ddf-84f7-9561d41205be None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:42:13.608809 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11204a2e-77d0-4ddf-84f7-9561d41205be None admin] RBAC: Authorization granted {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:42:13.615111 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 80/161] 10.222.0.84 () {56 vars in 1374 bytes} [Wed May 25 14:42:13 2022] GET /identity/v3/role_assignments?user.id=05d87e87798e429aa1c10b24391f915e&scope.project.id=42293c5d76254690ab29c96f76687d9c&role.id=a3b78e7d547d4d2d998b4c99a4396bba => generated 608 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 14:42:13.663081 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG dbcounter [-] [101893] Writing DB stats keystone:SELECT=100 {{(pid=101893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:42:13.723201 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d9f366c-5803-45de-a222-6d0025f41dbd None admin] Validating token access rules against request {{(pid=101893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:42:13.761873 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7d39aec-dbde-4e05-a152-b26e1d8690e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:42:13.762548 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d39aec-dbde-4e05-a152-b26e1d8690e3 None admin] REQUEST_METHOD: `GET` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:42:13.762833 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d39aec-dbde-4e05-a152-b26e1d8690e3 None admin] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:42:13.763111 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d39aec-dbde-4e05-a152-b26e1d8690e3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:42:13.836955 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7d39aec-dbde-4e05-a152-b26e1d8690e3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:42:13.838981 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7d39aec-dbde-4e05-a152-b26e1d8690e3 None admin] RBAC: Authorization granted {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:42:13.885878 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG dbcounter [-] [101893] Writing DB stats keystone:SELECT=100 {{(pid=101893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:42:13.888007 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe51df50-1f76-443c-a00a-47a6f4e587f6 None None] REQUEST_METHOD: `GET` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:42:13.888299 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe51df50-1f76-443c-a00a-47a6f4e587f6 None None] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:42:13.888577 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe51df50-1f76-443c-a00a-47a6f4e587f6 None None] PATH_INFO: `/` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:42:13.890273 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 81/162] 10.222.0.84 () {54 vars in 926 bytes} [Wed May 25 14:42:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 14:42:13.901746 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2c86e5-3deb-400d-beb7-d1a1e34cb1a3 None None] REQUEST_METHOD: `POST` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:42:13.902051 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2c86e5-3deb-400d-beb7-d1a1e34cb1a3 None None] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:42:13.902304 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2c86e5-3deb-400d-beb7-d1a1e34cb1a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:42:13.940633 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.auth.core [None req-3f2c86e5-3deb-400d-beb7-d1a1e34cb1a3 None None] MFA Rules not processed for user `05d87e87798e429aa1c10b24391f915e`. Rule list: `[]` (Enabled: `True`). {{(pid=101892) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:42:13.941843 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.fernet_utils [None req-3f2c86e5-3deb-400d-beb7-d1a1e34cb1a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=101892) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:42:13.950192 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 82/163] 10.222.0.84 () {58 vars in 1282 bytes} [Wed May 25 14:42:13 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 417 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 25 14:42:13.955513 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7d39aec-dbde-4e05-a152-b26e1d8690e3 None admin] Authenticating user token {{(pid=101893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:42:14.081248 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 82/164] 10.222.0.84 () {58 vars in 1023 bytes} [Wed May 25 14:42:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 25 14:42:14.082558 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7d39aec-dbde-4e05-a152-b26e1d8690e3 None admin] Validating token access rules against request {{(pid=101893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:42:14.125097 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f2c86e5-3deb-400d-beb7-d1a1e34cb1a3 None None] Authenticating user token {{(pid=101892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:42:14.160283 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-055d2a87-c45b-4c61-9865-35d94a019eb3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:42:14.161165 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-055d2a87-c45b-4c61-9865-35d94a019eb3 None admin] REQUEST_METHOD: `GET` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:42:14.161452 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-055d2a87-c45b-4c61-9865-35d94a019eb3 None admin] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:42:14.161728 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-055d2a87-c45b-4c61-9865-35d94a019eb3 None admin] PATH_INFO: `/v3/projects/42293c5d76254690ab29c96f76687d9c` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:42:14.163159 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-055d2a87-c45b-4c61-9865-35d94a019eb3 None admin] RBAC: Authorizing `identity:get_project(project_id=42293c5d76254690ab29c96f76687d9c)` {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:42:14.164781 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-055d2a87-c45b-4c61-9865-35d94a019eb3 None admin] RBAC: Authorization granted {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:42:14.166547 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 83/165] 10.222.0.84 () {56 vars in 1186 bytes} [Wed May 25 14:42:13 2022] GET /identity/v3/projects/42293c5d76254690ab29c96f76687d9c => generated 298 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 14:42:14.172203 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-055d2a87-c45b-4c61-9865-35d94a019eb3 None admin] Authenticating user token {{(pid=101893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:42:14.184191 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG dbcounter [-] [101893] Writing DB stats keystone:SELECT=100 {{(pid=101893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:42:14.236251 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG dbcounter [-] [101892] Writing DB stats keystone:SELECT=100 {{(pid=101892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:42:14.259337 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f2c86e5-3deb-400d-beb7-d1a1e34cb1a3 None None] Validating token access rules against request {{(pid=101892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:42:14.304630 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e175b080-2981-4d10-b14f-de797b88a0d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:42:14.305588 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e175b080-2981-4d10-b14f-de797b88a0d6 None admin] REQUEST_METHOD: `GET` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:42:14.305874 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e175b080-2981-4d10-b14f-de797b88a0d6 None admin] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:42:14.306152 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e175b080-2981-4d10-b14f-de797b88a0d6 None admin] PATH_INFO: `/v3/roles/member` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:42:14.319327 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e175b080-2981-4d10-b14f-de797b88a0d6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 14:42:14.329690 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application [None req-e175b080-2981-4d10-b14f-de797b88a0d6 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 25 14:42:14.329690 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:42:14.329690 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 14:42:14.329690 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 14:42:14.329690 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 14:42:14.329690 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 14:42:14.329690 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 14:42:14.329690 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 14:42:14.329690 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 14:42:14.329690 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 14:42:14.329690 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 14:42:14.329690 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 14:42:14.329690 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 14:42:14.329690 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 14:42:14.329690 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 14:42:14.329690 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 14:42:14.330587 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 14:42:14.330587 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 14:42:14.330587 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 14:42:14.330587 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 14:42:14.330587 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 14:42:14.330587 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 14:42:14.330587 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 14:42:14.330587 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 14:42:14.330587 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 14:42:14.330587 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application return self.get_or_create( May 25 14:42:14.330587 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 14:42:14.330587 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application with Lock( May 25 14:42:14.330587 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 14:42:14.330587 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application return self._enter() May 25 14:42:14.330587 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 14:42:14.330587 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 14:42:14.331605 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 14:42:14.331605 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application return self.creator() May 25 14:42:14.331605 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 14:42:14.331605 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application created_value = creator( May 25 14:42:14.331605 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 14:42:14.331605 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 14:42:14.331605 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 14:42:14.331605 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 14:42:14.331605 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 14:42:14.331605 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 14:42:14.331605 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 25 14:42:14.331605 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application May 25 14:42:14.331605 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 83/166] 10.222.0.84 () {56 vars in 1099 bytes} [Wed May 25 14:42:14 2022] GET /identity/v3/roles/member => generated 84 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 14:42:14.337553 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e175b080-2981-4d10-b14f-de797b88a0d6 None admin] Authenticating user token {{(pid=101892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:42:14.387958 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-055d2a87-c45b-4c61-9865-35d94a019eb3 None admin] Validating token access rules against request {{(pid=101893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:42:14.454838 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a15eaa7-f883-4762-a712-26c616418210 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:42:14.456326 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a15eaa7-f883-4762-a712-26c616418210 None admin] REQUEST_METHOD: `GET` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:42:14.456789 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a15eaa7-f883-4762-a712-26c616418210 None admin] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:42:14.457239 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a15eaa7-f883-4762-a712-26c616418210 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:42:14.458272 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a15eaa7-f883-4762-a712-26c616418210 None admin] RBAC: Adding query filter params (role.id=ff664fa0db7e4262a5accde96c3df4c3, scope.project.id=42293c5d76254690ab29c96f76687d9c, user.id=376a0503e64e47c795f924714268e715) {{(pid=101893) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:42:14.458387 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e175b080-2981-4d10-b14f-de797b88a0d6 None admin] Validating token access rules against request {{(pid=101892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:42:14.459148 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a15eaa7-f883-4762-a712-26c616418210 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:42:14.461019 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a15eaa7-f883-4762-a712-26c616418210 None admin] RBAC: Authorization granted {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:42:14.475006 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 84/167] 10.222.0.84 () {56 vars in 1374 bytes} [Wed May 25 14:42:14 2022] GET /identity/v3/role_assignments?user.id=376a0503e64e47c795f924714268e715&scope.project.id=42293c5d76254690ab29c96f76687d9c&role.id=ff664fa0db7e4262a5accde96c3df4c3 => generated 608 bytes in 303 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:42:14.497453 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ced353e-6967-49fa-9ce1-ef34007dd0e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:42:14.498161 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ced353e-6967-49fa-9ce1-ef34007dd0e5 None admin] REQUEST_METHOD: `GET` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:42:14.498452 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ced353e-6967-49fa-9ce1-ef34007dd0e5 None admin] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:42:14.498738 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ced353e-6967-49fa-9ce1-ef34007dd0e5 None admin] PATH_INFO: `/v3/roles` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:42:14.499537 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ced353e-6967-49fa-9ce1-ef34007dd0e5 None admin] RBAC: Adding query filter params (name=member) {{(pid=101892) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:42:14.499892 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ced353e-6967-49fa-9ce1-ef34007dd0e5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:42:14.501727 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ced353e-6967-49fa-9ce1-ef34007dd0e5 None admin] RBAC: Authorization granted {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:42:14.511917 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 84/168] 10.222.0.84 () {56 vars in 1101 bytes} [Wed May 25 14:42:14 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:42:14.517870 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a15eaa7-f883-4762-a712-26c616418210 None admin] Authenticating user token {{(pid=101893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:42:14.526208 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f7a007-c32e-4b41-a679-2768bc99a16b None None] REQUEST_METHOD: `GET` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:42:14.526500 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f7a007-c32e-4b41-a679-2768bc99a16b None None] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:42:14.526782 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f7a007-c32e-4b41-a679-2768bc99a16b None None] PATH_INFO: `/` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:42:14.528412 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 85/169] 10.222.0.84 () {54 vars in 926 bytes} [Wed May 25 14:42:14 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 25 14:42:14.544135 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c98acc67-7c54-4692-a003-1f194716869a None None] REQUEST_METHOD: `POST` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:42:14.544436 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c98acc67-7c54-4692-a003-1f194716869a None None] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:42:14.544696 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c98acc67-7c54-4692-a003-1f194716869a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:42:14.566827 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG dbcounter [-] [101892] Writing DB stats keystone:SELECT=100 {{(pid=101892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:42:14.576727 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.auth.core [None req-c98acc67-7c54-4692-a003-1f194716869a None None] MFA Rules not processed for user `05d87e87798e429aa1c10b24391f915e`. Rule list: `[]` (Enabled: `True`). {{(pid=101892) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:42:14.577971 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.fernet_utils [None req-c98acc67-7c54-4692-a003-1f194716869a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=101892) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:42:14.630711 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG dbcounter [-] [101893] Writing DB stats keystone:SELECT=100 {{(pid=101893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:42:14.668007 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a15eaa7-f883-4762-a712-26c616418210 None admin] Validating token access rules against request {{(pid=101893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:42:14.708892 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2377e3a-b060-4f3b-ba38-3428990f537a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:42:14.709781 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2377e3a-b060-4f3b-ba38-3428990f537a None admin] REQUEST_METHOD: `GET` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:42:14.710066 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2377e3a-b060-4f3b-ba38-3428990f537a None admin] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:42:14.710345 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2377e3a-b060-4f3b-ba38-3428990f537a None admin] PATH_INFO: `/v3/users/376a0503e64e47c795f924714268e715` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:42:14.711703 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2377e3a-b060-4f3b-ba38-3428990f537a None admin] RBAC: Authorizing `identity:get_user(user_id=376a0503e64e47c795f924714268e715)` {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:42:14.713625 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2377e3a-b060-4f3b-ba38-3428990f537a None admin] RBAC: Authorization granted {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:42:14.716478 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 85/170] 10.222.0.84 () {56 vars in 1177 bytes} [Wed May 25 14:42:14 2022] GET /identity/v3/users/376a0503e64e47c795f924714268e715 => generated 275 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:42:14.722189 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2377e3a-b060-4f3b-ba38-3428990f537a None admin] Authenticating user token {{(pid=101893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:42:14.801510 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 86/171] 10.222.0.84 () {58 vars in 1023 bytes} [Wed May 25 14:42:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 258 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 25 14:42:14.835293 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2377e3a-b060-4f3b-ba38-3428990f537a None admin] Validating token access rules against request {{(pid=101893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:42:14.846042 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c98acc67-7c54-4692-a003-1f194716869a None None] Authenticating user token {{(pid=101892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:42:14.873007 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59beb6a2-fe99-4b6d-b646-f9c038559702 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:42:14.873725 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59beb6a2-fe99-4b6d-b646-f9c038559702 None admin] REQUEST_METHOD: `GET` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:42:14.874016 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59beb6a2-fe99-4b6d-b646-f9c038559702 None admin] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:42:14.874296 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59beb6a2-fe99-4b6d-b646-f9c038559702 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:42:14.883467 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG dbcounter [-] [101893] Writing DB stats keystone:SELECT=100 {{(pid=101893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:42:14.948961 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59beb6a2-fe99-4b6d-b646-f9c038559702 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:42:14.950381 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59beb6a2-fe99-4b6d-b646-f9c038559702 None admin] RBAC: Authorization granted {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:42:15.061516 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c98acc67-7c54-4692-a003-1f194716869a None None] Validating token access rules against request {{(pid=101892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:42:15.066072 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 86/172] 10.222.0.84 () {58 vars in 1282 bytes} [Wed May 25 14:42:14 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 344 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 25 14:42:15.071985 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59beb6a2-fe99-4b6d-b646-f9c038559702 None admin] Authenticating user token {{(pid=101893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:42:15.117002 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG dbcounter [-] [101893] Writing DB stats keystone:SELECT=100 {{(pid=101893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:42:15.131927 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG dbcounter [-] [101892] Writing DB stats keystone:SELECT=100 {{(pid=101892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:42:15.144802 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e55c28f9-3591-4e67-ae65-f2097a6c042f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:42:15.145631 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55c28f9-3591-4e67-ae65-f2097a6c042f None admin] REQUEST_METHOD: `GET` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:42:15.145919 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55c28f9-3591-4e67-ae65-f2097a6c042f None admin] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:42:15.146197 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55c28f9-3591-4e67-ae65-f2097a6c042f None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:42:15.173625 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e55c28f9-3591-4e67-ae65-f2097a6c042f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 14:42:15.181622 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59beb6a2-fe99-4b6d-b646-f9c038559702 None admin] Validating token access rules against request {{(pid=101893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:42:15.186266 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application [None req-e55c28f9-3591-4e67-ae65-f2097a6c042f None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 25 14:42:15.186266 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:42:15.186266 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 14:42:15.186266 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 14:42:15.186266 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 14:42:15.186266 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 14:42:15.186266 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 14:42:15.186266 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 14:42:15.186266 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 14:42:15.186266 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 14:42:15.186266 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 14:42:15.186266 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 14:42:15.186266 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 14:42:15.186266 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 14:42:15.186266 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 14:42:15.186266 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 14:42:15.187285 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 14:42:15.187285 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 14:42:15.187285 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 14:42:15.187285 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 14:42:15.187285 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 14:42:15.187285 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 14:42:15.187285 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 14:42:15.187285 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 14:42:15.187285 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 14:42:15.187285 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application return self.get_or_create( May 25 14:42:15.187285 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 14:42:15.187285 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application with Lock( May 25 14:42:15.187285 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 14:42:15.187285 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application return self._enter() May 25 14:42:15.187285 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 14:42:15.187285 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 14:42:15.188132 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 14:42:15.188132 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application return self.creator() May 25 14:42:15.188132 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 14:42:15.188132 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application created_value = creator( May 25 14:42:15.188132 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 14:42:15.188132 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 14:42:15.188132 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 14:42:15.188132 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 14:42:15.188132 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 14:42:15.188132 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 14:42:15.188132 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 25 14:42:15.188132 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application May 25 14:42:15.188132 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 87/173] 10.222.0.84 () {56 vars in 1114 bytes} [Wed May 25 14:42:14 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 342 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 14:42:15.196638 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e55c28f9-3591-4e67-ae65-f2097a6c042f None admin] Authenticating user token {{(pid=101892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:42:15.219012 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74698ad2-f363-4383-83c4-455cdf992f98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:42:15.219974 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74698ad2-f363-4383-83c4-455cdf992f98 None admin] REQUEST_METHOD: `GET` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:42:15.220152 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74698ad2-f363-4383-83c4-455cdf992f98 None admin] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:42:15.220394 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74698ad2-f363-4383-83c4-455cdf992f98 None admin] PATH_INFO: `/v3/projects/eb97bb0dd11f4c10a9d2a2416a15a938` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:42:15.221641 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74698ad2-f363-4383-83c4-455cdf992f98 None admin] RBAC: Authorizing `identity:get_project(project_id=eb97bb0dd11f4c10a9d2a2416a15a938)` {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:42:15.223225 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74698ad2-f363-4383-83c4-455cdf992f98 None admin] RBAC: Authorization granted {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:42:15.224968 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 87/174] 10.222.0.84 () {56 vars in 1186 bytes} [Wed May 25 14:42:15 2022] GET /identity/v3/projects/eb97bb0dd11f4c10a9d2a2416a15a938 => generated 312 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 14:42:15.235780 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74698ad2-f363-4383-83c4-455cdf992f98 None admin] Authenticating user token {{(pid=101893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:42:15.437525 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74698ad2-f363-4383-83c4-455cdf992f98 None admin] Validating token access rules against request {{(pid=101893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:42:15.438262 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e55c28f9-3591-4e67-ae65-f2097a6c042f None admin] Validating token access rules against request {{(pid=101892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:42:15.454025 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG dbcounter [-] [101893] Writing DB stats keystone:SELECT=100 {{(pid=101893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:42:15.505443 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58ddddee-4174-4439-b67a-8c49eb314423 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:42:15.506050 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ddddee-4174-4439-b67a-8c49eb314423 None admin] REQUEST_METHOD: `GET` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:42:15.506329 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ddddee-4174-4439-b67a-8c49eb314423 None admin] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:42:15.506600 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ddddee-4174-4439-b67a-8c49eb314423 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:42:15.507438 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58ddddee-4174-4439-b67a-8c49eb314423 None admin] RBAC: Adding query filter params (role.id=ff664fa0db7e4262a5accde96c3df4c3, scope.project.id=eb97bb0dd11f4c10a9d2a2416a15a938, user.id=376a0503e64e47c795f924714268e715) {{(pid=101893) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:42:15.507769 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58ddddee-4174-4439-b67a-8c49eb314423 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:42:15.508259 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc3cc515-19df-46f0-89ae-c5ea70526136 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:42:15.508944 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3cc515-19df-46f0-89ae-c5ea70526136 None admin] REQUEST_METHOD: `GET` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:42:15.509237 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3cc515-19df-46f0-89ae-c5ea70526136 None admin] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:42:15.509337 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58ddddee-4174-4439-b67a-8c49eb314423 None admin] RBAC: Authorization granted {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:42:15.509519 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3cc515-19df-46f0-89ae-c5ea70526136 None admin] PATH_INFO: `/v3/roles` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:42:15.511009 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc3cc515-19df-46f0-89ae-c5ea70526136 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=101892) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:42:15.511324 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc3cc515-19df-46f0-89ae-c5ea70526136 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:42:15.512818 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc3cc515-19df-46f0-89ae-c5ea70526136 None admin] RBAC: Authorization granted {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:42:15.522659 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 88/175] 10.222.0.84 () {56 vars in 1374 bytes} [Wed May 25 14:42:15 2022] GET /identity/v3/role_assignments?user.id=376a0503e64e47c795f924714268e715&scope.project.id=eb97bb0dd11f4c10a9d2a2416a15a938&role.id=ff664fa0db7e4262a5accde96c3df4c3 => generated 608 bytes in 288 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 14:42:15.529978 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 88/176] 10.222.0.84 () {56 vars in 1111 bytes} [Wed May 25 14:42:15 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 334 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:42:15.535702 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58ddddee-4174-4439-b67a-8c49eb314423 None admin] Authenticating user token {{(pid=101893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:42:15.695963 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e59dbd8c-ee0d-4d14-871d-fbdfe17ee82c None None] REQUEST_METHOD: `GET` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:42:15.696286 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e59dbd8c-ee0d-4d14-871d-fbdfe17ee82c None None] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:42:15.696537 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e59dbd8c-ee0d-4d14-871d-fbdfe17ee82c None None] PATH_INFO: `/` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:42:15.698642 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 89/177] 10.222.0.84 () {54 vars in 926 bytes} [Wed May 25 14:42:15 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 14:42:15.709041 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb696a2-5b88-40f8-a06a-af5fc78a956f None None] REQUEST_METHOD: `POST` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:42:15.709380 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb696a2-5b88-40f8-a06a-af5fc78a956f None None] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:42:15.709632 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb696a2-5b88-40f8-a06a-af5fc78a956f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:42:15.727608 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58ddddee-4174-4439-b67a-8c49eb314423 None admin] Validating token access rules against request {{(pid=101893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:42:15.739431 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.auth.core [None req-dbb696a2-5b88-40f8-a06a-af5fc78a956f None None] MFA Rules not processed for user `05d87e87798e429aa1c10b24391f915e`. Rule list: `[]` (Enabled: `True`). {{(pid=101892) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:42:15.740674 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.fernet_utils [None req-dbb696a2-5b88-40f8-a06a-af5fc78a956f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=101892) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:42:15.796930 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a08f8c9a-15ac-4daa-b652-a370b6bf6f84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:42:15.797805 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08f8c9a-15ac-4daa-b652-a370b6bf6f84 None admin] REQUEST_METHOD: `GET` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:42:15.798087 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08f8c9a-15ac-4daa-b652-a370b6bf6f84 None admin] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:42:15.798357 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08f8c9a-15ac-4daa-b652-a370b6bf6f84 None admin] PATH_INFO: `/v3/users/376a0503e64e47c795f924714268e715` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:42:15.799640 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a08f8c9a-15ac-4daa-b652-a370b6bf6f84 None admin] RBAC: Authorizing `identity:get_user(user_id=376a0503e64e47c795f924714268e715)` {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:42:15.801139 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a08f8c9a-15ac-4daa-b652-a370b6bf6f84 None admin] RBAC: Authorization granted {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:42:15.802839 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 89/178] 10.222.0.84 () {56 vars in 1177 bytes} [Wed May 25 14:42:15 2022] GET /identity/v3/users/376a0503e64e47c795f924714268e715 => generated 275 bytes in 268 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:42:15.809009 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a08f8c9a-15ac-4daa-b652-a370b6bf6f84 None admin] Authenticating user token {{(pid=101893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:42:15.846532 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG dbcounter [-] [101892] Writing DB stats keystone:SELECT=100 {{(pid=101892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:42:15.875114 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 90/179] 10.222.0.84 () {58 vars in 1023 bytes} [Wed May 25 14:42:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 25 14:42:15.895974 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG dbcounter [-] [101893] Writing DB stats keystone:SELECT=100 {{(pid=101893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:42:15.900455 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb696a2-5b88-40f8-a06a-af5fc78a956f None None] Authenticating user token {{(pid=101892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:42:16.032031 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a08f8c9a-15ac-4daa-b652-a370b6bf6f84 None admin] Validating token access rules against request {{(pid=101893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:42:16.062129 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb696a2-5b88-40f8-a06a-af5fc78a956f None None] Validating token access rules against request {{(pid=101892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:42:16.099884 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e1ca200-b7f0-4730-ac71-a9811bc8ebfe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:42:16.100549 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1ca200-b7f0-4730-ac71-a9811bc8ebfe None admin] REQUEST_METHOD: `GET` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:42:16.100839 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1ca200-b7f0-4730-ac71-a9811bc8ebfe None admin] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:42:16.101127 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1ca200-b7f0-4730-ac71-a9811bc8ebfe None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:42:16.130784 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5b4db49-ed2a-4194-88d5-943086095634 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:42:16.131643 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b4db49-ed2a-4194-88d5-943086095634 None admin] REQUEST_METHOD: `GET` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:42:16.131928 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b4db49-ed2a-4194-88d5-943086095634 None admin] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:42:16.132206 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b4db49-ed2a-4194-88d5-943086095634 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:42:16.147287 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5b4db49-ed2a-4194-88d5-943086095634 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 14:42:16.157457 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application [None req-e5b4db49-ed2a-4194-88d5-943086095634 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 25 14:42:16.157457 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:42:16.157457 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 14:42:16.157457 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 14:42:16.157457 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 14:42:16.157457 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 14:42:16.157457 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 14:42:16.157457 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 14:42:16.157457 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 14:42:16.157457 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 14:42:16.157457 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 14:42:16.157457 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 14:42:16.157457 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 14:42:16.157457 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 14:42:16.157457 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 14:42:16.157457 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 14:42:16.158421 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 14:42:16.158421 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 14:42:16.158421 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 14:42:16.158421 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 14:42:16.158421 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 14:42:16.158421 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 14:42:16.158421 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 14:42:16.158421 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 14:42:16.158421 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 14:42:16.158421 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application return self.get_or_create( May 25 14:42:16.158421 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 14:42:16.158421 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application with Lock( May 25 14:42:16.158421 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 14:42:16.158421 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application return self._enter() May 25 14:42:16.158421 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 14:42:16.158421 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 14:42:16.159205 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 14:42:16.159205 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application return self.creator() May 25 14:42:16.159205 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 14:42:16.159205 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application created_value = creator( May 25 14:42:16.159205 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 14:42:16.159205 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 14:42:16.159205 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 14:42:16.159205 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 14:42:16.159205 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 14:42:16.159205 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 14:42:16.159205 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 25 14:42:16.159205 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application May 25 14:42:16.159205 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 91/180] 10.222.0.84 () {56 vars in 1096 bytes} [Wed May 25 14:42:15 2022] GET /identity/v3/roles/admin => generated 83 bytes in 259 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 25 14:42:16.166928 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5b4db49-ed2a-4194-88d5-943086095634 None admin] Authenticating user token {{(pid=101892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:42:16.224867 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e1ca200-b7f0-4730-ac71-a9811bc8ebfe None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:42:16.226345 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e1ca200-b7f0-4730-ac71-a9811bc8ebfe None admin] RBAC: Authorization granted {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:42:16.256159 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG dbcounter [-] [101892] Writing DB stats keystone:SELECT=100 {{(pid=101892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:42:16.287982 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG dbcounter [-] [101893] Writing DB stats keystone:SELECT=100 {{(pid=101893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:42:16.330906 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 90/181] 10.222.0.84 () {58 vars in 1282 bytes} [Wed May 25 14:42:15 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 522 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 25 14:42:16.332291 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f752dbb-d620-447b-b12e-2d04beee9426 None None] REQUEST_METHOD: `GET` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:42:16.332584 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f752dbb-d620-447b-b12e-2d04beee9426 None None] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:42:16.332858 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f752dbb-d620-447b-b12e-2d04beee9426 None None] PATH_INFO: `/` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:42:16.334373 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 91/182] 10.222.0.84 () {54 vars in 926 bytes} [Wed May 25 14:42:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 14:42:16.336721 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5b4db49-ed2a-4194-88d5-943086095634 None admin] Validating token access rules against request {{(pid=101892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:42:16.339654 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f752dbb-d620-447b-b12e-2d04beee9426 None None] Authenticating user token {{(pid=101893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:42:16.375373 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-296fe428-f80d-4dbf-87aa-b39c80f23617 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:42:16.376325 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296fe428-f80d-4dbf-87aa-b39c80f23617 None admin] REQUEST_METHOD: `GET` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:42:16.376609 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296fe428-f80d-4dbf-87aa-b39c80f23617 None admin] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:42:16.376887 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296fe428-f80d-4dbf-87aa-b39c80f23617 None admin] PATH_INFO: `/v3/roles` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:42:16.377640 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-296fe428-f80d-4dbf-87aa-b39c80f23617 None admin] RBAC: Adding query filter params (name=admin) {{(pid=101892) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:42:16.377950 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-296fe428-f80d-4dbf-87aa-b39c80f23617 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:42:16.379330 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-296fe428-f80d-4dbf-87aa-b39c80f23617 None admin] RBAC: Authorization granted {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:42:16.387710 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 92/183] 10.222.0.84 () {56 vars in 1099 bytes} [Wed May 25 14:42:16 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 14:42:16.388999 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22284b36-815a-460d-9a99-c1d72acbbe21 None None] REQUEST_METHOD: `POST` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:42:16.389293 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22284b36-815a-460d-9a99-c1d72acbbe21 None None] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:42:16.389570 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22284b36-815a-460d-9a99-c1d72acbbe21 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:42:16.406445 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.auth.core [None req-22284b36-815a-460d-9a99-c1d72acbbe21 None None] MFA Rules not processed for user `05d87e87798e429aa1c10b24391f915e`. Rule list: `[]` (Enabled: `True`). {{(pid=101892) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:42:16.407658 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.fernet_utils [None req-22284b36-815a-460d-9a99-c1d72acbbe21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=101892) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:42:16.458676 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f752dbb-d620-447b-b12e-2d04beee9426 None None] Validating token access rules against request {{(pid=101893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:42:16.486397 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 93/184] 10.222.0.84 () {58 vars in 1023 bytes} [Wed May 25 14:42:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 25 14:42:16.487786 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d8935cd-e1d5-4bed-877a-ca90a72f81c3 None None] REQUEST_METHOD: `GET` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:42:16.488112 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d8935cd-e1d5-4bed-877a-ca90a72f81c3 None None] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:42:16.488413 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d8935cd-e1d5-4bed-877a-ca90a72f81c3 None None] PATH_INFO: `/` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:42:16.493835 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 94/185] 10.222.0.84 () {54 vars in 926 bytes} [Wed May 25 14:42:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 14:42:16.493835 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d8935cd-e1d5-4bed-877a-ca90a72f81c3 None None] Authenticating user token {{(pid=101892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:42:16.506224 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a486a842-c5db-4c70-8346-261eb83e89e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:42:16.507221 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a486a842-c5db-4c70-8346-261eb83e89e5 None admin] REQUEST_METHOD: `GET` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:42:16.507647 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a486a842-c5db-4c70-8346-261eb83e89e5 None admin] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:42:16.508042 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a486a842-c5db-4c70-8346-261eb83e89e5 None admin] PATH_INFO: `/v3/projects/42293c5d76254690ab29c96f76687d9c` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:42:16.509464 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a486a842-c5db-4c70-8346-261eb83e89e5 None admin] RBAC: Authorizing `identity:get_project(project_id=42293c5d76254690ab29c96f76687d9c)` {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:42:16.511083 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a486a842-c5db-4c70-8346-261eb83e89e5 None admin] RBAC: Authorization granted {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:42:16.512961 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 92/186] 10.222.0.84 () {56 vars in 1186 bytes} [Wed May 25 14:42:16 2022] GET /identity/v3/projects/42293c5d76254690ab29c96f76687d9c => generated 298 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:42:16.513966 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9ef5f0-1eed-477f-8c54-9f74f6eb24ef None None] REQUEST_METHOD: `POST` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:42:16.514250 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9ef5f0-1eed-477f-8c54-9f74f6eb24ef None None] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:42:16.514527 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9ef5f0-1eed-477f-8c54-9f74f6eb24ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:42:16.525707 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG dbcounter [-] [101893] Writing DB stats keystone:SELECT=100 {{(pid=101893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:42:16.531488 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.auth.core [None req-7b9ef5f0-1eed-477f-8c54-9f74f6eb24ef None None] MFA Rules not processed for user `05d87e87798e429aa1c10b24391f915e`. Rule list: `[]` (Enabled: `True`). {{(pid=101893) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:42:16.532711 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.fernet_utils [None req-7b9ef5f0-1eed-477f-8c54-9f74f6eb24ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=101893) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:42:16.538706 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG dbcounter [-] [101892] Writing DB stats keystone:SELECT=100 {{(pid=101892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:42:16.611174 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 93/187] 10.222.0.84 () {58 vars in 1023 bytes} [Wed May 25 14:42:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 25 14:42:16.619769 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b9ef5f0-1eed-477f-8c54-9f74f6eb24ef None None] Authenticating user token {{(pid=101893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:42:16.624473 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d8935cd-e1d5-4bed-877a-ca90a72f81c3 None None] Validating token access rules against request {{(pid=101892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:42:16.660454 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eadff999-c973-4439-ac74-df91957e90d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:42:16.661652 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eadff999-c973-4439-ac74-df91957e90d7 None admin] REQUEST_METHOD: `GET` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:42:16.662123 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eadff999-c973-4439-ac74-df91957e90d7 None admin] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:42:16.662418 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eadff999-c973-4439-ac74-df91957e90d7 None admin] PATH_INFO: `/v3/users/14f94aea804545e38c953ee78da5281e` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:42:16.676532 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eadff999-c973-4439-ac74-df91957e90d7 None admin] RBAC: Authorizing `identity:get_user(user_id=14f94aea804545e38c953ee78da5281e)` {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:42:16.677972 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eadff999-c973-4439-ac74-df91957e90d7 None admin] RBAC: Authorization granted {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:42:16.679768 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 95/188] 10.222.0.84 () {56 vars in 1177 bytes} [Wed May 25 14:42:16 2022] GET /identity/v3/users/14f94aea804545e38c953ee78da5281e => generated 283 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:42:16.680367 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eadff999-c973-4439-ac74-df91957e90d7 None admin] Authenticating user token {{(pid=101892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:42:16.720227 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b9ef5f0-1eed-477f-8c54-9f74f6eb24ef None None] Validating token access rules against request {{(pid=101893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:42:16.752941 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f86ede78-3294-48cb-b230-513ed545aaf3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:42:16.753731 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86ede78-3294-48cb-b230-513ed545aaf3 None admin] REQUEST_METHOD: `GET` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:42:16.754008 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86ede78-3294-48cb-b230-513ed545aaf3 None admin] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:42:16.754282 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86ede78-3294-48cb-b230-513ed545aaf3 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:42:16.756883 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG dbcounter [-] [101893] Writing DB stats keystone:SELECT=100 {{(pid=101893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:42:16.765341 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f86ede78-3294-48cb-b230-513ed545aaf3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 14:42:16.770214 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG dbcounter [-] [101892] Writing DB stats keystone:SELECT=100 {{(pid=101892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:42:16.773197 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application [None req-f86ede78-3294-48cb-b230-513ed545aaf3 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 25 14:42:16.773197 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:42:16.773197 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 14:42:16.773197 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 14:42:16.773197 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 14:42:16.773197 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 14:42:16.773197 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 14:42:16.773197 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 14:42:16.773197 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 14:42:16.773197 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 14:42:16.773197 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 14:42:16.773197 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 14:42:16.773197 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 14:42:16.773197 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 14:42:16.773197 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 14:42:16.773197 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 14:42:16.776442 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 14:42:16.776442 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 14:42:16.776442 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 14:42:16.776442 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 14:42:16.776442 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 14:42:16.776442 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 14:42:16.776442 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 14:42:16.776442 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 14:42:16.776442 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 14:42:16.776442 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return self.get_or_create( May 25 14:42:16.776442 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 14:42:16.776442 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application with Lock( May 25 14:42:16.776442 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 14:42:16.776442 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return self._enter() May 25 14:42:16.776442 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 14:42:16.776442 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 14:42:16.777256 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 14:42:16.777256 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return self.creator() May 25 14:42:16.777256 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 14:42:16.777256 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application created_value = creator( May 25 14:42:16.777256 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 14:42:16.777256 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 14:42:16.777256 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 14:42:16.777256 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 14:42:16.777256 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 14:42:16.777256 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 14:42:16.777256 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 25 14:42:16.777256 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application May 25 14:42:16.777256 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 94/189] 10.222.0.84 () {56 vars in 1099 bytes} [Wed May 25 14:42:16 2022] GET /identity/v3/roles/reader => generated 84 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 14:42:16.777256 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2d3765-22e9-4686-9f28-a9f499afa7e4 None None] REQUEST_METHOD: `GET` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:42:16.777942 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2d3765-22e9-4686-9f28-a9f499afa7e4 None None] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:42:16.777942 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2d3765-22e9-4686-9f28-a9f499afa7e4 None None] PATH_INFO: `/` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:42:16.778364 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 95/190] 10.222.0.84 () {54 vars in 926 bytes} [Wed May 25 14:42:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 14:42:16.778946 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a2d3765-22e9-4686-9f28-a9f499afa7e4 None None] Authenticating user token {{(pid=101893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:42:16.783993 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eadff999-c973-4439-ac74-df91957e90d7 None admin] Validating token access rules against request {{(pid=101892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:42:16.817673 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c5c3e2-11b8-4baa-af0c-3f0260bd42f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:42:16.818329 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c5c3e2-11b8-4baa-af0c-3f0260bd42f2 None admin] REQUEST_METHOD: `GET` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:42:16.818617 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c5c3e2-11b8-4baa-af0c-3f0260bd42f2 None admin] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:42:16.818898 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c5c3e2-11b8-4baa-af0c-3f0260bd42f2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:42:16.819758 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1c5c3e2-11b8-4baa-af0c-3f0260bd42f2 None admin] RBAC: Adding query filter params (role.id=d3defd94f93b4e76af116df691240185, scope.project.id=42293c5d76254690ab29c96f76687d9c, user.id=376a0503e64e47c795f924714268e715) {{(pid=101892) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:42:16.820079 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1c5c3e2-11b8-4baa-af0c-3f0260bd42f2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:42:16.821519 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1c5c3e2-11b8-4baa-af0c-3f0260bd42f2 None admin] RBAC: Authorization granted {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:42:16.828068 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 96/191] 10.222.0.84 () {56 vars in 1374 bytes} [Wed May 25 14:42:16 2022] GET /identity/v3/role_assignments?user.id=376a0503e64e47c795f924714268e715&scope.project.id=42293c5d76254690ab29c96f76687d9c&role.id=d3defd94f93b4e76af116df691240185 => generated 608 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:42:16.829095 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c5c3e2-11b8-4baa-af0c-3f0260bd42f2 None admin] Authenticating user token {{(pid=101892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:42:16.889136 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a2d3765-22e9-4686-9f28-a9f499afa7e4 None None] Validating token access rules against request {{(pid=101893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:42:16.929768 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd33109-c5f3-48e6-ab83-0a3b573a6677 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:42:16.930609 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd33109-c5f3-48e6-ab83-0a3b573a6677 None admin] REQUEST_METHOD: `GET` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:42:16.930892 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd33109-c5f3-48e6-ab83-0a3b573a6677 None admin] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:42:16.931169 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd33109-c5f3-48e6-ab83-0a3b573a6677 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:42:16.942823 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bd33109-c5f3-48e6-ab83-0a3b573a6677 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 14:42:16.945224 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c5c3e2-11b8-4baa-af0c-3f0260bd42f2 None admin] Validating token access rules against request {{(pid=101892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:42:16.951946 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application [None req-8bd33109-c5f3-48e6-ab83-0a3b573a6677 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 25 14:42:16.951946 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:42:16.951946 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 14:42:16.951946 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 14:42:16.951946 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 14:42:16.951946 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 14:42:16.951946 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 14:42:16.951946 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 14:42:16.951946 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 14:42:16.951946 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 14:42:16.951946 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 14:42:16.951946 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 14:42:16.951946 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 14:42:16.951946 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 14:42:16.951946 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 14:42:16.951946 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 14:42:16.952895 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 14:42:16.952895 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 14:42:16.952895 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 14:42:16.952895 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 14:42:16.952895 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 14:42:16.952895 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 14:42:16.952895 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 14:42:16.952895 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 14:42:16.952895 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 14:42:16.952895 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return self.get_or_create( May 25 14:42:16.952895 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 14:42:16.952895 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application with Lock( May 25 14:42:16.952895 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 14:42:16.952895 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return self._enter() May 25 14:42:16.952895 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 14:42:16.952895 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 14:42:16.953699 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 14:42:16.953699 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return self.creator() May 25 14:42:16.953699 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 14:42:16.953699 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application created_value = creator( May 25 14:42:16.953699 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 14:42:16.953699 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 14:42:16.953699 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 14:42:16.953699 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 14:42:16.953699 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 14:42:16.953699 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 14:42:16.953699 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 25 14:42:16.953699 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application May 25 14:42:16.953699 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 96/192] 10.222.0.84 () {56 vars in 1114 bytes} [Wed May 25 14:42:16 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 14:42:16.954713 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd33109-c5f3-48e6-ab83-0a3b573a6677 None admin] Authenticating user token {{(pid=101893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:42:16.990257 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92e83f06-19c1-4120-b109-ce338dfd08d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:42:16.990922 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e83f06-19c1-4120-b109-ce338dfd08d8 None admin] REQUEST_METHOD: `GET` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:42:16.991210 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e83f06-19c1-4120-b109-ce338dfd08d8 None admin] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:42:16.991490 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e83f06-19c1-4120-b109-ce338dfd08d8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:42:17.017314 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG dbcounter [-] [101893] Writing DB stats keystone:SELECT=100 {{(pid=101893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:42:17.026970 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG dbcounter [-] [101892] Writing DB stats keystone:SELECT=100 {{(pid=101892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:42:17.071093 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd33109-c5f3-48e6-ab83-0a3b573a6677 None admin] Validating token access rules against request {{(pid=101893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:42:17.073335 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92e83f06-19c1-4120-b109-ce338dfd08d8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:42:17.074914 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92e83f06-19c1-4120-b109-ce338dfd08d8 None admin] RBAC: Authorization granted {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:42:17.108138 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de149028-0272-460b-8c3d-6e18e7adc8b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:42:17.108804 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de149028-0272-460b-8c3d-6e18e7adc8b8 None admin] REQUEST_METHOD: `GET` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:42:17.109084 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de149028-0272-460b-8c3d-6e18e7adc8b8 None admin] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:42:17.109356 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de149028-0272-460b-8c3d-6e18e7adc8b8 None admin] PATH_INFO: `/v3/roles` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:42:17.110104 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de149028-0272-460b-8c3d-6e18e7adc8b8 None admin] RBAC: Adding query filter params (name=reader) {{(pid=101893) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:42:17.110413 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de149028-0272-460b-8c3d-6e18e7adc8b8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:42:17.111803 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de149028-0272-460b-8c3d-6e18e7adc8b8 None admin] RBAC: Authorization granted {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:42:17.120208 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 97/193] 10.222.0.84 () {56 vars in 1101 bytes} [Wed May 25 14:42:16 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:42:17.122325 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e47d52-5ab2-4eef-9cd9-f3425e3c282e None None] REQUEST_METHOD: `POST` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:42:17.122696 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e47d52-5ab2-4eef-9cd9-f3425e3c282e None None] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:42:17.122984 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e47d52-5ab2-4eef-9cd9-f3425e3c282e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:42:17.139672 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.auth.core [None req-78e47d52-5ab2-4eef-9cd9-f3425e3c282e None None] MFA Rules not processed for user `05d87e87798e429aa1c10b24391f915e`. Rule list: `[]` (Enabled: `True`). {{(pid=101893) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:42:17.140846 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.fernet_utils [None req-78e47d52-5ab2-4eef-9cd9-f3425e3c282e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=101893) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:42:17.174328 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 97/194] 10.222.0.84 () {58 vars in 1282 bytes} [Wed May 25 14:42:16 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 346 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 25 14:42:17.175160 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92e83f06-19c1-4120-b109-ce338dfd08d8 None admin] Authenticating user token {{(pid=101892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:42:17.207740 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 98/195] 10.222.0.84 () {58 vars in 1023 bytes} [Wed May 25 14:42:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 25 14:42:17.208577 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78e47d52-5ab2-4eef-9cd9-f3425e3c282e None None] Authenticating user token {{(pid=101893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:42:17.234214 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG dbcounter [-] [101892] Writing DB stats keystone:SELECT=100 {{(pid=101892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:42:17.265030 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG dbcounter [-] [101893] Writing DB stats keystone:SELECT=100 {{(pid=101893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:42:17.282222 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92e83f06-19c1-4120-b109-ce338dfd08d8 None admin] Validating token access rules against request {{(pid=101892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:42:17.316405 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e735485-6a7a-4e59-9879-cf857cda7789 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:42:17.316765 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78e47d52-5ab2-4eef-9cd9-f3425e3c282e None None] Validating token access rules against request {{(pid=101893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:42:17.317078 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e735485-6a7a-4e59-9879-cf857cda7789 None admin] REQUEST_METHOD: `GET` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:42:17.317364 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e735485-6a7a-4e59-9879-cf857cda7789 None admin] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:42:17.317641 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e735485-6a7a-4e59-9879-cf857cda7789 None admin] PATH_INFO: `/v3/roles` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:42:17.318386 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e735485-6a7a-4e59-9879-cf857cda7789 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=101892) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:42:17.318691 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e735485-6a7a-4e59-9879-cf857cda7789 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:42:17.320132 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e735485-6a7a-4e59-9879-cf857cda7789 None admin] RBAC: Authorization granted {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:42:17.328503 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 98/196] 10.222.0.84 () {56 vars in 1111 bytes} [Wed May 25 14:42:17 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:42:17.333042 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e735485-6a7a-4e59-9879-cf857cda7789 None admin] Authenticating user token {{(pid=101892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:42:17.351201 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-711807e2-c134-47df-b819-2ee092f710f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:42:17.352117 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711807e2-c134-47df-b819-2ee092f710f0 None admin] REQUEST_METHOD: `GET` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:42:17.352404 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711807e2-c134-47df-b819-2ee092f710f0 None admin] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:42:17.352685 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711807e2-c134-47df-b819-2ee092f710f0 None admin] PATH_INFO: `/v3/users/769e12fb3925457a822476ecd804439a` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:42:17.353876 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-711807e2-c134-47df-b819-2ee092f710f0 None admin] RBAC: Authorizing `identity:get_user(user_id=769e12fb3925457a822476ecd804439a)` {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:42:17.355323 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-711807e2-c134-47df-b819-2ee092f710f0 None admin] RBAC: Authorization granted {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:42:17.356974 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 99/197] 10.222.0.84 () {56 vars in 1177 bytes} [Wed May 25 14:42:17 2022] GET /identity/v3/users/769e12fb3925457a822476ecd804439a => generated 289 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:42:17.357727 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-711807e2-c134-47df-b819-2ee092f710f0 None admin] Authenticating user token {{(pid=101893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:42:17.432569 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e735485-6a7a-4e59-9879-cf857cda7789 None admin] Validating token access rules against request {{(pid=101892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:42:17.453075 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG dbcounter [-] [101892] Writing DB stats keystone:SELECT=100 {{(pid=101892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:42:17.456627 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-711807e2-c134-47df-b819-2ee092f710f0 None admin] Validating token access rules against request {{(pid=101893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:42:17.466895 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2575db7-06ac-4098-a637-869a2c57bfc8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:42:17.467786 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2575db7-06ac-4098-a637-869a2c57bfc8 None admin] REQUEST_METHOD: `GET` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:42:17.468076 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2575db7-06ac-4098-a637-869a2c57bfc8 None admin] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:42:17.468354 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2575db7-06ac-4098-a637-869a2c57bfc8 None admin] PATH_INFO: `/v3/projects/ac9e4da865b34de49eecd54e4f6f34e6` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:42:17.469525 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2575db7-06ac-4098-a637-869a2c57bfc8 None admin] RBAC: Authorizing `identity:get_project(project_id=ac9e4da865b34de49eecd54e4f6f34e6)` {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:42:17.470985 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2575db7-06ac-4098-a637-869a2c57bfc8 None admin] RBAC: Authorization granted {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:42:17.472835 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG dbcounter [-] [101893] Writing DB stats keystone:SELECT=100 {{(pid=101893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:42:17.472942 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 99/198] 10.222.0.84 () {56 vars in 1186 bytes} [Wed May 25 14:42:17 2022] GET /identity/v3/projects/ac9e4da865b34de49eecd54e4f6f34e6 => generated 302 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:42:17.473594 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2575db7-06ac-4098-a637-869a2c57bfc8 None admin] Authenticating user token {{(pid=101892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:42:17.490710 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7fde542-5e6c-4029-9fa7-aa33a0714d92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:42:17.491509 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7fde542-5e6c-4029-9fa7-aa33a0714d92 None admin] REQUEST_METHOD: `GET` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:42:17.491820 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7fde542-5e6c-4029-9fa7-aa33a0714d92 None admin] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:42:17.492099 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7fde542-5e6c-4029-9fa7-aa33a0714d92 None admin] PATH_INFO: `/v3/domains/default` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:42:17.493284 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7fde542-5e6c-4029-9fa7-aa33a0714d92 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:42:17.495440 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7fde542-5e6c-4029-9fa7-aa33a0714d92 None admin] RBAC: Authorization granted {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:42:17.497266 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 100/199] 10.222.0.84 () {56 vars in 1108 bytes} [Wed May 25 14:42:17 2022] GET /identity/v3/domains/default => generated 199 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:42:17.497854 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7fde542-5e6c-4029-9fa7-aa33a0714d92 None admin] Authenticating user token {{(pid=101893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:42:17.580708 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2575db7-06ac-4098-a637-869a2c57bfc8 None admin] Validating token access rules against request {{(pid=101892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:42:17.597044 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7fde542-5e6c-4029-9fa7-aa33a0714d92 None admin] Validating token access rules against request {{(pid=101893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:42:17.614175 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-589ba514-abde-4204-9a9b-221c9b242f36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:42:17.615048 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589ba514-abde-4204-9a9b-221c9b242f36 None admin] REQUEST_METHOD: `GET` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:42:17.615330 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589ba514-abde-4204-9a9b-221c9b242f36 None admin] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:42:17.615631 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589ba514-abde-4204-9a9b-221c9b242f36 None admin] PATH_INFO: `/v3/users/14f94aea804545e38c953ee78da5281e` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:42:17.616824 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-589ba514-abde-4204-9a9b-221c9b242f36 None admin] RBAC: Authorizing `identity:get_user(user_id=14f94aea804545e38c953ee78da5281e)` {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:42:17.618258 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-589ba514-abde-4204-9a9b-221c9b242f36 None admin] RBAC: Authorization granted {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:42:17.619981 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 100/200] 10.222.0.84 () {56 vars in 1177 bytes} [Wed May 25 14:42:17 2022] GET /identity/v3/users/14f94aea804545e38c953ee78da5281e => generated 283 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:42:17.621167 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-589ba514-abde-4204-9a9b-221c9b242f36 None admin] Authenticating user token {{(pid=101892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:42:17.631077 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7a795d5-7197-4540-a4a5-fb6d338d78f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:42:17.631779 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a795d5-7197-4540-a4a5-fb6d338d78f1 None admin] REQUEST_METHOD: `GET` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:42:17.632066 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a795d5-7197-4540-a4a5-fb6d338d78f1 None admin] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:42:17.632339 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a795d5-7197-4540-a4a5-fb6d338d78f1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:42:17.677794 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG dbcounter [-] [101892] Writing DB stats keystone:SELECT=100 {{(pid=101892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:42:17.683206 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG dbcounter [-] [101893] Writing DB stats keystone:SELECT=100 {{(pid=101893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:42:17.698794 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7a795d5-7197-4540-a4a5-fb6d338d78f1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:42:17.700417 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7a795d5-7197-4540-a4a5-fb6d338d78f1 None admin] RBAC: Authorization granted {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:42:17.721135 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-589ba514-abde-4204-9a9b-221c9b242f36 None admin] Validating token access rules against request {{(pid=101892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:42:17.753295 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-501158f9-2a43-4c0d-8824-f251d6236c87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:42:17.753947 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501158f9-2a43-4c0d-8824-f251d6236c87 None admin] REQUEST_METHOD: `GET` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:42:17.754237 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501158f9-2a43-4c0d-8824-f251d6236c87 None admin] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:42:17.754519 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501158f9-2a43-4c0d-8824-f251d6236c87 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:42:17.755340 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-501158f9-2a43-4c0d-8824-f251d6236c87 None admin] RBAC: Adding query filter params (role.id=a3b78e7d547d4d2d998b4c99a4396bba, scope.project.id=ac9e4da865b34de49eecd54e4f6f34e6, user.id=14f94aea804545e38c953ee78da5281e) {{(pid=101892) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:42:17.755688 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-501158f9-2a43-4c0d-8824-f251d6236c87 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:42:17.757105 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-501158f9-2a43-4c0d-8824-f251d6236c87 None admin] RBAC: Authorization granted {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:42:17.762992 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 101/201] 10.222.0.84 () {56 vars in 1374 bytes} [Wed May 25 14:42:17 2022] GET /identity/v3/role_assignments?user.id=14f94aea804545e38c953ee78da5281e&scope.project.id=ac9e4da865b34de49eecd54e4f6f34e6&role.id=a3b78e7d547d4d2d998b4c99a4396bba => generated 259 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:42:17.763777 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-501158f9-2a43-4c0d-8824-f251d6236c87 None admin] Authenticating user token {{(pid=101892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:42:17.817919 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 101/202] 10.222.0.84 () {58 vars in 1282 bytes} [Wed May 25 14:42:17 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 320 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 25 14:42:17.820869 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7a795d5-7197-4540-a4a5-fb6d338d78f1 None admin] Authenticating user token {{(pid=101893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:42:17.887091 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-501158f9-2a43-4c0d-8824-f251d6236c87 None admin] Validating token access rules against request {{(pid=101892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:42:17.913915 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG dbcounter [-] [101892] Writing DB stats keystone:SELECT=100 {{(pid=101892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:42:17.914993 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG dbcounter [-] [101893] Writing DB stats keystone:SELECT=100 {{(pid=101893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:42:17.931212 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a26c2a2d-de5d-4129-a6ae-1036d6323ce1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:42:17.932044 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7a795d5-7197-4540-a4a5-fb6d338d78f1 None admin] Validating token access rules against request {{(pid=101893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:42:17.932472 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26c2a2d-de5d-4129-a6ae-1036d6323ce1 None admin] REQUEST_METHOD: `POST` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:42:17.932877 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26c2a2d-de5d-4129-a6ae-1036d6323ce1 None admin] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:42:17.933169 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26c2a2d-de5d-4129-a6ae-1036d6323ce1 None admin] PATH_INFO: `/v3/users` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:42:17.934061 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a26c2a2d-de5d-4129-a6ae-1036d6323ce1 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:42:17.935485 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a26c2a2d-de5d-4129-a6ae-1036d6323ce1 None admin] RBAC: Authorization granted {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:42:17.969356 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-135acf8d-fe38-4926-a609-ea6e87b42cd6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:42:17.970017 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135acf8d-fe38-4926-a609-ea6e87b42cd6 None admin] REQUEST_METHOD: `GET` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:42:17.970306 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135acf8d-fe38-4926-a609-ea6e87b42cd6 None admin] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:42:17.970592 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135acf8d-fe38-4926-a609-ea6e87b42cd6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:42:18.036147 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-135acf8d-fe38-4926-a609-ea6e87b42cd6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:42:18.037638 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-135acf8d-fe38-4926-a609-ea6e87b42cd6 None admin] RBAC: Authorization granted {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:42:18.057620 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 102/203] 10.222.0.84 () {60 vars in 1132 bytes} [Wed May 25 14:42:17 2022] POST /identity/v3/users => generated 297 bytes in 294 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 14:42:18.058681 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a26c2a2d-de5d-4129-a6ae-1036d6323ce1 None admin] Authenticating user token {{(pid=101892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:42:18.151320 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG dbcounter [-] [101893] Writing DB stats keystone:SELECT=100 {{(pid=101893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:42:18.170691 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 102/204] 10.222.0.84 () {58 vars in 1282 bytes} [Wed May 25 14:42:17 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 352 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 25 14:42:18.176367 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-135acf8d-fe38-4926-a609-ea6e87b42cd6 None admin] Authenticating user token {{(pid=101893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:42:18.205685 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a26c2a2d-de5d-4129-a6ae-1036d6323ce1 None admin] Validating token access rules against request {{(pid=101892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:42:18.248043 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a4e910b-d7df-446d-b90b-2da216f4101f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:42:18.248939 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4e910b-d7df-446d-b90b-2da216f4101f None admin] REQUEST_METHOD: `GET` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:42:18.249404 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4e910b-d7df-446d-b90b-2da216f4101f None admin] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:42:18.249694 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4e910b-d7df-446d-b90b-2da216f4101f None admin] PATH_INFO: `/v3/projects/42293c5d76254690ab29c96f76687d9c` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:42:18.252387 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a4e910b-d7df-446d-b90b-2da216f4101f None admin] RBAC: Authorizing `identity:get_project(project_id=42293c5d76254690ab29c96f76687d9c)` {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:42:18.253864 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a4e910b-d7df-446d-b90b-2da216f4101f None admin] RBAC: Authorization granted {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:42:18.255805 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 103/205] 10.222.0.84 () {56 vars in 1186 bytes} [Wed May 25 14:42:18 2022] GET /identity/v3/projects/42293c5d76254690ab29c96f76687d9c => generated 298 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:42:18.261794 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a4e910b-d7df-446d-b90b-2da216f4101f None admin] Authenticating user token {{(pid=101892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:42:18.318377 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG dbcounter [-] [101892] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=101892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:42:18.331510 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-135acf8d-fe38-4926-a609-ea6e87b42cd6 None admin] Validating token access rules against request {{(pid=101893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:42:18.398453 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3030545f-a32d-416d-a72c-456001cb0d4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:42:18.398453 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3030545f-a32d-416d-a72c-456001cb0d4c None admin] REQUEST_METHOD: `GET` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:42:18.398741 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3030545f-a32d-416d-a72c-456001cb0d4c None admin] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:42:18.398995 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3030545f-a32d-416d-a72c-456001cb0d4c None admin] PATH_INFO: `/v3/projects/ac9e4da865b34de49eecd54e4f6f34e6` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:42:18.401112 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3030545f-a32d-416d-a72c-456001cb0d4c None admin] RBAC: Authorizing `identity:get_project(project_id=ac9e4da865b34de49eecd54e4f6f34e6)` {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:42:18.402600 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3030545f-a32d-416d-a72c-456001cb0d4c None admin] RBAC: Authorization granted {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:42:18.405488 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 103/206] 10.222.0.84 () {56 vars in 1186 bytes} [Wed May 25 14:42:18 2022] GET /identity/v3/projects/ac9e4da865b34de49eecd54e4f6f34e6 => generated 302 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 14:42:18.413162 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3030545f-a32d-416d-a72c-456001cb0d4c None admin] Authenticating user token {{(pid=101893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:42:18.418410 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a4e910b-d7df-446d-b90b-2da216f4101f None admin] Validating token access rules against request {{(pid=101892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:42:18.482119 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32adb1dc-d18c-402c-8535-61e0c0ac728f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:42:18.482721 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32adb1dc-d18c-402c-8535-61e0c0ac728f None admin] REQUEST_METHOD: `GET` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:42:18.483008 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32adb1dc-d18c-402c-8535-61e0c0ac728f None admin] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:42:18.483288 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32adb1dc-d18c-402c-8535-61e0c0ac728f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:42:18.484161 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32adb1dc-d18c-402c-8535-61e0c0ac728f None admin] RBAC: Adding query filter params (role.id=d289ba5202044f90baf900bb40b116b8, scope.project.id=42293c5d76254690ab29c96f76687d9c, user.id=769e12fb3925457a822476ecd804439a) {{(pid=101892) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:42:18.484481 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32adb1dc-d18c-402c-8535-61e0c0ac728f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:42:18.485970 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32adb1dc-d18c-402c-8535-61e0c0ac728f None admin] RBAC: Authorization granted {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:42:18.501550 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 104/207] 10.222.0.84 () {56 vars in 1374 bytes} [Wed May 25 14:42:18 2022] GET /identity/v3/role_assignments?user.id=769e12fb3925457a822476ecd804439a&scope.project.id=42293c5d76254690ab29c96f76687d9c&role.id=d289ba5202044f90baf900bb40b116b8 => generated 608 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 14:42:18.517751 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG dbcounter [-] [101893] Writing DB stats keystone:SELECT=100 {{(pid=101893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:42:18.574334 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3030545f-a32d-416d-a72c-456001cb0d4c None admin] Validating token access rules against request {{(pid=101893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:42:18.613563 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d1b683c-e369-40ff-93bd-8a8137a91baf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:42:18.614333 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d1b683c-e369-40ff-93bd-8a8137a91baf None admin] REQUEST_METHOD: `GET` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:42:18.614525 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d1b683c-e369-40ff-93bd-8a8137a91baf None admin] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:42:18.614805 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d1b683c-e369-40ff-93bd-8a8137a91baf None admin] PATH_INFO: `/v3/role_assignments` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:42:18.615687 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d1b683c-e369-40ff-93bd-8a8137a91baf None admin] RBAC: Adding query filter params (role.id=d3defd94f93b4e76af116df691240185, scope.project.id=ac9e4da865b34de49eecd54e4f6f34e6, user.id=14f94aea804545e38c953ee78da5281e) {{(pid=101893) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:42:18.616009 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d1b683c-e369-40ff-93bd-8a8137a91baf None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:42:18.617546 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d1b683c-e369-40ff-93bd-8a8137a91baf None admin] RBAC: Authorization granted {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:42:18.624943 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 104/208] 10.222.0.84 () {56 vars in 1374 bytes} [Wed May 25 14:42:18 2022] GET /identity/v3/role_assignments?user.id=14f94aea804545e38c953ee78da5281e&scope.project.id=ac9e4da865b34de49eecd54e4f6f34e6&role.id=d3defd94f93b4e76af116df691240185 => generated 259 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:42:20.156483 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7d5522-ed38-4050-9802-030ca4dd81a3 None None] REQUEST_METHOD: `GET` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:42:20.156995 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7d5522-ed38-4050-9802-030ca4dd81a3 None None] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:42:20.157100 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7d5522-ed38-4050-9802-030ca4dd81a3 None None] PATH_INFO: `/` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:42:20.158486 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 105/209] 10.222.0.84 () {54 vars in 926 bytes} [Wed May 25 14:42:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 14:42:20.163968 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe21683-4aa4-40e5-b8f2-1584b5445486 None None] REQUEST_METHOD: `POST` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:42:20.164347 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe21683-4aa4-40e5-b8f2-1584b5445486 None None] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:42:20.164523 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe21683-4aa4-40e5-b8f2-1584b5445486 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:42:20.182527 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.auth.core [None req-abe21683-4aa4-40e5-b8f2-1584b5445486 None None] MFA Rules not processed for user `05d87e87798e429aa1c10b24391f915e`. Rule list: `[]` (Enabled: `True`). {{(pid=101893) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:42:20.183898 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.fernet_utils [None req-abe21683-4aa4-40e5-b8f2-1584b5445486 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=101893) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:42:20.253609 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 105/210] 10.222.0.84 () {58 vars in 1023 bytes} [Wed May 25 14:42:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 25 14:42:20.277052 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c7d5522-ed38-4050-9802-030ca4dd81a3 None None] Authenticating user token {{(pid=101892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:42:20.411177 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c7d5522-ed38-4050-9802-030ca4dd81a3 None None] Validating token access rules against request {{(pid=101892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:42:20.424301 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG dbcounter [-] [101892] Writing DB stats keystone:SELECT=100 {{(pid=101892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:42:20.445482 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66331323-ae70-4b98-8180-0acadfb3a56a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:42:20.446274 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66331323-ae70-4b98-8180-0acadfb3a56a None admin] REQUEST_METHOD: `GET` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:42:20.446555 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66331323-ae70-4b98-8180-0acadfb3a56a None admin] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:42:20.446871 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66331323-ae70-4b98-8180-0acadfb3a56a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:42:20.459074 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66331323-ae70-4b98-8180-0acadfb3a56a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 14:42:20.467757 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application [None req-66331323-ae70-4b98-8180-0acadfb3a56a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 25 14:42:20.467757 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:42:20.467757 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 14:42:20.467757 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 14:42:20.467757 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 14:42:20.467757 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 14:42:20.467757 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 14:42:20.467757 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 14:42:20.467757 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 14:42:20.467757 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 14:42:20.467757 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 14:42:20.467757 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 14:42:20.467757 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 14:42:20.467757 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 14:42:20.467757 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 14:42:20.467757 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 14:42:20.468857 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 14:42:20.468857 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 14:42:20.468857 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 14:42:20.468857 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 14:42:20.468857 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 14:42:20.468857 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 14:42:20.468857 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 14:42:20.468857 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 14:42:20.468857 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 14:42:20.468857 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application return self.get_or_create( May 25 14:42:20.468857 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 14:42:20.468857 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application with Lock( May 25 14:42:20.468857 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 14:42:20.468857 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application return self._enter() May 25 14:42:20.468857 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 14:42:20.468857 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 14:42:20.469857 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 14:42:20.469857 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application return self.creator() May 25 14:42:20.469857 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 14:42:20.469857 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application created_value = creator( May 25 14:42:20.469857 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 14:42:20.469857 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 14:42:20.469857 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 14:42:20.469857 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 14:42:20.469857 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 14:42:20.469857 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 14:42:20.469857 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 25 14:42:20.469857 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application May 25 14:42:20.472371 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 106/211] 10.222.0.84 () {56 vars in 1096 bytes} [Wed May 25 14:42:20 2022] GET /identity/v3/roles/admin => generated 83 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 14:42:20.478830 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abe21683-4aa4-40e5-b8f2-1584b5445486 None None] Authenticating user token {{(pid=101893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:42:20.537511 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG dbcounter [-] [101893] Writing DB stats keystone:SELECT=100 {{(pid=101893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:42:20.586914 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abe21683-4aa4-40e5-b8f2-1584b5445486 None None] Validating token access rules against request {{(pid=101893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:42:20.630251 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb71b4e3-d20a-4a7c-9a4d-7721a8b46b40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:42:20.631275 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb71b4e3-d20a-4a7c-9a4d-7721a8b46b40 None admin] REQUEST_METHOD: `GET` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:42:20.631791 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb71b4e3-d20a-4a7c-9a4d-7721a8b46b40 None admin] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:42:20.632289 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb71b4e3-d20a-4a7c-9a4d-7721a8b46b40 None admin] PATH_INFO: `/v3/roles` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:42:20.633246 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb71b4e3-d20a-4a7c-9a4d-7721a8b46b40 None admin] RBAC: Adding query filter params (name=admin) {{(pid=101893) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:42:20.633771 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb71b4e3-d20a-4a7c-9a4d-7721a8b46b40 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:42:20.635412 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb71b4e3-d20a-4a7c-9a4d-7721a8b46b40 None admin] RBAC: Authorization granted {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:42:20.645035 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 106/212] 10.222.0.84 () {56 vars in 1099 bytes} [Wed May 25 14:42:20 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:42:20.650547 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66331323-ae70-4b98-8180-0acadfb3a56a None admin] Authenticating user token {{(pid=101892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:42:20.683760 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-272c1929-8307-4ee3-8053-f68a52320bed None None] REQUEST_METHOD: `GET` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:42:20.684343 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-272c1929-8307-4ee3-8053-f68a52320bed None None] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:42:20.684797 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-272c1929-8307-4ee3-8053-f68a52320bed None None] PATH_INFO: `/` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:42:20.686347 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 107/213] 10.222.0.84 () {54 vars in 926 bytes} [Wed May 25 14:42:20 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 25 14:42:20.691507 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0eba6a6-fde4-41f3-8106-a82af32c611a None None] REQUEST_METHOD: `POST` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:42:20.691821 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0eba6a6-fde4-41f3-8106-a82af32c611a None None] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:42:20.692335 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0eba6a6-fde4-41f3-8106-a82af32c611a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:42:20.710415 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.auth.core [None req-e0eba6a6-fde4-41f3-8106-a82af32c611a None None] MFA Rules not processed for user `05d87e87798e429aa1c10b24391f915e`. Rule list: `[]` (Enabled: `True`). {{(pid=101893) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:42:20.711948 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.fernet_utils [None req-e0eba6a6-fde4-41f3-8106-a82af32c611a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=101893) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:42:20.755684 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66331323-ae70-4b98-8180-0acadfb3a56a None admin] Validating token access rules against request {{(pid=101892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:42:20.786978 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 108/214] 10.222.0.84 () {58 vars in 1023 bytes} [Wed May 25 14:42:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 25 14:42:20.791449 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-851c7959-43a5-46b0-9292-6660e203f41a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:42:20.792439 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851c7959-43a5-46b0-9292-6660e203f41a None admin] REQUEST_METHOD: `GET` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:42:20.792722 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851c7959-43a5-46b0-9292-6660e203f41a None admin] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:42:20.792997 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851c7959-43a5-46b0-9292-6660e203f41a None admin] PATH_INFO: `/v3/users/14f94aea804545e38c953ee78da5281e` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:42:20.794239 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-851c7959-43a5-46b0-9292-6660e203f41a None admin] RBAC: Authorizing `identity:get_user(user_id=14f94aea804545e38c953ee78da5281e)` {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:42:20.795759 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-851c7959-43a5-46b0-9292-6660e203f41a None admin] RBAC: Authorization granted {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:42:20.800947 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 107/215] 10.222.0.84 () {56 vars in 1177 bytes} [Wed May 25 14:42:20 2022] GET /identity/v3/users/14f94aea804545e38c953ee78da5281e => generated 283 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:42:20.802888 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f23a42-5cd5-4898-bd3e-c2f2f3dcde92 None None] REQUEST_METHOD: `GET` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:42:20.803398 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f23a42-5cd5-4898-bd3e-c2f2f3dcde92 None None] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:42:20.803628 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-851c7959-43a5-46b0-9292-6660e203f41a None admin] Authenticating user token {{(pid=101892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:42:20.804021 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f23a42-5cd5-4898-bd3e-c2f2f3dcde92 None None] PATH_INFO: `/` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:42:20.805671 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 109/216] 10.222.0.84 () {54 vars in 926 bytes} [Wed May 25 14:42:20 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 14:42:20.810926 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78f23a42-5cd5-4898-bd3e-c2f2f3dcde92 None None] Authenticating user token {{(pid=101893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:42:20.840249 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG dbcounter [-] [101892] Writing DB stats keystone:SELECT=100 {{(pid=101892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:42:20.858842 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG dbcounter [-] [101893] Writing DB stats keystone:SELECT=100 {{(pid=101893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:42:20.912258 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-851c7959-43a5-46b0-9292-6660e203f41a None admin] Validating token access rules against request {{(pid=101892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:42:20.925257 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78f23a42-5cd5-4898-bd3e-c2f2f3dcde92 None None] Validating token access rules against request {{(pid=101893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:42:20.948258 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5fcf490-6c0c-4d95-b49a-2ee3f4a27b11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:42:20.949073 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5fcf490-6c0c-4d95-b49a-2ee3f4a27b11 None admin] REQUEST_METHOD: `GET` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:42:20.949361 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5fcf490-6c0c-4d95-b49a-2ee3f4a27b11 None admin] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:42:20.949644 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5fcf490-6c0c-4d95-b49a-2ee3f4a27b11 None admin] PATH_INFO: `/v3/projects/ac9e4da865b34de49eecd54e4f6f34e6` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:42:20.950837 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5fcf490-6c0c-4d95-b49a-2ee3f4a27b11 None admin] RBAC: Authorizing `identity:get_project(project_id=ac9e4da865b34de49eecd54e4f6f34e6)` {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:42:20.952309 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5fcf490-6c0c-4d95-b49a-2ee3f4a27b11 None admin] RBAC: Authorization granted {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:42:20.954006 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 108/217] 10.222.0.84 () {56 vars in 1186 bytes} [Wed May 25 14:42:20 2022] GET /identity/v3/projects/ac9e4da865b34de49eecd54e4f6f34e6 => generated 302 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 14:42:20.955143 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b4aa29b-c656-4333-b9f9-bd1097523d37 None None] REQUEST_METHOD: `POST` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:42:20.955429 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b4aa29b-c656-4333-b9f9-bd1097523d37 None None] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:42:20.955739 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b4aa29b-c656-4333-b9f9-bd1097523d37 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:42:20.966822 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d11c02c-d5f2-4093-89ac-26a64a7e5ebf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:42:20.967701 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d11c02c-d5f2-4093-89ac-26a64a7e5ebf None admin] REQUEST_METHOD: `GET` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:42:20.967987 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d11c02c-d5f2-4093-89ac-26a64a7e5ebf None admin] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:42:20.968262 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d11c02c-d5f2-4093-89ac-26a64a7e5ebf None admin] PATH_INFO: `/v3/roles/member` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:42:20.972326 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.auth.core [None req-3b4aa29b-c656-4333-b9f9-bd1097523d37 None None] MFA Rules not processed for user `05d87e87798e429aa1c10b24391f915e`. Rule list: `[]` (Enabled: `True`). {{(pid=101892) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:42:20.973518 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.fernet_utils [None req-3b4aa29b-c656-4333-b9f9-bd1097523d37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=101892) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:42:20.978941 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d11c02c-d5f2-4093-89ac-26a64a7e5ebf None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 14:42:20.986700 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application [None req-1d11c02c-d5f2-4093-89ac-26a64a7e5ebf None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 25 14:42:20.986700 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:42:20.986700 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 14:42:20.986700 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 14:42:20.986700 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 14:42:20.986700 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 14:42:20.986700 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 14:42:20.986700 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 14:42:20.986700 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 14:42:20.986700 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 14:42:20.986700 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 14:42:20.986700 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 14:42:20.986700 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 14:42:20.986700 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 14:42:20.986700 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 14:42:20.986700 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 14:42:20.987631 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 14:42:20.987631 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 14:42:20.987631 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 14:42:20.987631 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 14:42:20.987631 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 14:42:20.987631 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 14:42:20.987631 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 14:42:20.987631 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 14:42:20.987631 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 14:42:20.987631 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return self.get_or_create( May 25 14:42:20.987631 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 14:42:20.987631 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application with Lock( May 25 14:42:20.987631 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 14:42:20.987631 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return self._enter() May 25 14:42:20.987631 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 14:42:20.987631 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 14:42:20.988426 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 14:42:20.988426 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return self.creator() May 25 14:42:20.988426 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 14:42:20.988426 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application created_value = creator( May 25 14:42:20.988426 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 14:42:20.988426 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 14:42:20.988426 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 14:42:20.988426 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 14:42:20.988426 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 14:42:20.988426 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 14:42:20.988426 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 25 14:42:20.988426 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application May 25 14:42:20.988426 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 110/218] 10.222.0.84 () {56 vars in 1099 bytes} [Wed May 25 14:42:20 2022] GET /identity/v3/roles/member => generated 84 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 14:42:20.989070 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d11c02c-d5f2-4093-89ac-26a64a7e5ebf None admin] Authenticating user token {{(pid=101893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:42:21.056795 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 109/219] 10.222.0.84 () {58 vars in 1023 bytes} [Wed May 25 14:42:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 25 14:42:21.057844 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b4aa29b-c656-4333-b9f9-bd1097523d37 None None] Authenticating user token {{(pid=101892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:42:21.091040 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG dbcounter [-] [101893] Writing DB stats keystone:SELECT=100 {{(pid=101893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:42:21.091876 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG dbcounter [-] [101892] Writing DB stats keystone:SELECT=100 {{(pid=101892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:42:21.095154 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d11c02c-d5f2-4093-89ac-26a64a7e5ebf None admin] Validating token access rules against request {{(pid=101893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:42:21.128745 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ac5e15d-0864-4a0a-b691-048d6e0cc8bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:42:21.129622 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac5e15d-0864-4a0a-b691-048d6e0cc8bc None admin] REQUEST_METHOD: `PUT` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:42:21.129903 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac5e15d-0864-4a0a-b691-048d6e0cc8bc None admin] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:42:21.130177 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac5e15d-0864-4a0a-b691-048d6e0cc8bc None admin] PATH_INFO: `/v3/projects/ac9e4da865b34de49eecd54e4f6f34e6/users/14f94aea804545e38c953ee78da5281e/roles/a3b78e7d547d4d2d998b4c99a4396bba` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:42:21.132147 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ac5e15d-0864-4a0a-b691-048d6e0cc8bc None admin] RBAC: Authorizing `identity:create_grant(project_id=ac9e4da865b34de49eecd54e4f6f34e6, user_id=14f94aea804545e38c953ee78da5281e, role_id=a3b78e7d547d4d2d998b4c99a4396bba)` {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:42:21.133606 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ac5e15d-0864-4a0a-b691-048d6e0cc8bc None admin] RBAC: Authorization granted {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:42:21.155580 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b4aa29b-c656-4333-b9f9-bd1097523d37 None None] Validating token access rules against request {{(pid=101892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:42:21.188041 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fff128a-bd72-4141-bf46-c3c987634568 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:42:21.188694 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fff128a-bd72-4141-bf46-c3c987634568 None admin] REQUEST_METHOD: `GET` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:42:21.188975 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fff128a-bd72-4141-bf46-c3c987634568 None admin] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:42:21.189248 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fff128a-bd72-4141-bf46-c3c987634568 None admin] PATH_INFO: `/v3/roles` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:42:21.189980 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fff128a-bd72-4141-bf46-c3c987634568 None admin] RBAC: Adding query filter params (name=member) {{(pid=101892) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:42:21.190322 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fff128a-bd72-4141-bf46-c3c987634568 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:42:21.191764 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fff128a-bd72-4141-bf46-c3c987634568 None admin] RBAC: Authorization granted {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:42:21.200267 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 110/220] 10.222.0.84 () {56 vars in 1101 bytes} [Wed May 25 14:42:21 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:42:21.201520 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca1a95b-30fd-4a1e-8ab1-6947a093ef75 None None] REQUEST_METHOD: `GET` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:42:21.201809 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca1a95b-30fd-4a1e-8ab1-6947a093ef75 None None] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:42:21.202108 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca1a95b-30fd-4a1e-8ab1-6947a093ef75 None None] PATH_INFO: `/` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:42:21.203339 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 111/221] 10.222.0.84 () {54 vars in 926 bytes} [Wed May 25 14:42:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 14:42:21.204044 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca1a95b-30fd-4a1e-8ab1-6947a093ef75 None None] Authenticating user token {{(pid=101892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:42:21.215837 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 111/222] 10.222.0.84 () {58 vars in 1439 bytes} [Wed May 25 14:42:20 2022] PUT /identity/v3/projects/ac9e4da865b34de49eecd54e4f6f34e6/users/14f94aea804545e38c953ee78da5281e/roles/a3b78e7d547d4d2d998b4c99a4396bba => generated 0 bytes in 227 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 14:42:21.216663 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ac5e15d-0864-4a0a-b691-048d6e0cc8bc None admin] Authenticating user token {{(pid=101893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:42:21.330949 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG dbcounter [-] [101892] Writing DB stats keystone:SELECT=100 {{(pid=101892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:42:21.338244 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ac5e15d-0864-4a0a-b691-048d6e0cc8bc None admin] Validating token access rules against request {{(pid=101893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:42:21.340077 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca1a95b-30fd-4a1e-8ab1-6947a093ef75 None None] Validating token access rules against request {{(pid=101892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:42:21.375675 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbaa85f7-51b4-4ff6-9896-7fd5ad15fb41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:42:21.376579 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbaa85f7-51b4-4ff6-9896-7fd5ad15fb41 None admin] REQUEST_METHOD: `GET` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:42:21.376862 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbaa85f7-51b4-4ff6-9896-7fd5ad15fb41 None admin] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:42:21.377144 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbaa85f7-51b4-4ff6-9896-7fd5ad15fb41 None admin] PATH_INFO: `/v3/users/040eba2aee9947abba3cf844a783d316` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:42:21.377458 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e714937c-a3d7-47cf-9e31-278b03dca5de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:42:21.378275 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e714937c-a3d7-47cf-9e31-278b03dca5de None admin] REQUEST_METHOD: `GET` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:42:21.378564 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e714937c-a3d7-47cf-9e31-278b03dca5de None admin] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:42:21.378846 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e714937c-a3d7-47cf-9e31-278b03dca5de None admin] PATH_INFO: `/v3/domains/default` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:42:21.380134 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e714937c-a3d7-47cf-9e31-278b03dca5de None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:42:21.381718 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e714937c-a3d7-47cf-9e31-278b03dca5de None admin] RBAC: Authorization granted {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:42:21.383621 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 112/223] 10.222.0.84 () {56 vars in 1108 bytes} [Wed May 25 14:42:21 2022] GET /identity/v3/domains/default => generated 199 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:42:21.385207 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f1afb8-75fb-4c17-9c19-cc1fa93cf43f None None] REQUEST_METHOD: `POST` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:42:21.385498 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f1afb8-75fb-4c17-9c19-cc1fa93cf43f None None] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:42:21.385779 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f1afb8-75fb-4c17-9c19-cc1fa93cf43f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:42:21.395501 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbaa85f7-51b4-4ff6-9896-7fd5ad15fb41 None admin] RBAC: Authorizing `identity:get_user(user_id=040eba2aee9947abba3cf844a783d316)` {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:42:21.395501 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbaa85f7-51b4-4ff6-9896-7fd5ad15fb41 None admin] RBAC: Authorization granted {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:42:21.396484 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 112/224] 10.222.0.84 () {56 vars in 1177 bytes} [Wed May 25 14:42:21 2022] GET /identity/v3/users/040eba2aee9947abba3cf844a783d316 => generated 297 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:42:21.401498 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbaa85f7-51b4-4ff6-9896-7fd5ad15fb41 None admin] Authenticating user token {{(pid=101893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:42:21.403991 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.auth.core [None req-65f1afb8-75fb-4c17-9c19-cc1fa93cf43f None None] MFA Rules not processed for user `05d87e87798e429aa1c10b24391f915e`. Rule list: `[]` (Enabled: `True`). {{(pid=101892) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:42:21.405278 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.fernet_utils [None req-65f1afb8-75fb-4c17-9c19-cc1fa93cf43f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=101892) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:42:21.427411 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG dbcounter [-] [101893] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=101893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:42:21.491661 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 113/225] 10.222.0.84 () {58 vars in 1023 bytes} [Wed May 25 14:42:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 25 14:42:21.491661 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65f1afb8-75fb-4c17-9c19-cc1fa93cf43f None None] Authenticating user token {{(pid=101892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:42:21.526589 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbaa85f7-51b4-4ff6-9896-7fd5ad15fb41 None admin] Validating token access rules against request {{(pid=101893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:42:21.564251 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a24a5fcf-3115-40d4-90cc-586068224d02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:42:21.564931 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24a5fcf-3115-40d4-90cc-586068224d02 None admin] REQUEST_METHOD: `POST` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:42:21.565219 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24a5fcf-3115-40d4-90cc-586068224d02 None admin] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:42:21.565500 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24a5fcf-3115-40d4-90cc-586068224d02 None admin] PATH_INFO: `/v3/users` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:42:21.566216 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a24a5fcf-3115-40d4-90cc-586068224d02 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:42:21.567702 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a24a5fcf-3115-40d4-90cc-586068224d02 None admin] RBAC: Authorization granted {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:42:21.595543 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG dbcounter [-] [101892] Writing DB stats keystone:SELECT=100 {{(pid=101892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:42:21.602039 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65f1afb8-75fb-4c17-9c19-cc1fa93cf43f None None] Validating token access rules against request {{(pid=101892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:42:21.635661 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db183753-df66-4e5b-97e8-17079c069c05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:42:21.636422 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db183753-df66-4e5b-97e8-17079c069c05 None admin] REQUEST_METHOD: `GET` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:42:21.636707 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db183753-df66-4e5b-97e8-17079c069c05 None admin] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:42:21.636982 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db183753-df66-4e5b-97e8-17079c069c05 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:42:21.651462 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 113/226] 10.222.0.84 () {60 vars in 1132 bytes} [Wed May 25 14:42:21 2022] POST /identity/v3/users => generated 297 bytes in 254 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 14:42:21.661695 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a24a5fcf-3115-40d4-90cc-586068224d02 None admin] Authenticating user token {{(pid=101893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:42:21.722346 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db183753-df66-4e5b-97e8-17079c069c05 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:42:21.724270 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db183753-df66-4e5b-97e8-17079c069c05 None admin] RBAC: Authorization granted {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:42:21.762244 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG dbcounter [-] [101893] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=101893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:42:21.803550 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a24a5fcf-3115-40d4-90cc-586068224d02 None admin] Validating token access rules against request {{(pid=101893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:42:21.852089 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69c11d32-cb97-4846-84df-164524a27f14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:42:21.853006 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG dbcounter [-] [101892] Writing DB stats keystone:SELECT=100 {{(pid=101892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:42:21.854394 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c11d32-cb97-4846-84df-164524a27f14 None admin] REQUEST_METHOD: `GET` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:42:21.855146 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c11d32-cb97-4846-84df-164524a27f14 None admin] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:42:21.855761 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c11d32-cb97-4846-84df-164524a27f14 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:42:21.864024 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 114/227] 10.222.0.84 () {58 vars in 1282 bytes} [Wed May 25 14:42:21 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 376 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 25 14:42:21.871200 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db183753-df66-4e5b-97e8-17079c069c05 None admin] Authenticating user token {{(pid=101892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:42:21.874907 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69c11d32-cb97-4846-84df-164524a27f14 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 14:42:21.883554 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application [None req-69c11d32-cb97-4846-84df-164524a27f14 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 25 14:42:21.883554 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:42:21.883554 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 14:42:21.883554 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 14:42:21.883554 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 14:42:21.883554 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 14:42:21.883554 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 14:42:21.883554 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 14:42:21.883554 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 14:42:21.883554 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 14:42:21.883554 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 14:42:21.883554 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 14:42:21.883554 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 14:42:21.883554 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 14:42:21.883554 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 14:42:21.883554 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 14:42:21.884537 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 14:42:21.884537 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 14:42:21.884537 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 14:42:21.884537 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 14:42:21.884537 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 14:42:21.884537 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 14:42:21.884537 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 14:42:21.884537 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 14:42:21.884537 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 14:42:21.884537 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return self.get_or_create( May 25 14:42:21.884537 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 14:42:21.884537 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application with Lock( May 25 14:42:21.884537 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 14:42:21.884537 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return self._enter() May 25 14:42:21.884537 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 14:42:21.884537 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 14:42:21.885326 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 14:42:21.885326 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return self.creator() May 25 14:42:21.885326 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 14:42:21.885326 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application created_value = creator( May 25 14:42:21.885326 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 14:42:21.885326 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 14:42:21.885326 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 14:42:21.885326 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 14:42:21.885326 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 14:42:21.885326 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 14:42:21.885326 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 25 14:42:21.885326 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application May 25 14:42:21.885326 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 114/228] 10.222.0.84 () {56 vars in 1114 bytes} [Wed May 25 14:42:21 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 14:42:21.890647 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69c11d32-cb97-4846-84df-164524a27f14 None admin] Authenticating user token {{(pid=101893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:42:22.004539 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db183753-df66-4e5b-97e8-17079c069c05 None admin] Validating token access rules against request {{(pid=101892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:42:22.025851 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69c11d32-cb97-4846-84df-164524a27f14 None admin] Validating token access rules against request {{(pid=101893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:42:22.050949 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec9df388-24fc-492b-832b-536d4ca6b6f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:42:22.052324 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9df388-24fc-492b-832b-536d4ca6b6f3 None admin] REQUEST_METHOD: `GET` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:42:22.053187 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9df388-24fc-492b-832b-536d4ca6b6f3 None admin] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:42:22.053628 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9df388-24fc-492b-832b-536d4ca6b6f3 None admin] PATH_INFO: `/v3/projects/ac9e4da865b34de49eecd54e4f6f34e6` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:42:22.055325 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec9df388-24fc-492b-832b-536d4ca6b6f3 None admin] RBAC: Authorizing `identity:get_project(project_id=ac9e4da865b34de49eecd54e4f6f34e6)` {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:42:22.057672 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec9df388-24fc-492b-832b-536d4ca6b6f3 None admin] RBAC: Authorization granted {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:42:22.060477 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 115/229] 10.222.0.84 () {56 vars in 1186 bytes} [Wed May 25 14:42:21 2022] GET /identity/v3/projects/ac9e4da865b34de49eecd54e4f6f34e6 => generated 302 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 14:42:22.061294 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG dbcounter [-] [101893] Writing DB stats keystone:SELECT=100 {{(pid=101893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:42:22.068686 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec9df388-24fc-492b-832b-536d4ca6b6f3 None admin] Authenticating user token {{(pid=101892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:42:22.072334 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29bce03d-0a87-49a0-b043-cef7d89856a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:42:22.073094 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29bce03d-0a87-49a0-b043-cef7d89856a3 None admin] REQUEST_METHOD: `GET` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:42:22.073567 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29bce03d-0a87-49a0-b043-cef7d89856a3 None admin] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:42:22.073849 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29bce03d-0a87-49a0-b043-cef7d89856a3 None admin] PATH_INFO: `/v3/roles` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:42:22.074615 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29bce03d-0a87-49a0-b043-cef7d89856a3 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=101893) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:42:22.074964 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29bce03d-0a87-49a0-b043-cef7d89856a3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:42:22.076398 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29bce03d-0a87-49a0-b043-cef7d89856a3 None admin] RBAC: Authorization granted {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:42:22.085233 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 115/230] 10.222.0.84 () {56 vars in 1111 bytes} [Wed May 25 14:42:21 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 14:42:22.092139 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29bce03d-0a87-49a0-b043-cef7d89856a3 None admin] Authenticating user token {{(pid=101893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:42:22.137576 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG dbcounter [-] [101892] Writing DB stats keystone:SELECT=100 {{(pid=101892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:42:22.180089 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec9df388-24fc-492b-832b-536d4ca6b6f3 None admin] Validating token access rules against request {{(pid=101892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:42:22.223573 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a8e3ddc-3207-4a24-b6ff-26afad6405dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:42:22.224325 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8e3ddc-3207-4a24-b6ff-26afad6405dd None admin] REQUEST_METHOD: `GET` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:42:22.224519 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8e3ddc-3207-4a24-b6ff-26afad6405dd None admin] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:42:22.224798 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8e3ddc-3207-4a24-b6ff-26afad6405dd None admin] PATH_INFO: `/v3/role_assignments` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:42:22.224910 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29bce03d-0a87-49a0-b043-cef7d89856a3 None admin] Validating token access rules against request {{(pid=101893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:42:22.231583 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a8e3ddc-3207-4a24-b6ff-26afad6405dd None admin] RBAC: Adding query filter params (role.id=ff664fa0db7e4262a5accde96c3df4c3, scope.project.id=ac9e4da865b34de49eecd54e4f6f34e6, user.id=040eba2aee9947abba3cf844a783d316) {{(pid=101892) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:42:22.231583 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a8e3ddc-3207-4a24-b6ff-26afad6405dd None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:42:22.233171 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a8e3ddc-3207-4a24-b6ff-26afad6405dd None admin] RBAC: Authorization granted {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:42:22.244963 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 116/231] 10.222.0.84 () {56 vars in 1374 bytes} [Wed May 25 14:42:22 2022] GET /identity/v3/role_assignments?user.id=040eba2aee9947abba3cf844a783d316&scope.project.id=ac9e4da865b34de49eecd54e4f6f34e6&role.id=ff664fa0db7e4262a5accde96c3df4c3 => generated 259 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:42:22.276292 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48bf9ce9-2f28-416d-a573-f6b143d5bf24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:42:22.277200 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48bf9ce9-2f28-416d-a573-f6b143d5bf24 None admin] REQUEST_METHOD: `GET` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:42:22.277484 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48bf9ce9-2f28-416d-a573-f6b143d5bf24 None admin] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:42:22.277759 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48bf9ce9-2f28-416d-a573-f6b143d5bf24 None admin] PATH_INFO: `/v3/users/14f94aea804545e38c953ee78da5281e` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:42:22.280464 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48bf9ce9-2f28-416d-a573-f6b143d5bf24 None admin] RBAC: Authorizing `identity:get_user(user_id=14f94aea804545e38c953ee78da5281e)` {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:42:22.281998 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48bf9ce9-2f28-416d-a573-f6b143d5bf24 None admin] RBAC: Authorization granted {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:42:22.284144 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 116/232] 10.222.0.84 () {56 vars in 1177 bytes} [Wed May 25 14:42:22 2022] GET /identity/v3/users/14f94aea804545e38c953ee78da5281e => generated 283 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 14:42:22.289515 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a8e3ddc-3207-4a24-b6ff-26afad6405dd None admin] Authenticating user token {{(pid=101892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:42:22.456235 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a8e3ddc-3207-4a24-b6ff-26afad6405dd None admin] Validating token access rules against request {{(pid=101892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:42:22.492706 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG dbcounter [-] [101892] Writing DB stats keystone:SELECT=100 {{(pid=101892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:42:22.503305 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c7d9d93-28be-4648-87cf-27d3d51b4fbc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:42:22.504207 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c7d9d93-28be-4648-87cf-27d3d51b4fbc None admin] REQUEST_METHOD: `GET` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:42:22.504490 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c7d9d93-28be-4648-87cf-27d3d51b4fbc None admin] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:42:22.504862 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c7d9d93-28be-4648-87cf-27d3d51b4fbc None admin] PATH_INFO: `/v3/projects/ac9e4da865b34de49eecd54e4f6f34e6` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:42:22.510348 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c7d9d93-28be-4648-87cf-27d3d51b4fbc None admin] RBAC: Authorizing `identity:get_project(project_id=ac9e4da865b34de49eecd54e4f6f34e6)` {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:42:22.510348 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c7d9d93-28be-4648-87cf-27d3d51b4fbc None admin] RBAC: Authorization granted {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:42:22.510348 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 117/233] 10.222.0.84 () {56 vars in 1186 bytes} [Wed May 25 14:42:22 2022] GET /identity/v3/projects/ac9e4da865b34de49eecd54e4f6f34e6 => generated 302 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:42:22.515588 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48bf9ce9-2f28-416d-a573-f6b143d5bf24 None admin] Authenticating user token {{(pid=101893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:42:22.609927 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG dbcounter [-] [101893] Writing DB stats keystone:SELECT=100 {{(pid=101893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:42:22.667987 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48bf9ce9-2f28-416d-a573-f6b143d5bf24 None admin] Validating token access rules against request {{(pid=101893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:42:22.710082 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9700323b-dfeb-4a51-a9b5-f0e53687e69b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:42:22.710978 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9700323b-dfeb-4a51-a9b5-f0e53687e69b None admin] REQUEST_METHOD: `PUT` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:42:22.711264 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9700323b-dfeb-4a51-a9b5-f0e53687e69b None admin] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:42:22.711539 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9700323b-dfeb-4a51-a9b5-f0e53687e69b None admin] PATH_INFO: `/v3/projects/ac9e4da865b34de49eecd54e4f6f34e6/users/14f94aea804545e38c953ee78da5281e/roles/d3defd94f93b4e76af116df691240185` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:42:22.713848 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9700323b-dfeb-4a51-a9b5-f0e53687e69b None admin] RBAC: Authorizing `identity:create_grant(project_id=ac9e4da865b34de49eecd54e4f6f34e6, user_id=14f94aea804545e38c953ee78da5281e, role_id=d3defd94f93b4e76af116df691240185)` {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:42:22.715311 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9700323b-dfeb-4a51-a9b5-f0e53687e69b None admin] RBAC: Authorization granted {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:42:22.821804 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 117/234] 10.222.0.84 () {58 vars in 1439 bytes} [Wed May 25 14:42:22 2022] PUT /identity/v3/projects/ac9e4da865b34de49eecd54e4f6f34e6/users/14f94aea804545e38c953ee78da5281e/roles/d3defd94f93b4e76af116df691240185 => generated 0 bytes in 306 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 14:42:23.821155 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4de1561-3bb5-4ff7-a39a-77f9878dd04d None None] REQUEST_METHOD: `GET` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:42:23.822702 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4de1561-3bb5-4ff7-a39a-77f9878dd04d None None] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:42:23.823191 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4de1561-3bb5-4ff7-a39a-77f9878dd04d None None] PATH_INFO: `/` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:42:23.824805 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 118/235] 10.222.0.84 () {54 vars in 926 bytes} [Wed May 25 14:42:23 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 14:42:23.830128 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d2c27d-149d-4bd7-a744-126ad6d3e96c None None] REQUEST_METHOD: `POST` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:42:23.830930 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d2c27d-149d-4bd7-a744-126ad6d3e96c None None] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:42:23.831423 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d2c27d-149d-4bd7-a744-126ad6d3e96c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:42:23.848571 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.auth.core [None req-71d2c27d-149d-4bd7-a744-126ad6d3e96c None None] MFA Rules not processed for user `05d87e87798e429aa1c10b24391f915e`. Rule list: `[]` (Enabled: `True`). {{(pid=101893) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:42:23.850060 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.fernet_utils [None req-71d2c27d-149d-4bd7-a744-126ad6d3e96c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=101893) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:42:23.927901 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 118/236] 10.222.0.84 () {58 vars in 1023 bytes} [Wed May 25 14:42:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 25 14:42:23.977048 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4de1561-3bb5-4ff7-a39a-77f9878dd04d None None] Authenticating user token {{(pid=101892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:42:24.097391 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4de1561-3bb5-4ff7-a39a-77f9878dd04d None None] Validating token access rules against request {{(pid=101892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:42:24.144027 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8664f3c8-9228-44f0-9e01-c45cfbc9880e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:42:24.145206 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8664f3c8-9228-44f0-9e01-c45cfbc9880e None admin] REQUEST_METHOD: `GET` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:42:24.145690 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8664f3c8-9228-44f0-9e01-c45cfbc9880e None admin] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:42:24.146208 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8664f3c8-9228-44f0-9e01-c45cfbc9880e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:42:24.163900 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8664f3c8-9228-44f0-9e01-c45cfbc9880e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 14:42:24.172003 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application [None req-8664f3c8-9228-44f0-9e01-c45cfbc9880e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 25 14:42:24.172003 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:42:24.172003 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 14:42:24.172003 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 14:42:24.172003 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 14:42:24.172003 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 14:42:24.172003 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 14:42:24.172003 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 14:42:24.172003 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 14:42:24.172003 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 14:42:24.172003 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 14:42:24.172003 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 14:42:24.172003 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 14:42:24.172003 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 14:42:24.172003 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 14:42:24.172003 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 14:42:24.172914 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 14:42:24.172914 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 14:42:24.172914 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 14:42:24.172914 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 14:42:24.172914 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 14:42:24.172914 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 14:42:24.172914 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 14:42:24.172914 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 14:42:24.172914 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 14:42:24.172914 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application return self.get_or_create( May 25 14:42:24.172914 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 14:42:24.172914 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application with Lock( May 25 14:42:24.172914 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 14:42:24.172914 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application return self._enter() May 25 14:42:24.172914 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 14:42:24.172914 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 14:42:24.173717 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 14:42:24.173717 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application return self.creator() May 25 14:42:24.173717 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 14:42:24.173717 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application created_value = creator( May 25 14:42:24.173717 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 14:42:24.173717 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 14:42:24.173717 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 14:42:24.173717 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 14:42:24.173717 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 14:42:24.173717 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 14:42:24.173717 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 25 14:42:24.173717 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application May 25 14:42:24.176136 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 119/237] 10.222.0.84 () {56 vars in 1096 bytes} [Wed May 25 14:42:23 2022] GET /identity/v3/roles/admin => generated 83 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 14:42:24.182736 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71d2c27d-149d-4bd7-a744-126ad6d3e96c None None] Authenticating user token {{(pid=101893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:42:24.241643 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG dbcounter [-] [101893] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=101893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:42:24.296685 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71d2c27d-149d-4bd7-a744-126ad6d3e96c None None] Validating token access rules against request {{(pid=101893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:42:24.342646 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14815836-3fd5-4ae8-8e6a-8979a221e103 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:42:24.343729 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14815836-3fd5-4ae8-8e6a-8979a221e103 None admin] REQUEST_METHOD: `GET` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:42:24.344211 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14815836-3fd5-4ae8-8e6a-8979a221e103 None admin] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:42:24.344707 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14815836-3fd5-4ae8-8e6a-8979a221e103 None admin] PATH_INFO: `/v3/roles` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:42:24.345652 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14815836-3fd5-4ae8-8e6a-8979a221e103 None admin] RBAC: Adding query filter params (name=admin) {{(pid=101893) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:42:24.346157 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14815836-3fd5-4ae8-8e6a-8979a221e103 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:42:24.347828 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14815836-3fd5-4ae8-8e6a-8979a221e103 None admin] RBAC: Authorization granted {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:42:24.358241 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 119/238] 10.222.0.84 () {56 vars in 1099 bytes} [Wed May 25 14:42:24 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:42:24.364944 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8664f3c8-9228-44f0-9e01-c45cfbc9880e None admin] Authenticating user token {{(pid=101892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:42:24.439056 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG dbcounter [-] [101892] Writing DB stats keystone:SELECT=100 {{(pid=101892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:42:24.482896 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead1ed86-1d6e-4f7a-bfd9-5467a6dbb544 None None] REQUEST_METHOD: `GET` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:42:24.483185 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead1ed86-1d6e-4f7a-bfd9-5467a6dbb544 None None] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:42:24.483643 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead1ed86-1d6e-4f7a-bfd9-5467a6dbb544 None None] PATH_INFO: `/` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:42:24.485342 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 120/239] 10.222.0.84 () {54 vars in 926 bytes} [Wed May 25 14:42:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 25 14:42:24.491280 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a090f246-9d08-44bb-8330-6dbe4e6e9760 None None] REQUEST_METHOD: `POST` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:42:24.491521 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a090f246-9d08-44bb-8330-6dbe4e6e9760 None None] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:42:24.491843 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a090f246-9d08-44bb-8330-6dbe4e6e9760 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:42:24.497263 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8664f3c8-9228-44f0-9e01-c45cfbc9880e None admin] Validating token access rules against request {{(pid=101892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:42:24.534539 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.auth.core [None req-a090f246-9d08-44bb-8330-6dbe4e6e9760 None None] MFA Rules not processed for user `05d87e87798e429aa1c10b24391f915e`. Rule list: `[]` (Enabled: `True`). {{(pid=101893) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:42:24.536500 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.fernet_utils [None req-a090f246-9d08-44bb-8330-6dbe4e6e9760 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=101893) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:42:24.541561 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d56ecb47-40c7-46bd-9ca5-4248d37b0fd3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:42:24.542739 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56ecb47-40c7-46bd-9ca5-4248d37b0fd3 None admin] REQUEST_METHOD: `GET` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:42:24.543197 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56ecb47-40c7-46bd-9ca5-4248d37b0fd3 None admin] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:42:24.543662 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56ecb47-40c7-46bd-9ca5-4248d37b0fd3 None admin] PATH_INFO: `/v3/users/14f94aea804545e38c953ee78da5281e` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:42:24.547100 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d56ecb47-40c7-46bd-9ca5-4248d37b0fd3 None admin] RBAC: Authorizing `identity:get_user(user_id=14f94aea804545e38c953ee78da5281e)` {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:42:24.548885 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d56ecb47-40c7-46bd-9ca5-4248d37b0fd3 None admin] RBAC: Authorization granted {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:42:24.550851 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 120/240] 10.222.0.84 () {56 vars in 1177 bytes} [Wed May 25 14:42:24 2022] GET /identity/v3/users/14f94aea804545e38c953ee78da5281e => generated 283 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:42:24.573057 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d56ecb47-40c7-46bd-9ca5-4248d37b0fd3 None admin] Authenticating user token {{(pid=101892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:42:24.658125 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 121/241] 10.222.0.84 () {58 vars in 1023 bytes} [Wed May 25 14:42:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 25 14:42:24.701519 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a090f246-9d08-44bb-8330-6dbe4e6e9760 None None] Authenticating user token {{(pid=101893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:42:24.740378 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d56ecb47-40c7-46bd-9ca5-4248d37b0fd3 None admin] Validating token access rules against request {{(pid=101892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:42:24.763401 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG dbcounter [-] [101892] Writing DB stats keystone:SELECT=100 {{(pid=101892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:42:24.774054 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG dbcounter [-] [101893] Writing DB stats keystone:SELECT=100 {{(pid=101893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:42:24.780970 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44b19164-a578-4072-ad3b-5bf2a52f5f10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:42:24.785145 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b19164-a578-4072-ad3b-5bf2a52f5f10 None admin] REQUEST_METHOD: `GET` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:42:24.785145 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b19164-a578-4072-ad3b-5bf2a52f5f10 None admin] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:42:24.785145 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b19164-a578-4072-ad3b-5bf2a52f5f10 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:42:24.839838 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a090f246-9d08-44bb-8330-6dbe4e6e9760 None None] Validating token access rules against request {{(pid=101893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:42:24.858218 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44b19164-a578-4072-ad3b-5bf2a52f5f10 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:42:24.859719 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44b19164-a578-4072-ad3b-5bf2a52f5f10 None admin] RBAC: Authorization granted {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:42:24.879141 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b8e6929-ab0d-4b61-b03a-311da49f28b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:42:24.880022 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8e6929-ab0d-4b61-b03a-311da49f28b1 None admin] REQUEST_METHOD: `GET` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:42:24.880351 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8e6929-ab0d-4b61-b03a-311da49f28b1 None admin] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:42:24.880740 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8e6929-ab0d-4b61-b03a-311da49f28b1 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:42:24.893537 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b8e6929-ab0d-4b61-b03a-311da49f28b1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 14:42:24.902287 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application [None req-4b8e6929-ab0d-4b61-b03a-311da49f28b1 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 25 14:42:24.902287 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:42:24.902287 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 14:42:24.902287 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 14:42:24.902287 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 14:42:24.902287 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 14:42:24.902287 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 14:42:24.902287 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 14:42:24.902287 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 14:42:24.902287 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 14:42:24.902287 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 14:42:24.902287 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 14:42:24.902287 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 14:42:24.902287 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 14:42:24.902287 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 14:42:24.902287 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 14:42:24.903161 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 14:42:24.903161 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 14:42:24.903161 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 14:42:24.903161 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 14:42:24.903161 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 14:42:24.903161 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 14:42:24.903161 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 14:42:24.903161 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 14:42:24.903161 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 14:42:24.903161 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return self.get_or_create( May 25 14:42:24.903161 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 14:42:24.903161 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application with Lock( May 25 14:42:24.903161 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 14:42:24.903161 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return self._enter() May 25 14:42:24.903161 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 14:42:24.903161 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 14:42:24.904005 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 14:42:24.904005 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return self.creator() May 25 14:42:24.904005 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 14:42:24.904005 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application created_value = creator( May 25 14:42:24.904005 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 14:42:24.904005 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 14:42:24.904005 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 14:42:24.904005 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 14:42:24.904005 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 14:42:24.904005 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 14:42:24.904005 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 25 14:42:24.904005 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application May 25 14:42:24.904005 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 122/242] 10.222.0.84 () {56 vars in 1099 bytes} [Wed May 25 14:42:24 2022] GET /identity/v3/roles/reader => generated 84 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 25 14:42:24.905423 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6857d9df-826a-4ec3-8d85-3d8080a14707 None None] REQUEST_METHOD: `GET` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:42:24.905423 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6857d9df-826a-4ec3-8d85-3d8080a14707 None None] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:42:24.905592 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6857d9df-826a-4ec3-8d85-3d8080a14707 None None] PATH_INFO: `/` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:42:24.911813 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 123/243] 10.222.0.84 () {54 vars in 926 bytes} [Wed May 25 14:42:24 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 14:42:24.912512 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6857d9df-826a-4ec3-8d85-3d8080a14707 None None] Authenticating user token {{(pid=101893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:42:24.961486 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 121/244] 10.222.0.84 () {58 vars in 1282 bytes} [Wed May 25 14:42:24 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 389 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 25 14:42:24.967830 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e36cba-19ee-4dc5-a9f9-d3fb41503c76 None None] REQUEST_METHOD: `POST` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:42:24.968120 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e36cba-19ee-4dc5-a9f9-d3fb41503c76 None None] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:42:24.968401 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e36cba-19ee-4dc5-a9f9-d3fb41503c76 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:42:24.984911 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.auth.core [None req-b3e36cba-19ee-4dc5-a9f9-d3fb41503c76 None None] MFA Rules not processed for user `05d87e87798e429aa1c10b24391f915e`. Rule list: `[]` (Enabled: `True`). {{(pid=101892) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:42:24.986077 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.fernet_utils [None req-b3e36cba-19ee-4dc5-a9f9-d3fb41503c76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=101892) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:42:25.003306 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG dbcounter [-] [101892] Writing DB stats keystone:SELECT=100 {{(pid=101892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:42:25.025855 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6857d9df-826a-4ec3-8d85-3d8080a14707 None None] Validating token access rules against request {{(pid=101893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:42:25.029298 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG dbcounter [-] [101893] Writing DB stats keystone:SELECT=100 {{(pid=101893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:42:25.054268 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 122/245] 10.222.0.84 () {58 vars in 1023 bytes} [Wed May 25 14:42:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 25 14:42:25.055319 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3e36cba-19ee-4dc5-a9f9-d3fb41503c76 None None] Authenticating user token {{(pid=101892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:42:25.068143 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14a7fcbc-3251-4002-86d0-f859b5743141 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:42:25.069396 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a7fcbc-3251-4002-86d0-f859b5743141 None admin] REQUEST_METHOD: `GET` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:42:25.070309 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a7fcbc-3251-4002-86d0-f859b5743141 None admin] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:42:25.071106 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a7fcbc-3251-4002-86d0-f859b5743141 None admin] PATH_INFO: `/v3/roles` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:42:25.072876 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14a7fcbc-3251-4002-86d0-f859b5743141 None admin] RBAC: Adding query filter params (name=reader) {{(pid=101893) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:42:25.073393 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14a7fcbc-3251-4002-86d0-f859b5743141 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:42:25.075414 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14a7fcbc-3251-4002-86d0-f859b5743141 None admin] RBAC: Authorization granted {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:42:25.085831 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 124/246] 10.222.0.84 () {56 vars in 1101 bytes} [Wed May 25 14:42:24 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:42:25.092025 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f3adf4-298e-4e98-a47c-cd12858b5571 None None] REQUEST_METHOD: `GET` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:42:25.092320 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f3adf4-298e-4e98-a47c-cd12858b5571 None None] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:42:25.092603 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f3adf4-298e-4e98-a47c-cd12858b5571 None None] PATH_INFO: `/` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:42:25.093991 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 125/247] 10.222.0.84 () {54 vars in 926 bytes} [Wed May 25 14:42:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 14:42:25.095753 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28f3adf4-298e-4e98-a47c-cd12858b5571 None None] Authenticating user token {{(pid=101893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:42:25.161749 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3e36cba-19ee-4dc5-a9f9-d3fb41503c76 None None] Validating token access rules against request {{(pid=101892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:42:25.202532 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c4a8910-be3a-49db-824f-82874cf606c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:42:25.203310 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c4a8910-be3a-49db-824f-82874cf606c2 None admin] REQUEST_METHOD: `GET` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:42:25.203616 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c4a8910-be3a-49db-824f-82874cf606c2 None admin] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:42:25.203891 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c4a8910-be3a-49db-824f-82874cf606c2 None admin] PATH_INFO: `/v3/projects/ac9e4da865b34de49eecd54e4f6f34e6` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:42:25.205030 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c4a8910-be3a-49db-824f-82874cf606c2 None admin] RBAC: Authorizing `identity:get_project(project_id=ac9e4da865b34de49eecd54e4f6f34e6)` {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:42:25.205241 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28f3adf4-298e-4e98-a47c-cd12858b5571 None None] Validating token access rules against request {{(pid=101893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:42:25.206469 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c4a8910-be3a-49db-824f-82874cf606c2 None admin] RBAC: Authorization granted {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:42:25.208225 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 123/248] 10.222.0.84 () {56 vars in 1186 bytes} [Wed May 25 14:42:25 2022] GET /identity/v3/projects/ac9e4da865b34de49eecd54e4f6f34e6 => generated 302 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:42:25.213568 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c4a8910-be3a-49db-824f-82874cf606c2 None admin] Authenticating user token {{(pid=101892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:42:25.235746 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG dbcounter [-] [101892] Writing DB stats keystone:SELECT=100 {{(pid=101892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:42:25.243781 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19dc23c4-7a6f-4419-b23a-fe3d543eee03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:42:25.244576 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19dc23c4-7a6f-4419-b23a-fe3d543eee03 None admin] REQUEST_METHOD: `GET` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:42:25.247083 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19dc23c4-7a6f-4419-b23a-fe3d543eee03 None admin] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:42:25.247083 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19dc23c4-7a6f-4419-b23a-fe3d543eee03 None admin] PATH_INFO: `/v3/domains/default` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:42:25.247083 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19dc23c4-7a6f-4419-b23a-fe3d543eee03 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:42:25.247945 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19dc23c4-7a6f-4419-b23a-fe3d543eee03 None admin] RBAC: Authorization granted {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:42:25.254384 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 126/249] 10.222.0.84 () {56 vars in 1108 bytes} [Wed May 25 14:42:25 2022] GET /identity/v3/domains/default => generated 199 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:42:25.254384 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10cc71c3-a8e8-462b-b2ea-9041eed914ef None None] REQUEST_METHOD: `POST` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:42:25.254384 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10cc71c3-a8e8-462b-b2ea-9041eed914ef None None] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:42:25.254384 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10cc71c3-a8e8-462b-b2ea-9041eed914ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:42:25.272339 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.auth.core [None req-10cc71c3-a8e8-462b-b2ea-9041eed914ef None None] MFA Rules not processed for user `05d87e87798e429aa1c10b24391f915e`. Rule list: `[]` (Enabled: `True`). {{(pid=101893) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:42:25.273804 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.fernet_utils [None req-10cc71c3-a8e8-462b-b2ea-9041eed914ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=101893) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:42:25.307817 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG dbcounter [-] [101893] Writing DB stats keystone:SELECT=100 {{(pid=101893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:42:25.320045 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c4a8910-be3a-49db-824f-82874cf606c2 None admin] Validating token access rules against request {{(pid=101892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:42:25.349519 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 127/250] 10.222.0.84 () {58 vars in 1023 bytes} [Wed May 25 14:42:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 25 14:42:25.350180 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10cc71c3-a8e8-462b-b2ea-9041eed914ef None None] Authenticating user token {{(pid=101893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:42:25.365219 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80ef83f8-667a-42f4-a710-68a8871bc8c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:42:25.367136 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ef83f8-667a-42f4-a710-68a8871bc8c2 None admin] REQUEST_METHOD: `GET` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:42:25.367675 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ef83f8-667a-42f4-a710-68a8871bc8c2 None admin] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:42:25.368918 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ef83f8-667a-42f4-a710-68a8871bc8c2 None admin] PATH_INFO: `/v3/users/a876555c722e4fdb9131f1e896597cc1` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:42:25.399324 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80ef83f8-667a-42f4-a710-68a8871bc8c2 None admin] RBAC: Authorizing `identity:get_user(user_id=a876555c722e4fdb9131f1e896597cc1)` {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:42:25.400830 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80ef83f8-667a-42f4-a710-68a8871bc8c2 None admin] RBAC: Authorization granted {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:42:25.407055 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 124/251] 10.222.0.84 () {56 vars in 1177 bytes} [Wed May 25 14:42:25 2022] GET /identity/v3/users/a876555c722e4fdb9131f1e896597cc1 => generated 297 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:42:25.407055 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80ef83f8-667a-42f4-a710-68a8871bc8c2 None admin] Authenticating user token {{(pid=101892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:42:25.468369 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10cc71c3-a8e8-462b-b2ea-9041eed914ef None None] Validating token access rules against request {{(pid=101893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:42:25.488800 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG dbcounter [-] [101892] Writing DB stats keystone:SELECT=100 {{(pid=101892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:42:25.505243 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5d78f6c-2474-44a7-8ca0-807099c4c336 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:42:25.505923 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d78f6c-2474-44a7-8ca0-807099c4c336 None admin] REQUEST_METHOD: `GET` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:42:25.506186 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d78f6c-2474-44a7-8ca0-807099c4c336 None admin] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:42:25.506471 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d78f6c-2474-44a7-8ca0-807099c4c336 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:42:25.507300 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5d78f6c-2474-44a7-8ca0-807099c4c336 None admin] RBAC: Adding query filter params (role.id=a3b78e7d547d4d2d998b4c99a4396bba, scope.project.id=ac9e4da865b34de49eecd54e4f6f34e6, user.id=14f94aea804545e38c953ee78da5281e) {{(pid=101893) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:42:25.507640 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5d78f6c-2474-44a7-8ca0-807099c4c336 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:42:25.509145 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5d78f6c-2474-44a7-8ca0-807099c4c336 None admin] RBAC: Authorization granted {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:42:25.511332 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80ef83f8-667a-42f4-a710-68a8871bc8c2 None admin] Validating token access rules against request {{(pid=101892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:42:25.516348 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 128/252] 10.222.0.84 () {56 vars in 1374 bytes} [Wed May 25 14:42:25 2022] GET /identity/v3/role_assignments?user.id=14f94aea804545e38c953ee78da5281e&scope.project.id=ac9e4da865b34de49eecd54e4f6f34e6&role.id=a3b78e7d547d4d2d998b4c99a4396bba => generated 608 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:42:25.516974 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5d78f6c-2474-44a7-8ca0-807099c4c336 None admin] Authenticating user token {{(pid=101893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:42:25.549448 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG dbcounter [-] [101893] Writing DB stats keystone:SELECT=100 {{(pid=101893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:42:25.569618 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea3313d7-b156-4f32-a082-f9b2a62a6b84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:42:25.570812 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3313d7-b156-4f32-a082-f9b2a62a6b84 None admin] REQUEST_METHOD: `POST` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:42:25.571326 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3313d7-b156-4f32-a082-f9b2a62a6b84 None admin] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:42:25.572871 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3313d7-b156-4f32-a082-f9b2a62a6b84 None admin] PATH_INFO: `/v3/users` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:42:25.574638 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea3313d7-b156-4f32-a082-f9b2a62a6b84 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:42:25.577082 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea3313d7-b156-4f32-a082-f9b2a62a6b84 None admin] RBAC: Authorization granted {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:42:25.635256 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5d78f6c-2474-44a7-8ca0-807099c4c336 None admin] Validating token access rules against request {{(pid=101893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:42:25.659205 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 125/253] 10.222.0.84 () {60 vars in 1132 bytes} [Wed May 25 14:42:25 2022] POST /identity/v3/users => generated 293 bytes in 256 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 14:42:25.660440 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea3313d7-b156-4f32-a082-f9b2a62a6b84 None admin] Authenticating user token {{(pid=101892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:42:25.699022 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa9e574d-231e-41ed-91bb-ffcd1caf913c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:42:25.699984 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9e574d-231e-41ed-91bb-ffcd1caf913c None admin] REQUEST_METHOD: `GET` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:42:25.700338 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9e574d-231e-41ed-91bb-ffcd1caf913c None admin] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:42:25.700778 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9e574d-231e-41ed-91bb-ffcd1caf913c None admin] PATH_INFO: `/v3/roles/member` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:42:25.726830 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa9e574d-231e-41ed-91bb-ffcd1caf913c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 14:42:25.737710 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application [None req-fa9e574d-231e-41ed-91bb-ffcd1caf913c None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 25 14:42:25.737710 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:42:25.737710 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 14:42:25.737710 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 14:42:25.737710 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 14:42:25.737710 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 14:42:25.737710 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 14:42:25.737710 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 14:42:25.737710 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 14:42:25.737710 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 14:42:25.737710 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 14:42:25.737710 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 14:42:25.737710 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 14:42:25.737710 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 14:42:25.737710 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 14:42:25.737710 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 14:42:25.738672 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 14:42:25.738672 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 14:42:25.738672 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 14:42:25.738672 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 14:42:25.738672 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 14:42:25.738672 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 14:42:25.738672 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 14:42:25.738672 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 14:42:25.738672 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 14:42:25.738672 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return self.get_or_create( May 25 14:42:25.738672 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 14:42:25.738672 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application with Lock( May 25 14:42:25.738672 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 14:42:25.738672 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return self._enter() May 25 14:42:25.738672 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 14:42:25.738672 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 14:42:25.739450 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 14:42:25.739450 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return self.creator() May 25 14:42:25.739450 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 14:42:25.739450 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application created_value = creator( May 25 14:42:25.739450 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 14:42:25.739450 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 14:42:25.739450 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 14:42:25.739450 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 14:42:25.739450 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 14:42:25.739450 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 14:42:25.739450 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 25 14:42:25.739450 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application May 25 14:42:25.744093 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 129/254] 10.222.0.84 () {56 vars in 1099 bytes} [Wed May 25 14:42:25 2022] GET /identity/v3/roles/member => generated 84 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 14:42:25.746995 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa9e574d-231e-41ed-91bb-ffcd1caf913c None admin] Authenticating user token {{(pid=101893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:42:25.800027 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea3313d7-b156-4f32-a082-f9b2a62a6b84 None admin] Validating token access rules against request {{(pid=101892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:42:25.839654 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-946caa23-803b-43ff-b024-e974aa28b8da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:42:25.840448 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946caa23-803b-43ff-b024-e974aa28b8da None admin] REQUEST_METHOD: `GET` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:42:25.840801 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946caa23-803b-43ff-b024-e974aa28b8da None admin] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:42:25.841176 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946caa23-803b-43ff-b024-e974aa28b8da None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:42:25.844495 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG dbcounter [-] [101892] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=101892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:42:25.858179 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG dbcounter [-] [101893] Writing DB stats keystone:SELECT=100 {{(pid=101893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:42:25.872888 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa9e574d-231e-41ed-91bb-ffcd1caf913c None admin] Validating token access rules against request {{(pid=101893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:42:25.919471 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3439334-5a26-4e80-b465-c531dc56938a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:42:25.920463 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3439334-5a26-4e80-b465-c531dc56938a None admin] REQUEST_METHOD: `GET` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:42:25.920900 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3439334-5a26-4e80-b465-c531dc56938a None admin] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:42:25.921325 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3439334-5a26-4e80-b465-c531dc56938a None admin] PATH_INFO: `/v3/roles` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:42:25.922248 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3439334-5a26-4e80-b465-c531dc56938a None admin] RBAC: Adding query filter params (name=member) {{(pid=101893) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:42:25.922563 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3439334-5a26-4e80-b465-c531dc56938a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:42:25.926619 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3439334-5a26-4e80-b465-c531dc56938a None admin] RBAC: Authorization granted {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:42:25.926832 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-946caa23-803b-43ff-b024-e974aa28b8da None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:42:25.928529 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-946caa23-803b-43ff-b024-e974aa28b8da None admin] RBAC: Authorization granted {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:42:25.937354 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 130/255] 10.222.0.84 () {56 vars in 1101 bytes} [Wed May 25 14:42:25 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:42:25.938676 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d017fbf-7b58-4bc8-b9de-1b639e01e75a None None] REQUEST_METHOD: `GET` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:42:25.938963 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d017fbf-7b58-4bc8-b9de-1b639e01e75a None None] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:42:25.939240 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d017fbf-7b58-4bc8-b9de-1b639e01e75a None None] PATH_INFO: `/` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:42:25.940505 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 131/256] 10.222.0.84 () {54 vars in 926 bytes} [Wed May 25 14:42:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 14:42:25.943738 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d017fbf-7b58-4bc8-b9de-1b639e01e75a None None] Authenticating user token {{(pid=101893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:42:26.051639 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 126/257] 10.222.0.84 () {58 vars in 1282 bytes} [Wed May 25 14:42:25 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 391 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 25 14:42:26.052883 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53624051-7949-4d73-8a18-4dc24fa2461e None None] REQUEST_METHOD: `POST` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:42:26.053178 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53624051-7949-4d73-8a18-4dc24fa2461e None None] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:42:26.053459 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53624051-7949-4d73-8a18-4dc24fa2461e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:42:26.063049 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d017fbf-7b58-4bc8-b9de-1b639e01e75a None None] Validating token access rules against request {{(pid=101893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:42:26.075875 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.auth.core [None req-53624051-7949-4d73-8a18-4dc24fa2461e None None] MFA Rules not processed for user `05d87e87798e429aa1c10b24391f915e`. Rule list: `[]` (Enabled: `True`). {{(pid=101892) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:42:26.077064 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.fernet_utils [None req-53624051-7949-4d73-8a18-4dc24fa2461e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=101892) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:42:26.104712 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93e65f25-ca2b-4040-b90b-bd5de58fbe00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:42:26.105832 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e65f25-ca2b-4040-b90b-bd5de58fbe00 None admin] REQUEST_METHOD: `GET` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:42:26.106482 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e65f25-ca2b-4040-b90b-bd5de58fbe00 None admin] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:42:26.106770 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e65f25-ca2b-4040-b90b-bd5de58fbe00 None admin] PATH_INFO: `/v3/users/040eba2aee9947abba3cf844a783d316` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:42:26.108312 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93e65f25-ca2b-4040-b90b-bd5de58fbe00 None admin] RBAC: Authorizing `identity:get_user(user_id=040eba2aee9947abba3cf844a783d316)` {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:42:26.109612 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG dbcounter [-] [101892] Writing DB stats keystone:SELECT=100 {{(pid=101892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:42:26.110389 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93e65f25-ca2b-4040-b90b-bd5de58fbe00 None admin] RBAC: Authorization granted {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:42:26.112541 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 132/258] 10.222.0.84 () {56 vars in 1177 bytes} [Wed May 25 14:42:25 2022] GET /identity/v3/users/040eba2aee9947abba3cf844a783d316 => generated 297 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:42:26.113151 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93e65f25-ca2b-4040-b90b-bd5de58fbe00 None admin] Authenticating user token {{(pid=101893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:42:26.136651 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG dbcounter [-] [101893] Writing DB stats keystone:SELECT=100 {{(pid=101893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:42:26.172579 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 127/259] 10.222.0.84 () {58 vars in 1023 bytes} [Wed May 25 14:42:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 25 14:42:26.179581 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53624051-7949-4d73-8a18-4dc24fa2461e None None] Authenticating user token {{(pid=101892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:42:26.255043 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93e65f25-ca2b-4040-b90b-bd5de58fbe00 None admin] Validating token access rules against request {{(pid=101893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:42:26.296627 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21b484d4-d9ce-404f-ae2a-4f2a9c77a0ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:42:26.297757 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b484d4-d9ce-404f-ae2a-4f2a9c77a0ff None admin] REQUEST_METHOD: `GET` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:42:26.298217 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b484d4-d9ce-404f-ae2a-4f2a9c77a0ff None admin] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:42:26.298652 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b484d4-d9ce-404f-ae2a-4f2a9c77a0ff None admin] PATH_INFO: `/v3/projects/ac9e4da865b34de49eecd54e4f6f34e6` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:42:26.300637 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21b484d4-d9ce-404f-ae2a-4f2a9c77a0ff None admin] RBAC: Authorizing `identity:get_project(project_id=ac9e4da865b34de49eecd54e4f6f34e6)` {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:42:26.302857 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21b484d4-d9ce-404f-ae2a-4f2a9c77a0ff None admin] RBAC: Authorization granted {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:42:26.305198 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 133/260] 10.222.0.84 () {56 vars in 1186 bytes} [Wed May 25 14:42:26 2022] GET /identity/v3/projects/ac9e4da865b34de49eecd54e4f6f34e6 => generated 302 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:42:26.307067 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21b484d4-d9ce-404f-ae2a-4f2a9c77a0ff None admin] Authenticating user token {{(pid=101893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:42:26.326609 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53624051-7949-4d73-8a18-4dc24fa2461e None None] Validating token access rules against request {{(pid=101892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:42:26.361327 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f09d600a-cf10-4057-b3f5-0816ed694d66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:42:26.362563 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09d600a-cf10-4057-b3f5-0816ed694d66 None admin] REQUEST_METHOD: `GET` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:42:26.363050 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09d600a-cf10-4057-b3f5-0816ed694d66 None admin] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:42:26.363424 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09d600a-cf10-4057-b3f5-0816ed694d66 None admin] PATH_INFO: `/v3/projects/ac9e4da865b34de49eecd54e4f6f34e6` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:42:26.364782 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f09d600a-cf10-4057-b3f5-0816ed694d66 None admin] RBAC: Authorizing `identity:get_project(project_id=ac9e4da865b34de49eecd54e4f6f34e6)` {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:42:26.366338 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f09d600a-cf10-4057-b3f5-0816ed694d66 None admin] RBAC: Authorization granted {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:42:26.369002 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 128/261] 10.222.0.84 () {56 vars in 1186 bytes} [Wed May 25 14:42:26 2022] GET /identity/v3/projects/ac9e4da865b34de49eecd54e4f6f34e6 => generated 302 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:42:26.370015 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f09d600a-cf10-4057-b3f5-0816ed694d66 None admin] Authenticating user token {{(pid=101892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:42:26.413520 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG dbcounter [-] [101893] Writing DB stats keystone:SELECT=100 {{(pid=101893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:42:26.414715 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG dbcounter [-] [101892] Writing DB stats keystone:SELECT=100 {{(pid=101892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:42:26.426127 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21b484d4-d9ce-404f-ae2a-4f2a9c77a0ff None admin] Validating token access rules against request {{(pid=101893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:42:26.465554 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84823953-5168-4791-a39c-129e92e0cc46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:42:26.466697 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84823953-5168-4791-a39c-129e92e0cc46 None admin] REQUEST_METHOD: `GET` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:42:26.467191 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84823953-5168-4791-a39c-129e92e0cc46 None admin] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:42:26.467662 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84823953-5168-4791-a39c-129e92e0cc46 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:42:26.479586 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84823953-5168-4791-a39c-129e92e0cc46 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 14:42:26.488374 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application [None req-84823953-5168-4791-a39c-129e92e0cc46 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 25 14:42:26.488374 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:42:26.488374 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 14:42:26.488374 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 14:42:26.488374 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 14:42:26.488374 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 14:42:26.488374 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 14:42:26.488374 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 14:42:26.488374 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 14:42:26.488374 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 14:42:26.488374 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 14:42:26.488374 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 14:42:26.488374 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 14:42:26.488374 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 14:42:26.488374 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 14:42:26.488374 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 14:42:26.489333 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 14:42:26.489333 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 14:42:26.489333 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 14:42:26.489333 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 14:42:26.489333 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 14:42:26.489333 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 14:42:26.489333 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 14:42:26.489333 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 14:42:26.489333 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 14:42:26.489333 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return self.get_or_create( May 25 14:42:26.489333 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 14:42:26.489333 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application with Lock( May 25 14:42:26.489333 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 14:42:26.489333 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return self._enter() May 25 14:42:26.489333 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 14:42:26.489333 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 14:42:26.490108 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 14:42:26.490108 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return self.creator() May 25 14:42:26.490108 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 14:42:26.490108 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application created_value = creator( May 25 14:42:26.490108 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 14:42:26.490108 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 14:42:26.490108 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 14:42:26.490108 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 14:42:26.490108 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 14:42:26.490108 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 14:42:26.490108 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 25 14:42:26.490108 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application May 25 14:42:26.492474 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 134/262] 10.222.0.84 () {56 vars in 1114 bytes} [Wed May 25 14:42:26 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 14:42:26.493968 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84823953-5168-4791-a39c-129e92e0cc46 None admin] Authenticating user token {{(pid=101893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:42:26.501961 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f09d600a-cf10-4057-b3f5-0816ed694d66 None admin] Validating token access rules against request {{(pid=101892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:42:26.545072 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a76344bd-ed34-43f3-a953-36a772ffbe92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:42:26.545740 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76344bd-ed34-43f3-a953-36a772ffbe92 None admin] REQUEST_METHOD: `GET` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:42:26.546024 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76344bd-ed34-43f3-a953-36a772ffbe92 None admin] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:42:26.546326 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76344bd-ed34-43f3-a953-36a772ffbe92 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:42:26.547398 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a76344bd-ed34-43f3-a953-36a772ffbe92 None admin] RBAC: Adding query filter params (role.id=d289ba5202044f90baf900bb40b116b8, scope.project.id=ac9e4da865b34de49eecd54e4f6f34e6, user.id=a876555c722e4fdb9131f1e896597cc1) {{(pid=101892) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:42:26.547744 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a76344bd-ed34-43f3-a953-36a772ffbe92 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:42:26.549626 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a76344bd-ed34-43f3-a953-36a772ffbe92 None admin] RBAC: Authorization granted {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:42:26.563801 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 129/263] 10.222.0.84 () {56 vars in 1374 bytes} [Wed May 25 14:42:26 2022] GET /identity/v3/role_assignments?user.id=a876555c722e4fdb9131f1e896597cc1&scope.project.id=ac9e4da865b34de49eecd54e4f6f34e6&role.id=d289ba5202044f90baf900bb40b116b8 => generated 259 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:42:26.563801 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a76344bd-ed34-43f3-a953-36a772ffbe92 None admin] Authenticating user token {{(pid=101892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:42:26.678097 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84823953-5168-4791-a39c-129e92e0cc46 None admin] Validating token access rules against request {{(pid=101893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:42:26.752339 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c2bed3e-3424-4d22-add2-34ff0a4561d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:42:26.753258 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2bed3e-3424-4d22-add2-34ff0a4561d7 None admin] REQUEST_METHOD: `PUT` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:42:26.753541 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2bed3e-3424-4d22-add2-34ff0a4561d7 None admin] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:42:26.753819 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2bed3e-3424-4d22-add2-34ff0a4561d7 None admin] PATH_INFO: `/v3/projects/ac9e4da865b34de49eecd54e4f6f34e6/users/040eba2aee9947abba3cf844a783d316/roles/ff664fa0db7e4262a5accde96c3df4c3` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:42:26.761314 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c2bed3e-3424-4d22-add2-34ff0a4561d7 None admin] RBAC: Authorizing `identity:create_grant(project_id=ac9e4da865b34de49eecd54e4f6f34e6, user_id=040eba2aee9947abba3cf844a783d316, role_id=ff664fa0db7e4262a5accde96c3df4c3)` {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:42:26.762839 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c2bed3e-3424-4d22-add2-34ff0a4561d7 None admin] RBAC: Authorization granted {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:42:26.763943 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG dbcounter [-] [101892] Writing DB stats keystone:SELECT=100 {{(pid=101892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:42:26.770219 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a76344bd-ed34-43f3-a953-36a772ffbe92 None admin] Validating token access rules against request {{(pid=101892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:42:26.806688 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a493fb6-c6d6-4701-bddb-1db4089fff84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:42:26.807355 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a493fb6-c6d6-4701-bddb-1db4089fff84 None admin] REQUEST_METHOD: `GET` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:42:26.807664 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a493fb6-c6d6-4701-bddb-1db4089fff84 None admin] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:42:26.807940 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a493fb6-c6d6-4701-bddb-1db4089fff84 None admin] PATH_INFO: `/v3/roles` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:42:26.808687 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a493fb6-c6d6-4701-bddb-1db4089fff84 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=101892) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:42:26.808992 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a493fb6-c6d6-4701-bddb-1db4089fff84 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:42:26.810486 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a493fb6-c6d6-4701-bddb-1db4089fff84 None admin] RBAC: Authorization granted {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:42:26.818993 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 130/264] 10.222.0.84 () {56 vars in 1111 bytes} [Wed May 25 14:42:26 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 262 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:42:26.824768 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a493fb6-c6d6-4701-bddb-1db4089fff84 None admin] Authenticating user token {{(pid=101892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:42:26.878352 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 135/265] 10.222.0.84 () {58 vars in 1439 bytes} [Wed May 25 14:42:26 2022] PUT /identity/v3/projects/ac9e4da865b34de49eecd54e4f6f34e6/users/040eba2aee9947abba3cf844a783d316/roles/ff664fa0db7e4262a5accde96c3df4c3 => generated 0 bytes in 385 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 14:42:26.941360 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a493fb6-c6d6-4701-bddb-1db4089fff84 None admin] Validating token access rules against request {{(pid=101892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:42:26.988752 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad38a495-8e91-4140-8b9c-466b0dac789e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:42:26.989660 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad38a495-8e91-4140-8b9c-466b0dac789e None admin] REQUEST_METHOD: `GET` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:42:26.989942 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad38a495-8e91-4140-8b9c-466b0dac789e None admin] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:42:26.990214 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad38a495-8e91-4140-8b9c-466b0dac789e None admin] PATH_INFO: `/v3/users/14f94aea804545e38c953ee78da5281e` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:42:26.991521 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad38a495-8e91-4140-8b9c-466b0dac789e None admin] RBAC: Authorizing `identity:get_user(user_id=14f94aea804545e38c953ee78da5281e)` {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:42:26.993181 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad38a495-8e91-4140-8b9c-466b0dac789e None admin] RBAC: Authorization granted {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:42:26.995675 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 131/266] 10.222.0.84 () {56 vars in 1177 bytes} [Wed May 25 14:42:26 2022] GET /identity/v3/users/14f94aea804545e38c953ee78da5281e => generated 283 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 14:42:27.001340 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c2bed3e-3424-4d22-add2-34ff0a4561d7 None admin] Authenticating user token {{(pid=101893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:42:27.018291 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG dbcounter [-] [101893] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=101893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:42:27.162893 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c2bed3e-3424-4d22-add2-34ff0a4561d7 None admin] Validating token access rules against request {{(pid=101893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:42:27.198923 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9755e2e-435e-4bb6-b0bd-f7176d10d8bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:42:27.199614 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9755e2e-435e-4bb6-b0bd-f7176d10d8bb None admin] REQUEST_METHOD: `GET` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:42:27.199910 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9755e2e-435e-4bb6-b0bd-f7176d10d8bb None admin] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:42:27.200190 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9755e2e-435e-4bb6-b0bd-f7176d10d8bb None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:42:27.273160 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9755e2e-435e-4bb6-b0bd-f7176d10d8bb None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:42:27.274693 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9755e2e-435e-4bb6-b0bd-f7176d10d8bb None admin] RBAC: Authorization granted {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:42:27.317398 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG dbcounter [-] [101893] Writing DB stats keystone:SELECT=100 {{(pid=101893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:42:27.442512 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 136/267] 10.222.0.84 () {58 vars in 1282 bytes} [Wed May 25 14:42:26 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 442 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 25 14:42:27.447928 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad38a495-8e91-4140-8b9c-466b0dac789e None admin] Authenticating user token {{(pid=101892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:42:27.476252 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG dbcounter [-] [101892] Writing DB stats keystone:SELECT=100 {{(pid=101892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:42:27.567283 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad38a495-8e91-4140-8b9c-466b0dac789e None admin] Validating token access rules against request {{(pid=101892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:42:27.622626 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47444de6-908e-466d-8a39-8d7acc99a8b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:42:27.623501 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47444de6-908e-466d-8a39-8d7acc99a8b1 None admin] REQUEST_METHOD: `GET` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:42:27.623901 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47444de6-908e-466d-8a39-8d7acc99a8b1 None admin] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:42:27.624184 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47444de6-908e-466d-8a39-8d7acc99a8b1 None admin] PATH_INFO: `/v3/projects/ac9e4da865b34de49eecd54e4f6f34e6` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:42:27.625664 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47444de6-908e-466d-8a39-8d7acc99a8b1 None admin] RBAC: Authorizing `identity:get_project(project_id=ac9e4da865b34de49eecd54e4f6f34e6)` {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:42:27.627120 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47444de6-908e-466d-8a39-8d7acc99a8b1 None admin] RBAC: Authorization granted {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:42:27.629840 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 132/268] 10.222.0.84 () {56 vars in 1186 bytes} [Wed May 25 14:42:27 2022] GET /identity/v3/projects/ac9e4da865b34de49eecd54e4f6f34e6 => generated 302 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:42:27.634590 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9755e2e-435e-4bb6-b0bd-f7176d10d8bb None admin] Authenticating user token {{(pid=101893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:42:27.747326 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9755e2e-435e-4bb6-b0bd-f7176d10d8bb None admin] Validating token access rules against request {{(pid=101893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:42:27.754986 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG dbcounter [-] [101893] Writing DB stats keystone:SELECT=100 {{(pid=101893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:42:27.782282 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb5fc64d-d358-41cb-a69b-5ee16acc459d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:42:27.782938 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5fc64d-d358-41cb-a69b-5ee16acc459d None admin] REQUEST_METHOD: `GET` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:42:27.783220 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5fc64d-d358-41cb-a69b-5ee16acc459d None admin] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:42:27.783496 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5fc64d-d358-41cb-a69b-5ee16acc459d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:42:27.784354 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb5fc64d-d358-41cb-a69b-5ee16acc459d None admin] RBAC: Adding query filter params (role.id=d3defd94f93b4e76af116df691240185, scope.project.id=ac9e4da865b34de49eecd54e4f6f34e6, user.id=14f94aea804545e38c953ee78da5281e) {{(pid=101893) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:42:27.784666 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb5fc64d-d358-41cb-a69b-5ee16acc459d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:42:27.786239 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb5fc64d-d358-41cb-a69b-5ee16acc459d None admin] RBAC: Authorization granted {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:42:27.792983 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 137/269] 10.222.0.84 () {56 vars in 1374 bytes} [Wed May 25 14:42:27 2022] GET /identity/v3/role_assignments?user.id=14f94aea804545e38c953ee78da5281e&scope.project.id=ac9e4da865b34de49eecd54e4f6f34e6&role.id=d3defd94f93b4e76af116df691240185 => generated 608 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:42:28.411682 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe4dc19-9f0b-4cd4-8de6-c1d7c747c302 None None] REQUEST_METHOD: `GET` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:42:28.412302 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe4dc19-9f0b-4cd4-8de6-c1d7c747c302 None None] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:42:28.412447 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe4dc19-9f0b-4cd4-8de6-c1d7c747c302 None None] PATH_INFO: `/` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:42:28.414654 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 133/270] 10.222.0.84 () {54 vars in 926 bytes} [Wed May 25 14:42:28 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 14:42:28.421061 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-006d2392-6a38-41af-9a3b-3bab8622b2cf None None] REQUEST_METHOD: `POST` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:42:28.421511 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-006d2392-6a38-41af-9a3b-3bab8622b2cf None None] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:42:28.421709 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-006d2392-6a38-41af-9a3b-3bab8622b2cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:42:28.442947 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.auth.core [None req-006d2392-6a38-41af-9a3b-3bab8622b2cf None None] MFA Rules not processed for user `05d87e87798e429aa1c10b24391f915e`. Rule list: `[]` (Enabled: `True`). {{(pid=101893) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:42:28.444333 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.fernet_utils [None req-006d2392-6a38-41af-9a3b-3bab8622b2cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=101893) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:42:28.518047 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e40382-37af-44d8-94c9-549afd4c1781 None None] REQUEST_METHOD: `GET` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:42:28.518362 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e40382-37af-44d8-94c9-549afd4c1781 None None] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:42:28.518595 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e40382-37af-44d8-94c9-549afd4c1781 None None] PATH_INFO: `/` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:42:28.520009 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 134/271] 10.222.0.84 () {54 vars in 926 bytes} [Wed May 25 14:42:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 25 14:42:28.523685 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 138/272] 10.222.0.84 () {58 vars in 1023 bytes} [Wed May 25 14:42:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 25 14:42:28.525144 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d96ec6-eca4-46bb-b16f-af8752640e16 None None] REQUEST_METHOD: `POST` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:42:28.525437 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d96ec6-eca4-46bb-b16f-af8752640e16 None None] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:42:28.525721 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d96ec6-eca4-46bb-b16f-af8752640e16 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:42:28.543674 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.auth.core [None req-34d96ec6-eca4-46bb-b16f-af8752640e16 None None] MFA Rules not processed for user `05d87e87798e429aa1c10b24391f915e`. Rule list: `[]` (Enabled: `True`). {{(pid=101892) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:42:28.545186 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.fernet_utils [None req-34d96ec6-eca4-46bb-b16f-af8752640e16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=101892) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:42:28.551411 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-006d2392-6a38-41af-9a3b-3bab8622b2cf None None] Authenticating user token {{(pid=101893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:42:28.624082 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 135/273] 10.222.0.84 () {58 vars in 1023 bytes} [Wed May 25 14:42:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 25 14:42:28.649659 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34d96ec6-eca4-46bb-b16f-af8752640e16 None None] Authenticating user token {{(pid=101892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:42:28.660866 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG dbcounter [-] [101893] Writing DB stats keystone:SELECT=100 {{(pid=101893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:42:28.663997 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-006d2392-6a38-41af-9a3b-3bab8622b2cf None None] Validating token access rules against request {{(pid=101893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:42:28.680023 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG dbcounter [-] [101892] Writing DB stats keystone:SELECT=100 {{(pid=101892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:42:28.702612 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08abe6d4-7485-4df9-8f99-699910ea5296 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:42:28.703760 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08abe6d4-7485-4df9-8f99-699910ea5296 None admin] REQUEST_METHOD: `GET` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:42:28.704221 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08abe6d4-7485-4df9-8f99-699910ea5296 None admin] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:42:28.711915 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08abe6d4-7485-4df9-8f99-699910ea5296 None admin] PATH_INFO: `/v3/domains/default` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:42:28.711915 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08abe6d4-7485-4df9-8f99-699910ea5296 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:42:28.711915 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08abe6d4-7485-4df9-8f99-699910ea5296 None admin] RBAC: Authorization granted {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:42:28.711915 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 139/274] 10.222.0.84 () {56 vars in 1108 bytes} [Wed May 25 14:42:28 2022] GET /identity/v3/domains/default => generated 199 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 14:42:28.719776 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08abe6d4-7485-4df9-8f99-699910ea5296 None admin] Authenticating user token {{(pid=101893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:42:28.790876 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34d96ec6-eca4-46bb-b16f-af8752640e16 None None] Validating token access rules against request {{(pid=101892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:42:28.835374 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08abe6d4-7485-4df9-8f99-699910ea5296 None admin] Validating token access rules against request {{(pid=101893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:42:28.836872 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec308301-6fd0-4a77-bb9c-a28000c4d37f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:42:28.838047 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec308301-6fd0-4a77-bb9c-a28000c4d37f None admin] REQUEST_METHOD: `GET` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:42:28.838400 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec308301-6fd0-4a77-bb9c-a28000c4d37f None admin] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:42:28.839668 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec308301-6fd0-4a77-bb9c-a28000c4d37f None admin] PATH_INFO: `/v3/roles/member` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:42:28.857573 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec308301-6fd0-4a77-bb9c-a28000c4d37f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 14:42:28.869933 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application [None req-ec308301-6fd0-4a77-bb9c-a28000c4d37f None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 25 14:42:28.869933 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:42:28.869933 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 14:42:28.869933 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 14:42:28.869933 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 14:42:28.869933 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 14:42:28.869933 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 14:42:28.869933 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 14:42:28.869933 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 14:42:28.869933 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 14:42:28.869933 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 14:42:28.869933 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 14:42:28.869933 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 14:42:28.869933 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 14:42:28.869933 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 14:42:28.869933 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 14:42:28.870864 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 14:42:28.870864 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 14:42:28.870864 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 14:42:28.870864 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 14:42:28.870864 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 14:42:28.870864 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 14:42:28.870864 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 14:42:28.870864 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 14:42:28.870864 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 14:42:28.870864 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application return self.get_or_create( May 25 14:42:28.870864 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 14:42:28.870864 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application with Lock( May 25 14:42:28.870864 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 14:42:28.870864 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application return self._enter() May 25 14:42:28.870864 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 14:42:28.870864 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 14:42:28.871769 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 14:42:28.871769 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application return self.creator() May 25 14:42:28.871769 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 14:42:28.871769 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application created_value = creator( May 25 14:42:28.871769 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 14:42:28.871769 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 14:42:28.871769 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 14:42:28.871769 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 14:42:28.871769 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 14:42:28.871769 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 14:42:28.871769 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 25 14:42:28.871769 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application May 25 14:42:28.878122 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 136/275] 10.222.0.84 () {56 vars in 1099 bytes} [Wed May 25 14:42:28 2022] GET /identity/v3/roles/member => generated 84 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 25 14:42:28.879939 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec308301-6fd0-4a77-bb9c-a28000c4d37f None admin] Authenticating user token {{(pid=101892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:42:28.880629 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fbae16f-56b7-4b36-a294-0a26bfd911d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:42:28.881577 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fbae16f-56b7-4b36-a294-0a26bfd911d3 None admin] REQUEST_METHOD: `POST` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:42:28.882117 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fbae16f-56b7-4b36-a294-0a26bfd911d3 None admin] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:42:28.882829 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fbae16f-56b7-4b36-a294-0a26bfd911d3 None admin] PATH_INFO: `/v3/users` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:42:28.884770 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fbae16f-56b7-4b36-a294-0a26bfd911d3 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:42:28.886461 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fbae16f-56b7-4b36-a294-0a26bfd911d3 None admin] RBAC: Authorization granted {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:42:28.970988 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 140/276] 10.222.0.84 () {60 vars in 1132 bytes} [Wed May 25 14:42:28 2022] POST /identity/v3/users => generated 293 bytes in 251 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 25 14:42:28.975583 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG dbcounter [-] [101892] Writing DB stats keystone:SELECT=100 {{(pid=101892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:42:28.997446 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec308301-6fd0-4a77-bb9c-a28000c4d37f None admin] Validating token access rules against request {{(pid=101892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:42:29.037108 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1075ef35-32b6-4f7b-8ecd-79c4b403768a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:42:29.038310 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1075ef35-32b6-4f7b-8ecd-79c4b403768a None admin] REQUEST_METHOD: `GET` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:42:29.038826 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1075ef35-32b6-4f7b-8ecd-79c4b403768a None admin] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:42:29.039312 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1075ef35-32b6-4f7b-8ecd-79c4b403768a None admin] PATH_INFO: `/v3/roles` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:42:29.040999 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1075ef35-32b6-4f7b-8ecd-79c4b403768a None admin] RBAC: Adding query filter params (name=member) {{(pid=101892) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:42:29.041719 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1075ef35-32b6-4f7b-8ecd-79c4b403768a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:42:29.043544 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1075ef35-32b6-4f7b-8ecd-79c4b403768a None admin] RBAC: Authorization granted {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:42:29.059907 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 137/277] 10.222.0.84 () {56 vars in 1101 bytes} [Wed May 25 14:42:28 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:42:29.061707 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fbae16f-56b7-4b36-a294-0a26bfd911d3 None admin] Authenticating user token {{(pid=101893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:42:29.104266 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG dbcounter [-] [101893] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=101893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:42:29.171213 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a7d5fb-8e12-4bbe-9187-b410188d4914 None None] REQUEST_METHOD: `GET` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:42:29.171599 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a7d5fb-8e12-4bbe-9187-b410188d4914 None None] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:42:29.171806 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a7d5fb-8e12-4bbe-9187-b410188d4914 None None] PATH_INFO: `/` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:42:29.173341 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 138/278] 10.222.0.84 () {54 vars in 926 bytes} [Wed May 25 14:42:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 14:42:29.178801 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f03a79-c2b9-4e54-ac49-4231da416835 None None] REQUEST_METHOD: `POST` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:42:29.179097 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f03a79-c2b9-4e54-ac49-4231da416835 None None] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:42:29.179381 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f03a79-c2b9-4e54-ac49-4231da416835 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:42:29.202781 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fbae16f-56b7-4b36-a294-0a26bfd911d3 None admin] Validating token access rules against request {{(pid=101893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:42:29.204037 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.auth.core [None req-11f03a79-c2b9-4e54-ac49-4231da416835 None None] MFA Rules not processed for user `05d87e87798e429aa1c10b24391f915e`. Rule list: `[]` (Enabled: `True`). {{(pid=101892) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:42:29.205249 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.fernet_utils [None req-11f03a79-c2b9-4e54-ac49-4231da416835 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=101892) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:42:29.253319 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c9acc0c-f65b-44f1-b6c8-19939a4b065c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:42:29.254424 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9acc0c-f65b-44f1-b6c8-19939a4b065c None admin] REQUEST_METHOD: `GET` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:42:29.254763 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9acc0c-f65b-44f1-b6c8-19939a4b065c None admin] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:42:29.255032 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9acc0c-f65b-44f1-b6c8-19939a4b065c None admin] PATH_INFO: `/v3/users/0eb9e5b6a292486a964626fe077319a1` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:42:29.272576 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c9acc0c-f65b-44f1-b6c8-19939a4b065c None admin] RBAC: Authorizing `identity:get_user(user_id=0eb9e5b6a292486a964626fe077319a1)` {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:42:29.273607 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c9acc0c-f65b-44f1-b6c8-19939a4b065c None admin] RBAC: Authorization granted {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:42:29.276636 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 141/279] 10.222.0.84 () {56 vars in 1177 bytes} [Wed May 25 14:42:29 2022] GET /identity/v3/users/0eb9e5b6a292486a964626fe077319a1 => generated 293 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:42:29.282335 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c9acc0c-f65b-44f1-b6c8-19939a4b065c None admin] Authenticating user token {{(pid=101893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:42:29.295347 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 139/280] 10.222.0.84 () {58 vars in 1023 bytes} [Wed May 25 14:42:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 25 14:42:29.321137 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11f03a79-c2b9-4e54-ac49-4231da416835 None None] Authenticating user token {{(pid=101892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:42:29.406913 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG dbcounter [-] [101893] Writing DB stats keystone:SELECT=100 {{(pid=101893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:42:29.438477 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c9acc0c-f65b-44f1-b6c8-19939a4b065c None admin] Validating token access rules against request {{(pid=101893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:42:29.442913 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG dbcounter [-] [101892] Writing DB stats keystone:SELECT=100 {{(pid=101892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:42:29.476913 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11f03a79-c2b9-4e54-ac49-4231da416835 None None] Validating token access rules against request {{(pid=101892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:42:29.479405 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf4d165c-8c9a-4e20-a2ab-42e31d3a19cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:42:29.480324 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4d165c-8c9a-4e20-a2ab-42e31d3a19cc None admin] REQUEST_METHOD: `GET` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:42:29.480797 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4d165c-8c9a-4e20-a2ab-42e31d3a19cc None admin] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:42:29.481283 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4d165c-8c9a-4e20-a2ab-42e31d3a19cc None admin] PATH_INFO: `/v3/role_assignments` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:42:29.482304 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf4d165c-8c9a-4e20-a2ab-42e31d3a19cc None admin] RBAC: Adding query filter params (role.id=ff664fa0db7e4262a5accde96c3df4c3, user.id=0eb9e5b6a292486a964626fe077319a1, scope.system=all) {{(pid=101893) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:42:29.482834 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf4d165c-8c9a-4e20-a2ab-42e31d3a19cc None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:42:29.484540 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf4d165c-8c9a-4e20-a2ab-42e31d3a19cc None admin] RBAC: Authorization granted {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:42:29.490523 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 142/281] 10.222.0.84 () {56 vars in 1308 bytes} [Wed May 25 14:42:29 2022] GET /identity/v3/role_assignments?user.id=0eb9e5b6a292486a964626fe077319a1&scope.system=all&role.id=ff664fa0db7e4262a5accde96c3df4c3 => generated 226 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 14:42:29.528468 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e0f9aa6-eaa9-44c0-af96-aead586eafaa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:42:29.529663 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0f9aa6-eaa9-44c0-af96-aead586eafaa None admin] REQUEST_METHOD: `GET` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:42:29.530147 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0f9aa6-eaa9-44c0-af96-aead586eafaa None admin] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:42:29.530619 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0f9aa6-eaa9-44c0-af96-aead586eafaa None admin] PATH_INFO: `/v3/roles/reader` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:42:29.547005 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e0f9aa6-eaa9-44c0-af96-aead586eafaa None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 14:42:29.548096 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24fe828-1c70-4c48-8925-ee216c216fe3 None None] REQUEST_METHOD: `GET` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:42:29.548395 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24fe828-1c70-4c48-8925-ee216c216fe3 None None] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:42:29.548676 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24fe828-1c70-4c48-8925-ee216c216fe3 None None] PATH_INFO: `/` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:42:29.551162 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 143/282] 10.222.0.84 () {54 vars in 926 bytes} [Wed May 25 14:42:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 25 14:42:29.554942 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application [None req-1e0f9aa6-eaa9-44c0-af96-aead586eafaa None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 25 14:42:29.554942 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:42:29.554942 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 14:42:29.554942 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 14:42:29.554942 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 14:42:29.554942 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 14:42:29.554942 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 14:42:29.554942 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 14:42:29.554942 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 14:42:29.554942 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 14:42:29.554942 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 14:42:29.554942 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 14:42:29.554942 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 14:42:29.554942 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 14:42:29.554942 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 14:42:29.554942 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 14:42:29.556143 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 14:42:29.556143 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 14:42:29.556143 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 14:42:29.556143 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 14:42:29.556143 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 14:42:29.556143 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 14:42:29.556143 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 14:42:29.556143 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 14:42:29.556143 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 14:42:29.556143 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application return self.get_or_create( May 25 14:42:29.556143 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 14:42:29.556143 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application with Lock( May 25 14:42:29.556143 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 14:42:29.556143 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application return self._enter() May 25 14:42:29.556143 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 14:42:29.556143 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 14:42:29.557246 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 14:42:29.557246 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application return self.creator() May 25 14:42:29.557246 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 14:42:29.557246 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application created_value = creator( May 25 14:42:29.557246 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 14:42:29.557246 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 14:42:29.557246 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 14:42:29.557246 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 14:42:29.557246 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 14:42:29.557246 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 14:42:29.557246 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 25 14:42:29.557246 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application May 25 14:42:29.559467 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba50d02a-a6bb-4a9e-921c-7b78f7ede58f None None] REQUEST_METHOD: `POST` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:42:29.559936 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba50d02a-a6bb-4a9e-921c-7b78f7ede58f None None] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:42:29.560356 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba50d02a-a6bb-4a9e-921c-7b78f7ede58f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:42:29.563780 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 140/283] 10.222.0.84 () {56 vars in 1099 bytes} [Wed May 25 14:42:29 2022] GET /identity/v3/roles/reader => generated 84 bytes in 243 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 25 14:42:29.565000 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e0f9aa6-eaa9-44c0-af96-aead586eafaa None admin] Authenticating user token {{(pid=101892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:42:29.599817 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.auth.core [None req-ba50d02a-a6bb-4a9e-921c-7b78f7ede58f None None] MFA Rules not processed for user `05d87e87798e429aa1c10b24391f915e`. Rule list: `[]` (Enabled: `True`). {{(pid=101893) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:42:29.601044 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.fernet_utils [None req-ba50d02a-a6bb-4a9e-921c-7b78f7ede58f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=101893) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:42:29.679524 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e0f9aa6-eaa9-44c0-af96-aead586eafaa None admin] Validating token access rules against request {{(pid=101892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:42:29.723457 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff399ea-b46c-4d1d-a708-d8d85e70f5b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:42:29.725666 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff399ea-b46c-4d1d-a708-d8d85e70f5b1 None admin] REQUEST_METHOD: `GET` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:42:29.727596 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff399ea-b46c-4d1d-a708-d8d85e70f5b1 None admin] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:42:29.728141 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff399ea-b46c-4d1d-a708-d8d85e70f5b1 None admin] PATH_INFO: `/v3/roles` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:42:29.729141 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fff399ea-b46c-4d1d-a708-d8d85e70f5b1 None admin] RBAC: Adding query filter params (name=reader) {{(pid=101892) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:42:29.730584 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fff399ea-b46c-4d1d-a708-d8d85e70f5b1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:42:29.732272 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fff399ea-b46c-4d1d-a708-d8d85e70f5b1 None admin] RBAC: Authorization granted {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:42:29.739273 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG dbcounter [-] [101892] Writing DB stats keystone:SELECT=100 {{(pid=101892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:42:29.750194 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 141/284] 10.222.0.84 () {56 vars in 1101 bytes} [Wed May 25 14:42:29 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:42:29.757050 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff399ea-b46c-4d1d-a708-d8d85e70f5b1 None admin] Authenticating user token {{(pid=101892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:42:29.765793 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 144/285] 10.222.0.84 () {58 vars in 1023 bytes} [Wed May 25 14:42:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 25 14:42:29.811874 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba50d02a-a6bb-4a9e-921c-7b78f7ede58f None None] Authenticating user token {{(pid=101893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:42:29.923965 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG dbcounter [-] [101893] Writing DB stats keystone:SELECT=100 {{(pid=101893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:42:29.940504 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba50d02a-a6bb-4a9e-921c-7b78f7ede58f None None] Validating token access rules against request {{(pid=101893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:42:29.954370 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff399ea-b46c-4d1d-a708-d8d85e70f5b1 None admin] Validating token access rules against request {{(pid=101892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:42:30.010780 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e722b2c0-a2d9-4186-be5a-bbaff691d70a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:42:30.011686 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e722b2c0-a2d9-4186-be5a-bbaff691d70a None admin] REQUEST_METHOD: `GET` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:42:30.011975 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e722b2c0-a2d9-4186-be5a-bbaff691d70a None admin] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:42:30.012624 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e722b2c0-a2d9-4186-be5a-bbaff691d70a None admin] PATH_INFO: `/v3/users/a876555c722e4fdb9131f1e896597cc1` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:42:30.013956 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d16f3b2-3e3b-4f38-a05c-f5358df6dcb6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:42:30.014912 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d16f3b2-3e3b-4f38-a05c-f5358df6dcb6 None admin] REQUEST_METHOD: `GET` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:42:30.015363 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d16f3b2-3e3b-4f38-a05c-f5358df6dcb6 None admin] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:42:30.015818 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d16f3b2-3e3b-4f38-a05c-f5358df6dcb6 None admin] PATH_INFO: `/v3/roles/member` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:42:30.017598 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e722b2c0-a2d9-4186-be5a-bbaff691d70a None admin] RBAC: Authorizing `identity:get_user(user_id=a876555c722e4fdb9131f1e896597cc1)` {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:42:30.019359 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e722b2c0-a2d9-4186-be5a-bbaff691d70a None admin] RBAC: Authorization granted {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:42:30.025714 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 142/286] 10.222.0.84 () {56 vars in 1177 bytes} [Wed May 25 14:42:29 2022] GET /identity/v3/users/a876555c722e4fdb9131f1e896597cc1 => generated 297 bytes in 267 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 14:42:30.028724 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e722b2c0-a2d9-4186-be5a-bbaff691d70a None admin] Authenticating user token {{(pid=101892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:42:30.042068 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d16f3b2-3e3b-4f38-a05c-f5358df6dcb6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 14:42:30.058190 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application [None req-1d16f3b2-3e3b-4f38-a05c-f5358df6dcb6 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 25 14:42:30.058190 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:42:30.058190 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 14:42:30.058190 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 14:42:30.058190 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 14:42:30.058190 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 14:42:30.058190 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 14:42:30.058190 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 14:42:30.058190 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 14:42:30.058190 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 14:42:30.058190 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 14:42:30.058190 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 14:42:30.058190 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 14:42:30.058190 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 14:42:30.058190 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 14:42:30.058190 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 14:42:30.059386 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 14:42:30.059386 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 14:42:30.059386 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 14:42:30.059386 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 14:42:30.059386 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 14:42:30.059386 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 14:42:30.059386 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 14:42:30.059386 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 14:42:30.059386 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 14:42:30.059386 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return self.get_or_create( May 25 14:42:30.059386 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 14:42:30.059386 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application with Lock( May 25 14:42:30.059386 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 14:42:30.059386 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return self._enter() May 25 14:42:30.059386 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 14:42:30.059386 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 14:42:30.060409 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 14:42:30.060409 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return self.creator() May 25 14:42:30.060409 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 14:42:30.060409 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application created_value = creator( May 25 14:42:30.060409 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 14:42:30.060409 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 14:42:30.060409 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 14:42:30.060409 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 14:42:30.060409 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 14:42:30.060409 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 14:42:30.060409 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 25 14:42:30.060409 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application May 25 14:42:30.065483 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 145/287] 10.222.0.84 () {56 vars in 1099 bytes} [Wed May 25 14:42:29 2022] GET /identity/v3/roles/member => generated 84 bytes in 254 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 14:42:30.068200 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d16f3b2-3e3b-4f38-a05c-f5358df6dcb6 None admin] Authenticating user token {{(pid=101893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:42:30.138778 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG dbcounter [-] [101892] Writing DB stats keystone:SELECT=100 {{(pid=101892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:42:30.175157 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e722b2c0-a2d9-4186-be5a-bbaff691d70a None admin] Validating token access rules against request {{(pid=101892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:42:30.212944 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0867a505-8ac8-4ff7-99ed-325ce99e1c1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:42:30.214126 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0867a505-8ac8-4ff7-99ed-325ce99e1c1e None admin] REQUEST_METHOD: `GET` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:42:30.214633 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0867a505-8ac8-4ff7-99ed-325ce99e1c1e None admin] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:42:30.215084 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0867a505-8ac8-4ff7-99ed-325ce99e1c1e None admin] PATH_INFO: `/v3/projects/ac9e4da865b34de49eecd54e4f6f34e6` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:42:30.216476 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0867a505-8ac8-4ff7-99ed-325ce99e1c1e None admin] RBAC: Authorizing `identity:get_project(project_id=ac9e4da865b34de49eecd54e4f6f34e6)` {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:42:30.218851 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0867a505-8ac8-4ff7-99ed-325ce99e1c1e None admin] RBAC: Authorization granted {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:42:30.220755 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 143/288] 10.222.0.84 () {56 vars in 1186 bytes} [Wed May 25 14:42:30 2022] GET /identity/v3/projects/ac9e4da865b34de49eecd54e4f6f34e6 => generated 302 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:42:30.229890 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0867a505-8ac8-4ff7-99ed-325ce99e1c1e None admin] Authenticating user token {{(pid=101892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:42:30.262371 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d16f3b2-3e3b-4f38-a05c-f5358df6dcb6 None admin] Validating token access rules against request {{(pid=101893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:42:30.317755 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9709af38-6703-4c64-8372-5f787e5dcb01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:42:30.318338 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9709af38-6703-4c64-8372-5f787e5dcb01 None admin] REQUEST_METHOD: `GET` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:42:30.318620 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9709af38-6703-4c64-8372-5f787e5dcb01 None admin] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:42:30.318934 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9709af38-6703-4c64-8372-5f787e5dcb01 None admin] PATH_INFO: `/v3/roles` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:42:30.319712 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9709af38-6703-4c64-8372-5f787e5dcb01 None admin] RBAC: Adding query filter params (name=member) {{(pid=101893) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:42:30.320022 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9709af38-6703-4c64-8372-5f787e5dcb01 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:42:30.321437 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9709af38-6703-4c64-8372-5f787e5dcb01 None admin] RBAC: Authorization granted {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:42:30.324037 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG dbcounter [-] [101893] Writing DB stats keystone:SELECT=100 {{(pid=101893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:42:30.334870 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 146/289] 10.222.0.84 () {56 vars in 1101 bytes} [Wed May 25 14:42:30 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 265 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 14:42:30.338095 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9709af38-6703-4c64-8372-5f787e5dcb01 None admin] Authenticating user token {{(pid=101893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:42:30.407468 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0867a505-8ac8-4ff7-99ed-325ce99e1c1e None admin] Validating token access rules against request {{(pid=101892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:42:30.466877 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-975b5db7-c489-4cd8-980f-0022c56eb43a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:42:30.467788 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975b5db7-c489-4cd8-980f-0022c56eb43a None admin] REQUEST_METHOD: `PUT` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:42:30.468071 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975b5db7-c489-4cd8-980f-0022c56eb43a None admin] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:42:30.468351 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975b5db7-c489-4cd8-980f-0022c56eb43a None admin] PATH_INFO: `/v3/projects/ac9e4da865b34de49eecd54e4f6f34e6/users/a876555c722e4fdb9131f1e896597cc1/roles/d289ba5202044f90baf900bb40b116b8` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:42:30.473018 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-975b5db7-c489-4cd8-980f-0022c56eb43a None admin] RBAC: Authorizing `identity:create_grant(project_id=ac9e4da865b34de49eecd54e4f6f34e6, user_id=a876555c722e4fdb9131f1e896597cc1, role_id=d289ba5202044f90baf900bb40b116b8)` {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:42:30.474474 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-975b5db7-c489-4cd8-980f-0022c56eb43a None admin] RBAC: Authorization granted {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:42:30.480498 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG dbcounter [-] [101892] Writing DB stats keystone:SELECT=100 {{(pid=101892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:42:30.504543 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9709af38-6703-4c64-8372-5f787e5dcb01 None admin] Validating token access rules against request {{(pid=101893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:42:30.541266 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21d0cce1-64e4-4ebd-958b-b0aa2741dad3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:42:30.542135 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d0cce1-64e4-4ebd-958b-b0aa2741dad3 None admin] REQUEST_METHOD: `GET` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:42:30.542412 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d0cce1-64e4-4ebd-958b-b0aa2741dad3 None admin] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:42:30.542682 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d0cce1-64e4-4ebd-958b-b0aa2741dad3 None admin] PATH_INFO: `/v3/users/040eba2aee9947abba3cf844a783d316` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:42:30.543892 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21d0cce1-64e4-4ebd-958b-b0aa2741dad3 None admin] RBAC: Authorizing `identity:get_user(user_id=040eba2aee9947abba3cf844a783d316)` {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:42:30.545342 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21d0cce1-64e4-4ebd-958b-b0aa2741dad3 None admin] RBAC: Authorization granted {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:42:30.547181 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 147/290] 10.222.0.84 () {56 vars in 1177 bytes} [Wed May 25 14:42:30 2022] GET /identity/v3/users/040eba2aee9947abba3cf844a783d316 => generated 297 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:42:30.552682 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21d0cce1-64e4-4ebd-958b-b0aa2741dad3 None admin] Authenticating user token {{(pid=101893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:42:30.586877 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 144/291] 10.222.0.84 () {58 vars in 1439 bytes} [Wed May 25 14:42:30 2022] PUT /identity/v3/projects/ac9e4da865b34de49eecd54e4f6f34e6/users/a876555c722e4fdb9131f1e896597cc1/roles/d289ba5202044f90baf900bb40b116b8 => generated 0 bytes in 357 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 14:42:30.653842 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG dbcounter [-] [101893] Writing DB stats keystone:SELECT=100 {{(pid=101893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:42:30.706451 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21d0cce1-64e4-4ebd-958b-b0aa2741dad3 None admin] Validating token access rules against request {{(pid=101893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:42:30.751110 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a17ca3-1489-4ce4-a24c-af7a4740380f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:42:30.751911 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a17ca3-1489-4ce4-a24c-af7a4740380f None admin] REQUEST_METHOD: `GET` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:42:30.752246 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a17ca3-1489-4ce4-a24c-af7a4740380f None admin] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:42:30.752523 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a17ca3-1489-4ce4-a24c-af7a4740380f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:42:30.843882 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77a17ca3-1489-4ce4-a24c-af7a4740380f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:42:30.845278 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77a17ca3-1489-4ce4-a24c-af7a4740380f None admin] RBAC: Authorization granted {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:42:30.916625 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG dbcounter [-] [101893] Writing DB stats keystone:SELECT=100 {{(pid=101893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:42:30.955132 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 148/292] 10.222.0.84 () {58 vars in 1282 bytes} [Wed May 25 14:42:30 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 402 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 25 14:42:30.960358 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-975b5db7-c489-4cd8-980f-0022c56eb43a None admin] Authenticating user token {{(pid=101892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:42:31.100873 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-975b5db7-c489-4cd8-980f-0022c56eb43a None admin] Validating token access rules against request {{(pid=101892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:42:31.150441 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08247763-482b-450b-a991-3f198ae483ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:42:31.151319 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08247763-482b-450b-a991-3f198ae483ec None admin] REQUEST_METHOD: `GET` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:42:31.151632 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08247763-482b-450b-a991-3f198ae483ec None admin] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:42:31.151920 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08247763-482b-450b-a991-3f198ae483ec None admin] PATH_INFO: `/v3/projects/ac9e4da865b34de49eecd54e4f6f34e6` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:42:31.153145 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08247763-482b-450b-a991-3f198ae483ec None admin] RBAC: Authorizing `identity:get_project(project_id=ac9e4da865b34de49eecd54e4f6f34e6)` {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:42:31.154584 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08247763-482b-450b-a991-3f198ae483ec None admin] RBAC: Authorization granted {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:42:31.156679 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 145/293] 10.222.0.84 () {56 vars in 1186 bytes} [Wed May 25 14:42:30 2022] GET /identity/v3/projects/ac9e4da865b34de49eecd54e4f6f34e6 => generated 302 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:42:31.162638 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a17ca3-1489-4ce4-a24c-af7a4740380f None admin] Authenticating user token {{(pid=101893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:42:31.278389 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a17ca3-1489-4ce4-a24c-af7a4740380f None admin] Validating token access rules against request {{(pid=101893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:42:31.323533 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1312e43d-549f-48b8-bb70-92d24d51e811 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:42:31.324236 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1312e43d-549f-48b8-bb70-92d24d51e811 None admin] REQUEST_METHOD: `GET` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:42:31.324525 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1312e43d-549f-48b8-bb70-92d24d51e811 None admin] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:42:31.324804 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1312e43d-549f-48b8-bb70-92d24d51e811 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:42:31.325647 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1312e43d-549f-48b8-bb70-92d24d51e811 None admin] RBAC: Adding query filter params (role.id=ff664fa0db7e4262a5accde96c3df4c3, scope.project.id=ac9e4da865b34de49eecd54e4f6f34e6, user.id=040eba2aee9947abba3cf844a783d316) {{(pid=101893) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:42:31.325965 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1312e43d-549f-48b8-bb70-92d24d51e811 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:42:31.327420 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1312e43d-549f-48b8-bb70-92d24d51e811 None admin] RBAC: Authorization granted {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:42:31.337459 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 149/294] 10.222.0.84 () {56 vars in 1374 bytes} [Wed May 25 14:42:31 2022] GET /identity/v3/role_assignments?user.id=040eba2aee9947abba3cf844a783d316&scope.project.id=ac9e4da865b34de49eecd54e4f6f34e6&role.id=ff664fa0db7e4262a5accde96c3df4c3 => generated 608 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:42:31.916523 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05cc71f-bde0-4831-b13f-7a225dab95a4 None None] REQUEST_METHOD: `GET` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:42:31.917550 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05cc71f-bde0-4831-b13f-7a225dab95a4 None None] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:42:31.918031 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05cc71f-bde0-4831-b13f-7a225dab95a4 None None] PATH_INFO: `/` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:42:31.919610 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 146/295] 10.222.0.84 () {54 vars in 926 bytes} [Wed May 25 14:42:31 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 14:42:31.925067 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c9d481-703f-47d9-9eab-cd008c9788d1 None None] REQUEST_METHOD: `POST` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:42:31.925885 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c9d481-703f-47d9-9eab-cd008c9788d1 None None] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:42:31.926377 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c9d481-703f-47d9-9eab-cd008c9788d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:42:31.941557 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c694811-bbdb-45ab-b032-532d022e853b None None] REQUEST_METHOD: `GET` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:42:31.941847 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c694811-bbdb-45ab-b032-532d022e853b None None] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:42:31.942108 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c694811-bbdb-45ab-b032-532d022e853b None None] PATH_INFO: `/` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:42:31.943617 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 147/296] 10.222.0.84 () {54 vars in 926 bytes} [Wed May 25 14:42:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 14:42:31.948938 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda66b1a-2270-4d42-af7f-bb2be909a55a None None] REQUEST_METHOD: `POST` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:42:31.949280 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda66b1a-2270-4d42-af7f-bb2be909a55a None None] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:42:31.949561 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda66b1a-2270-4d42-af7f-bb2be909a55a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:42:31.958099 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.auth.core [None req-77c9d481-703f-47d9-9eab-cd008c9788d1 None None] MFA Rules not processed for user `05d87e87798e429aa1c10b24391f915e`. Rule list: `[]` (Enabled: `True`). {{(pid=101893) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:42:31.962464 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.fernet_utils [None req-77c9d481-703f-47d9-9eab-cd008c9788d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=101893) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:42:31.972581 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.auth.core [None req-bda66b1a-2270-4d42-af7f-bb2be909a55a None None] MFA Rules not processed for user `05d87e87798e429aa1c10b24391f915e`. Rule list: `[]` (Enabled: `True`). {{(pid=101892) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:42:31.974070 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.fernet_utils [None req-bda66b1a-2270-4d42-af7f-bb2be909a55a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=101892) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:42:31.994186 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG dbcounter [-] [101893] Writing DB stats keystone:SELECT=100 {{(pid=101893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:42:32.050333 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG dbcounter [-] [101892] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=101892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:42:32.061342 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 150/297] 10.222.0.84 () {58 vars in 1023 bytes} [Wed May 25 14:42:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 25 14:42:32.061581 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 148/298] 10.222.0.84 () {58 vars in 1023 bytes} [Wed May 25 14:42:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 25 14:42:32.077601 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf82c69-2575-4f81-a85b-820df37a63ae None None] REQUEST_METHOD: `GET` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:42:32.078134 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf82c69-2575-4f81-a85b-820df37a63ae None None] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:42:32.078587 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf82c69-2575-4f81-a85b-820df37a63ae None None] PATH_INFO: `/` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:42:32.080140 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 151/299] 10.222.0.84 () {54 vars in 926 bytes} [Wed May 25 14:42:32 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 14:42:32.084896 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda66b1a-2270-4d42-af7f-bb2be909a55a None None] Authenticating user token {{(pid=101892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:42:32.085687 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a61394-95b5-47c5-8287-2282d4170feb None None] REQUEST_METHOD: `POST` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:42:32.085973 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a61394-95b5-47c5-8287-2282d4170feb None None] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:42:32.086252 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a61394-95b5-47c5-8287-2282d4170feb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:42:32.104410 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.auth.core [None req-33a61394-95b5-47c5-8287-2282d4170feb None None] MFA Rules not processed for user `05d87e87798e429aa1c10b24391f915e`. Rule list: `[]` (Enabled: `True`). {{(pid=101893) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:42:32.105798 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.fernet_utils [None req-33a61394-95b5-47c5-8287-2282d4170feb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=101893) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:42:32.184126 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 152/300] 10.222.0.84 () {58 vars in 1023 bytes} [Wed May 25 14:42:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 25 14:42:32.184126 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33a61394-95b5-47c5-8287-2282d4170feb None None] Authenticating user token {{(pid=101893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:42:32.199688 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda66b1a-2270-4d42-af7f-bb2be909a55a None None] Validating token access rules against request {{(pid=101892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:42:32.235249 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c41a1895-7f40-4899-b372-7b0c7ac09dc7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:42:32.238930 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41a1895-7f40-4899-b372-7b0c7ac09dc7 None admin] REQUEST_METHOD: `GET` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:42:32.238930 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41a1895-7f40-4899-b372-7b0c7ac09dc7 None admin] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:42:32.238930 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41a1895-7f40-4899-b372-7b0c7ac09dc7 None admin] PATH_INFO: `/v3/domains/default` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:42:32.238930 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c41a1895-7f40-4899-b372-7b0c7ac09dc7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:42:32.239217 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c41a1895-7f40-4899-b372-7b0c7ac09dc7 None admin] RBAC: Authorization granted {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:42:32.240797 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 149/301] 10.222.0.84 () {56 vars in 1108 bytes} [Wed May 25 14:42:32 2022] GET /identity/v3/domains/default => generated 199 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:42:32.245948 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c41a1895-7f40-4899-b372-7b0c7ac09dc7 None admin] Authenticating user token {{(pid=101892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:42:32.290558 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG dbcounter [-] [101893] Writing DB stats keystone:SELECT=100 {{(pid=101893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:42:32.300159 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33a61394-95b5-47c5-8287-2282d4170feb None None] Validating token access rules against request {{(pid=101893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:42:32.304529 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG dbcounter [-] [101892] Writing DB stats keystone:SELECT=100 {{(pid=101892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:42:32.336138 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f23289f4-e278-4846-a710-c2cd3066e90f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:42:32.336965 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f23289f4-e278-4846-a710-c2cd3066e90f None admin] REQUEST_METHOD: `GET` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:42:32.337250 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f23289f4-e278-4846-a710-c2cd3066e90f None admin] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:42:32.337523 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f23289f4-e278-4846-a710-c2cd3066e90f None admin] PATH_INFO: `/v3/roles/reader` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:42:32.345922 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c41a1895-7f40-4899-b372-7b0c7ac09dc7 None admin] Validating token access rules against request {{(pid=101892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:42:32.347779 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f23289f4-e278-4846-a710-c2cd3066e90f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 14:42:32.355464 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application [None req-f23289f4-e278-4846-a710-c2cd3066e90f None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 25 14:42:32.355464 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:42:32.355464 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 14:42:32.355464 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 14:42:32.355464 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 14:42:32.355464 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 14:42:32.355464 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 14:42:32.355464 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 14:42:32.355464 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 14:42:32.355464 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 14:42:32.355464 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 14:42:32.355464 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 14:42:32.355464 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 14:42:32.355464 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 14:42:32.355464 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 14:42:32.355464 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 14:42:32.356553 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 14:42:32.356553 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 14:42:32.356553 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 14:42:32.356553 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 14:42:32.356553 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 14:42:32.356553 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 14:42:32.356553 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 14:42:32.356553 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 14:42:32.356553 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 14:42:32.356553 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return self.get_or_create( May 25 14:42:32.356553 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 14:42:32.356553 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application with Lock( May 25 14:42:32.356553 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 14:42:32.356553 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return self._enter() May 25 14:42:32.356553 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 14:42:32.356553 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 14:42:32.357356 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 14:42:32.357356 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return self.creator() May 25 14:42:32.357356 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 14:42:32.357356 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application created_value = creator( May 25 14:42:32.357356 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 14:42:32.357356 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 14:42:32.357356 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 14:42:32.357356 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 14:42:32.357356 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 14:42:32.357356 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 14:42:32.357356 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 25 14:42:32.357356 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application May 25 14:42:32.357356 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 153/302] 10.222.0.84 () {56 vars in 1099 bytes} [Wed May 25 14:42:32 2022] GET /identity/v3/roles/reader => generated 84 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 14:42:32.361999 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f23289f4-e278-4846-a710-c2cd3066e90f None admin] Authenticating user token {{(pid=101893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:42:32.383264 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2702952b-81f4-48dd-82ce-42279b8f96f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:42:32.384620 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2702952b-81f4-48dd-82ce-42279b8f96f1 None admin] REQUEST_METHOD: `GET` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:42:32.384906 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2702952b-81f4-48dd-82ce-42279b8f96f1 None admin] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:42:32.385172 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2702952b-81f4-48dd-82ce-42279b8f96f1 None admin] PATH_INFO: `/v3/roles/member` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:42:32.395214 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2702952b-81f4-48dd-82ce-42279b8f96f1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 14:42:32.403127 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application [None req-2702952b-81f4-48dd-82ce-42279b8f96f1 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 25 14:42:32.403127 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:42:32.403127 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 14:42:32.403127 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 14:42:32.403127 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 14:42:32.403127 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 14:42:32.403127 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 14:42:32.403127 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 14:42:32.403127 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 14:42:32.403127 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 14:42:32.403127 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 14:42:32.403127 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 14:42:32.403127 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 14:42:32.403127 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 14:42:32.403127 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 14:42:32.403127 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 14:42:32.404347 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 14:42:32.404347 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 14:42:32.404347 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 14:42:32.404347 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 14:42:32.404347 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 14:42:32.404347 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 14:42:32.404347 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 14:42:32.404347 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 14:42:32.404347 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 14:42:32.404347 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application return self.get_or_create( May 25 14:42:32.404347 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 14:42:32.404347 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application with Lock( May 25 14:42:32.404347 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 14:42:32.404347 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application return self._enter() May 25 14:42:32.404347 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 14:42:32.404347 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 14:42:32.405344 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 14:42:32.405344 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application return self.creator() May 25 14:42:32.405344 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 14:42:32.405344 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application created_value = creator( May 25 14:42:32.405344 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 14:42:32.405344 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 14:42:32.405344 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 14:42:32.405344 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 14:42:32.405344 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 14:42:32.405344 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 14:42:32.405344 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 25 14:42:32.405344 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application May 25 14:42:32.405344 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 150/303] 10.222.0.84 () {56 vars in 1099 bytes} [Wed May 25 14:42:32 2022] GET /identity/v3/roles/member => generated 84 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 14:42:32.405344 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2702952b-81f4-48dd-82ce-42279b8f96f1 None admin] Authenticating user token {{(pid=101892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:42:32.470288 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f23289f4-e278-4846-a710-c2cd3066e90f None admin] Validating token access rules against request {{(pid=101893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:42:32.505413 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6abd4f8-10ec-4e53-bf69-e2a46b23c83c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:42:32.506085 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6abd4f8-10ec-4e53-bf69-e2a46b23c83c None admin] REQUEST_METHOD: `POST` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:42:32.506369 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6abd4f8-10ec-4e53-bf69-e2a46b23c83c None admin] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:42:32.506643 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2702952b-81f4-48dd-82ce-42279b8f96f1 None admin] Validating token access rules against request {{(pid=101892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:42:32.506756 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6abd4f8-10ec-4e53-bf69-e2a46b23c83c None admin] PATH_INFO: `/v3/groups` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:42:32.507323 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6abd4f8-10ec-4e53-bf69-e2a46b23c83c None admin] RBAC: Authorizing `identity:create_group()` {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:42:32.509455 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6abd4f8-10ec-4e53-bf69-e2a46b23c83c None admin] RBAC: Authorization granted {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:42:32.528124 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG dbcounter [-] [101892] Writing DB stats keystone:SELECT=100 {{(pid=101892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:42:32.541845 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c8f3340-cd76-4303-8029-b6403c74b6f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:42:32.542506 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c8f3340-cd76-4303-8029-b6403c74b6f3 None admin] REQUEST_METHOD: `GET` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:42:32.542791 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c8f3340-cd76-4303-8029-b6403c74b6f3 None admin] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:42:32.543070 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c8f3340-cd76-4303-8029-b6403c74b6f3 None admin] PATH_INFO: `/v3/roles` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:42:32.543845 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c8f3340-cd76-4303-8029-b6403c74b6f3 None admin] RBAC: Adding query filter params (name=reader) {{(pid=101892) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:42:32.544155 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c8f3340-cd76-4303-8029-b6403c74b6f3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:42:32.545529 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c8f3340-cd76-4303-8029-b6403c74b6f3 None admin] RBAC: Authorization granted {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:42:32.560854 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 151/304] 10.222.0.84 () {56 vars in 1101 bytes} [Wed May 25 14:42:32 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:42:32.560854 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c8f3340-cd76-4303-8029-b6403c74b6f3 None admin] Authenticating user token {{(pid=101892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:42:32.579761 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 154/305] 10.222.0.84 () {60 vars in 1134 bytes} [Wed May 25 14:42:32 2022] POST /identity/v3/groups => generated 229 bytes in 222 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 14:42:32.580662 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6abd4f8-10ec-4e53-bf69-e2a46b23c83c None admin] Authenticating user token {{(pid=101893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:42:32.599745 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG dbcounter [-] [101893] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=101893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:42:32.712785 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c8f3340-cd76-4303-8029-b6403c74b6f3 None admin] Validating token access rules against request {{(pid=101892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:42:32.716672 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6abd4f8-10ec-4e53-bf69-e2a46b23c83c None admin] Validating token access rules against request {{(pid=101893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:42:32.754259 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-438a5b31-ed76-402c-ade0-181d939d7cb2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:42:32.755287 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-438a5b31-ed76-402c-ade0-181d939d7cb2 None admin] REQUEST_METHOD: `GET` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:42:32.755835 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-438a5b31-ed76-402c-ade0-181d939d7cb2 None admin] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:42:32.756318 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-438a5b31-ed76-402c-ade0-181d939d7cb2 None admin] PATH_INFO: `/v3/roles` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:42:32.757421 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-438a5b31-ed76-402c-ade0-181d939d7cb2 None admin] RBAC: Adding query filter params (name=member) {{(pid=101892) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:42:32.758098 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-438a5b31-ed76-402c-ade0-181d939d7cb2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:42:32.760798 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-438a5b31-ed76-402c-ade0-181d939d7cb2 None admin] RBAC: Authorization granted {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:42:32.762570 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cd6edf9-b167-4acb-8cf3-23ee5557b33d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:42:32.763853 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd6edf9-b167-4acb-8cf3-23ee5557b33d None admin] REQUEST_METHOD: `GET` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:42:32.764649 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd6edf9-b167-4acb-8cf3-23ee5557b33d None admin] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:42:32.765934 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd6edf9-b167-4acb-8cf3-23ee5557b33d None admin] PATH_INFO: `/v3/users/a81dd1fc2f5649b282c0feee7f63fd2b` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:42:32.773053 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 152/306] 10.222.0.84 () {56 vars in 1101 bytes} [Wed May 25 14:42:32 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:42:32.780956 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-438a5b31-ed76-402c-ade0-181d939d7cb2 None admin] Authenticating user token {{(pid=101892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:42:32.789122 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cd6edf9-b167-4acb-8cf3-23ee5557b33d None admin] RBAC: Authorizing `identity:get_user(user_id=a81dd1fc2f5649b282c0feee7f63fd2b)` {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:42:32.790639 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cd6edf9-b167-4acb-8cf3-23ee5557b33d None admin] RBAC: Authorization granted {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:42:32.797536 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 155/307] 10.222.0.84 () {56 vars in 1177 bytes} [Wed May 25 14:42:32 2022] GET /identity/v3/users/a81dd1fc2f5649b282c0feee7f63fd2b => generated 293 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:42:32.798755 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cd6edf9-b167-4acb-8cf3-23ee5557b33d None admin] Authenticating user token {{(pid=101893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:42:32.839485 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG dbcounter [-] [101892] Writing DB stats keystone:SELECT=100 {{(pid=101892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:42:32.874953 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG dbcounter [-] [101893] Writing DB stats keystone:SELECT=100 {{(pid=101893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:42:32.911320 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cd6edf9-b167-4acb-8cf3-23ee5557b33d None admin] Validating token access rules against request {{(pid=101893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:42:32.915593 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-438a5b31-ed76-402c-ade0-181d939d7cb2 None admin] Validating token access rules against request {{(pid=101892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:42:32.950767 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5153ff7-a873-4361-ae39-280e960cdd56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:42:32.952039 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5153ff7-a873-4361-ae39-280e960cdd56 None admin] REQUEST_METHOD: `GET` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:42:32.952468 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5153ff7-a873-4361-ae39-280e960cdd56 None admin] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:42:32.952891 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5153ff7-a873-4361-ae39-280e960cdd56 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:42:32.953892 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5153ff7-a873-4361-ae39-280e960cdd56 None admin] RBAC: Adding query filter params (role.id=d289ba5202044f90baf900bb40b116b8, user.id=a81dd1fc2f5649b282c0feee7f63fd2b, scope.system=all) {{(pid=101893) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:42:32.954350 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5153ff7-a873-4361-ae39-280e960cdd56 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:42:32.956353 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5153ff7-a873-4361-ae39-280e960cdd56 None admin] RBAC: Authorization granted {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:42:32.958498 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f61097dc-b4df-4c9e-b855-5a3b78a90c22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:42:32.959407 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f61097dc-b4df-4c9e-b855-5a3b78a90c22 None admin] REQUEST_METHOD: `GET` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:42:32.959718 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f61097dc-b4df-4c9e-b855-5a3b78a90c22 None admin] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:42:32.959992 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f61097dc-b4df-4c9e-b855-5a3b78a90c22 None admin] PATH_INFO: `/v3/users/0eb9e5b6a292486a964626fe077319a1` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:42:32.961958 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f61097dc-b4df-4c9e-b855-5a3b78a90c22 None admin] RBAC: Authorizing `identity:get_user(user_id=0eb9e5b6a292486a964626fe077319a1)` {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:42:32.963865 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f61097dc-b4df-4c9e-b855-5a3b78a90c22 None admin] RBAC: Authorization granted {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:42:32.964763 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 156/308] 10.222.0.84 () {56 vars in 1308 bytes} [Wed May 25 14:42:32 2022] GET /identity/v3/role_assignments?user.id=a81dd1fc2f5649b282c0feee7f63fd2b&scope.system=all&role.id=d289ba5202044f90baf900bb40b116b8 => generated 226 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:42:32.969225 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 153/309] 10.222.0.84 () {56 vars in 1177 bytes} [Wed May 25 14:42:32 2022] GET /identity/v3/users/0eb9e5b6a292486a964626fe077319a1 => generated 293 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:42:32.975463 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5153ff7-a873-4361-ae39-280e960cdd56 None admin] Authenticating user token {{(pid=101893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:42:33.093383 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5153ff7-a873-4361-ae39-280e960cdd56 None admin] Validating token access rules against request {{(pid=101893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:42:33.127269 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG dbcounter [-] [101893] Writing DB stats keystone:SELECT=100 {{(pid=101893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:42:33.132978 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab3f8ebc-eff5-473d-840d-d90f20765b0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:42:33.134413 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3f8ebc-eff5-473d-840d-d90f20765b0c None admin] REQUEST_METHOD: `PUT` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:42:33.134690 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3f8ebc-eff5-473d-840d-d90f20765b0c None admin] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:42:33.134962 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3f8ebc-eff5-473d-840d-d90f20765b0c None admin] PATH_INFO: `/v3/system/users/0eb9e5b6a292486a964626fe077319a1/roles/ff664fa0db7e4262a5accde96c3df4c3` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:42:33.136680 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab3f8ebc-eff5-473d-840d-d90f20765b0c None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=0eb9e5b6a292486a964626fe077319a1, role_id=ff664fa0db7e4262a5accde96c3df4c3)` {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:42:33.138106 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab3f8ebc-eff5-473d-840d-d90f20765b0c None admin] RBAC: Authorization granted {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:42:33.165903 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d54be9b-e64f-4893-81d0-b46574aa2da6 None None] REQUEST_METHOD: `GET` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:42:33.166195 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d54be9b-e64f-4893-81d0-b46574aa2da6 None None] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:42:33.166485 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d54be9b-e64f-4893-81d0-b46574aa2da6 None None] PATH_INFO: `/` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:42:33.168088 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 154/310] 10.222.0.84 () {54 vars in 926 bytes} [Wed May 25 14:42:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 25 14:42:33.173028 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06251e1c-2326-4379-9daa-30ebd6ee00d4 None None] REQUEST_METHOD: `POST` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:42:33.173317 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06251e1c-2326-4379-9daa-30ebd6ee00d4 None None] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:42:33.173598 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06251e1c-2326-4379-9daa-30ebd6ee00d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:42:33.191614 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.auth.core [None req-06251e1c-2326-4379-9daa-30ebd6ee00d4 None None] MFA Rules not processed for user `05d87e87798e429aa1c10b24391f915e`. Rule list: `[]` (Enabled: `True`). {{(pid=101892) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:42:33.192887 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.fernet_utils [None req-06251e1c-2326-4379-9daa-30ebd6ee00d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=101892) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:42:33.215912 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 157/311] 10.222.0.84 () {58 vars in 1334 bytes} [Wed May 25 14:42:32 2022] PUT /identity/v3/system/users/0eb9e5b6a292486a964626fe077319a1/roles/ff664fa0db7e4262a5accde96c3df4c3 => generated 0 bytes in 241 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 14:42:33.277643 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 155/312] 10.222.0.84 () {58 vars in 1023 bytes} [Wed May 25 14:42:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 25 14:42:33.305550 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab3f8ebc-eff5-473d-840d-d90f20765b0c None admin] Authenticating user token {{(pid=101893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:42:33.417336 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab3f8ebc-eff5-473d-840d-d90f20765b0c None admin] Validating token access rules against request {{(pid=101893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:42:33.453896 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47145124-4b71-46bf-a6a9-db26dc64969c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:42:33.454695 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47145124-4b71-46bf-a6a9-db26dc64969c None admin] REQUEST_METHOD: `GET` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:42:33.454982 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47145124-4b71-46bf-a6a9-db26dc64969c None admin] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:42:33.455261 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47145124-4b71-46bf-a6a9-db26dc64969c None admin] PATH_INFO: `/v3/roles/reader` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:42:33.465628 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47145124-4b71-46bf-a6a9-db26dc64969c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 14:42:33.473462 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application [None req-47145124-4b71-46bf-a6a9-db26dc64969c None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 25 14:42:33.473462 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:42:33.473462 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 14:42:33.473462 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 14:42:33.473462 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 14:42:33.473462 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 14:42:33.473462 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 14:42:33.473462 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 14:42:33.473462 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 14:42:33.473462 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 14:42:33.473462 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 14:42:33.473462 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 14:42:33.473462 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 14:42:33.473462 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 14:42:33.473462 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 14:42:33.473462 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 14:42:33.474357 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 14:42:33.474357 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 14:42:33.474357 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 14:42:33.474357 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 14:42:33.474357 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 14:42:33.474357 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 14:42:33.474357 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 14:42:33.474357 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 14:42:33.474357 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 14:42:33.474357 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return self.get_or_create( May 25 14:42:33.474357 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 14:42:33.474357 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application with Lock( May 25 14:42:33.474357 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 14:42:33.474357 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return self._enter() May 25 14:42:33.474357 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 14:42:33.474357 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 14:42:33.475142 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 14:42:33.475142 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return self.creator() May 25 14:42:33.475142 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 14:42:33.475142 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application created_value = creator( May 25 14:42:33.475142 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 14:42:33.475142 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 14:42:33.475142 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 14:42:33.475142 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 14:42:33.475142 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 14:42:33.475142 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 14:42:33.475142 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 25 14:42:33.475142 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application May 25 14:42:33.475142 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 158/313] 10.222.0.84 () {56 vars in 1099 bytes} [Wed May 25 14:42:33 2022] GET /identity/v3/roles/reader => generated 84 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 14:42:33.485358 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06251e1c-2326-4379-9daa-30ebd6ee00d4 None None] Authenticating user token {{(pid=101892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:42:33.544711 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG dbcounter [-] [101892] Writing DB stats keystone:SELECT=100 {{(pid=101892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:42:33.607506 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06251e1c-2326-4379-9daa-30ebd6ee00d4 None None] Validating token access rules against request {{(pid=101892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:42:33.642587 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a14c73-4e91-4fac-8b6d-23e585d6ccba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:42:33.643255 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a14c73-4e91-4fac-8b6d-23e585d6ccba None admin] REQUEST_METHOD: `GET` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:42:33.643538 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a14c73-4e91-4fac-8b6d-23e585d6ccba None admin] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:42:33.643840 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a14c73-4e91-4fac-8b6d-23e585d6ccba None admin] PATH_INFO: `/v3/roles` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:42:33.644590 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2a14c73-4e91-4fac-8b6d-23e585d6ccba None admin] RBAC: Adding query filter params (name=reader) {{(pid=101892) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:42:33.644900 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2a14c73-4e91-4fac-8b6d-23e585d6ccba None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:42:33.646276 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2a14c73-4e91-4fac-8b6d-23e585d6ccba None admin] RBAC: Authorization granted {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:42:33.655667 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 156/314] 10.222.0.84 () {56 vars in 1101 bytes} [Wed May 25 14:42:33 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:42:33.661026 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47145124-4b71-46bf-a6a9-db26dc64969c None admin] Authenticating user token {{(pid=101893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:42:33.719639 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG dbcounter [-] [101893] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=101893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:42:33.766069 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47145124-4b71-46bf-a6a9-db26dc64969c None admin] Validating token access rules against request {{(pid=101893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:42:33.806194 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06254cde-12f0-4e47-969a-9fffe27e134b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:42:33.807455 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06254cde-12f0-4e47-969a-9fffe27e134b None admin] REQUEST_METHOD: `GET` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:42:33.808059 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06254cde-12f0-4e47-969a-9fffe27e134b None admin] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:42:33.808827 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06254cde-12f0-4e47-969a-9fffe27e134b None admin] PATH_INFO: `/v3/users/a876555c722e4fdb9131f1e896597cc1` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:42:33.810252 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06254cde-12f0-4e47-969a-9fffe27e134b None admin] RBAC: Authorizing `identity:get_user(user_id=a876555c722e4fdb9131f1e896597cc1)` {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:42:33.811983 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06254cde-12f0-4e47-969a-9fffe27e134b None admin] RBAC: Authorization granted {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:42:33.814122 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 159/315] 10.222.0.84 () {56 vars in 1177 bytes} [Wed May 25 14:42:33 2022] GET /identity/v3/users/a876555c722e4fdb9131f1e896597cc1 => generated 297 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:42:33.819729 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a14c73-4e91-4fac-8b6d-23e585d6ccba None admin] Authenticating user token {{(pid=101892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:42:33.925878 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a14c73-4e91-4fac-8b6d-23e585d6ccba None admin] Validating token access rules against request {{(pid=101892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:42:33.928237 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG dbcounter [-] [101892] Writing DB stats keystone:SELECT=100 {{(pid=101892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:42:33.964919 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fe642d5-b809-4969-8ea7-abdaa67217ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:42:33.965580 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe642d5-b809-4969-8ea7-abdaa67217ac None admin] REQUEST_METHOD: `GET` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:42:33.965835 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe642d5-b809-4969-8ea7-abdaa67217ac None admin] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:42:33.966108 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe642d5-b809-4969-8ea7-abdaa67217ac None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:42:34.036341 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fe642d5-b809-4969-8ea7-abdaa67217ac None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:42:34.037702 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fe642d5-b809-4969-8ea7-abdaa67217ac None admin] RBAC: Authorization granted {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:42:34.139118 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 157/316] 10.222.0.84 () {58 vars in 1282 bytes} [Wed May 25 14:42:33 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 320 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 25 14:42:34.144631 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06254cde-12f0-4e47-969a-9fffe27e134b None admin] Authenticating user token {{(pid=101893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:42:34.248940 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06254cde-12f0-4e47-969a-9fffe27e134b None admin] Validating token access rules against request {{(pid=101893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:42:34.273602 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG dbcounter [-] [101893] Writing DB stats keystone:SELECT=100 {{(pid=101893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:42:34.285094 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a8aa8f-e5bf-4af6-ae2f-6974815fc794 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:42:34.286224 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a8aa8f-e5bf-4af6-ae2f-6974815fc794 None admin] REQUEST_METHOD: `GET` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:42:34.286722 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a8aa8f-e5bf-4af6-ae2f-6974815fc794 None admin] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:42:34.287162 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a8aa8f-e5bf-4af6-ae2f-6974815fc794 None admin] PATH_INFO: `/v3/projects/ac9e4da865b34de49eecd54e4f6f34e6` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:42:34.288548 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69a8aa8f-e5bf-4af6-ae2f-6974815fc794 None admin] RBAC: Authorizing `identity:get_project(project_id=ac9e4da865b34de49eecd54e4f6f34e6)` {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:42:34.290192 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69a8aa8f-e5bf-4af6-ae2f-6974815fc794 None admin] RBAC: Authorization granted {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:42:34.292427 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 160/317] 10.222.0.84 () {56 vars in 1186 bytes} [Wed May 25 14:42:34 2022] GET /identity/v3/projects/ac9e4da865b34de49eecd54e4f6f34e6 => generated 302 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:42:34.298351 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fe642d5-b809-4969-8ea7-abdaa67217ac None admin] Authenticating user token {{(pid=101892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:42:34.301683 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG dbcounter [-] [101892] Writing DB stats keystone:SELECT=100 {{(pid=101892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:42:34.405660 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fe642d5-b809-4969-8ea7-abdaa67217ac None admin] Validating token access rules against request {{(pid=101892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:42:34.443255 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da48f3af-c0c7-4a9f-bf5f-b9236a2112cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:42:34.443939 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da48f3af-c0c7-4a9f-bf5f-b9236a2112cb None admin] REQUEST_METHOD: `GET` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:42:34.444223 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da48f3af-c0c7-4a9f-bf5f-b9236a2112cb None admin] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:42:34.444498 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da48f3af-c0c7-4a9f-bf5f-b9236a2112cb None admin] PATH_INFO: `/v3/role_assignments` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:42:34.445320 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da48f3af-c0c7-4a9f-bf5f-b9236a2112cb None admin] RBAC: Adding query filter params (role.id=d289ba5202044f90baf900bb40b116b8, scope.project.id=ac9e4da865b34de49eecd54e4f6f34e6, user.id=a876555c722e4fdb9131f1e896597cc1) {{(pid=101892) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:42:34.445630 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da48f3af-c0c7-4a9f-bf5f-b9236a2112cb None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:42:34.447665 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da48f3af-c0c7-4a9f-bf5f-b9236a2112cb None admin] RBAC: Authorization granted {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:42:34.453958 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 158/318] 10.222.0.84 () {56 vars in 1374 bytes} [Wed May 25 14:42:34 2022] GET /identity/v3/role_assignments?user.id=a876555c722e4fdb9131f1e896597cc1&scope.project.id=ac9e4da865b34de49eecd54e4f6f34e6&role.id=d289ba5202044f90baf900bb40b116b8 => generated 608 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:42:34.913789 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a92e46f-a7d6-4ad4-a2a0-f9f853929e8c None None] REQUEST_METHOD: `GET` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:42:34.914205 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a92e46f-a7d6-4ad4-a2a0-f9f853929e8c None None] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:42:34.914481 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a92e46f-a7d6-4ad4-a2a0-f9f853929e8c None None] PATH_INFO: `/` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:42:34.916585 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 161/319] 10.222.0.84 () {54 vars in 926 bytes} [Wed May 25 14:42:34 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 14:42:34.921578 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd0a04b-af89-46dc-a71f-84e591371b76 None None] REQUEST_METHOD: `POST` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:42:34.921874 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd0a04b-af89-46dc-a71f-84e591371b76 None None] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:42:34.922155 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd0a04b-af89-46dc-a71f-84e591371b76 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:42:34.939484 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.auth.core [None req-fcd0a04b-af89-46dc-a71f-84e591371b76 None None] MFA Rules not processed for user `05d87e87798e429aa1c10b24391f915e`. Rule list: `[]` (Enabled: `True`). {{(pid=101892) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:42:34.940681 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.fernet_utils [None req-fcd0a04b-af89-46dc-a71f-84e591371b76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=101892) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:42:35.005927 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG dbcounter [-] [101892] Writing DB stats keystone:SELECT=100 {{(pid=101892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:42:35.011749 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 159/320] 10.222.0.84 () {58 vars in 1023 bytes} [Wed May 25 14:42:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 25 14:42:35.033701 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a92e46f-a7d6-4ad4-a2a0-f9f853929e8c None None] Authenticating user token {{(pid=101893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:42:35.139425 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a92e46f-a7d6-4ad4-a2a0-f9f853929e8c None None] Validating token access rules against request {{(pid=101893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:42:35.177704 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e8b503-60ec-4e9c-a401-c91424b4207d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:42:35.181352 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e8b503-60ec-4e9c-a401-c91424b4207d None admin] REQUEST_METHOD: `GET` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:42:35.181775 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e8b503-60ec-4e9c-a401-c91424b4207d None admin] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:42:35.182309 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e8b503-60ec-4e9c-a401-c91424b4207d None admin] PATH_INFO: `/v3/domains/default` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:42:35.183705 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72e8b503-60ec-4e9c-a401-c91424b4207d None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:42:35.185536 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72e8b503-60ec-4e9c-a401-c91424b4207d None admin] RBAC: Authorization granted {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:42:35.187438 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 162/321] 10.222.0.84 () {56 vars in 1108 bytes} [Wed May 25 14:42:35 2022] GET /identity/v3/domains/default => generated 199 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:42:35.193233 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd0a04b-af89-46dc-a71f-84e591371b76 None None] Authenticating user token {{(pid=101892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:42:35.334403 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f47c7ab-304e-47c5-9b99-a768fb0a2a82 None None] REQUEST_METHOD: `GET` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:42:35.334691 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f47c7ab-304e-47c5-9b99-a768fb0a2a82 None None] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:42:35.334977 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f47c7ab-304e-47c5-9b99-a768fb0a2a82 None None] PATH_INFO: `/` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:42:35.336622 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 163/322] 10.222.0.84 () {54 vars in 926 bytes} [Wed May 25 14:42:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 14:42:35.342771 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef69a44-e411-444f-8504-327256d6583d None None] REQUEST_METHOD: `POST` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:42:35.343070 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef69a44-e411-444f-8504-327256d6583d None None] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:42:35.343345 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef69a44-e411-444f-8504-327256d6583d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:42:35.346482 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd0a04b-af89-46dc-a71f-84e591371b76 None None] Validating token access rules against request {{(pid=101892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:42:35.360704 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.auth.core [None req-bef69a44-e411-444f-8504-327256d6583d None None] MFA Rules not processed for user `05d87e87798e429aa1c10b24391f915e`. Rule list: `[]` (Enabled: `True`). {{(pid=101893) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:42:35.361894 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.fernet_utils [None req-bef69a44-e411-444f-8504-327256d6583d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=101893) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:42:35.385567 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-368889e5-2dee-4325-834f-ab4fe3cb681d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:42:35.386262 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368889e5-2dee-4325-834f-ab4fe3cb681d None admin] REQUEST_METHOD: `POST` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:42:35.386545 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368889e5-2dee-4325-834f-ab4fe3cb681d None admin] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:42:35.386823 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368889e5-2dee-4325-834f-ab4fe3cb681d None admin] PATH_INFO: `/v3/groups` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:42:35.387530 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-368889e5-2dee-4325-834f-ab4fe3cb681d None admin] RBAC: Authorizing `identity:create_group()` {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:42:35.388995 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-368889e5-2dee-4325-834f-ab4fe3cb681d None admin] RBAC: Authorization granted {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:42:35.420410 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG dbcounter [-] [101893] Writing DB stats keystone:SELECT=100 {{(pid=101893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:42:35.432184 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 164/323] 10.222.0.84 () {58 vars in 1023 bytes} [Wed May 25 14:42:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 25 14:42:35.455631 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bef69a44-e411-444f-8504-327256d6583d None None] Authenticating user token {{(pid=101893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:42:35.484297 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 160/324] 10.222.0.84 () {60 vars in 1134 bytes} [Wed May 25 14:42:35 2022] POST /identity/v3/groups => generated 226 bytes in 292 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 14:42:35.532668 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-930aa9f7-968f-4df6-aa15-b1edf6253484 None None] REQUEST_METHOD: `GET` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:42:35.532960 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-930aa9f7-968f-4df6-aa15-b1edf6253484 None None] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:42:35.533246 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-930aa9f7-968f-4df6-aa15-b1edf6253484 None None] PATH_INFO: `/` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:42:35.534806 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 161/325] 10.222.0.84 () {54 vars in 926 bytes} [Wed May 25 14:42:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 25 14:42:35.540728 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a06cf3-9278-490f-9a85-ffe3402991f7 None None] REQUEST_METHOD: `POST` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:42:35.541014 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a06cf3-9278-490f-9a85-ffe3402991f7 None None] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:42:35.541291 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a06cf3-9278-490f-9a85-ffe3402991f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:42:35.559148 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.auth.core [None req-53a06cf3-9278-490f-9a85-ffe3402991f7 None None] MFA Rules not processed for user `05d87e87798e429aa1c10b24391f915e`. Rule list: `[]` (Enabled: `True`). {{(pid=101892) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:42:35.560404 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.fernet_utils [None req-53a06cf3-9278-490f-9a85-ffe3402991f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=101892) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:42:35.586908 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bef69a44-e411-444f-8504-327256d6583d None None] Validating token access rules against request {{(pid=101893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:42:35.624942 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccda5419-db73-456a-b398-24db67591253 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:42:35.625779 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccda5419-db73-456a-b398-24db67591253 None admin] REQUEST_METHOD: `GET` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:42:35.626063 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccda5419-db73-456a-b398-24db67591253 None admin] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:42:35.626343 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccda5419-db73-456a-b398-24db67591253 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:42:35.627222 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG dbcounter [-] [101892] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=101892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:42:35.638146 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccda5419-db73-456a-b398-24db67591253 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 14:42:35.647069 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application [None req-ccda5419-db73-456a-b398-24db67591253 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 25 14:42:35.647069 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:42:35.647069 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 14:42:35.647069 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 14:42:35.647069 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 14:42:35.647069 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 14:42:35.647069 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 14:42:35.647069 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 14:42:35.647069 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 14:42:35.647069 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 14:42:35.647069 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 14:42:35.647069 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 14:42:35.647069 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 14:42:35.647069 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 14:42:35.647069 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 14:42:35.647069 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 14:42:35.648357 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 14:42:35.648357 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 14:42:35.648357 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 14:42:35.648357 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 14:42:35.648357 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 14:42:35.648357 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 14:42:35.648357 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 14:42:35.648357 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 14:42:35.648357 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 14:42:35.648357 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return self.get_or_create( May 25 14:42:35.648357 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 14:42:35.648357 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application with Lock( May 25 14:42:35.648357 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 14:42:35.648357 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return self._enter() May 25 14:42:35.648357 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 14:42:35.648357 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 14:42:35.649150 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 14:42:35.649150 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return self.creator() May 25 14:42:35.649150 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 14:42:35.649150 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application created_value = creator( May 25 14:42:35.649150 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 14:42:35.649150 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 14:42:35.649150 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 14:42:35.649150 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 14:42:35.649150 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 14:42:35.649150 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 14:42:35.649150 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 25 14:42:35.649150 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application May 25 14:42:35.649150 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 165/326] 10.222.0.84 () {56 vars in 1099 bytes} [Wed May 25 14:42:35 2022] GET /identity/v3/roles/reader => generated 84 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 25 14:42:35.650590 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 162/327] 10.222.0.84 () {58 vars in 1023 bytes} [Wed May 25 14:42:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 25 14:42:35.653637 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccda5419-db73-456a-b398-24db67591253 None admin] Authenticating user token {{(pid=101893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:42:35.667306 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53a06cf3-9278-490f-9a85-ffe3402991f7 None None] Authenticating user token {{(pid=101892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:42:35.714459 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG dbcounter [-] [101893] Writing DB stats keystone:SELECT=100 {{(pid=101893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:42:35.780549 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccda5419-db73-456a-b398-24db67591253 None admin] Validating token access rules against request {{(pid=101893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:42:35.791437 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53a06cf3-9278-490f-9a85-ffe3402991f7 None None] Validating token access rules against request {{(pid=101892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:42:35.831041 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f60518-f4a7-4edc-8df0-3c67ddfe1127 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:42:35.831765 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f60518-f4a7-4edc-8df0-3c67ddfe1127 None admin] REQUEST_METHOD: `GET` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:42:35.832055 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f60518-f4a7-4edc-8df0-3c67ddfe1127 None admin] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:42:35.832333 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f60518-f4a7-4edc-8df0-3c67ddfe1127 None admin] PATH_INFO: `/v3/roles` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:42:35.833095 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84f60518-f4a7-4edc-8df0-3c67ddfe1127 None admin] RBAC: Adding query filter params (name=reader) {{(pid=101893) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:42:35.833407 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84f60518-f4a7-4edc-8df0-3c67ddfe1127 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:42:35.834796 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84f60518-f4a7-4edc-8df0-3c67ddfe1127 None admin] RBAC: Authorization granted {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:42:35.841291 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e6fb704-ef76-42dc-9f75-7e27994aa80f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:42:35.842704 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6fb704-ef76-42dc-9f75-7e27994aa80f None admin] REQUEST_METHOD: `GET` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:42:35.842992 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6fb704-ef76-42dc-9f75-7e27994aa80f None admin] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:42:35.843270 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6fb704-ef76-42dc-9f75-7e27994aa80f None admin] PATH_INFO: `/v3/roles/member` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:42:35.845567 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 166/328] 10.222.0.84 () {56 vars in 1101 bytes} [Wed May 25 14:42:35 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:42:35.850698 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f60518-f4a7-4edc-8df0-3c67ddfe1127 None admin] Authenticating user token {{(pid=101893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:42:35.863316 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e6fb704-ef76-42dc-9f75-7e27994aa80f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 14:42:35.871209 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application [None req-3e6fb704-ef76-42dc-9f75-7e27994aa80f None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 25 14:42:35.871209 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:42:35.871209 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 14:42:35.871209 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 14:42:35.871209 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 14:42:35.871209 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 14:42:35.871209 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 14:42:35.871209 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 14:42:35.871209 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 14:42:35.871209 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 14:42:35.871209 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 14:42:35.871209 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 14:42:35.871209 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 14:42:35.871209 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 14:42:35.871209 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 14:42:35.871209 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 14:42:35.872302 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 14:42:35.872302 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 14:42:35.872302 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 14:42:35.872302 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 14:42:35.872302 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 14:42:35.872302 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 14:42:35.872302 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 14:42:35.872302 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 14:42:35.872302 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 14:42:35.872302 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application return self.get_or_create( May 25 14:42:35.872302 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 14:42:35.872302 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application with Lock( May 25 14:42:35.872302 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 14:42:35.872302 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application return self._enter() May 25 14:42:35.872302 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 14:42:35.872302 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 14:42:35.873152 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 14:42:35.873152 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application return self.creator() May 25 14:42:35.873152 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 14:42:35.873152 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application created_value = creator( May 25 14:42:35.873152 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 14:42:35.873152 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 14:42:35.873152 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 14:42:35.873152 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 14:42:35.873152 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 14:42:35.873152 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 14:42:35.873152 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 25 14:42:35.873152 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application May 25 14:42:35.873152 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 163/329] 10.222.0.84 () {56 vars in 1099 bytes} [Wed May 25 14:42:35 2022] GET /identity/v3/roles/member => generated 84 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 25 14:42:35.880149 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e6fb704-ef76-42dc-9f75-7e27994aa80f None admin] Authenticating user token {{(pid=101892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:42:35.946503 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG dbcounter [-] [101892] Writing DB stats keystone:SELECT=100 {{(pid=101892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:42:36.002968 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f60518-f4a7-4edc-8df0-3c67ddfe1127 None admin] Validating token access rules against request {{(pid=101893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:42:36.009540 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e6fb704-ef76-42dc-9f75-7e27994aa80f None admin] Validating token access rules against request {{(pid=101892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:42:36.021946 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG dbcounter [-] [101893] Writing DB stats keystone:SELECT=100 {{(pid=101893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:42:36.050940 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a98ef014-60b8-41c6-8dfe-7eb72d169eaf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:42:36.052099 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98ef014-60b8-41c6-8dfe-7eb72d169eaf None admin] REQUEST_METHOD: `GET` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:42:36.052551 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98ef014-60b8-41c6-8dfe-7eb72d169eaf None admin] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:42:36.052970 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98ef014-60b8-41c6-8dfe-7eb72d169eaf None admin] PATH_INFO: `/v3/users/a81dd1fc2f5649b282c0feee7f63fd2b` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:42:36.053801 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da5cfa9a-be99-49e7-b224-fd7dfae566f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:42:36.054484 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a98ef014-60b8-41c6-8dfe-7eb72d169eaf None admin] RBAC: Authorizing `identity:get_user(user_id=a81dd1fc2f5649b282c0feee7f63fd2b)` {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:42:36.054634 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da5cfa9a-be99-49e7-b224-fd7dfae566f9 None admin] REQUEST_METHOD: `GET` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:42:36.055036 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da5cfa9a-be99-49e7-b224-fd7dfae566f9 None admin] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:42:36.056053 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da5cfa9a-be99-49e7-b224-fd7dfae566f9 None admin] PATH_INFO: `/v3/roles` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:42:36.056954 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da5cfa9a-be99-49e7-b224-fd7dfae566f9 None admin] RBAC: Adding query filter params (name=member) {{(pid=101892) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:42:36.057341 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a98ef014-60b8-41c6-8dfe-7eb72d169eaf None admin] RBAC: Authorization granted {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:42:36.057452 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da5cfa9a-be99-49e7-b224-fd7dfae566f9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:42:36.058868 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da5cfa9a-be99-49e7-b224-fd7dfae566f9 None admin] RBAC: Authorization granted {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:42:36.059745 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 167/330] 10.222.0.84 () {56 vars in 1177 bytes} [Wed May 25 14:42:35 2022] GET /identity/v3/users/a81dd1fc2f5649b282c0feee7f63fd2b => generated 293 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:42:36.065758 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a98ef014-60b8-41c6-8dfe-7eb72d169eaf None admin] Authenticating user token {{(pid=101893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:42:36.069719 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 164/331] 10.222.0.84 () {56 vars in 1101 bytes} [Wed May 25 14:42:35 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 14:42:36.076472 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da5cfa9a-be99-49e7-b224-fd7dfae566f9 None admin] Authenticating user token {{(pid=101892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:42:36.206145 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a98ef014-60b8-41c6-8dfe-7eb72d169eaf None admin] Validating token access rules against request {{(pid=101893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:42:36.213564 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da5cfa9a-be99-49e7-b224-fd7dfae566f9 None admin] Validating token access rules against request {{(pid=101892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:42:36.227367 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG dbcounter [-] [101892] Writing DB stats keystone:SELECT=100 {{(pid=101892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:42:36.251153 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7df64073-4e3d-4034-b088-304d6c48b9fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:42:36.252242 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df64073-4e3d-4034-b088-304d6c48b9fc None admin] REQUEST_METHOD: `PUT` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:42:36.252646 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df64073-4e3d-4034-b088-304d6c48b9fc None admin] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:42:36.253063 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df64073-4e3d-4034-b088-304d6c48b9fc None admin] PATH_INFO: `/v3/system/users/a81dd1fc2f5649b282c0feee7f63fd2b/roles/d289ba5202044f90baf900bb40b116b8` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:42:36.254714 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7df64073-4e3d-4034-b088-304d6c48b9fc None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=a81dd1fc2f5649b282c0feee7f63fd2b, role_id=d289ba5202044f90baf900bb40b116b8)` {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:42:36.256330 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7df64073-4e3d-4034-b088-304d6c48b9fc None admin] RBAC: Authorization granted {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:42:36.262465 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a23008-52b0-45ef-9db0-d9ab2771f5d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:42:36.263353 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a23008-52b0-45ef-9db0-d9ab2771f5d3 None admin] REQUEST_METHOD: `GET` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:42:36.264784 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a23008-52b0-45ef-9db0-d9ab2771f5d3 None admin] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:42:36.264784 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a23008-52b0-45ef-9db0-d9ab2771f5d3 None admin] PATH_INFO: `/v3/users/0eb9e5b6a292486a964626fe077319a1` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:42:36.265924 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2a23008-52b0-45ef-9db0-d9ab2771f5d3 None admin] RBAC: Authorizing `identity:get_user(user_id=0eb9e5b6a292486a964626fe077319a1)` {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:42:36.267383 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2a23008-52b0-45ef-9db0-d9ab2771f5d3 None admin] RBAC: Authorization granted {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:42:36.271757 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 165/332] 10.222.0.84 () {56 vars in 1177 bytes} [Wed May 25 14:42:36 2022] GET /identity/v3/users/0eb9e5b6a292486a964626fe077319a1 => generated 293 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:42:36.276383 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a23008-52b0-45ef-9db0-d9ab2771f5d3 None admin] Authenticating user token {{(pid=101892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:42:36.341887 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 168/333] 10.222.0.84 () {58 vars in 1334 bytes} [Wed May 25 14:42:36 2022] PUT /identity/v3/system/users/a81dd1fc2f5649b282c0feee7f63fd2b/roles/d289ba5202044f90baf900bb40b116b8 => generated 0 bytes in 276 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 14:42:36.389359 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a23008-52b0-45ef-9db0-d9ab2771f5d3 None admin] Validating token access rules against request {{(pid=101892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:42:36.431685 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74e47445-456f-4240-9d8c-3d085609a6b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:42:36.432641 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e47445-456f-4240-9d8c-3d085609a6b4 None admin] REQUEST_METHOD: `GET` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:42:36.433071 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e47445-456f-4240-9d8c-3d085609a6b4 None admin] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:42:36.433493 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e47445-456f-4240-9d8c-3d085609a6b4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:42:36.434491 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74e47445-456f-4240-9d8c-3d085609a6b4 None admin] RBAC: Adding query filter params (role.id=ff664fa0db7e4262a5accde96c3df4c3, user.id=0eb9e5b6a292486a964626fe077319a1, scope.system=all) {{(pid=101892) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:42:36.434964 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74e47445-456f-4240-9d8c-3d085609a6b4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:42:36.436595 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74e47445-456f-4240-9d8c-3d085609a6b4 None admin] RBAC: Authorization granted {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:42:36.450284 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 166/334] 10.222.0.84 () {56 vars in 1308 bytes} [Wed May 25 14:42:36 2022] GET /identity/v3/role_assignments?user.id=0eb9e5b6a292486a964626fe077319a1&scope.system=all&role.id=ff664fa0db7e4262a5accde96c3df4c3 => generated 510 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 14:42:38.082035 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f510cda3-d9d5-465f-87d5-f3221b75461c None None] REQUEST_METHOD: `GET` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:42:38.082607 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f510cda3-d9d5-465f-87d5-f3221b75461c None None] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:42:38.082607 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f510cda3-d9d5-465f-87d5-f3221b75461c None None] PATH_INFO: `/` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:42:38.084072 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 169/335] 10.222.0.84 () {54 vars in 926 bytes} [Wed May 25 14:42:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 14:42:38.090649 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4340797-7857-4dcf-a0c6-9729bfdac10d None None] REQUEST_METHOD: `POST` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:42:38.091140 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4340797-7857-4dcf-a0c6-9729bfdac10d None None] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:42:38.091244 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4340797-7857-4dcf-a0c6-9729bfdac10d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:42:38.119199 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.auth.core [None req-b4340797-7857-4dcf-a0c6-9729bfdac10d None None] MFA Rules not processed for user `05d87e87798e429aa1c10b24391f915e`. Rule list: `[]` (Enabled: `True`). {{(pid=101892) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:42:38.120452 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.fernet_utils [None req-b4340797-7857-4dcf-a0c6-9729bfdac10d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=101892) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:42:38.157005 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG dbcounter [-] [101892] Writing DB stats keystone:SELECT=100 {{(pid=101892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:42:38.214427 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 167/336] 10.222.0.84 () {58 vars in 1023 bytes} [Wed May 25 14:42:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 25 14:42:38.251649 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f510cda3-d9d5-465f-87d5-f3221b75461c None None] Authenticating user token {{(pid=101893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:42:38.308155 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG dbcounter [-] [101893] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=101893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:42:38.376391 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f510cda3-d9d5-465f-87d5-f3221b75461c None None] Validating token access rules against request {{(pid=101893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:42:38.422320 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf4df463-28ff-47ad-80fd-86ef10ccb123 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:42:38.423122 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4df463-28ff-47ad-80fd-86ef10ccb123 None admin] REQUEST_METHOD: `GET` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:42:38.423403 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4df463-28ff-47ad-80fd-86ef10ccb123 None admin] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:42:38.423699 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4df463-28ff-47ad-80fd-86ef10ccb123 None admin] PATH_INFO: `/v3/roles/member` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:42:38.438359 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf4df463-28ff-47ad-80fd-86ef10ccb123 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 14:42:38.446707 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application [None req-bf4df463-28ff-47ad-80fd-86ef10ccb123 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 25 14:42:38.446707 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:42:38.446707 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 14:42:38.446707 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 14:42:38.446707 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 14:42:38.446707 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 14:42:38.446707 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 14:42:38.446707 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 14:42:38.446707 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 14:42:38.446707 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 14:42:38.446707 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 14:42:38.446707 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 14:42:38.446707 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 14:42:38.446707 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 14:42:38.446707 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 14:42:38.446707 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 14:42:38.447637 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 14:42:38.447637 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 14:42:38.447637 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 14:42:38.447637 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 14:42:38.447637 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 14:42:38.447637 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 14:42:38.447637 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 14:42:38.447637 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 14:42:38.447637 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 14:42:38.447637 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return self.get_or_create( May 25 14:42:38.447637 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 14:42:38.447637 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application with Lock( May 25 14:42:38.447637 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 14:42:38.447637 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return self._enter() May 25 14:42:38.447637 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 14:42:38.447637 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 14:42:38.448439 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 14:42:38.448439 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return self.creator() May 25 14:42:38.448439 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 14:42:38.448439 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application created_value = creator( May 25 14:42:38.448439 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 14:42:38.448439 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 14:42:38.448439 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 14:42:38.448439 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 14:42:38.448439 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 14:42:38.448439 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 14:42:38.448439 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 25 14:42:38.448439 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application May 25 14:42:38.448439 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 170/337] 10.222.0.84 () {56 vars in 1099 bytes} [Wed May 25 14:42:38 2022] GET /identity/v3/roles/member => generated 84 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 14:42:38.454080 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4340797-7857-4dcf-a0c6-9729bfdac10d None None] Authenticating user token {{(pid=101892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:42:38.560193 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf0cd9e-42bd-424e-a619-2bf149d43c99 None None] REQUEST_METHOD: `GET` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:42:38.560193 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf0cd9e-42bd-424e-a619-2bf149d43c99 None None] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:42:38.560193 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf0cd9e-42bd-424e-a619-2bf149d43c99 None None] PATH_INFO: `/` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:42:38.560884 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 171/338] 10.222.0.84 () {54 vars in 926 bytes} [Wed May 25 14:42:38 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 14:42:38.566083 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c8b052-2f86-45d7-8559-f732e8ccc476 None None] REQUEST_METHOD: `POST` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:42:38.566375 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c8b052-2f86-45d7-8559-f732e8ccc476 None None] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:42:38.566655 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c8b052-2f86-45d7-8559-f732e8ccc476 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:42:38.576044 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4340797-7857-4dcf-a0c6-9729bfdac10d None None] Validating token access rules against request {{(pid=101892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:42:38.605210 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.auth.core [None req-d4c8b052-2f86-45d7-8559-f732e8ccc476 None None] MFA Rules not processed for user `05d87e87798e429aa1c10b24391f915e`. Rule list: `[]` (Enabled: `True`). {{(pid=101893) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:42:38.606399 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.fernet_utils [None req-d4c8b052-2f86-45d7-8559-f732e8ccc476 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=101893) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:42:38.615081 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ea20983-bf94-40dc-80c0-3c0464d38953 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:42:38.615782 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea20983-bf94-40dc-80c0-3c0464d38953 None admin] REQUEST_METHOD: `GET` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:42:38.616069 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea20983-bf94-40dc-80c0-3c0464d38953 None admin] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:42:38.616348 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea20983-bf94-40dc-80c0-3c0464d38953 None admin] PATH_INFO: `/v3/roles` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:42:38.617299 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ea20983-bf94-40dc-80c0-3c0464d38953 None admin] RBAC: Adding query filter params (name=member) {{(pid=101892) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:42:38.618493 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ea20983-bf94-40dc-80c0-3c0464d38953 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:42:38.622115 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ea20983-bf94-40dc-80c0-3c0464d38953 None admin] RBAC: Authorization granted {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:42:38.632585 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 168/339] 10.222.0.84 () {56 vars in 1101 bytes} [Wed May 25 14:42:38 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:42:38.638088 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ea20983-bf94-40dc-80c0-3c0464d38953 None admin] Authenticating user token {{(pid=101892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:42:38.697742 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG dbcounter [-] [101892] Writing DB stats keystone:SELECT=100 {{(pid=101892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:42:38.727538 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 172/340] 10.222.0.84 () {58 vars in 1023 bytes} [Wed May 25 14:42:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 25 14:42:38.767305 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4c8b052-2f86-45d7-8559-f732e8ccc476 None None] Authenticating user token {{(pid=101893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:42:38.824014 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG dbcounter [-] [101893] Writing DB stats keystone:SELECT=100 {{(pid=101893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:42:38.856850 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ea20983-bf94-40dc-80c0-3c0464d38953 None admin] Validating token access rules against request {{(pid=101892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:42:38.894161 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4c8b052-2f86-45d7-8559-f732e8ccc476 None None] Validating token access rules against request {{(pid=101893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:42:38.934372 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fcd51ac-2741-4a88-ba0d-ad9721043d70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:42:38.935198 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fcd51ac-2741-4a88-ba0d-ad9721043d70 None admin] REQUEST_METHOD: `GET` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:42:38.935485 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fcd51ac-2741-4a88-ba0d-ad9721043d70 None admin] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:42:38.935789 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fcd51ac-2741-4a88-ba0d-ad9721043d70 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:42:38.948289 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68d3040e-59b7-452c-8e70-78a97d2eb1e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:42:38.948966 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d3040e-59b7-452c-8e70-78a97d2eb1e3 None admin] REQUEST_METHOD: `GET` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:42:38.949254 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d3040e-59b7-452c-8e70-78a97d2eb1e3 None admin] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:42:38.949539 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d3040e-59b7-452c-8e70-78a97d2eb1e3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:42:38.957309 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fcd51ac-2741-4a88-ba0d-ad9721043d70 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 14:42:38.974162 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application [None req-1fcd51ac-2741-4a88-ba0d-ad9721043d70 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 25 14:42:38.974162 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:42:38.974162 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 14:42:38.974162 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 14:42:38.974162 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 14:42:38.974162 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 14:42:38.974162 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 14:42:38.974162 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 14:42:38.974162 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 14:42:38.974162 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 14:42:38.974162 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 14:42:38.974162 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 14:42:38.974162 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 14:42:38.974162 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 14:42:38.974162 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 14:42:38.974162 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 14:42:38.975101 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 14:42:38.975101 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 14:42:38.975101 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 14:42:38.975101 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 14:42:38.975101 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 14:42:38.975101 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 14:42:38.975101 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 14:42:38.975101 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 14:42:38.975101 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 14:42:38.975101 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return self.get_or_create( May 25 14:42:38.975101 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 14:42:38.975101 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application with Lock( May 25 14:42:38.975101 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 14:42:38.975101 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return self._enter() May 25 14:42:38.975101 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 14:42:38.975101 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 14:42:38.976389 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 14:42:38.976389 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return self.creator() May 25 14:42:38.976389 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 14:42:38.976389 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application created_value = creator( May 25 14:42:38.976389 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 14:42:38.976389 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 14:42:38.976389 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 14:42:38.976389 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 14:42:38.976389 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 14:42:38.976389 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 14:42:38.976389 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 25 14:42:38.976389 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application May 25 14:42:38.976389 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 173/341] 10.222.0.84 () {56 vars in 1114 bytes} [Wed May 25 14:42:38 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 14:42:38.981284 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fcd51ac-2741-4a88-ba0d-ad9721043d70 None admin] Authenticating user token {{(pid=101893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:42:39.051937 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68d3040e-59b7-452c-8e70-78a97d2eb1e3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:42:39.053397 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68d3040e-59b7-452c-8e70-78a97d2eb1e3 None admin] RBAC: Authorization granted {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:42:39.141143 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG dbcounter [-] [101893] Writing DB stats keystone:SELECT=100 {{(pid=101893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:42:39.156406 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG dbcounter [-] [101892] Writing DB stats keystone:SELECT=100 {{(pid=101892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:42:39.165725 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fcd51ac-2741-4a88-ba0d-ad9721043d70 None admin] Validating token access rules against request {{(pid=101893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:42:39.201177 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 169/342] 10.222.0.84 () {58 vars in 1282 bytes} [Wed May 25 14:42:38 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 563 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 25 14:42:39.206925 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68d3040e-59b7-452c-8e70-78a97d2eb1e3 None admin] Authenticating user token {{(pid=101892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:42:39.233415 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cebc489e-f08b-44de-87a3-3951006b6dab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:42:39.236625 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cebc489e-f08b-44de-87a3-3951006b6dab None admin] REQUEST_METHOD: `GET` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:42:39.237124 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cebc489e-f08b-44de-87a3-3951006b6dab None admin] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:42:39.237608 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cebc489e-f08b-44de-87a3-3951006b6dab None admin] PATH_INFO: `/v3/roles` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:42:39.238572 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cebc489e-f08b-44de-87a3-3951006b6dab None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=101893) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:42:39.239107 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cebc489e-f08b-44de-87a3-3951006b6dab None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:42:39.240737 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cebc489e-f08b-44de-87a3-3951006b6dab None admin] RBAC: Authorization granted {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:42:39.260015 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 174/343] 10.222.0.84 () {56 vars in 1111 bytes} [Wed May 25 14:42:38 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 279 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 14:42:39.265873 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cebc489e-f08b-44de-87a3-3951006b6dab None admin] Authenticating user token {{(pid=101893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:42:39.346745 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68d3040e-59b7-452c-8e70-78a97d2eb1e3 None admin] Validating token access rules against request {{(pid=101892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:42:39.377350 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG dbcounter [-] [101892] Writing DB stats keystone:SELECT=100 {{(pid=101892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:42:39.396718 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdea1110-70d1-428b-9377-97f45fa68ed9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:42:39.397582 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdea1110-70d1-428b-9377-97f45fa68ed9 None admin] REQUEST_METHOD: `GET` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:42:39.397871 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdea1110-70d1-428b-9377-97f45fa68ed9 None admin] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:42:39.398153 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdea1110-70d1-428b-9377-97f45fa68ed9 None admin] PATH_INFO: `/v3/projects/42293c5d76254690ab29c96f76687d9c` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:42:39.400201 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdea1110-70d1-428b-9377-97f45fa68ed9 None admin] RBAC: Authorizing `identity:get_project(project_id=42293c5d76254690ab29c96f76687d9c)` {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:42:39.401689 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdea1110-70d1-428b-9377-97f45fa68ed9 None admin] RBAC: Authorization granted {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:42:39.403909 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 170/344] 10.222.0.84 () {56 vars in 1186 bytes} [Wed May 25 14:42:39 2022] GET /identity/v3/projects/42293c5d76254690ab29c96f76687d9c => generated 298 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:42:39.409581 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdea1110-70d1-428b-9377-97f45fa68ed9 None admin] Authenticating user token {{(pid=101892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:42:39.505748 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cebc489e-f08b-44de-87a3-3951006b6dab None admin] Validating token access rules against request {{(pid=101893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:42:39.529342 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdea1110-70d1-428b-9377-97f45fa68ed9 None admin] Validating token access rules against request {{(pid=101892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:42:39.585927 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-047ef983-d218-46d4-83ea-b3cd713a6742 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:42:39.587485 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047ef983-d218-46d4-83ea-b3cd713a6742 None admin] REQUEST_METHOD: `GET` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:42:39.587811 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047ef983-d218-46d4-83ea-b3cd713a6742 None admin] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:42:39.588086 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047ef983-d218-46d4-83ea-b3cd713a6742 None admin] PATH_INFO: `/v3/groups/ea8743b893f94df9bc571308c507b491` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:42:39.598011 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1419b8b1-51bc-40f9-979e-f20d89c9f336 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:42:39.599100 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1419b8b1-51bc-40f9-979e-f20d89c9f336 None admin] REQUEST_METHOD: `GET` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:42:39.599637 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1419b8b1-51bc-40f9-979e-f20d89c9f336 None admin] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:42:39.600125 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1419b8b1-51bc-40f9-979e-f20d89c9f336 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:42:39.603389 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-047ef983-d218-46d4-83ea-b3cd713a6742 None admin] RBAC: Authorizing `identity:get_group(group_id=ea8743b893f94df9bc571308c507b491)` {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:42:39.604902 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-047ef983-d218-46d4-83ea-b3cd713a6742 None admin] RBAC: Authorization granted {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:42:39.608628 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 171/345] 10.222.0.84 () {56 vars in 1180 bytes} [Wed May 25 14:42:39 2022] GET /identity/v3/groups/ea8743b893f94df9bc571308c507b491 => generated 226 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 14:42:39.616537 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-047ef983-d218-46d4-83ea-b3cd713a6742 None admin] Authenticating user token {{(pid=101892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:42:39.650121 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG dbcounter [-] [101893] Writing DB stats keystone:SELECT=100 {{(pid=101893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:42:39.709688 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG dbcounter [-] [101892] Writing DB stats keystone:SELECT=100 {{(pid=101892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:42:39.731236 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1419b8b1-51bc-40f9-979e-f20d89c9f336 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:42:39.732754 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1419b8b1-51bc-40f9-979e-f20d89c9f336 None admin] RBAC: Authorization granted {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:42:39.779507 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-047ef983-d218-46d4-83ea-b3cd713a6742 None admin] Validating token access rules against request {{(pid=101892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:42:39.856418 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 175/346] 10.222.0.84 () {58 vars in 1282 bytes} [Wed May 25 14:42:39 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 591 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 25 14:42:39.857679 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9752be-7cb9-43d7-b38e-5e1621a41f70 None None] REQUEST_METHOD: `GET` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:42:39.857963 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9752be-7cb9-43d7-b38e-5e1621a41f70 None None] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:42:39.858335 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9752be-7cb9-43d7-b38e-5e1621a41f70 None None] PATH_INFO: `/` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:42:39.860600 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 176/347] 10.222.0.84 () {54 vars in 926 bytes} [Wed May 25 14:42:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 14:42:39.861958 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda29b93-3f5a-47db-bff6-5e8612f2bc73 None None] REQUEST_METHOD: `GET` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:42:39.862241 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda29b93-3f5a-47db-bff6-5e8612f2bc73 None None] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:42:39.862512 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda29b93-3f5a-47db-bff6-5e8612f2bc73 None None] PATH_INFO: `/` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:42:39.863996 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 177/348] 10.222.0.84 () {54 vars in 926 bytes} [Wed May 25 14:42:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 14:42:39.868828 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-680dc0fa-52fc-45d2-adf8-f658917ff1ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:42:39.869328 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a4d9a0-e5bd-47c5-aa4b-234267fb7039 None None] REQUEST_METHOD: `POST` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:42:39.869503 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680dc0fa-52fc-45d2-adf8-f658917ff1ea None admin] REQUEST_METHOD: `GET` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:42:39.869603 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a4d9a0-e5bd-47c5-aa4b-234267fb7039 None None] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:42:39.869767 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680dc0fa-52fc-45d2-adf8-f658917ff1ea None admin] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:42:39.869864 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a4d9a0-e5bd-47c5-aa4b-234267fb7039 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:42:39.870026 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680dc0fa-52fc-45d2-adf8-f658917ff1ea None admin] PATH_INFO: `/v3/role_assignments` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:42:39.870862 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-680dc0fa-52fc-45d2-adf8-f658917ff1ea None admin] RBAC: Adding query filter params (group.id=ea8743b893f94df9bc571308c507b491, role.id=ff664fa0db7e4262a5accde96c3df4c3, scope.project.id=42293c5d76254690ab29c96f76687d9c) {{(pid=101892) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:42:39.871175 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-680dc0fa-52fc-45d2-adf8-f658917ff1ea None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:42:39.872707 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-680dc0fa-52fc-45d2-adf8-f658917ff1ea None admin] RBAC: Authorization granted {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:42:39.880691 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 172/349] 10.222.0.84 () {56 vars in 1376 bytes} [Wed May 25 14:42:39 2022] GET /identity/v3/role_assignments?group.id=ea8743b893f94df9bc571308c507b491&scope.project.id=42293c5d76254690ab29c96f76687d9c&role.id=ff664fa0db7e4262a5accde96c3df4c3 => generated 260 bytes in 265 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 14:42:39.881975 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667c0b7d-ba24-4baf-8942-fef43849ce2e None None] REQUEST_METHOD: `POST` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:42:39.882267 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667c0b7d-ba24-4baf-8942-fef43849ce2e None None] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:42:39.882546 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667c0b7d-ba24-4baf-8942-fef43849ce2e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:42:39.898762 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.auth.core [None req-73a4d9a0-e5bd-47c5-aa4b-234267fb7039 None None] MFA Rules not processed for user `05d87e87798e429aa1c10b24391f915e`. Rule list: `[]` (Enabled: `True`). {{(pid=101893) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:42:39.900056 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.fernet_utils [None req-73a4d9a0-e5bd-47c5-aa4b-234267fb7039 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=101893) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:42:39.903649 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.auth.core [None req-667c0b7d-ba24-4baf-8942-fef43849ce2e None None] MFA Rules not processed for user `05d87e87798e429aa1c10b24391f915e`. Rule list: `[]` (Enabled: `True`). {{(pid=101892) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:42:39.904884 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.fernet_utils [None req-667c0b7d-ba24-4baf-8942-fef43849ce2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=101892) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:42:39.983348 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 173/350] 10.222.0.84 () {58 vars in 1023 bytes} [Wed May 25 14:42:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 25 14:42:39.984182 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-667c0b7d-ba24-4baf-8942-fef43849ce2e None None] Authenticating user token {{(pid=101892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:42:40.006893 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG dbcounter [-] [101893] Writing DB stats keystone:SELECT=100 {{(pid=101893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:42:40.033362 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 178/351] 10.222.0.84 () {58 vars in 1023 bytes} [Wed May 25 14:42:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 25 14:42:40.034380 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a4d9a0-e5bd-47c5-aa4b-234267fb7039 None None] Authenticating user token {{(pid=101893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:42:40.055988 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG dbcounter [-] [101892] Writing DB stats keystone:SELECT=100 {{(pid=101892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:42:40.098100 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-667c0b7d-ba24-4baf-8942-fef43849ce2e None None] Validating token access rules against request {{(pid=101892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:42:40.136976 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec1d228-c4bd-4bf9-9e4f-cf33c9a58200 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:42:40.137845 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec1d228-c4bd-4bf9-9e4f-cf33c9a58200 None admin] REQUEST_METHOD: `GET` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:42:40.138203 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec1d228-c4bd-4bf9-9e4f-cf33c9a58200 None admin] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:42:40.138686 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec1d228-c4bd-4bf9-9e4f-cf33c9a58200 None admin] PATH_INFO: `/v3/projects/42293c5d76254690ab29c96f76687d9c` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:42:40.140182 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ec1d228-c4bd-4bf9-9e4f-cf33c9a58200 None admin] RBAC: Authorizing `identity:get_project(project_id=42293c5d76254690ab29c96f76687d9c)` {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:42:40.141634 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ec1d228-c4bd-4bf9-9e4f-cf33c9a58200 None admin] RBAC: Authorization granted {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:42:40.143543 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 174/352] 10.222.0.84 () {56 vars in 1186 bytes} [Wed May 25 14:42:39 2022] GET /identity/v3/projects/42293c5d76254690ab29c96f76687d9c => generated 298 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:42:40.148114 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec1d228-c4bd-4bf9-9e4f-cf33c9a58200 None admin] Authenticating user token {{(pid=101892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:42:40.183243 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a4d9a0-e5bd-47c5-aa4b-234267fb7039 None None] Validating token access rules against request {{(pid=101893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:42:40.242379 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b20c3b8c-413c-424f-ae8f-ee2b5016e986 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:42:40.243609 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20c3b8c-413c-424f-ae8f-ee2b5016e986 None admin] REQUEST_METHOD: `GET` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:42:40.244206 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20c3b8c-413c-424f-ae8f-ee2b5016e986 None admin] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:42:40.244811 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20c3b8c-413c-424f-ae8f-ee2b5016e986 None admin] PATH_INFO: `/v3/roles/member` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:42:40.253731 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec1d228-c4bd-4bf9-9e4f-cf33c9a58200 None admin] Validating token access rules against request {{(pid=101892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:42:40.268569 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b20c3b8c-413c-424f-ae8f-ee2b5016e986 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 14:42:40.277879 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application [None req-b20c3b8c-413c-424f-ae8f-ee2b5016e986 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 25 14:42:40.277879 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:42:40.277879 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 14:42:40.277879 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 14:42:40.277879 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 14:42:40.277879 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 14:42:40.277879 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 14:42:40.277879 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 14:42:40.277879 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 14:42:40.277879 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 14:42:40.277879 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 14:42:40.277879 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 14:42:40.277879 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 14:42:40.277879 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 14:42:40.277879 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 14:42:40.277879 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 14:42:40.278819 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 14:42:40.278819 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 14:42:40.278819 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 14:42:40.278819 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 14:42:40.278819 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 14:42:40.278819 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 14:42:40.278819 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 14:42:40.278819 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 14:42:40.278819 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 14:42:40.278819 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return self.get_or_create( May 25 14:42:40.278819 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 14:42:40.278819 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application with Lock( May 25 14:42:40.278819 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 14:42:40.278819 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return self._enter() May 25 14:42:40.278819 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 14:42:40.278819 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 14:42:40.279696 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 14:42:40.279696 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return self.creator() May 25 14:42:40.279696 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 14:42:40.279696 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application created_value = creator( May 25 14:42:40.279696 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 14:42:40.279696 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 14:42:40.279696 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 14:42:40.279696 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 14:42:40.279696 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 14:42:40.279696 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 14:42:40.279696 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 25 14:42:40.279696 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application May 25 14:42:40.287488 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG dbcounter [-] [101892] Writing DB stats keystone:SELECT=100 {{(pid=101892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:42:40.290322 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 179/353] 10.222.0.84 () {56 vars in 1099 bytes} [Wed May 25 14:42:40 2022] GET /identity/v3/roles/member => generated 84 bytes in 256 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 14:42:40.291774 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b20c3b8c-413c-424f-ae8f-ee2b5016e986 None admin] Authenticating user token {{(pid=101893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:42:40.292629 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-863f5058-e96e-47bb-847c-0f776df9c081 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:42:40.294607 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-863f5058-e96e-47bb-847c-0f776df9c081 None admin] REQUEST_METHOD: `GET` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:42:40.294607 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-863f5058-e96e-47bb-847c-0f776df9c081 None admin] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:42:40.294607 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-863f5058-e96e-47bb-847c-0f776df9c081 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:42:40.311603 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-863f5058-e96e-47bb-847c-0f776df9c081 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 14:42:40.315161 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application [None req-863f5058-e96e-47bb-847c-0f776df9c081 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 25 14:42:40.315161 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:42:40.315161 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 14:42:40.315161 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 14:42:40.315161 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 14:42:40.315161 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 14:42:40.315161 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 14:42:40.315161 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 14:42:40.315161 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 14:42:40.315161 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 14:42:40.315161 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 14:42:40.315161 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 14:42:40.315161 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 14:42:40.315161 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 14:42:40.315161 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 14:42:40.315161 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 14:42:40.316258 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 14:42:40.316258 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 14:42:40.316258 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 14:42:40.316258 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 14:42:40.316258 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 14:42:40.316258 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 14:42:40.316258 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 14:42:40.316258 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 14:42:40.316258 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 14:42:40.316258 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application return self.get_or_create( May 25 14:42:40.316258 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 14:42:40.316258 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application with Lock( May 25 14:42:40.316258 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 14:42:40.316258 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application return self._enter() May 25 14:42:40.316258 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 14:42:40.316258 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 14:42:40.317238 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 14:42:40.317238 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application return self.creator() May 25 14:42:40.317238 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 14:42:40.317238 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application created_value = creator( May 25 14:42:40.317238 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 14:42:40.317238 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 14:42:40.317238 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 14:42:40.317238 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 14:42:40.317238 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 14:42:40.317238 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 14:42:40.317238 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 25 14:42:40.317238 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application May 25 14:42:40.319359 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 175/354] 10.222.0.84 () {56 vars in 1099 bytes} [Wed May 25 14:42:40 2022] GET /identity/v3/roles/reader => generated 84 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 14:42:40.320393 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-863f5058-e96e-47bb-847c-0f776df9c081 None admin] Authenticating user token {{(pid=101892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:42:40.388746 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG dbcounter [-] [101893] Writing DB stats keystone:SELECT=100 {{(pid=101893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:42:40.432682 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-863f5058-e96e-47bb-847c-0f776df9c081 None admin] Validating token access rules against request {{(pid=101892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:42:40.472264 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5a18bd7-8fa9-42c9-8da6-4f02b0edae7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:42:40.472936 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a18bd7-8fa9-42c9-8da6-4f02b0edae7a None admin] REQUEST_METHOD: `GET` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:42:40.473219 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a18bd7-8fa9-42c9-8da6-4f02b0edae7a None admin] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:42:40.473491 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a18bd7-8fa9-42c9-8da6-4f02b0edae7a None admin] PATH_INFO: `/v3/roles` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:42:40.474240 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5a18bd7-8fa9-42c9-8da6-4f02b0edae7a None admin] RBAC: Adding query filter params (name=member) {{(pid=101892) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:42:40.474546 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5a18bd7-8fa9-42c9-8da6-4f02b0edae7a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:42:40.475942 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5a18bd7-8fa9-42c9-8da6-4f02b0edae7a None admin] RBAC: Authorization granted {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:42:40.489741 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b20c3b8c-413c-424f-ae8f-ee2b5016e986 None admin] Validating token access rules against request {{(pid=101893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:42:40.495061 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 176/355] 10.222.0.84 () {56 vars in 1101 bytes} [Wed May 25 14:42:40 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:42:40.501846 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5a18bd7-8fa9-42c9-8da6-4f02b0edae7a None admin] Authenticating user token {{(pid=101892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:42:40.562820 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG dbcounter [-] [101892] Writing DB stats keystone:SELECT=100 {{(pid=101892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:42:40.568281 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d020c512-a56d-464d-915b-7a75d38956dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:42:40.569164 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d020c512-a56d-464d-915b-7a75d38956dd None admin] REQUEST_METHOD: `GET` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:42:40.569445 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d020c512-a56d-464d-915b-7a75d38956dd None admin] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:42:40.569718 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d020c512-a56d-464d-915b-7a75d38956dd None admin] PATH_INFO: `/v3/groups/ea8743b893f94df9bc571308c507b491` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:42:40.576340 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d020c512-a56d-464d-915b-7a75d38956dd None admin] RBAC: Authorizing `identity:get_group(group_id=ea8743b893f94df9bc571308c507b491)` {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:42:40.585022 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d020c512-a56d-464d-915b-7a75d38956dd None admin] RBAC: Authorization granted {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:42:40.585022 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 180/356] 10.222.0.84 () {56 vars in 1180 bytes} [Wed May 25 14:42:40 2022] GET /identity/v3/groups/ea8743b893f94df9bc571308c507b491 => generated 226 bytes in 288 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:42:40.585022 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d020c512-a56d-464d-915b-7a75d38956dd None admin] Authenticating user token {{(pid=101893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:42:40.626547 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5a18bd7-8fa9-42c9-8da6-4f02b0edae7a None admin] Validating token access rules against request {{(pid=101892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:42:40.670004 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d4d133b-8501-482b-80bb-ff0c70f9c871 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:42:40.670842 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4d133b-8501-482b-80bb-ff0c70f9c871 None admin] REQUEST_METHOD: `GET` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:42:40.671230 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4d133b-8501-482b-80bb-ff0c70f9c871 None admin] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:42:40.671671 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4d133b-8501-482b-80bb-ff0c70f9c871 None admin] PATH_INFO: `/v3/roles` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:42:40.672535 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d4d133b-8501-482b-80bb-ff0c70f9c871 None admin] RBAC: Adding query filter params (name=reader) {{(pid=101892) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:42:40.672957 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d4d133b-8501-482b-80bb-ff0c70f9c871 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:42:40.674441 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d4d133b-8501-482b-80bb-ff0c70f9c871 None admin] RBAC: Authorization granted {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:42:40.685392 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 177/357] 10.222.0.84 () {56 vars in 1101 bytes} [Wed May 25 14:42:40 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:42:40.686841 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b063e761-055d-4108-815f-dbd8616c3c57 None None] REQUEST_METHOD: `GET` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:42:40.687235 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b063e761-055d-4108-815f-dbd8616c3c57 None None] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:42:40.687651 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b063e761-055d-4108-815f-dbd8616c3c57 None None] PATH_INFO: `/` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:42:40.689115 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 178/358] 10.222.0.84 () {54 vars in 926 bytes} [Wed May 25 14:42:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 14:42:40.690058 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b063e761-055d-4108-815f-dbd8616c3c57 None None] Authenticating user token {{(pid=101892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:42:40.702510 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d020c512-a56d-464d-915b-7a75d38956dd None admin] Validating token access rules against request {{(pid=101893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:42:40.727922 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG dbcounter [-] [101893] Writing DB stats keystone:SELECT=100 {{(pid=101893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:42:40.741903 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b38dd8df-a679-4c05-8e49-1093d1b01386 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:42:40.743601 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38dd8df-a679-4c05-8e49-1093d1b01386 None admin] REQUEST_METHOD: `GET` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:42:40.744142 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38dd8df-a679-4c05-8e49-1093d1b01386 None admin] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:42:40.744576 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38dd8df-a679-4c05-8e49-1093d1b01386 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:42:40.820868 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b063e761-055d-4108-815f-dbd8616c3c57 None None] Validating token access rules against request {{(pid=101892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:42:40.825236 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b38dd8df-a679-4c05-8e49-1093d1b01386 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:42:40.826897 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b38dd8df-a679-4c05-8e49-1093d1b01386 None admin] RBAC: Authorization granted {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:42:40.833234 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG dbcounter [-] [101892] Writing DB stats keystone:SELECT=100 {{(pid=101892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:42:40.862105 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-054244d7-dff9-4e81-be5b-e08d9f60a0c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:42:40.863040 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054244d7-dff9-4e81-be5b-e08d9f60a0c7 None admin] REQUEST_METHOD: `GET` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:42:40.863609 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054244d7-dff9-4e81-be5b-e08d9f60a0c7 None admin] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:42:40.864942 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054244d7-dff9-4e81-be5b-e08d9f60a0c7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:42:40.865975 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-054244d7-dff9-4e81-be5b-e08d9f60a0c7 None admin] RBAC: Adding query filter params (group.id=ea8743b893f94df9bc571308c507b491, role.id=d3defd94f93b4e76af116df691240185, scope.project.id=42293c5d76254690ab29c96f76687d9c) {{(pid=101892) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:42:40.866444 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-054244d7-dff9-4e81-be5b-e08d9f60a0c7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:42:40.868732 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-054244d7-dff9-4e81-be5b-e08d9f60a0c7 None admin] RBAC: Authorization granted {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:42:40.876766 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 179/359] 10.222.0.84 () {56 vars in 1376 bytes} [Wed May 25 14:42:40 2022] GET /identity/v3/role_assignments?group.id=ea8743b893f94df9bc571308c507b491&scope.project.id=42293c5d76254690ab29c96f76687d9c&role.id=d3defd94f93b4e76af116df691240185 => generated 260 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:42:40.878017 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-054244d7-dff9-4e81-be5b-e08d9f60a0c7 None admin] Authenticating user token {{(pid=101892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:42:41.000594 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-054244d7-dff9-4e81-be5b-e08d9f60a0c7 None admin] Validating token access rules against request {{(pid=101892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:42:41.018146 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 181/360] 10.222.0.84 () {58 vars in 1282 bytes} [Wed May 25 14:42:40 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 438 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 25 14:42:41.024078 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee7dcb1-f8fd-426f-b969-c2c6f37e1ac2 None None] REQUEST_METHOD: `POST` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:42:41.024678 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee7dcb1-f8fd-426f-b969-c2c6f37e1ac2 None None] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:42:41.025123 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee7dcb1-f8fd-426f-b969-c2c6f37e1ac2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:42:41.044603 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.auth.core [None req-1ee7dcb1-f8fd-426f-b969-c2c6f37e1ac2 None None] MFA Rules not processed for user `05d87e87798e429aa1c10b24391f915e`. Rule list: `[]` (Enabled: `True`). {{(pid=101893) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:42:41.045293 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87cb522f-157e-4e09-840a-0178d4d87186 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:42:41.046197 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87cb522f-157e-4e09-840a-0178d4d87186 None admin] REQUEST_METHOD: `GET` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:42:41.046441 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.fernet_utils [None req-1ee7dcb1-f8fd-426f-b969-c2c6f37e1ac2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=101893) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:42:41.046552 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87cb522f-157e-4e09-840a-0178d4d87186 None admin] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:42:41.046740 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87cb522f-157e-4e09-840a-0178d4d87186 None admin] PATH_INFO: `/v3/users/a81dd1fc2f5649b282c0feee7f63fd2b` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:42:41.048028 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87cb522f-157e-4e09-840a-0178d4d87186 None admin] RBAC: Authorizing `identity:get_user(user_id=a81dd1fc2f5649b282c0feee7f63fd2b)` {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:42:41.049890 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87cb522f-157e-4e09-840a-0178d4d87186 None admin] RBAC: Authorization granted {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:42:41.053059 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 180/361] 10.222.0.84 () {56 vars in 1177 bytes} [Wed May 25 14:42:40 2022] GET /identity/v3/users/a81dd1fc2f5649b282c0feee7f63fd2b => generated 293 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:42:41.054475 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fcbde66-1d5c-42d4-8480-97cb7b9896a5 None None] REQUEST_METHOD: `GET` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:42:41.054764 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fcbde66-1d5c-42d4-8480-97cb7b9896a5 None None] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:42:41.055090 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fcbde66-1d5c-42d4-8480-97cb7b9896a5 None None] PATH_INFO: `/` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:42:41.056877 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 181/362] 10.222.0.84 () {54 vars in 926 bytes} [Wed May 25 14:42:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 14:42:41.060865 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fcbde66-1d5c-42d4-8480-97cb7b9896a5 None None] Authenticating user token {{(pid=101892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:42:41.064531 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG dbcounter [-] [101893] Writing DB stats keystone:SELECT=100 {{(pid=101893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:42:41.119356 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG dbcounter [-] [101892] Writing DB stats keystone:SELECT=100 {{(pid=101892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:42:41.141778 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 182/363] 10.222.0.84 () {58 vars in 1023 bytes} [Wed May 25 14:42:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 25 14:42:41.142648 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee7dcb1-f8fd-426f-b969-c2c6f37e1ac2 None None] Authenticating user token {{(pid=101893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:42:41.228336 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fcbde66-1d5c-42d4-8480-97cb7b9896a5 None None] Validating token access rules against request {{(pid=101892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:42:41.269975 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07edde5d-c8f8-40d1-a4ee-49b1039eccb5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:42:41.271775 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07edde5d-c8f8-40d1-a4ee-49b1039eccb5 None admin] REQUEST_METHOD: `GET` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:42:41.272340 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07edde5d-c8f8-40d1-a4ee-49b1039eccb5 None admin] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:42:41.272820 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07edde5d-c8f8-40d1-a4ee-49b1039eccb5 None admin] PATH_INFO: `/v3/projects/ac9e4da865b34de49eecd54e4f6f34e6` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:42:41.274541 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07edde5d-c8f8-40d1-a4ee-49b1039eccb5 None admin] RBAC: Authorizing `identity:get_project(project_id=ac9e4da865b34de49eecd54e4f6f34e6)` {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:42:41.276222 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07edde5d-c8f8-40d1-a4ee-49b1039eccb5 None admin] RBAC: Authorization granted {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:42:41.276992 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee7dcb1-f8fd-426f-b969-c2c6f37e1ac2 None None] Validating token access rules against request {{(pid=101893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:42:41.278935 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 182/364] 10.222.0.84 () {56 vars in 1186 bytes} [Wed May 25 14:42:41 2022] GET /identity/v3/projects/ac9e4da865b34de49eecd54e4f6f34e6 => generated 302 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:42:41.284618 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b417d93-8302-44ee-a413-69e8ea92f627 None None] REQUEST_METHOD: `POST` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:42:41.285438 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b417d93-8302-44ee-a413-69e8ea92f627 None None] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:42:41.285928 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b417d93-8302-44ee-a413-69e8ea92f627 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:42:41.306633 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.auth.core [None req-0b417d93-8302-44ee-a413-69e8ea92f627 None None] MFA Rules not processed for user `05d87e87798e429aa1c10b24391f915e`. Rule list: `[]` (Enabled: `True`). {{(pid=101892) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:42:41.308342 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.fernet_utils [None req-0b417d93-8302-44ee-a413-69e8ea92f627 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=101892) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:42:41.319228 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb9ff5ca-31e1-40d8-a69d-0629d541d7ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:42:41.319931 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9ff5ca-31e1-40d8-a69d-0629d541d7ad None admin] REQUEST_METHOD: `GET` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:42:41.320242 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9ff5ca-31e1-40d8-a69d-0629d541d7ad None admin] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:42:41.322484 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9ff5ca-31e1-40d8-a69d-0629d541d7ad None admin] PATH_INFO: `/v3/role_assignments` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:42:41.322484 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb9ff5ca-31e1-40d8-a69d-0629d541d7ad None admin] RBAC: Adding query filter params (role.id=d289ba5202044f90baf900bb40b116b8, user.id=a81dd1fc2f5649b282c0feee7f63fd2b, scope.system=all) {{(pid=101893) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:42:41.322683 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb9ff5ca-31e1-40d8-a69d-0629d541d7ad None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:42:41.325362 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb9ff5ca-31e1-40d8-a69d-0629d541d7ad None admin] RBAC: Authorization granted {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:42:41.343672 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 183/365] 10.222.0.84 () {56 vars in 1308 bytes} [Wed May 25 14:42:41 2022] GET /identity/v3/role_assignments?user.id=a81dd1fc2f5649b282c0feee7f63fd2b&scope.system=all&role.id=d289ba5202044f90baf900bb40b116b8 => generated 510 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:42:41.343672 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb9ff5ca-31e1-40d8-a69d-0629d541d7ad None admin] Authenticating user token {{(pid=101893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:42:41.345634 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG dbcounter [-] [101893] Writing DB stats keystone:SELECT=100 {{(pid=101893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:42:41.468735 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb9ff5ca-31e1-40d8-a69d-0629d541d7ad None admin] Validating token access rules against request {{(pid=101893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:42:41.477931 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 183/366] 10.222.0.84 () {58 vars in 1023 bytes} [Wed May 25 14:42:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 25 14:42:41.478832 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b417d93-8302-44ee-a413-69e8ea92f627 None None] Authenticating user token {{(pid=101892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:42:41.515191 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-164a5972-debe-4057-961a-dbf8762e04d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:42:41.516470 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-164a5972-debe-4057-961a-dbf8762e04d4 None admin] REQUEST_METHOD: `GET` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:42:41.517036 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-164a5972-debe-4057-961a-dbf8762e04d4 None admin] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:42:41.517515 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-164a5972-debe-4057-961a-dbf8762e04d4 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:42:41.536168 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-164a5972-debe-4057-961a-dbf8762e04d4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 14:42:41.545821 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application [None req-164a5972-debe-4057-961a-dbf8762e04d4 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 25 14:42:41.545821 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:42:41.545821 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 14:42:41.545821 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 14:42:41.545821 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 14:42:41.545821 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 14:42:41.545821 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 14:42:41.545821 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 14:42:41.545821 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 14:42:41.545821 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 14:42:41.545821 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 14:42:41.545821 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 14:42:41.545821 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 14:42:41.545821 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 14:42:41.545821 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 14:42:41.545821 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 14:42:41.546789 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 14:42:41.546789 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 14:42:41.546789 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 14:42:41.546789 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 14:42:41.546789 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 14:42:41.546789 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 14:42:41.546789 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 14:42:41.546789 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 14:42:41.546789 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 14:42:41.546789 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return self.get_or_create( May 25 14:42:41.546789 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 14:42:41.546789 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application with Lock( May 25 14:42:41.546789 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 14:42:41.546789 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return self._enter() May 25 14:42:41.546789 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 14:42:41.546789 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 14:42:41.547623 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 14:42:41.547623 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return self.creator() May 25 14:42:41.547623 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 14:42:41.547623 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application created_value = creator( May 25 14:42:41.547623 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 14:42:41.547623 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 14:42:41.547623 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 14:42:41.547623 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 14:42:41.547623 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 14:42:41.547623 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 14:42:41.547623 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 25 14:42:41.547623 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application May 25 14:42:41.550921 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 184/367] 10.222.0.84 () {56 vars in 1114 bytes} [Wed May 25 14:42:41 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 14:42:41.552073 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-164a5972-debe-4057-961a-dbf8762e04d4 None admin] Authenticating user token {{(pid=101893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:42:41.625914 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG dbcounter [-] [101892] Writing DB stats keystone:SELECT=100 {{(pid=101892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:42:41.653974 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG dbcounter [-] [101893] Writing DB stats keystone:SELECT=100 {{(pid=101893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:42:41.680747 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-164a5972-debe-4057-961a-dbf8762e04d4 None admin] Validating token access rules against request {{(pid=101893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:42:41.743335 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-094fcc39-ea0f-4542-a2d7-be9038658e65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:42:41.744156 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094fcc39-ea0f-4542-a2d7-be9038658e65 None admin] REQUEST_METHOD: `GET` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:42:41.744444 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094fcc39-ea0f-4542-a2d7-be9038658e65 None admin] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:42:41.744720 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094fcc39-ea0f-4542-a2d7-be9038658e65 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:42:41.750596 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b417d93-8302-44ee-a413-69e8ea92f627 None None] Validating token access rules against request {{(pid=101892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:42:41.762418 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-094fcc39-ea0f-4542-a2d7-be9038658e65 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 14:42:41.770440 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application [None req-094fcc39-ea0f-4542-a2d7-be9038658e65 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 25 14:42:41.770440 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:42:41.770440 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 14:42:41.770440 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 14:42:41.770440 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 14:42:41.770440 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 14:42:41.770440 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 14:42:41.770440 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 14:42:41.770440 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 14:42:41.770440 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 14:42:41.770440 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 14:42:41.770440 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 14:42:41.770440 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 14:42:41.770440 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 14:42:41.770440 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 14:42:41.770440 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 14:42:41.771375 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 14:42:41.771375 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 14:42:41.771375 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 14:42:41.771375 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 14:42:41.771375 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 14:42:41.771375 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 14:42:41.771375 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 14:42:41.771375 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 14:42:41.771375 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 14:42:41.771375 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return self.get_or_create( May 25 14:42:41.771375 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 14:42:41.771375 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application with Lock( May 25 14:42:41.771375 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 14:42:41.771375 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return self._enter() May 25 14:42:41.771375 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 14:42:41.771375 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 14:42:41.772296 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 14:42:41.772296 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return self.creator() May 25 14:42:41.772296 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 14:42:41.772296 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application created_value = creator( May 25 14:42:41.772296 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 14:42:41.772296 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 14:42:41.772296 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 14:42:41.772296 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 14:42:41.772296 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 14:42:41.772296 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 14:42:41.772296 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 25 14:42:41.772296 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application May 25 14:42:41.772296 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 185/368] 10.222.0.84 () {56 vars in 1096 bytes} [Wed May 25 14:42:41 2022] GET /identity/v3/roles/admin => generated 83 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 14:42:41.772971 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-094fcc39-ea0f-4542-a2d7-be9038658e65 None admin] Authenticating user token {{(pid=101893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:42:41.796654 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bed7ddc9-2f9e-45bf-8445-e354d6907a41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:42:41.797508 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed7ddc9-2f9e-45bf-8445-e354d6907a41 None admin] REQUEST_METHOD: `GET` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:42:41.797788 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed7ddc9-2f9e-45bf-8445-e354d6907a41 None admin] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:42:41.798070 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed7ddc9-2f9e-45bf-8445-e354d6907a41 None admin] PATH_INFO: `/v3/groups/ea8743b893f94df9bc571308c507b491` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:42:41.799235 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bed7ddc9-2f9e-45bf-8445-e354d6907a41 None admin] RBAC: Authorizing `identity:get_group(group_id=ea8743b893f94df9bc571308c507b491)` {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:42:41.802639 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bed7ddc9-2f9e-45bf-8445-e354d6907a41 None admin] RBAC: Authorization granted {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:42:41.804530 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 184/369] 10.222.0.84 () {56 vars in 1180 bytes} [Wed May 25 14:42:41 2022] GET /identity/v3/groups/ea8743b893f94df9bc571308c507b491 => generated 226 bytes in 326 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:42:41.805663 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bed7ddc9-2f9e-45bf-8445-e354d6907a41 None admin] Authenticating user token {{(pid=101892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:42:41.925457 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-094fcc39-ea0f-4542-a2d7-be9038658e65 None admin] Validating token access rules against request {{(pid=101893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:42:41.941935 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bed7ddc9-2f9e-45bf-8445-e354d6907a41 None admin] Validating token access rules against request {{(pid=101892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:42:41.944869 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG dbcounter [-] [101892] Writing DB stats keystone:SELECT=100 {{(pid=101892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:42:41.951646 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG dbcounter [-] [101893] Writing DB stats keystone:SELECT=100 {{(pid=101893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:42:41.964955 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-decca9dd-2a28-407a-bc95-43f61b77e948 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:42:41.965861 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-decca9dd-2a28-407a-bc95-43f61b77e948 None admin] REQUEST_METHOD: `GET` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:42:41.966436 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-decca9dd-2a28-407a-bc95-43f61b77e948 None admin] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:42:41.966769 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-decca9dd-2a28-407a-bc95-43f61b77e948 None admin] PATH_INFO: `/v3/roles` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:42:41.967534 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-decca9dd-2a28-407a-bc95-43f61b77e948 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=101893) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:42:41.967893 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-decca9dd-2a28-407a-bc95-43f61b77e948 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:42:41.970060 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-decca9dd-2a28-407a-bc95-43f61b77e948 None admin] RBAC: Authorization granted {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:42:41.983781 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 186/370] 10.222.0.84 () {56 vars in 1111 bytes} [Wed May 25 14:42:41 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:42:41.988252 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ebfa07-9ddc-4172-bc79-2ee34b7bed50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:42:41.988934 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ebfa07-9ddc-4172-bc79-2ee34b7bed50 None admin] REQUEST_METHOD: `GET` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:42:41.990565 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ebfa07-9ddc-4172-bc79-2ee34b7bed50 None admin] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:42:41.990565 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ebfa07-9ddc-4172-bc79-2ee34b7bed50 None admin] PATH_INFO: `/v3/roles` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:42:41.990565 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8ebfa07-9ddc-4172-bc79-2ee34b7bed50 None admin] RBAC: Adding query filter params (name=admin) {{(pid=101892) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:42:41.990565 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8ebfa07-9ddc-4172-bc79-2ee34b7bed50 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:42:41.992164 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8ebfa07-9ddc-4172-bc79-2ee34b7bed50 None admin] RBAC: Authorization granted {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:42:41.992991 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-decca9dd-2a28-407a-bc95-43f61b77e948 None admin] Authenticating user token {{(pid=101893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:42:42.003701 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 185/371] 10.222.0.84 () {56 vars in 1099 bytes} [Wed May 25 14:42:41 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:42:42.004891 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ebfa07-9ddc-4172-bc79-2ee34b7bed50 None admin] Authenticating user token {{(pid=101892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:42:42.110530 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-decca9dd-2a28-407a-bc95-43f61b77e948 None admin] Validating token access rules against request {{(pid=101893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:42:42.114867 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ebfa07-9ddc-4172-bc79-2ee34b7bed50 None admin] Validating token access rules against request {{(pid=101892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:42:42.147173 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f317c8b-6ff7-44a6-ab51-c230ef90bcf2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:42:42.147774 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f317c8b-6ff7-44a6-ab51-c230ef90bcf2 None admin] REQUEST_METHOD: `GET` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:42:42.148055 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f317c8b-6ff7-44a6-ab51-c230ef90bcf2 None admin] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:42:42.148328 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f317c8b-6ff7-44a6-ab51-c230ef90bcf2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:42:42.149192 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f317c8b-6ff7-44a6-ab51-c230ef90bcf2 None admin] RBAC: Adding query filter params (group.id=ea8743b893f94df9bc571308c507b491, role.id=ff664fa0db7e4262a5accde96c3df4c3, scope.project.id=ac9e4da865b34de49eecd54e4f6f34e6) {{(pid=101893) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:42:42.149505 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f317c8b-6ff7-44a6-ab51-c230ef90bcf2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:42:42.151026 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f317c8b-6ff7-44a6-ab51-c230ef90bcf2 None admin] RBAC: Authorization granted {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:42:42.152752 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb593bf-adf3-43fd-bad9-83d534db30c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:42:42.153635 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb593bf-adf3-43fd-bad9-83d534db30c2 None admin] REQUEST_METHOD: `GET` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:42:42.154114 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb593bf-adf3-43fd-bad9-83d534db30c2 None admin] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:42:42.154680 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb593bf-adf3-43fd-bad9-83d534db30c2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:42:42.156937 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 187/372] 10.222.0.84 () {56 vars in 1376 bytes} [Wed May 25 14:42:41 2022] GET /identity/v3/role_assignments?group.id=ea8743b893f94df9bc571308c507b491&scope.project.id=ac9e4da865b34de49eecd54e4f6f34e6&role.id=ff664fa0db7e4262a5accde96c3df4c3 => generated 260 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:42:42.157800 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f317c8b-6ff7-44a6-ab51-c230ef90bcf2 None admin] Authenticating user token {{(pid=101893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:42:42.201063 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG dbcounter [-] [101892] Writing DB stats keystone:SELECT=100 {{(pid=101892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:42:42.212109 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG dbcounter [-] [101893] Writing DB stats keystone:SELECT=100 {{(pid=101893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:42:42.245622 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cb593bf-adf3-43fd-bad9-83d534db30c2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:42:42.247460 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cb593bf-adf3-43fd-bad9-83d534db30c2 None admin] RBAC: Authorization granted {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:42:42.270190 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f317c8b-6ff7-44a6-ab51-c230ef90bcf2 None admin] Validating token access rules against request {{(pid=101893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:42:42.310870 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce86644b-1d6d-451c-88e9-0ec941a1f4cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:42:42.311549 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce86644b-1d6d-451c-88e9-0ec941a1f4cc None admin] REQUEST_METHOD: `GET` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:42:42.311813 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce86644b-1d6d-451c-88e9-0ec941a1f4cc None admin] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:42:42.312095 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce86644b-1d6d-451c-88e9-0ec941a1f4cc None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:42:42.362820 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 186/373] 10.222.0.84 () {58 vars in 1282 bytes} [Wed May 25 14:42:42 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 358 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 25 14:42:42.369641 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb593bf-adf3-43fd-bad9-83d534db30c2 None admin] Authenticating user token {{(pid=101892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:42:42.387930 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce86644b-1d6d-451c-88e9-0ec941a1f4cc None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:42:42.389399 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce86644b-1d6d-451c-88e9-0ec941a1f4cc None admin] RBAC: Authorization granted {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:42:42.441645 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG dbcounter [-] [101893] Writing DB stats keystone:SELECT=100 {{(pid=101893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:42:42.443036 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG dbcounter [-] [101892] Writing DB stats keystone:SELECT=100 {{(pid=101892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:42:42.480016 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb593bf-adf3-43fd-bad9-83d534db30c2 None admin] Validating token access rules against request {{(pid=101892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:42:42.500568 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 188/374] 10.222.0.84 () {58 vars in 1282 bytes} [Wed May 25 14:42:42 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 343 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 25 14:42:42.506315 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce86644b-1d6d-451c-88e9-0ec941a1f4cc None admin] Authenticating user token {{(pid=101893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:42:42.518707 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c50e2287-bd5a-46fe-949a-1fcd3579213c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:42:42.520135 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50e2287-bd5a-46fe-949a-1fcd3579213c None admin] REQUEST_METHOD: `GET` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:42:42.520691 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50e2287-bd5a-46fe-949a-1fcd3579213c None admin] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:42:42.521161 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50e2287-bd5a-46fe-949a-1fcd3579213c None admin] PATH_INFO: `/v3/projects/ac9e4da865b34de49eecd54e4f6f34e6` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:42:42.523106 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c50e2287-bd5a-46fe-949a-1fcd3579213c None admin] RBAC: Authorizing `identity:get_project(project_id=ac9e4da865b34de49eecd54e4f6f34e6)` {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:42:42.525049 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c50e2287-bd5a-46fe-949a-1fcd3579213c None admin] RBAC: Authorization granted {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:42:42.527924 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 187/375] 10.222.0.84 () {56 vars in 1186 bytes} [Wed May 25 14:42:42 2022] GET /identity/v3/projects/ac9e4da865b34de49eecd54e4f6f34e6 => generated 302 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:42:42.534040 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c50e2287-bd5a-46fe-949a-1fcd3579213c None admin] Authenticating user token {{(pid=101892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:42:42.627673 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce86644b-1d6d-451c-88e9-0ec941a1f4cc None admin] Validating token access rules against request {{(pid=101893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:42:42.662541 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c50e2287-bd5a-46fe-949a-1fcd3579213c None admin] Validating token access rules against request {{(pid=101892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:42:42.666325 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c1d1972-cb95-4408-a8f7-18759ee99f2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:42:42.667471 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1d1972-cb95-4408-a8f7-18759ee99f2d None admin] REQUEST_METHOD: `GET` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:42:42.667969 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1d1972-cb95-4408-a8f7-18759ee99f2d None admin] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:42:42.668434 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1d1972-cb95-4408-a8f7-18759ee99f2d None admin] PATH_INFO: `/v3/projects/cec56f74b2fa4826a506dc7b919465be` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:42:42.669820 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c1d1972-cb95-4408-a8f7-18759ee99f2d None admin] RBAC: Authorizing `identity:get_project(project_id=cec56f74b2fa4826a506dc7b919465be)` {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:42:42.671525 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c1d1972-cb95-4408-a8f7-18759ee99f2d None admin] RBAC: Authorization granted {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:42:42.673798 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 189/376] 10.222.0.84 () {56 vars in 1186 bytes} [Wed May 25 14:42:42 2022] GET /identity/v3/projects/cec56f74b2fa4826a506dc7b919465be => generated 344 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 14:42:42.679388 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c1d1972-cb95-4408-a8f7-18759ee99f2d None admin] Authenticating user token {{(pid=101893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:42:42.699377 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18c1670f-480a-49d5-9b29-9c0c6f82f691 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:42:42.700012 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG dbcounter [-] [101893] Writing DB stats keystone:SELECT=100 {{(pid=101893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:42:42.700697 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c1670f-480a-49d5-9b29-9c0c6f82f691 None admin] REQUEST_METHOD: `GET` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:42:42.701167 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c1670f-480a-49d5-9b29-9c0c6f82f691 None admin] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:42:42.701618 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c1670f-480a-49d5-9b29-9c0c6f82f691 None admin] PATH_INFO: `/v3/groups/ea8743b893f94df9bc571308c507b491` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:42:42.703134 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18c1670f-480a-49d5-9b29-9c0c6f82f691 None admin] RBAC: Authorizing `identity:get_group(group_id=ea8743b893f94df9bc571308c507b491)` {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:42:42.704797 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18c1670f-480a-49d5-9b29-9c0c6f82f691 None admin] RBAC: Authorization granted {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:42:42.706990 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 188/377] 10.222.0.84 () {56 vars in 1180 bytes} [Wed May 25 14:42:42 2022] GET /identity/v3/groups/ea8743b893f94df9bc571308c507b491 => generated 226 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 14:42:42.713470 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18c1670f-480a-49d5-9b29-9c0c6f82f691 None admin] Authenticating user token {{(pid=101892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:42:42.716640 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG dbcounter [-] [101892] Writing DB stats keystone:SELECT=100 {{(pid=101892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:42:42.788313 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c1d1972-cb95-4408-a8f7-18759ee99f2d None admin] Validating token access rules against request {{(pid=101893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:42:42.821287 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18c1670f-480a-49d5-9b29-9c0c6f82f691 None admin] Validating token access rules against request {{(pid=101892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:42:42.827370 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b2fb757-aff9-47ff-a5e2-e540708a8e05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:42:42.828606 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2fb757-aff9-47ff-a5e2-e540708a8e05 None admin] REQUEST_METHOD: `GET` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:42:42.829131 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2fb757-aff9-47ff-a5e2-e540708a8e05 None admin] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:42:42.829714 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2fb757-aff9-47ff-a5e2-e540708a8e05 None admin] PATH_INFO: `/v3/groups/4cb4d13fb87e42f383c3be884bf229aa` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:42:42.837116 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b2fb757-aff9-47ff-a5e2-e540708a8e05 None admin] RBAC: Authorizing `identity:get_group(group_id=4cb4d13fb87e42f383c3be884bf229aa)` {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:42:42.838947 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b2fb757-aff9-47ff-a5e2-e540708a8e05 None admin] RBAC: Authorization granted {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:42:42.841361 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 190/378] 10.222.0.84 () {56 vars in 1180 bytes} [Wed May 25 14:42:42 2022] GET /identity/v3/groups/4cb4d13fb87e42f383c3be884bf229aa => generated 229 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 14:42:42.842788 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854afc56-8d72-417a-b1aa-1bf4fe4e1b0f None None] REQUEST_METHOD: `GET` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:42:42.843359 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854afc56-8d72-417a-b1aa-1bf4fe4e1b0f None None] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:42:42.848123 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854afc56-8d72-417a-b1aa-1bf4fe4e1b0f None None] PATH_INFO: `/` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:42:42.849828 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 191/379] 10.222.0.84 () {54 vars in 926 bytes} [Wed May 25 14:42:42 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 14:42:42.851701 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-854afc56-8d72-417a-b1aa-1bf4fe4e1b0f None None] Authenticating user token {{(pid=101893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:42:42.858686 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6577dd39-b597-4384-a504-135c75aa6a1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:42:42.859356 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6577dd39-b597-4384-a504-135c75aa6a1c None admin] REQUEST_METHOD: `GET` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:42:42.859670 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6577dd39-b597-4384-a504-135c75aa6a1c None admin] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:42:42.859953 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6577dd39-b597-4384-a504-135c75aa6a1c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:42:42.860795 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6577dd39-b597-4384-a504-135c75aa6a1c None admin] RBAC: Adding query filter params (group.id=ea8743b893f94df9bc571308c507b491, role.id=d3defd94f93b4e76af116df691240185, scope.project.id=ac9e4da865b34de49eecd54e4f6f34e6) {{(pid=101892) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:42:42.861113 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6577dd39-b597-4384-a504-135c75aa6a1c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:42:42.862539 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6577dd39-b597-4384-a504-135c75aa6a1c None admin] RBAC: Authorization granted {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:42:42.868374 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 189/380] 10.222.0.84 () {56 vars in 1376 bytes} [Wed May 25 14:42:42 2022] GET /identity/v3/role_assignments?group.id=ea8743b893f94df9bc571308c507b491&scope.project.id=ac9e4da865b34de49eecd54e4f6f34e6&role.id=d3defd94f93b4e76af116df691240185 => generated 260 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 14:42:42.876628 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12184b2-39a8-4387-b180-e2c27ed58fca None None] REQUEST_METHOD: `POST` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:42:42.876949 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12184b2-39a8-4387-b180-e2c27ed58fca None None] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:42:42.877200 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12184b2-39a8-4387-b180-e2c27ed58fca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:42:42.917528 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.auth.core [None req-a12184b2-39a8-4387-b180-e2c27ed58fca None None] MFA Rules not processed for user `05d87e87798e429aa1c10b24391f915e`. Rule list: `[]` (Enabled: `True`). {{(pid=101892) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:42:42.917993 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.fernet_utils [None req-a12184b2-39a8-4387-b180-e2c27ed58fca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=101892) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:42:42.973336 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-854afc56-8d72-417a-b1aa-1bf4fe4e1b0f None None] Validating token access rules against request {{(pid=101893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:42:42.976998 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG dbcounter [-] [101893] Writing DB stats keystone:SELECT=100 {{(pid=101893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:42:43.044408 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG dbcounter [-] [101892] Writing DB stats keystone:SELECT=100 {{(pid=101892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:42:43.046572 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-706703b6-5aad-4660-ac13-3c6c7a065ec0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:42:43.047467 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706703b6-5aad-4660-ac13-3c6c7a065ec0 None admin] REQUEST_METHOD: `GET` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:42:43.047775 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706703b6-5aad-4660-ac13-3c6c7a065ec0 None admin] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:42:43.048052 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706703b6-5aad-4660-ac13-3c6c7a065ec0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:42:43.049175 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-706703b6-5aad-4660-ac13-3c6c7a065ec0 None admin] RBAC: Adding query filter params (group.id=4cb4d13fb87e42f383c3be884bf229aa, role.id=a3b78e7d547d4d2d998b4c99a4396bba, scope.project.id=cec56f74b2fa4826a506dc7b919465be) {{(pid=101893) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:42:43.049488 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-706703b6-5aad-4660-ac13-3c6c7a065ec0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:42:43.050991 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-706703b6-5aad-4660-ac13-3c6c7a065ec0 None admin] RBAC: Authorization granted {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:42:43.062662 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 190/381] 10.222.0.84 () {58 vars in 1023 bytes} [Wed May 25 14:42:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 25 14:42:43.065067 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 192/382] 10.222.0.84 () {56 vars in 1376 bytes} [Wed May 25 14:42:42 2022] GET /identity/v3/role_assignments?group.id=4cb4d13fb87e42f383c3be884bf229aa&scope.project.id=cec56f74b2fa4826a506dc7b919465be&role.id=a3b78e7d547d4d2d998b4c99a4396bba => generated 260 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 14:42:43.101476 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a12184b2-39a8-4387-b180-e2c27ed58fca None None] Authenticating user token {{(pid=101892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:42:43.228010 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a12184b2-39a8-4387-b180-e2c27ed58fca None None] Validating token access rules against request {{(pid=101892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:42:43.272668 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce741a8f-6d85-4167-ad07-3b0a58ddc689 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:42:43.274413 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce741a8f-6d85-4167-ad07-3b0a58ddc689 None admin] REQUEST_METHOD: `GET` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:42:43.274891 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce741a8f-6d85-4167-ad07-3b0a58ddc689 None admin] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:42:43.275355 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce741a8f-6d85-4167-ad07-3b0a58ddc689 None admin] PATH_INFO: `/v3/roles/member` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:42:43.290352 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce741a8f-6d85-4167-ad07-3b0a58ddc689 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 14:42:43.298587 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application [None req-ce741a8f-6d85-4167-ad07-3b0a58ddc689 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 25 14:42:43.298587 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:42:43.298587 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 14:42:43.298587 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 14:42:43.298587 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 14:42:43.298587 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 14:42:43.298587 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 14:42:43.298587 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 14:42:43.298587 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 14:42:43.298587 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 14:42:43.298587 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 14:42:43.298587 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 14:42:43.298587 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 14:42:43.298587 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 14:42:43.298587 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 14:42:43.298587 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 14:42:43.299465 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 14:42:43.299465 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 14:42:43.299465 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 14:42:43.299465 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 14:42:43.299465 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 14:42:43.299465 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 14:42:43.299465 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 14:42:43.299465 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 14:42:43.299465 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 14:42:43.299465 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application return self.get_or_create( May 25 14:42:43.299465 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 14:42:43.299465 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application with Lock( May 25 14:42:43.299465 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 14:42:43.299465 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application return self._enter() May 25 14:42:43.299465 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 14:42:43.299465 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 14:42:43.300436 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 14:42:43.300436 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application return self.creator() May 25 14:42:43.300436 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 14:42:43.300436 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application created_value = creator( May 25 14:42:43.300436 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 14:42:43.300436 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 14:42:43.300436 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 14:42:43.300436 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 14:42:43.300436 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 14:42:43.300436 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 14:42:43.300436 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 25 14:42:43.300436 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application May 25 14:42:43.307679 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 191/383] 10.222.0.84 () {56 vars in 1099 bytes} [Wed May 25 14:42:43 2022] GET /identity/v3/roles/member => generated 84 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 14:42:43.309626 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-706703b6-5aad-4660-ac13-3c6c7a065ec0 None admin] Authenticating user token {{(pid=101893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:42:43.436434 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-706703b6-5aad-4660-ac13-3c6c7a065ec0 None admin] Validating token access rules against request {{(pid=101893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:42:43.479983 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16295869-907e-41d6-a9ab-295255ddc379 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:42:43.480891 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16295869-907e-41d6-a9ab-295255ddc379 None admin] REQUEST_METHOD: `GET` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:42:43.481313 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16295869-907e-41d6-a9ab-295255ddc379 None admin] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:42:43.481837 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16295869-907e-41d6-a9ab-295255ddc379 None admin] PATH_INFO: `/v3/roles` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:42:43.482722 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16295869-907e-41d6-a9ab-295255ddc379 None admin] RBAC: Adding query filter params (name=member) {{(pid=101893) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:42:43.483204 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16295869-907e-41d6-a9ab-295255ddc379 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:42:43.485546 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16295869-907e-41d6-a9ab-295255ddc379 None admin] RBAC: Authorization granted {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:42:43.499728 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 193/384] 10.222.0.84 () {56 vars in 1101 bytes} [Wed May 25 14:42:43 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:42:43.501681 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce741a8f-6d85-4167-ad07-3b0a58ddc689 None admin] Authenticating user token {{(pid=101892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:42:43.578709 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG dbcounter [-] [101892] Writing DB stats keystone:SELECT=100 {{(pid=101892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:42:43.638070 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce741a8f-6d85-4167-ad07-3b0a58ddc689 None admin] Validating token access rules against request {{(pid=101892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:42:43.688101 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b83dff6-373a-470b-abd7-3cccec1b7be3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:42:43.688961 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b83dff6-373a-470b-abd7-3cccec1b7be3 None admin] REQUEST_METHOD: `GET` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:42:43.689243 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b83dff6-373a-470b-abd7-3cccec1b7be3 None admin] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:42:43.689518 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b83dff6-373a-470b-abd7-3cccec1b7be3 None admin] PATH_INFO: `/v3/groups/ea8743b893f94df9bc571308c507b491` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:42:43.693719 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b83dff6-373a-470b-abd7-3cccec1b7be3 None admin] RBAC: Authorizing `identity:get_group(group_id=ea8743b893f94df9bc571308c507b491)` {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:42:43.695167 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b83dff6-373a-470b-abd7-3cccec1b7be3 None admin] RBAC: Authorization granted {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:42:43.697723 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 192/385] 10.222.0.84 () {56 vars in 1180 bytes} [Wed May 25 14:42:43 2022] GET /identity/v3/groups/ea8743b893f94df9bc571308c507b491 => generated 226 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:42:43.703341 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16295869-907e-41d6-a9ab-295255ddc379 None admin] Authenticating user token {{(pid=101893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:42:43.713005 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG dbcounter [-] [101893] Writing DB stats keystone:SELECT=100 {{(pid=101893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:42:43.834591 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16295869-907e-41d6-a9ab-295255ddc379 None admin] Validating token access rules against request {{(pid=101893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:42:43.874910 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d52c593a-d0ce-4d6e-bb9d-773d3a5e6199 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:42:43.875824 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52c593a-d0ce-4d6e-bb9d-773d3a5e6199 None admin] REQUEST_METHOD: `GET` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:42:43.876106 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52c593a-d0ce-4d6e-bb9d-773d3a5e6199 None admin] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:42:43.876381 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52c593a-d0ce-4d6e-bb9d-773d3a5e6199 None admin] PATH_INFO: `/v3/projects/42293c5d76254690ab29c96f76687d9c` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:42:43.877579 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d52c593a-d0ce-4d6e-bb9d-773d3a5e6199 None admin] RBAC: Authorizing `identity:get_project(project_id=42293c5d76254690ab29c96f76687d9c)` {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:42:43.879026 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d52c593a-d0ce-4d6e-bb9d-773d3a5e6199 None admin] RBAC: Authorization granted {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:42:43.882120 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 194/386] 10.222.0.84 () {56 vars in 1186 bytes} [Wed May 25 14:42:43 2022] GET /identity/v3/projects/42293c5d76254690ab29c96f76687d9c => generated 298 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:42:43.886747 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b83dff6-373a-470b-abd7-3cccec1b7be3 None admin] Authenticating user token {{(pid=101892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:42:43.959455 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b08acf8-3e1a-4b8b-b137-2a8d1c83fd5a None None] REQUEST_METHOD: `GET` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:42:43.959943 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b08acf8-3e1a-4b8b-b137-2a8d1c83fd5a None None] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:42:43.960063 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b08acf8-3e1a-4b8b-b137-2a8d1c83fd5a None None] PATH_INFO: `/` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:42:43.961695 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 195/387] 10.222.0.84 () {54 vars in 926 bytes} [Wed May 25 14:42:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 14:42:43.977955 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7143c04-1931-48f3-95a6-d9ff4631cf3d None None] REQUEST_METHOD: `POST` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:42:43.978274 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7143c04-1931-48f3-95a6-d9ff4631cf3d None None] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:42:43.978507 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7143c04-1931-48f3-95a6-d9ff4631cf3d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:42:44.008070 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.auth.core [None req-a7143c04-1931-48f3-95a6-d9ff4631cf3d None None] MFA Rules not processed for user `05d87e87798e429aa1c10b24391f915e`. Rule list: `[]` (Enabled: `True`). {{(pid=101893) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:42:44.009275 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.fernet_utils [None req-a7143c04-1931-48f3-95a6-d9ff4631cf3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=101893) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:42:44.040068 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b83dff6-373a-470b-abd7-3cccec1b7be3 None admin] Validating token access rules against request {{(pid=101892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:42:44.093228 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG dbcounter [-] [101892] Writing DB stats keystone:SELECT=100 {{(pid=101892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:42:44.111013 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60f18a94-a157-4192-a840-176e1f99e272 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:42:44.111928 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f18a94-a157-4192-a840-176e1f99e272 None admin] REQUEST_METHOD: `PUT` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:42:44.112210 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f18a94-a157-4192-a840-176e1f99e272 None admin] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:42:44.112484 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f18a94-a157-4192-a840-176e1f99e272 None admin] PATH_INFO: `/v3/projects/42293c5d76254690ab29c96f76687d9c/groups/ea8743b893f94df9bc571308c507b491/roles/ff664fa0db7e4262a5accde96c3df4c3` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:42:44.115448 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60f18a94-a157-4192-a840-176e1f99e272 None admin] RBAC: Authorizing `identity:create_grant(project_id=42293c5d76254690ab29c96f76687d9c, group_id=ea8743b893f94df9bc571308c507b491, role_id=ff664fa0db7e4262a5accde96c3df4c3)` {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:42:44.117070 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60f18a94-a157-4192-a840-176e1f99e272 None admin] RBAC: Authorization granted {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:42:44.142566 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 196/388] 10.222.0.84 () {58 vars in 1023 bytes} [Wed May 25 14:42:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 25 14:42:44.167277 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7143c04-1931-48f3-95a6-d9ff4631cf3d None None] Authenticating user token {{(pid=101893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:42:44.170533 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG dbcounter [-] [101893] Writing DB stats keystone:SELECT=100 {{(pid=101893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:42:44.213938 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 193/389] 10.222.0.84 () {58 vars in 1442 bytes} [Wed May 25 14:42:43 2022] PUT /identity/v3/projects/42293c5d76254690ab29c96f76687d9c/groups/ea8743b893f94df9bc571308c507b491/roles/ff664fa0db7e4262a5accde96c3df4c3 => generated 0 bytes in 328 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 25 14:42:44.298597 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7143c04-1931-48f3-95a6-d9ff4631cf3d None None] Validating token access rules against request {{(pid=101893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:42:44.343843 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c5ad3d-80c9-4906-9642-05b57f812589 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:42:44.344583 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c5ad3d-80c9-4906-9642-05b57f812589 None admin] REQUEST_METHOD: `GET` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:42:44.344871 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c5ad3d-80c9-4906-9642-05b57f812589 None admin] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:42:44.345296 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c5ad3d-80c9-4906-9642-05b57f812589 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:42:44.359985 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35c5ad3d-80c9-4906-9642-05b57f812589 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 14:42:44.368964 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application [None req-35c5ad3d-80c9-4906-9642-05b57f812589 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 25 14:42:44.368964 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:42:44.368964 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 14:42:44.368964 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 14:42:44.368964 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 14:42:44.368964 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 14:42:44.368964 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 14:42:44.368964 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 14:42:44.368964 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 14:42:44.368964 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 14:42:44.368964 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 14:42:44.368964 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 14:42:44.368964 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 14:42:44.368964 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 14:42:44.368964 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 14:42:44.368964 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 14:42:44.370012 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 14:42:44.370012 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 14:42:44.370012 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 14:42:44.370012 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 14:42:44.370012 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 14:42:44.370012 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 14:42:44.370012 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 14:42:44.370012 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 14:42:44.370012 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 14:42:44.370012 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return self.get_or_create( May 25 14:42:44.370012 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 14:42:44.370012 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application with Lock( May 25 14:42:44.370012 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 14:42:44.370012 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return self._enter() May 25 14:42:44.370012 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 14:42:44.370012 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 14:42:44.370830 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 14:42:44.370830 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return self.creator() May 25 14:42:44.370830 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 14:42:44.370830 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application created_value = creator( May 25 14:42:44.370830 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 14:42:44.370830 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 14:42:44.370830 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 14:42:44.370830 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 14:42:44.370830 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 14:42:44.370830 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 14:42:44.370830 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 25 14:42:44.370830 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application May 25 14:42:44.370830 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 197/390] 10.222.0.84 () {56 vars in 1114 bytes} [Wed May 25 14:42:44 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 14:42:44.376600 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60f18a94-a157-4192-a840-176e1f99e272 None admin] Authenticating user token {{(pid=101892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:42:44.489212 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60f18a94-a157-4192-a840-176e1f99e272 None admin] Validating token access rules against request {{(pid=101892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:42:44.526018 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce86c413-0d4c-4ee5-b97e-19de7dd1f179 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:42:44.526772 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce86c413-0d4c-4ee5-b97e-19de7dd1f179 None admin] REQUEST_METHOD: `GET` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:42:44.526965 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce86c413-0d4c-4ee5-b97e-19de7dd1f179 None admin] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:42:44.527242 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce86c413-0d4c-4ee5-b97e-19de7dd1f179 None admin] PATH_INFO: `/v3/roles` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:42:44.528024 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce86c413-0d4c-4ee5-b97e-19de7dd1f179 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=101892) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:42:44.528335 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce86c413-0d4c-4ee5-b97e-19de7dd1f179 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:42:44.529706 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce86c413-0d4c-4ee5-b97e-19de7dd1f179 None admin] RBAC: Authorization granted {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:42:44.538603 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 194/391] 10.222.0.84 () {56 vars in 1111 bytes} [Wed May 25 14:42:44 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:42:44.544502 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c5ad3d-80c9-4906-9642-05b57f812589 None admin] Authenticating user token {{(pid=101893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:42:44.624923 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG dbcounter [-] [101893] Writing DB stats keystone:SELECT=100 {{(pid=101893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:42:44.669098 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c5ad3d-80c9-4906-9642-05b57f812589 None admin] Validating token access rules against request {{(pid=101893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:42:44.709985 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f055ebd-71a6-4003-8a41-c9997a46bfc8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:42:44.710851 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f055ebd-71a6-4003-8a41-c9997a46bfc8 None admin] REQUEST_METHOD: `GET` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:42:44.711768 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f055ebd-71a6-4003-8a41-c9997a46bfc8 None admin] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:42:44.712174 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f055ebd-71a6-4003-8a41-c9997a46bfc8 None admin] PATH_INFO: `/v3/groups/ea8743b893f94df9bc571308c507b491` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:42:44.716275 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f055ebd-71a6-4003-8a41-c9997a46bfc8 None admin] RBAC: Authorizing `identity:get_group(group_id=ea8743b893f94df9bc571308c507b491)` {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:42:44.717813 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f055ebd-71a6-4003-8a41-c9997a46bfc8 None admin] RBAC: Authorization granted {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:42:44.719818 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 198/392] 10.222.0.84 () {56 vars in 1180 bytes} [Wed May 25 14:42:44 2022] GET /identity/v3/groups/ea8743b893f94df9bc571308c507b491 => generated 226 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 14:42:44.725248 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce86c413-0d4c-4ee5-b97e-19de7dd1f179 None admin] Authenticating user token {{(pid=101892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:42:44.801703 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG dbcounter [-] [101892] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=101892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:42:44.870068 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce86c413-0d4c-4ee5-b97e-19de7dd1f179 None admin] Validating token access rules against request {{(pid=101892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:42:44.911490 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-714a1bdd-b550-4518-b2e3-c1ace92d9e9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:42:44.912326 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714a1bdd-b550-4518-b2e3-c1ace92d9e9f None admin] REQUEST_METHOD: `GET` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:42:44.912606 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714a1bdd-b550-4518-b2e3-c1ace92d9e9f None admin] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:42:44.912883 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714a1bdd-b550-4518-b2e3-c1ace92d9e9f None admin] PATH_INFO: `/v3/projects/42293c5d76254690ab29c96f76687d9c` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:42:44.914078 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-714a1bdd-b550-4518-b2e3-c1ace92d9e9f None admin] RBAC: Authorizing `identity:get_project(project_id=42293c5d76254690ab29c96f76687d9c)` {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:42:44.915591 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-714a1bdd-b550-4518-b2e3-c1ace92d9e9f None admin] RBAC: Authorization granted {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:42:44.917748 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 195/393] 10.222.0.84 () {56 vars in 1186 bytes} [Wed May 25 14:42:44 2022] GET /identity/v3/projects/42293c5d76254690ab29c96f76687d9c => generated 298 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:42:44.922945 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f055ebd-71a6-4003-8a41-c9997a46bfc8 None admin] Authenticating user token {{(pid=101893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:42:45.080646 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f055ebd-71a6-4003-8a41-c9997a46bfc8 None admin] Validating token access rules against request {{(pid=101893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:42:45.122343 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG dbcounter [-] [101893] Writing DB stats keystone:SELECT=100 {{(pid=101893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:42:45.127689 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca86f055-f648-40c8-b1d8-6bd28df49463 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:42:45.128895 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca86f055-f648-40c8-b1d8-6bd28df49463 None admin] REQUEST_METHOD: `PUT` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:42:45.129191 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca86f055-f648-40c8-b1d8-6bd28df49463 None admin] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:42:45.129475 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca86f055-f648-40c8-b1d8-6bd28df49463 None admin] PATH_INFO: `/v3/projects/42293c5d76254690ab29c96f76687d9c/groups/ea8743b893f94df9bc571308c507b491/roles/d3defd94f93b4e76af116df691240185` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:42:45.137505 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca86f055-f648-40c8-b1d8-6bd28df49463 None admin] RBAC: Authorizing `identity:create_grant(project_id=42293c5d76254690ab29c96f76687d9c, group_id=ea8743b893f94df9bc571308c507b491, role_id=d3defd94f93b4e76af116df691240185)` {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:42:45.138978 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca86f055-f648-40c8-b1d8-6bd28df49463 None admin] RBAC: Authorization granted {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:42:45.215206 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 199/394] 10.222.0.84 () {58 vars in 1442 bytes} [Wed May 25 14:42:44 2022] PUT /identity/v3/projects/42293c5d76254690ab29c96f76687d9c/groups/ea8743b893f94df9bc571308c507b491/roles/d3defd94f93b4e76af116df691240185 => generated 0 bytes in 293 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 14:42:45.379664 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aefc376-a229-454d-8dbe-36620dca7c83 None None] REQUEST_METHOD: `GET` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:42:45.380044 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aefc376-a229-454d-8dbe-36620dca7c83 None None] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:42:45.380222 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aefc376-a229-454d-8dbe-36620dca7c83 None None] PATH_INFO: `/` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:42:45.382000 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 196/395] 10.222.0.84 () {54 vars in 926 bytes} [Wed May 25 14:42:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 14:42:45.388245 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db09fa4d-8459-4863-af78-9de79495f280 None None] REQUEST_METHOD: `POST` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:42:45.388532 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db09fa4d-8459-4863-af78-9de79495f280 None None] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:42:45.388825 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db09fa4d-8459-4863-af78-9de79495f280 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:42:45.413374 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.auth.core [None req-db09fa4d-8459-4863-af78-9de79495f280 None None] MFA Rules not processed for user `05d87e87798e429aa1c10b24391f915e`. Rule list: `[]` (Enabled: `True`). {{(pid=101893) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:42:45.415160 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.fernet_utils [None req-db09fa4d-8459-4863-af78-9de79495f280 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=101893) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:42:45.510604 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 200/396] 10.222.0.84 () {58 vars in 1023 bytes} [Wed May 25 14:42:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 25 14:42:45.537934 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aefc376-a229-454d-8dbe-36620dca7c83 None None] Authenticating user token {{(pid=101892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:42:45.688736 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aefc376-a229-454d-8dbe-36620dca7c83 None None] Validating token access rules against request {{(pid=101892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:42:45.704398 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG dbcounter [-] [101892] Writing DB stats keystone:SELECT=100 {{(pid=101892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:42:45.730792 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfe3a816-4e6e-428f-a753-79334f733fd1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:42:45.731647 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe3a816-4e6e-428f-a753-79334f733fd1 None admin] REQUEST_METHOD: `GET` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:42:45.731941 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe3a816-4e6e-428f-a753-79334f733fd1 None admin] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:42:45.732216 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe3a816-4e6e-428f-a753-79334f733fd1 None admin] PATH_INFO: `/v3/roles/member` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:42:45.751958 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfe3a816-4e6e-428f-a753-79334f733fd1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 14:42:45.760545 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application [None req-bfe3a816-4e6e-428f-a753-79334f733fd1 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 25 14:42:45.760545 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:42:45.760545 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 14:42:45.760545 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 14:42:45.760545 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 14:42:45.760545 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 14:42:45.760545 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 14:42:45.760545 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 14:42:45.760545 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 14:42:45.760545 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 14:42:45.760545 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 14:42:45.760545 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 14:42:45.760545 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 14:42:45.760545 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 14:42:45.760545 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 14:42:45.760545 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 14:42:45.761504 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 14:42:45.761504 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 14:42:45.761504 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 14:42:45.761504 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 14:42:45.761504 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 14:42:45.761504 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 14:42:45.761504 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 14:42:45.761504 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 14:42:45.761504 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 14:42:45.761504 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application return self.get_or_create( May 25 14:42:45.761504 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 14:42:45.761504 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application with Lock( May 25 14:42:45.761504 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 14:42:45.761504 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application return self._enter() May 25 14:42:45.761504 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 14:42:45.761504 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 14:42:45.762304 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 14:42:45.762304 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application return self.creator() May 25 14:42:45.762304 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 14:42:45.762304 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application created_value = creator( May 25 14:42:45.762304 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 14:42:45.762304 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 14:42:45.762304 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 14:42:45.762304 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 14:42:45.762304 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 14:42:45.762304 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 14:42:45.762304 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 25 14:42:45.762304 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application May 25 14:42:45.762304 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 197/397] 10.222.0.84 () {56 vars in 1099 bytes} [Wed May 25 14:42:45 2022] GET /identity/v3/roles/member => generated 84 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 14:42:45.768197 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db09fa4d-8459-4863-af78-9de79495f280 None None] Authenticating user token {{(pid=101893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:42:45.820032 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-013a193b-4f29-482d-8513-c9b60bca1b1d None None] REQUEST_METHOD: `GET` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:42:45.820417 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-013a193b-4f29-482d-8513-c9b60bca1b1d None None] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:42:45.821231 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-013a193b-4f29-482d-8513-c9b60bca1b1d None None] PATH_INFO: `/` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:42:45.822902 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 198/398] 10.222.0.84 () {54 vars in 926 bytes} [Wed May 25 14:42:45 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 14:42:45.828272 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e934e5-750d-4751-b01d-aa92c912ce56 None None] REQUEST_METHOD: `POST` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:42:45.828563 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e934e5-750d-4751-b01d-aa92c912ce56 None None] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:42:45.828848 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e934e5-750d-4751-b01d-aa92c912ce56 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:42:45.863133 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.auth.core [None req-f6e934e5-750d-4751-b01d-aa92c912ce56 None None] MFA Rules not processed for user `05d87e87798e429aa1c10b24391f915e`. Rule list: `[]` (Enabled: `True`). {{(pid=101892) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:42:45.865506 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.fernet_utils [None req-f6e934e5-750d-4751-b01d-aa92c912ce56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=101892) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:42:45.958644 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db09fa4d-8459-4863-af78-9de79495f280 None None] Validating token access rules against request {{(pid=101893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:42:45.992834 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 199/399] 10.222.0.84 () {58 vars in 1023 bytes} [Wed May 25 14:42:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 25 14:42:46.003944 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG dbcounter [-] [101893] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=101893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:42:46.011780 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b45aef66-28f0-4d51-a4ba-c39f92d2945b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:42:46.012525 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b45aef66-28f0-4d51-a4ba-c39f92d2945b None admin] REQUEST_METHOD: `GET` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:42:46.012910 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b45aef66-28f0-4d51-a4ba-c39f92d2945b None admin] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:42:46.013253 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b45aef66-28f0-4d51-a4ba-c39f92d2945b None admin] PATH_INFO: `/v3/roles` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:42:46.014077 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b45aef66-28f0-4d51-a4ba-c39f92d2945b None admin] RBAC: Adding query filter params (name=member) {{(pid=101893) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:42:46.014455 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b45aef66-28f0-4d51-a4ba-c39f92d2945b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:42:46.015935 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b45aef66-28f0-4d51-a4ba-c39f92d2945b None admin] RBAC: Authorization granted {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:42:46.020074 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6e934e5-750d-4751-b01d-aa92c912ce56 None None] Authenticating user token {{(pid=101892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:42:46.039916 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 201/400] 10.222.0.84 () {56 vars in 1101 bytes} [Wed May 25 14:42:45 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 272 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:42:46.044184 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b45aef66-28f0-4d51-a4ba-c39f92d2945b None admin] Authenticating user token {{(pid=101893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:42:46.198724 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6e934e5-750d-4751-b01d-aa92c912ce56 None None] Validating token access rules against request {{(pid=101892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:42:46.201178 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG dbcounter [-] [101892] Writing DB stats keystone:SELECT=100 {{(pid=101892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:42:46.214846 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b45aef66-28f0-4d51-a4ba-c39f92d2945b None admin] Validating token access rules against request {{(pid=101893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:42:46.245180 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7ac324e-2a9f-4d7e-ac49-71aee6d5e38d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:42:46.246693 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ac324e-2a9f-4d7e-ac49-71aee6d5e38d None admin] REQUEST_METHOD: `GET` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:42:46.247385 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ac324e-2a9f-4d7e-ac49-71aee6d5e38d None admin] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:42:46.247835 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ac324e-2a9f-4d7e-ac49-71aee6d5e38d None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:42:46.259117 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e65e3ba-2e1d-44f3-838a-759459b8c0bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:42:46.260407 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e65e3ba-2e1d-44f3-838a-759459b8c0bb None admin] REQUEST_METHOD: `GET` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:42:46.260893 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e65e3ba-2e1d-44f3-838a-759459b8c0bb None admin] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:42:46.260997 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7ac324e-2a9f-4d7e-ac49-71aee6d5e38d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 14:42:46.261456 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e65e3ba-2e1d-44f3-838a-759459b8c0bb None admin] PATH_INFO: `/v3/groups/ea8743b893f94df9bc571308c507b491` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:42:46.263414 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e65e3ba-2e1d-44f3-838a-759459b8c0bb None admin] RBAC: Authorizing `identity:get_group(group_id=ea8743b893f94df9bc571308c507b491)` {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:42:46.265143 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e65e3ba-2e1d-44f3-838a-759459b8c0bb None admin] RBAC: Authorization granted {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:42:46.266968 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 202/401] 10.222.0.84 () {56 vars in 1180 bytes} [Wed May 25 14:42:46 2022] GET /identity/v3/groups/ea8743b893f94df9bc571308c507b491 => generated 226 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:42:46.268412 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b639f1e-e1fc-4f67-a304-c45899a200e4 None None] REQUEST_METHOD: `GET` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:42:46.268907 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b639f1e-e1fc-4f67-a304-c45899a200e4 None None] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:42:46.269285 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application [None req-f7ac324e-2a9f-4d7e-ac49-71aee6d5e38d None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 25 14:42:46.269285 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:42:46.269285 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 14:42:46.269285 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 14:42:46.269285 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 14:42:46.269285 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 14:42:46.269285 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 14:42:46.269285 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 14:42:46.269285 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 14:42:46.269285 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 14:42:46.269285 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 14:42:46.269285 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 14:42:46.269285 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 14:42:46.269285 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 14:42:46.269285 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 14:42:46.269285 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 14:42:46.270156 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 14:42:46.270156 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 14:42:46.270156 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 14:42:46.270156 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 14:42:46.270156 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 14:42:46.270156 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 14:42:46.270156 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 14:42:46.270156 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 14:42:46.270156 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 14:42:46.270156 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application return self.get_or_create( May 25 14:42:46.270156 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 14:42:46.270156 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application with Lock( May 25 14:42:46.270156 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 14:42:46.270156 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application return self._enter() May 25 14:42:46.270156 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 14:42:46.270156 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 14:42:46.270960 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 14:42:46.270960 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application return self.creator() May 25 14:42:46.270960 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 14:42:46.270960 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application created_value = creator( May 25 14:42:46.270960 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 14:42:46.270960 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 14:42:46.270960 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 14:42:46.270960 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 14:42:46.270960 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 14:42:46.270960 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 14:42:46.270960 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 25 14:42:46.270960 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application May 25 14:42:46.270960 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 200/402] 10.222.0.84 () {56 vars in 1114 bytes} [Wed May 25 14:42:46 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 251 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 25 14:42:46.272328 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b639f1e-e1fc-4f67-a304-c45899a200e4 None None] PATH_INFO: `/` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:42:46.274118 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 203/403] 10.222.0.84 () {54 vars in 926 bytes} [Wed May 25 14:42:46 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 14:42:46.276115 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7ac324e-2a9f-4d7e-ac49-71aee6d5e38d None admin] Authenticating user token {{(pid=101892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:42:46.278566 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b639f1e-e1fc-4f67-a304-c45899a200e4 None None] Authenticating user token {{(pid=101893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:42:46.355305 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG dbcounter [-] [101893] Writing DB stats keystone:SELECT=100 {{(pid=101893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:42:46.420343 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7ac324e-2a9f-4d7e-ac49-71aee6d5e38d None admin] Validating token access rules against request {{(pid=101892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:42:46.423888 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b639f1e-e1fc-4f67-a304-c45899a200e4 None None] Validating token access rules against request {{(pid=101893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:42:46.471174 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-623d86d7-e86d-4d96-a5b8-949ddfd76b5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:42:46.471408 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab49b5af-17e1-4aeb-b67e-b8cf5918f9cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:42:46.472036 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab49b5af-17e1-4aeb-b67e-b8cf5918f9cf None admin] REQUEST_METHOD: `GET` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:42:46.472485 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab49b5af-17e1-4aeb-b67e-b8cf5918f9cf None admin] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:42:46.472666 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623d86d7-e86d-4d96-a5b8-949ddfd76b5c None admin] REQUEST_METHOD: `GET` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:42:46.473021 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623d86d7-e86d-4d96-a5b8-949ddfd76b5c None admin] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:42:46.473193 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab49b5af-17e1-4aeb-b67e-b8cf5918f9cf None admin] PATH_INFO: `/v3/roles` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:42:46.473433 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623d86d7-e86d-4d96-a5b8-949ddfd76b5c None admin] PATH_INFO: `/v3/projects/ac9e4da865b34de49eecd54e4f6f34e6` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:42:46.474358 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab49b5af-17e1-4aeb-b67e-b8cf5918f9cf None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=101893) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:42:46.474780 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-623d86d7-e86d-4d96-a5b8-949ddfd76b5c None admin] RBAC: Authorizing `identity:get_project(project_id=ac9e4da865b34de49eecd54e4f6f34e6)` {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:42:46.474950 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab49b5af-17e1-4aeb-b67e-b8cf5918f9cf None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:42:46.476465 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-623d86d7-e86d-4d96-a5b8-949ddfd76b5c None admin] RBAC: Authorization granted {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:42:46.477155 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab49b5af-17e1-4aeb-b67e-b8cf5918f9cf None admin] RBAC: Authorization granted {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:42:46.479203 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 201/404] 10.222.0.84 () {56 vars in 1186 bytes} [Wed May 25 14:42:46 2022] GET /identity/v3/projects/ac9e4da865b34de49eecd54e4f6f34e6 => generated 302 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 14:42:46.480981 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b43429-1456-4e60-86e4-d3997d2179aa None None] REQUEST_METHOD: `POST` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:42:46.481343 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b43429-1456-4e60-86e4-d3997d2179aa None None] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:42:46.481690 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b43429-1456-4e60-86e4-d3997d2179aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:42:46.489305 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 204/405] 10.222.0.84 () {56 vars in 1111 bytes} [Wed May 25 14:42:46 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:42:46.491262 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab49b5af-17e1-4aeb-b67e-b8cf5918f9cf None admin] Authenticating user token {{(pid=101893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:42:46.508024 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.auth.core [None req-c3b43429-1456-4e60-86e4-d3997d2179aa None None] MFA Rules not processed for user `05d87e87798e429aa1c10b24391f915e`. Rule list: `[]` (Enabled: `True`). {{(pid=101892) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:42:46.510061 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.fernet_utils [None req-c3b43429-1456-4e60-86e4-d3997d2179aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=101892) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:42:46.547777 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG dbcounter [-] [101892] Writing DB stats keystone:SELECT=100 {{(pid=101892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:42:46.615032 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 202/406] 10.222.0.84 () {58 vars in 1023 bytes} [Wed May 25 14:42:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 25 14:42:46.616309 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3b43429-1456-4e60-86e4-d3997d2179aa None None] Authenticating user token {{(pid=101892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:42:46.634805 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab49b5af-17e1-4aeb-b67e-b8cf5918f9cf None admin] Validating token access rules against request {{(pid=101893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:42:46.654450 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG dbcounter [-] [101893] Writing DB stats keystone:SELECT=100 {{(pid=101893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:42:46.682825 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e46e3a17-e9b1-47d6-ab99-bfcf14c0a78d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:42:46.685004 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46e3a17-e9b1-47d6-ab99-bfcf14c0a78d None admin] REQUEST_METHOD: `PUT` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:42:46.685855 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46e3a17-e9b1-47d6-ab99-bfcf14c0a78d None admin] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:42:46.686321 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46e3a17-e9b1-47d6-ab99-bfcf14c0a78d None admin] PATH_INFO: `/v3/projects/ac9e4da865b34de49eecd54e4f6f34e6/groups/ea8743b893f94df9bc571308c507b491/roles/ff664fa0db7e4262a5accde96c3df4c3` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:42:46.688823 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e46e3a17-e9b1-47d6-ab99-bfcf14c0a78d None admin] RBAC: Authorizing `identity:create_grant(project_id=ac9e4da865b34de49eecd54e4f6f34e6, group_id=ea8743b893f94df9bc571308c507b491, role_id=ff664fa0db7e4262a5accde96c3df4c3)` {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:42:46.691455 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e46e3a17-e9b1-47d6-ab99-bfcf14c0a78d None admin] RBAC: Authorization granted {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:42:46.725624 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3b43429-1456-4e60-86e4-d3997d2179aa None None] Validating token access rules against request {{(pid=101892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:42:46.766324 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 205/407] 10.222.0.84 () {58 vars in 1442 bytes} [Wed May 25 14:42:46 2022] PUT /identity/v3/projects/ac9e4da865b34de49eecd54e4f6f34e6/groups/ea8743b893f94df9bc571308c507b491/roles/ff664fa0db7e4262a5accde96c3df4c3 => generated 0 bytes in 276 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 14:42:46.771650 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e46e3a17-e9b1-47d6-ab99-bfcf14c0a78d None admin] Authenticating user token {{(pid=101893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:42:46.774588 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c54ff81b-8500-4ea6-ad3c-c667d0724a1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:42:46.775490 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54ff81b-8500-4ea6-ad3c-c667d0724a1e None admin] REQUEST_METHOD: `GET` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:42:46.775803 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54ff81b-8500-4ea6-ad3c-c667d0724a1e None admin] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:42:46.776082 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54ff81b-8500-4ea6-ad3c-c667d0724a1e None admin] PATH_INFO: `/v3/groups/ea8743b893f94df9bc571308c507b491` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:42:46.777543 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c54ff81b-8500-4ea6-ad3c-c667d0724a1e None admin] RBAC: Authorizing `identity:get_group(group_id=ea8743b893f94df9bc571308c507b491)` {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:42:46.779037 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c54ff81b-8500-4ea6-ad3c-c667d0724a1e None admin] RBAC: Authorization granted {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:42:46.784301 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 203/408] 10.222.0.84 () {56 vars in 1180 bytes} [Wed May 25 14:42:46 2022] GET /identity/v3/groups/ea8743b893f94df9bc571308c507b491 => generated 226 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:42:46.791128 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c54ff81b-8500-4ea6-ad3c-c667d0724a1e None admin] Authenticating user token {{(pid=101892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:42:46.857897 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG dbcounter [-] [101892] Writing DB stats keystone:SELECT=100 {{(pid=101892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:42:46.978938 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e46e3a17-e9b1-47d6-ab99-bfcf14c0a78d None admin] Validating token access rules against request {{(pid=101893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:42:46.996404 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c54ff81b-8500-4ea6-ad3c-c667d0724a1e None admin] Validating token access rules against request {{(pid=101892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:42:47.018741 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-816a8202-8f81-4b21-aa27-0d5038443594 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:42:47.020910 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816a8202-8f81-4b21-aa27-0d5038443594 None admin] REQUEST_METHOD: `GET` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:42:47.020910 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816a8202-8f81-4b21-aa27-0d5038443594 None admin] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:42:47.020910 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816a8202-8f81-4b21-aa27-0d5038443594 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:42:47.041249 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-816a8202-8f81-4b21-aa27-0d5038443594 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 14:42:47.049326 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application [None req-816a8202-8f81-4b21-aa27-0d5038443594 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 25 14:42:47.049326 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:42:47.049326 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 14:42:47.049326 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 14:42:47.049326 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 14:42:47.049326 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 14:42:47.049326 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 14:42:47.049326 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 14:42:47.049326 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 14:42:47.049326 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 14:42:47.049326 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 14:42:47.049326 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 14:42:47.049326 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 14:42:47.049326 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 14:42:47.049326 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 14:42:47.049326 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 14:42:47.050198 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 14:42:47.050198 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 14:42:47.050198 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 14:42:47.050198 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 14:42:47.050198 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 14:42:47.050198 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 14:42:47.050198 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 14:42:47.050198 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 14:42:47.050198 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 14:42:47.050198 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return self.get_or_create( May 25 14:42:47.050198 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 14:42:47.050198 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application with Lock( May 25 14:42:47.050198 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 14:42:47.050198 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return self._enter() May 25 14:42:47.050198 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 14:42:47.050198 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 14:42:47.050998 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 14:42:47.050998 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return self.creator() May 25 14:42:47.050998 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 14:42:47.050998 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application created_value = creator( May 25 14:42:47.050998 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 14:42:47.050998 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 14:42:47.050998 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 14:42:47.050998 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 14:42:47.050998 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 14:42:47.050998 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 14:42:47.050998 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 25 14:42:47.050998 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application May 25 14:42:47.053227 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 206/409] 10.222.0.84 () {56 vars in 1096 bytes} [Wed May 25 14:42:46 2022] GET /identity/v3/roles/admin => generated 83 bytes in 286 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 14:42:47.059153 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-816a8202-8f81-4b21-aa27-0d5038443594 None admin] Authenticating user token {{(pid=101893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:42:47.061372 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be950c6a-d683-4e94-8f3f-c0e1886c0a56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:42:47.062250 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be950c6a-d683-4e94-8f3f-c0e1886c0a56 None admin] REQUEST_METHOD: `GET` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:42:47.062536 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be950c6a-d683-4e94-8f3f-c0e1886c0a56 None admin] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:42:47.062810 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be950c6a-d683-4e94-8f3f-c0e1886c0a56 None admin] PATH_INFO: `/v3/projects/ac9e4da865b34de49eecd54e4f6f34e6` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:42:47.064057 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be950c6a-d683-4e94-8f3f-c0e1886c0a56 None admin] RBAC: Authorizing `identity:get_project(project_id=ac9e4da865b34de49eecd54e4f6f34e6)` {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:42:47.065834 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be950c6a-d683-4e94-8f3f-c0e1886c0a56 None admin] RBAC: Authorization granted {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:42:47.067472 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 204/410] 10.222.0.84 () {56 vars in 1186 bytes} [Wed May 25 14:42:46 2022] GET /identity/v3/projects/ac9e4da865b34de49eecd54e4f6f34e6 => generated 302 bytes in 277 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:42:47.076519 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be950c6a-d683-4e94-8f3f-c0e1886c0a56 None admin] Authenticating user token {{(pid=101892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:42:47.114191 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG dbcounter [-] [101893] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=101893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:42:47.177368 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-816a8202-8f81-4b21-aa27-0d5038443594 None admin] Validating token access rules against request {{(pid=101893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:42:47.193509 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG dbcounter [-] [101892] Writing DB stats keystone:SELECT=100 {{(pid=101892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:42:47.200808 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be950c6a-d683-4e94-8f3f-c0e1886c0a56 None admin] Validating token access rules against request {{(pid=101892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:42:47.219084 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-811c2836-58ad-4c63-8917-30a43faf40c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:42:47.219794 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811c2836-58ad-4c63-8917-30a43faf40c6 None admin] REQUEST_METHOD: `GET` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:42:47.220083 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811c2836-58ad-4c63-8917-30a43faf40c6 None admin] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:42:47.220365 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811c2836-58ad-4c63-8917-30a43faf40c6 None admin] PATH_INFO: `/v3/roles` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:42:47.221121 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-811c2836-58ad-4c63-8917-30a43faf40c6 None admin] RBAC: Adding query filter params (name=admin) {{(pid=101893) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:42:47.221432 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-811c2836-58ad-4c63-8917-30a43faf40c6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:42:47.222812 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-811c2836-58ad-4c63-8917-30a43faf40c6 None admin] RBAC: Authorization granted {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:42:47.238276 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 207/411] 10.222.0.84 () {56 vars in 1099 bytes} [Wed May 25 14:42:47 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:42:47.244676 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-811c2836-58ad-4c63-8917-30a43faf40c6 None admin] Authenticating user token {{(pid=101893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:42:47.246783 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c69898f2-6ea4-452e-b595-405b2c40fdc1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:42:47.248422 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69898f2-6ea4-452e-b595-405b2c40fdc1 None admin] REQUEST_METHOD: `PUT` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:42:47.248422 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69898f2-6ea4-452e-b595-405b2c40fdc1 None admin] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:42:47.248422 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69898f2-6ea4-452e-b595-405b2c40fdc1 None admin] PATH_INFO: `/v3/projects/ac9e4da865b34de49eecd54e4f6f34e6/groups/ea8743b893f94df9bc571308c507b491/roles/d3defd94f93b4e76af116df691240185` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:42:47.251178 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c69898f2-6ea4-452e-b595-405b2c40fdc1 None admin] RBAC: Authorizing `identity:create_grant(project_id=ac9e4da865b34de49eecd54e4f6f34e6, group_id=ea8743b893f94df9bc571308c507b491, role_id=d3defd94f93b4e76af116df691240185)` {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:42:47.252722 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c69898f2-6ea4-452e-b595-405b2c40fdc1 None admin] RBAC: Authorization granted {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:42:47.349116 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG dbcounter [-] [101893] Writing DB stats keystone:SELECT=100 {{(pid=101893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:42:47.355315 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-811c2836-58ad-4c63-8917-30a43faf40c6 None admin] Validating token access rules against request {{(pid=101893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:42:47.356916 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 205/412] 10.222.0.84 () {58 vars in 1442 bytes} [Wed May 25 14:42:47 2022] PUT /identity/v3/projects/ac9e4da865b34de49eecd54e4f6f34e6/groups/ea8743b893f94df9bc571308c507b491/roles/d3defd94f93b4e76af116df691240185 => generated 0 bytes in 280 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 14:42:47.358675 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8930a8-6790-44d5-8dc2-d3b60c9d6047 None None] REQUEST_METHOD: `GET` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:42:47.359186 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8930a8-6790-44d5-8dc2-d3b60c9d6047 None None] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:42:47.359807 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8930a8-6790-44d5-8dc2-d3b60c9d6047 None None] PATH_INFO: `/` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:42:47.370850 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 206/413] 10.222.0.84 () {54 vars in 926 bytes} [Wed May 25 14:42:47 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 14:42:47.370850 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad51a7aa-a032-4e59-81e7-aa4d4e514bb9 None None] REQUEST_METHOD: `POST` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:42:47.370850 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad51a7aa-a032-4e59-81e7-aa4d4e514bb9 None None] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:42:47.370850 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad51a7aa-a032-4e59-81e7-aa4d4e514bb9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:42:47.393045 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.auth.core [None req-ad51a7aa-a032-4e59-81e7-aa4d4e514bb9 None None] MFA Rules not processed for user `05d87e87798e429aa1c10b24391f915e`. Rule list: `[]` (Enabled: `True`). {{(pid=101892) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:42:47.395389 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.fernet_utils [None req-ad51a7aa-a032-4e59-81e7-aa4d4e514bb9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=101892) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:42:47.432037 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c27f3df8-6ba0-4f76-a789-b64574883b12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:42:47.433407 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c27f3df8-6ba0-4f76-a789-b64574883b12 None admin] REQUEST_METHOD: `GET` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:42:47.433872 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c27f3df8-6ba0-4f76-a789-b64574883b12 None admin] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:42:47.434382 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c27f3df8-6ba0-4f76-a789-b64574883b12 None admin] PATH_INFO: `/v3/groups/4cb4d13fb87e42f383c3be884bf229aa` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:42:47.437647 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c27f3df8-6ba0-4f76-a789-b64574883b12 None admin] RBAC: Authorizing `identity:get_group(group_id=4cb4d13fb87e42f383c3be884bf229aa)` {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:42:47.439631 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c27f3df8-6ba0-4f76-a789-b64574883b12 None admin] RBAC: Authorization granted {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:42:47.443976 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 208/414] 10.222.0.84 () {56 vars in 1180 bytes} [Wed May 25 14:42:47 2022] GET /identity/v3/groups/4cb4d13fb87e42f383c3be884bf229aa => generated 229 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 14:42:47.450483 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c27f3df8-6ba0-4f76-a789-b64574883b12 None admin] Authenticating user token {{(pid=101893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:42:47.528453 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 207/415] 10.222.0.84 () {58 vars in 1023 bytes} [Wed May 25 14:42:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 25 14:42:47.577956 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c27f3df8-6ba0-4f76-a789-b64574883b12 None admin] Validating token access rules against request {{(pid=101893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:42:47.579827 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad51a7aa-a032-4e59-81e7-aa4d4e514bb9 None None] Authenticating user token {{(pid=101892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:42:47.619763 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cddd3c9e-df2c-4283-8c7e-2aa800555c4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:42:47.620661 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cddd3c9e-df2c-4283-8c7e-2aa800555c4c None admin] REQUEST_METHOD: `GET` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:42:47.621001 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cddd3c9e-df2c-4283-8c7e-2aa800555c4c None admin] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:42:47.621223 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cddd3c9e-df2c-4283-8c7e-2aa800555c4c None admin] PATH_INFO: `/v3/projects/cec56f74b2fa4826a506dc7b919465be` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:42:47.622544 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cddd3c9e-df2c-4283-8c7e-2aa800555c4c None admin] RBAC: Authorizing `identity:get_project(project_id=cec56f74b2fa4826a506dc7b919465be)` {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:42:47.624495 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cddd3c9e-df2c-4283-8c7e-2aa800555c4c None admin] RBAC: Authorization granted {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:42:47.631598 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 209/416] 10.222.0.84 () {56 vars in 1186 bytes} [Wed May 25 14:42:47 2022] GET /identity/v3/projects/cec56f74b2fa4826a506dc7b919465be => generated 344 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:42:47.632091 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cddd3c9e-df2c-4283-8c7e-2aa800555c4c None admin] Authenticating user token {{(pid=101893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:42:47.670218 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG dbcounter [-] [101893] Writing DB stats keystone:SELECT=100 {{(pid=101893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:42:47.728570 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG dbcounter [-] [101892] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=101892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:42:47.743000 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad51a7aa-a032-4e59-81e7-aa4d4e514bb9 None None] Validating token access rules against request {{(pid=101892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:42:47.743309 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cddd3c9e-df2c-4283-8c7e-2aa800555c4c None admin] Validating token access rules against request {{(pid=101893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:42:47.779680 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d7eb00d-0a45-4519-be42-050d2d14de4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:42:47.780573 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d7eb00d-0a45-4519-be42-050d2d14de4a None admin] REQUEST_METHOD: `PUT` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:42:47.780863 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d7eb00d-0a45-4519-be42-050d2d14de4a None admin] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:42:47.781153 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d7eb00d-0a45-4519-be42-050d2d14de4a None admin] PATH_INFO: `/v3/projects/cec56f74b2fa4826a506dc7b919465be/groups/4cb4d13fb87e42f383c3be884bf229aa/roles/a3b78e7d547d4d2d998b4c99a4396bba` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:42:47.783212 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d7eb00d-0a45-4519-be42-050d2d14de4a None admin] RBAC: Authorizing `identity:create_grant(project_id=cec56f74b2fa4826a506dc7b919465be, group_id=4cb4d13fb87e42f383c3be884bf229aa, role_id=a3b78e7d547d4d2d998b4c99a4396bba)` {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:42:47.784802 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d7eb00d-0a45-4519-be42-050d2d14de4a None admin] RBAC: Authorization granted {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:42:47.786648 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9417b9ad-8118-4c8d-b9f3-a95ed9085d39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:42:47.787879 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9417b9ad-8118-4c8d-b9f3-a95ed9085d39 None admin] REQUEST_METHOD: `GET` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:42:47.788470 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9417b9ad-8118-4c8d-b9f3-a95ed9085d39 None admin] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:42:47.788977 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9417b9ad-8118-4c8d-b9f3-a95ed9085d39 None admin] PATH_INFO: `/v3/roles/member` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:42:47.814098 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9417b9ad-8118-4c8d-b9f3-a95ed9085d39 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 14:42:47.823142 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application [None req-9417b9ad-8118-4c8d-b9f3-a95ed9085d39 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 25 14:42:47.823142 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:42:47.823142 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 14:42:47.823142 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 14:42:47.823142 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 14:42:47.823142 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 14:42:47.823142 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 14:42:47.823142 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 14:42:47.823142 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 14:42:47.823142 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 14:42:47.823142 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 14:42:47.823142 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 14:42:47.823142 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 14:42:47.823142 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 14:42:47.823142 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 14:42:47.823142 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 14:42:47.824291 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 14:42:47.824291 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 14:42:47.824291 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 14:42:47.824291 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 14:42:47.824291 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 14:42:47.824291 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 14:42:47.824291 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 14:42:47.824291 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 14:42:47.824291 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 14:42:47.824291 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application return self.get_or_create( May 25 14:42:47.824291 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 14:42:47.824291 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application with Lock( May 25 14:42:47.824291 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 14:42:47.824291 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application return self._enter() May 25 14:42:47.824291 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 14:42:47.824291 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 14:42:47.825133 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 14:42:47.825133 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application return self.creator() May 25 14:42:47.825133 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 14:42:47.825133 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application created_value = creator( May 25 14:42:47.825133 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 14:42:47.825133 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 14:42:47.825133 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 14:42:47.825133 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 14:42:47.825133 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 14:42:47.825133 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 14:42:47.825133 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 25 14:42:47.825133 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application May 25 14:42:47.825133 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 208/417] 10.222.0.84 () {56 vars in 1099 bytes} [Wed May 25 14:42:47 2022] GET /identity/v3/roles/member => generated 84 bytes in 245 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 14:42:47.831966 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9417b9ad-8118-4c8d-b9f3-a95ed9085d39 None admin] Authenticating user token {{(pid=101892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:42:47.896006 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 210/418] 10.222.0.84 () {58 vars in 1442 bytes} [Wed May 25 14:42:47 2022] PUT /identity/v3/projects/cec56f74b2fa4826a506dc7b919465be/groups/4cb4d13fb87e42f383c3be884bf229aa/roles/a3b78e7d547d4d2d998b4c99a4396bba => generated 0 bytes in 264 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 25 14:42:47.968189 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9417b9ad-8118-4c8d-b9f3-a95ed9085d39 None admin] Validating token access rules against request {{(pid=101892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:42:47.991053 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd3772d-ee04-416d-b84a-f5c266132965 None None] REQUEST_METHOD: `GET` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:42:47.991341 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd3772d-ee04-416d-b84a-f5c266132965 None None] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:42:47.991668 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd3772d-ee04-416d-b84a-f5c266132965 None None] PATH_INFO: `/` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:42:47.993877 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 211/419] 10.222.0.84 () {54 vars in 926 bytes} [Wed May 25 14:42:47 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 25 14:42:47.999211 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903ef6d9-9cca-4f3c-8ea8-e4b6c30ad93e None None] REQUEST_METHOD: `POST` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:42:47.999499 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903ef6d9-9cca-4f3c-8ea8-e4b6c30ad93e None None] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:42:47.999819 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903ef6d9-9cca-4f3c-8ea8-e4b6c30ad93e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:42:48.022090 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4585d59-f8d7-4565-9dbe-52c18ceb673d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:42:48.023081 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4585d59-f8d7-4565-9dbe-52c18ceb673d None admin] REQUEST_METHOD: `GET` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:42:48.023614 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4585d59-f8d7-4565-9dbe-52c18ceb673d None admin] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:42:48.024095 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4585d59-f8d7-4565-9dbe-52c18ceb673d None admin] PATH_INFO: `/v3/roles` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:42:48.025026 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4585d59-f8d7-4565-9dbe-52c18ceb673d None admin] RBAC: Adding query filter params (name=member) {{(pid=101892) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:42:48.025510 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4585d59-f8d7-4565-9dbe-52c18ceb673d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:42:48.027592 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4585d59-f8d7-4565-9dbe-52c18ceb673d None admin] RBAC: Authorization granted {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:42:48.037916 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 209/420] 10.222.0.84 () {56 vars in 1101 bytes} [Wed May 25 14:42:47 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 14:42:48.044041 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.auth.core [None req-903ef6d9-9cca-4f3c-8ea8-e4b6c30ad93e None None] MFA Rules not processed for user `05d87e87798e429aa1c10b24391f915e`. Rule list: `[]` (Enabled: `True`). {{(pid=101893) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:42:48.044223 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4585d59-f8d7-4565-9dbe-52c18ceb673d None admin] Authenticating user token {{(pid=101892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:42:48.045483 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.fernet_utils [None req-903ef6d9-9cca-4f3c-8ea8-e4b6c30ad93e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=101893) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:42:48.060593 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG dbcounter [-] [101892] Writing DB stats keystone:SELECT=100 {{(pid=101892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:42:48.166305 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 212/421] 10.222.0.84 () {58 vars in 1023 bytes} [Wed May 25 14:42:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 25 14:42:48.184496 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4585d59-f8d7-4565-9dbe-52c18ceb673d None admin] Validating token access rules against request {{(pid=101892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:42:48.192423 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-903ef6d9-9cca-4f3c-8ea8-e4b6c30ad93e None None] Authenticating user token {{(pid=101893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:42:48.225442 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG dbcounter [-] [101893] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=101893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:42:48.232396 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bcb1c0f-2a9f-4423-84b7-e27bbb5e1981 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:42:48.233119 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bcb1c0f-2a9f-4423-84b7-e27bbb5e1981 None admin] REQUEST_METHOD: `GET` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:42:48.233410 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bcb1c0f-2a9f-4423-84b7-e27bbb5e1981 None admin] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:42:48.235976 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bcb1c0f-2a9f-4423-84b7-e27bbb5e1981 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:42:48.321526 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-903ef6d9-9cca-4f3c-8ea8-e4b6c30ad93e None None] Validating token access rules against request {{(pid=101893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:42:48.369702 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bcb1c0f-2a9f-4423-84b7-e27bbb5e1981 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:42:48.371190 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bcb1c0f-2a9f-4423-84b7-e27bbb5e1981 None admin] RBAC: Authorization granted {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:42:48.388482 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03039f68-8183-4f91-a487-a035f66614dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:42:48.389301 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03039f68-8183-4f91-a487-a035f66614dc None admin] REQUEST_METHOD: `GET` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:42:48.389580 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03039f68-8183-4f91-a487-a035f66614dc None admin] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:42:48.389850 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03039f68-8183-4f91-a487-a035f66614dc None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:42:48.393012 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG dbcounter [-] [101892] Writing DB stats keystone:SELECT=100 {{(pid=101892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:42:48.410380 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03039f68-8183-4f91-a487-a035f66614dc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 14:42:48.419240 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application [None req-03039f68-8183-4f91-a487-a035f66614dc None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 25 14:42:48.419240 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:42:48.419240 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 14:42:48.419240 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 14:42:48.419240 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 14:42:48.419240 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 14:42:48.419240 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 14:42:48.419240 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 14:42:48.419240 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 14:42:48.419240 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 14:42:48.419240 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 14:42:48.419240 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 14:42:48.419240 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 14:42:48.419240 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 14:42:48.419240 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 14:42:48.419240 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 14:42:48.420141 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 14:42:48.420141 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 14:42:48.420141 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 14:42:48.420141 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 14:42:48.420141 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 14:42:48.420141 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 14:42:48.420141 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 14:42:48.420141 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 14:42:48.420141 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 14:42:48.420141 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return self.get_or_create( May 25 14:42:48.420141 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 14:42:48.420141 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application with Lock( May 25 14:42:48.420141 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 14:42:48.420141 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return self._enter() May 25 14:42:48.420141 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 14:42:48.420141 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 14:42:48.420946 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 14:42:48.420946 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return self.creator() May 25 14:42:48.420946 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 14:42:48.420946 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application created_value = creator( May 25 14:42:48.420946 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 14:42:48.420946 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 14:42:48.420946 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 14:42:48.420946 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 14:42:48.420946 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 14:42:48.420946 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 14:42:48.420946 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 25 14:42:48.420946 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application May 25 14:42:48.420946 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 213/422] 10.222.0.84 () {56 vars in 1114 bytes} [Wed May 25 14:42:48 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 25 14:42:48.426307 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03039f68-8183-4f91-a487-a035f66614dc None admin] Authenticating user token {{(pid=101893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:42:48.541478 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 210/423] 10.222.0.84 () {58 vars in 1282 bytes} [Wed May 25 14:42:48 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 498 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 25 14:42:48.546823 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bcb1c0f-2a9f-4423-84b7-e27bbb5e1981 None admin] Authenticating user token {{(pid=101892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:42:48.633177 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG dbcounter [-] [101893] Writing DB stats keystone:SELECT=100 {{(pid=101893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:42:48.663949 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bcb1c0f-2a9f-4423-84b7-e27bbb5e1981 None admin] Validating token access rules against request {{(pid=101892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:42:48.674780 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03039f68-8183-4f91-a487-a035f66614dc None admin] Validating token access rules against request {{(pid=101893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:42:48.688958 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG dbcounter [-] [101892] Writing DB stats keystone:SELECT=100 {{(pid=101892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:42:48.700818 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67b77b00-5b75-48a6-973c-103ff6e6c5a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:42:48.702459 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b77b00-5b75-48a6-973c-103ff6e6c5a1 None admin] REQUEST_METHOD: `GET` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:42:48.702459 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b77b00-5b75-48a6-973c-103ff6e6c5a1 None admin] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:42:48.702816 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b77b00-5b75-48a6-973c-103ff6e6c5a1 None admin] PATH_INFO: `/v3/projects/42293c5d76254690ab29c96f76687d9c` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:42:48.704304 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67b77b00-5b75-48a6-973c-103ff6e6c5a1 None admin] RBAC: Authorizing `identity:get_project(project_id=42293c5d76254690ab29c96f76687d9c)` {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:42:48.706033 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67b77b00-5b75-48a6-973c-103ff6e6c5a1 None admin] RBAC: Authorization granted {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:42:48.708252 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 211/424] 10.222.0.84 () {56 vars in 1186 bytes} [Wed May 25 14:42:48 2022] GET /identity/v3/projects/42293c5d76254690ab29c96f76687d9c => generated 298 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:42:48.719618 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6f4aa1c-8a12-4a8a-825f-576dd432c878 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:42:48.719618 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f4aa1c-8a12-4a8a-825f-576dd432c878 None admin] REQUEST_METHOD: `GET` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:42:48.719618 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f4aa1c-8a12-4a8a-825f-576dd432c878 None admin] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:42:48.719618 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f4aa1c-8a12-4a8a-825f-576dd432c878 None admin] PATH_INFO: `/v3/roles` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:42:48.719998 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6f4aa1c-8a12-4a8a-825f-576dd432c878 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=101893) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:42:48.719998 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6f4aa1c-8a12-4a8a-825f-576dd432c878 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:42:48.719998 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6f4aa1c-8a12-4a8a-825f-576dd432c878 None admin] RBAC: Authorization granted {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:42:48.721328 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67b77b00-5b75-48a6-973c-103ff6e6c5a1 None admin] Authenticating user token {{(pid=101892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:42:48.728384 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 214/425] 10.222.0.84 () {56 vars in 1111 bytes} [Wed May 25 14:42:48 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 302 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:42:48.737589 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6f4aa1c-8a12-4a8a-825f-576dd432c878 None admin] Authenticating user token {{(pid=101893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:42:48.855490 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6f4aa1c-8a12-4a8a-825f-576dd432c878 None admin] Validating token access rules against request {{(pid=101893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:42:48.861404 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67b77b00-5b75-48a6-973c-103ff6e6c5a1 None admin] Validating token access rules against request {{(pid=101892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:42:48.906571 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38cd3d2d-e0ea-47d8-8d34-fc1e9f0851c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:42:48.907333 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38cd3d2d-e0ea-47d8-8d34-fc1e9f0851c0 None admin] REQUEST_METHOD: `GET` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:42:48.907718 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38cd3d2d-e0ea-47d8-8d34-fc1e9f0851c0 None admin] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:42:48.908067 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38cd3d2d-e0ea-47d8-8d34-fc1e9f0851c0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:42:48.908289 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34b1d928-e3f1-422d-ae69-d2d220846846 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:42:48.909162 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b1d928-e3f1-422d-ae69-d2d220846846 None admin] REQUEST_METHOD: `GET` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:42:48.909446 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b1d928-e3f1-422d-ae69-d2d220846846 None admin] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:42:48.909727 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b1d928-e3f1-422d-ae69-d2d220846846 None admin] PATH_INFO: `/v3/groups/ea8743b893f94df9bc571308c507b491` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:42:48.916320 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34b1d928-e3f1-422d-ae69-d2d220846846 None admin] RBAC: Authorizing `identity:get_group(group_id=ea8743b893f94df9bc571308c507b491)` {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:42:48.917786 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34b1d928-e3f1-422d-ae69-d2d220846846 None admin] RBAC: Authorization granted {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:42:48.919765 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 212/426] 10.222.0.84 () {56 vars in 1180 bytes} [Wed May 25 14:42:48 2022] GET /identity/v3/groups/ea8743b893f94df9bc571308c507b491 => generated 226 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:42:48.932600 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34b1d928-e3f1-422d-ae69-d2d220846846 None admin] Authenticating user token {{(pid=101892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:42:48.975946 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG dbcounter [-] [101893] Writing DB stats keystone:SELECT=100 {{(pid=101893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:42:48.990555 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38cd3d2d-e0ea-47d8-8d34-fc1e9f0851c0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:42:48.992809 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38cd3d2d-e0ea-47d8-8d34-fc1e9f0851c0 None admin] RBAC: Authorization granted {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:42:49.033139 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG dbcounter [-] [101892] Writing DB stats keystone:SELECT=100 {{(pid=101892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:42:49.087842 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34b1d928-e3f1-422d-ae69-d2d220846846 None admin] Validating token access rules against request {{(pid=101892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:42:49.122384 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bccdab93-c34e-4467-a2ce-f16ed0628937 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:42:49.123340 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bccdab93-c34e-4467-a2ce-f16ed0628937 None admin] REQUEST_METHOD: `GET` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:42:49.123788 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bccdab93-c34e-4467-a2ce-f16ed0628937 None admin] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:42:49.124461 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bccdab93-c34e-4467-a2ce-f16ed0628937 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:42:49.125420 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bccdab93-c34e-4467-a2ce-f16ed0628937 None admin] RBAC: Adding query filter params (group.id=ea8743b893f94df9bc571308c507b491, role.id=ff664fa0db7e4262a5accde96c3df4c3, scope.project.id=42293c5d76254690ab29c96f76687d9c) {{(pid=101892) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:42:49.125892 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bccdab93-c34e-4467-a2ce-f16ed0628937 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:42:49.127448 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bccdab93-c34e-4467-a2ce-f16ed0628937 None admin] RBAC: Authorization granted {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:42:49.134137 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 213/427] 10.222.0.84 () {56 vars in 1376 bytes} [Wed May 25 14:42:48 2022] GET /identity/v3/role_assignments?group.id=ea8743b893f94df9bc571308c507b491&scope.project.id=42293c5d76254690ab29c96f76687d9c&role.id=ff664fa0db7e4262a5accde96c3df4c3 => generated 611 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:42:49.180994 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 215/428] 10.222.0.84 () {58 vars in 1282 bytes} [Wed May 25 14:42:48 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 448 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 25 14:42:49.186360 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bccdab93-c34e-4467-a2ce-f16ed0628937 None admin] Authenticating user token {{(pid=101892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:42:49.325491 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bccdab93-c34e-4467-a2ce-f16ed0628937 None admin] Validating token access rules against request {{(pid=101892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:42:49.337510 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG dbcounter [-] [101892] Writing DB stats keystone:SELECT=100 {{(pid=101892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:42:49.370364 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d49cb296-4092-4d03-8c85-d6ba52e97d84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:42:49.371503 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49cb296-4092-4d03-8c85-d6ba52e97d84 None admin] REQUEST_METHOD: `GET` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:42:49.371956 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49cb296-4092-4d03-8c85-d6ba52e97d84 None admin] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:42:49.372406 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49cb296-4092-4d03-8c85-d6ba52e97d84 None admin] PATH_INFO: `/v3/projects/42293c5d76254690ab29c96f76687d9c` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:42:49.374656 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d49cb296-4092-4d03-8c85-d6ba52e97d84 None admin] RBAC: Authorizing `identity:get_project(project_id=42293c5d76254690ab29c96f76687d9c)` {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:42:49.376648 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d49cb296-4092-4d03-8c85-d6ba52e97d84 None admin] RBAC: Authorization granted {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:42:49.379075 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 214/429] 10.222.0.84 () {56 vars in 1186 bytes} [Wed May 25 14:42:49 2022] GET /identity/v3/projects/42293c5d76254690ab29c96f76687d9c => generated 298 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:42:49.384782 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38cd3d2d-e0ea-47d8-8d34-fc1e9f0851c0 None admin] Authenticating user token {{(pid=101893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:42:49.435608 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG dbcounter [-] [101893] Writing DB stats keystone:SELECT=100 {{(pid=101893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:42:49.496148 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38cd3d2d-e0ea-47d8-8d34-fc1e9f0851c0 None admin] Validating token access rules against request {{(pid=101893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:42:49.534017 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c51cbd8d-784b-48f5-9df0-79604bde2a46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:42:49.534875 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c51cbd8d-784b-48f5-9df0-79604bde2a46 None admin] REQUEST_METHOD: `GET` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:42:49.535154 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c51cbd8d-784b-48f5-9df0-79604bde2a46 None admin] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:42:49.535433 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c51cbd8d-784b-48f5-9df0-79604bde2a46 None admin] PATH_INFO: `/v3/groups/ea8743b893f94df9bc571308c507b491` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:42:49.536647 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c51cbd8d-784b-48f5-9df0-79604bde2a46 None admin] RBAC: Authorizing `identity:get_group(group_id=ea8743b893f94df9bc571308c507b491)` {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:42:49.538099 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c51cbd8d-784b-48f5-9df0-79604bde2a46 None admin] RBAC: Authorization granted {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:42:49.540661 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 216/430] 10.222.0.84 () {56 vars in 1180 bytes} [Wed May 25 14:42:49 2022] GET /identity/v3/groups/ea8743b893f94df9bc571308c507b491 => generated 226 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:42:49.546432 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d49cb296-4092-4d03-8c85-d6ba52e97d84 None admin] Authenticating user token {{(pid=101892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:42:49.676956 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d49cb296-4092-4d03-8c85-d6ba52e97d84 None admin] Validating token access rules against request {{(pid=101892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:42:49.693073 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f453e1-9744-4b28-879c-ae65a78f6ae7 None None] REQUEST_METHOD: `GET` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:42:49.693367 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f453e1-9744-4b28-879c-ae65a78f6ae7 None None] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:42:49.693628 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f453e1-9744-4b28-879c-ae65a78f6ae7 None None] PATH_INFO: `/` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:42:49.695151 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 217/431] 10.222.0.84 () {54 vars in 926 bytes} [Wed May 25 14:42:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 25 14:42:49.701245 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d950cfc-2ea1-4062-9199-30f0573de5dc None None] REQUEST_METHOD: `POST` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:42:49.701798 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d950cfc-2ea1-4062-9199-30f0573de5dc None None] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:42:49.702279 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d950cfc-2ea1-4062-9199-30f0573de5dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:42:49.721150 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.auth.core [None req-6d950cfc-2ea1-4062-9199-30f0573de5dc None None] MFA Rules not processed for user `05d87e87798e429aa1c10b24391f915e`. Rule list: `[]` (Enabled: `True`). {{(pid=101893) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:42:49.722613 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.fernet_utils [None req-6d950cfc-2ea1-4062-9199-30f0573de5dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=101893) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:42:49.732439 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66eba33b-228a-43b0-8069-610530b7e443 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:42:49.733097 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66eba33b-228a-43b0-8069-610530b7e443 None admin] REQUEST_METHOD: `GET` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:42:49.733784 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66eba33b-228a-43b0-8069-610530b7e443 None admin] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:42:49.734081 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66eba33b-228a-43b0-8069-610530b7e443 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:42:49.735538 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66eba33b-228a-43b0-8069-610530b7e443 None admin] RBAC: Adding query filter params (group.id=ea8743b893f94df9bc571308c507b491, role.id=d3defd94f93b4e76af116df691240185, scope.project.id=42293c5d76254690ab29c96f76687d9c) {{(pid=101892) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:42:49.735538 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66eba33b-228a-43b0-8069-610530b7e443 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:42:49.736688 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66eba33b-228a-43b0-8069-610530b7e443 None admin] RBAC: Authorization granted {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:42:49.747670 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 215/432] 10.222.0.84 () {56 vars in 1376 bytes} [Wed May 25 14:42:49 2022] GET /identity/v3/role_assignments?group.id=ea8743b893f94df9bc571308c507b491&scope.project.id=42293c5d76254690ab29c96f76687d9c&role.id=d3defd94f93b4e76af116df691240185 => generated 611 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:42:49.805170 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 218/433] 10.222.0.84 () {58 vars in 1023 bytes} [Wed May 25 14:42:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 25 14:42:49.833928 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66eba33b-228a-43b0-8069-610530b7e443 None admin] Authenticating user token {{(pid=101892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:42:49.896553 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG dbcounter [-] [101892] Writing DB stats keystone:SELECT=100 {{(pid=101892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:42:49.972829 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66eba33b-228a-43b0-8069-610530b7e443 None admin] Validating token access rules against request {{(pid=101892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:42:50.010622 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb970f62-0a57-40d7-a100-d5144ec351ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:42:50.011794 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb970f62-0a57-40d7-a100-d5144ec351ef None admin] REQUEST_METHOD: `GET` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:42:50.012276 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb970f62-0a57-40d7-a100-d5144ec351ef None admin] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:42:50.012762 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb970f62-0a57-40d7-a100-d5144ec351ef None admin] PATH_INFO: `/v3/roles/member` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:42:50.023699 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb970f62-0a57-40d7-a100-d5144ec351ef None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 14:42:50.031873 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application [None req-bb970f62-0a57-40d7-a100-d5144ec351ef None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 25 14:42:50.031873 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:42:50.031873 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 14:42:50.031873 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 14:42:50.031873 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 14:42:50.031873 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 14:42:50.031873 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 14:42:50.031873 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 14:42:50.031873 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 14:42:50.031873 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 14:42:50.031873 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 14:42:50.031873 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 14:42:50.031873 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 14:42:50.031873 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 14:42:50.031873 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 14:42:50.031873 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 14:42:50.032872 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 14:42:50.032872 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 14:42:50.032872 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 14:42:50.032872 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 14:42:50.032872 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 14:42:50.032872 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 14:42:50.032872 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 14:42:50.032872 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 14:42:50.032872 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 14:42:50.032872 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application return self.get_or_create( May 25 14:42:50.032872 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 14:42:50.032872 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application with Lock( May 25 14:42:50.032872 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 14:42:50.032872 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application return self._enter() May 25 14:42:50.032872 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 14:42:50.032872 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 14:42:50.033841 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 14:42:50.033841 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application return self.creator() May 25 14:42:50.033841 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 14:42:50.033841 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application created_value = creator( May 25 14:42:50.033841 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 14:42:50.033841 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 14:42:50.033841 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 14:42:50.033841 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 14:42:50.033841 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 14:42:50.033841 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 14:42:50.033841 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 25 14:42:50.033841 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application May 25 14:42:50.036283 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 216/434] 10.222.0.84 () {56 vars in 1099 bytes} [Wed May 25 14:42:49 2022] GET /identity/v3/roles/member => generated 84 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 14:42:50.042248 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d950cfc-2ea1-4062-9199-30f0573de5dc None None] Authenticating user token {{(pid=101893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:42:50.088252 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG dbcounter [-] [101893] Writing DB stats keystone:SELECT=100 {{(pid=101893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:42:50.152236 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d950cfc-2ea1-4062-9199-30f0573de5dc None None] Validating token access rules against request {{(pid=101893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:42:50.161052 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3345150-9c43-478e-910b-b40a17b0a7ed None None] REQUEST_METHOD: `GET` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:42:50.161334 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3345150-9c43-478e-910b-b40a17b0a7ed None None] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:42:50.161622 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3345150-9c43-478e-910b-b40a17b0a7ed None None] PATH_INFO: `/` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:42:50.163496 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 217/435] 10.222.0.84 () {54 vars in 926 bytes} [Wed May 25 14:42:50 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 25 14:42:50.171514 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0739fb9-5e6e-4625-922e-83cbfe9329ad None None] REQUEST_METHOD: `POST` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:42:50.171514 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0739fb9-5e6e-4625-922e-83cbfe9329ad None None] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:42:50.171514 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0739fb9-5e6e-4625-922e-83cbfe9329ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:42:50.189035 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.auth.core [None req-f0739fb9-5e6e-4625-922e-83cbfe9329ad None None] MFA Rules not processed for user `05d87e87798e429aa1c10b24391f915e`. Rule list: `[]` (Enabled: `True`). {{(pid=101892) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:42:50.190637 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.fernet_utils [None req-f0739fb9-5e6e-4625-922e-83cbfe9329ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=101892) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:42:50.195465 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4da5db39-ddcf-405e-8c96-fd135be865e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:42:50.196182 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da5db39-ddcf-405e-8c96-fd135be865e9 None admin] REQUEST_METHOD: `GET` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:42:50.196470 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da5db39-ddcf-405e-8c96-fd135be865e9 None admin] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:42:50.196748 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da5db39-ddcf-405e-8c96-fd135be865e9 None admin] PATH_INFO: `/v3/roles` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:42:50.197505 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4da5db39-ddcf-405e-8c96-fd135be865e9 None admin] RBAC: Adding query filter params (name=member) {{(pid=101893) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:42:50.197820 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4da5db39-ddcf-405e-8c96-fd135be865e9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:42:50.199315 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4da5db39-ddcf-405e-8c96-fd135be865e9 None admin] RBAC: Authorization granted {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:42:50.212254 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 219/436] 10.222.0.84 () {56 vars in 1101 bytes} [Wed May 25 14:42:50 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:42:50.218061 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4da5db39-ddcf-405e-8c96-fd135be865e9 None admin] Authenticating user token {{(pid=101893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:42:50.282611 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 218/437] 10.222.0.84 () {58 vars in 1023 bytes} [Wed May 25 14:42:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 25 14:42:50.300233 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0739fb9-5e6e-4625-922e-83cbfe9329ad None None] Authenticating user token {{(pid=101892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:42:50.343364 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4da5db39-ddcf-405e-8c96-fd135be865e9 None admin] Validating token access rules against request {{(pid=101893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:42:50.344202 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG dbcounter [-] [101892] Writing DB stats keystone:SELECT=100 {{(pid=101892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:42:50.346313 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG dbcounter [-] [101893] Writing DB stats keystone:SELECT=100 {{(pid=101893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:42:50.384435 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b29a10d-0eac-4b53-bea4-6e9fc5287e38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:42:50.385126 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b29a10d-0eac-4b53-bea4-6e9fc5287e38 None admin] REQUEST_METHOD: `GET` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:42:50.385411 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b29a10d-0eac-4b53-bea4-6e9fc5287e38 None admin] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:42:50.385682 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b29a10d-0eac-4b53-bea4-6e9fc5287e38 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:42:50.427375 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0739fb9-5e6e-4625-922e-83cbfe9329ad None None] Validating token access rules against request {{(pid=101892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:42:50.458932 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b29a10d-0eac-4b53-bea4-6e9fc5287e38 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:42:50.460449 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b29a10d-0eac-4b53-bea4-6e9fc5287e38 None admin] RBAC: Authorization granted {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:42:50.467837 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5191ed1-fe2e-4b1e-bd10-87817d36d9c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:42:50.468915 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5191ed1-fe2e-4b1e-bd10-87817d36d9c2 None admin] REQUEST_METHOD: `GET` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:42:50.469918 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5191ed1-fe2e-4b1e-bd10-87817d36d9c2 None admin] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:42:50.470370 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5191ed1-fe2e-4b1e-bd10-87817d36d9c2 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:42:50.481968 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5191ed1-fe2e-4b1e-bd10-87817d36d9c2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 14:42:50.490274 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application [None req-b5191ed1-fe2e-4b1e-bd10-87817d36d9c2 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 25 14:42:50.490274 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:42:50.490274 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 14:42:50.490274 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 14:42:50.490274 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 14:42:50.490274 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 14:42:50.490274 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 14:42:50.490274 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 14:42:50.490274 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 14:42:50.490274 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 14:42:50.490274 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 14:42:50.490274 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 14:42:50.490274 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 14:42:50.490274 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 14:42:50.490274 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 14:42:50.490274 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 14:42:50.491365 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 14:42:50.491365 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 14:42:50.491365 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 14:42:50.491365 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 14:42:50.491365 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 14:42:50.491365 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 14:42:50.491365 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 14:42:50.491365 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 14:42:50.491365 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 14:42:50.491365 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application return self.get_or_create( May 25 14:42:50.491365 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 14:42:50.491365 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application with Lock( May 25 14:42:50.491365 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 14:42:50.491365 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application return self._enter() May 25 14:42:50.491365 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 14:42:50.491365 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 14:42:50.492426 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 14:42:50.492426 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application return self.creator() May 25 14:42:50.492426 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 14:42:50.492426 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application created_value = creator( May 25 14:42:50.492426 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 14:42:50.492426 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 14:42:50.492426 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 14:42:50.492426 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 14:42:50.492426 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 14:42:50.492426 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 14:42:50.492426 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 25 14:42:50.492426 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application May 25 14:42:50.499342 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 219/438] 10.222.0.84 () {56 vars in 1114 bytes} [Wed May 25 14:42:50 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 25 14:42:50.500371 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5191ed1-fe2e-4b1e-bd10-87817d36d9c2 None admin] Authenticating user token {{(pid=101892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:42:50.576163 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 220/439] 10.222.0.84 () {58 vars in 1282 bytes} [Wed May 25 14:42:50 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 359 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 25 14:42:50.581508 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b29a10d-0eac-4b53-bea4-6e9fc5287e38 None admin] Authenticating user token {{(pid=101893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:42:50.585056 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG dbcounter [-] [101893] Writing DB stats keystone:SELECT=100 {{(pid=101893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:42:50.608067 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG dbcounter [-] [101892] Writing DB stats keystone:SELECT=100 {{(pid=101892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:42:50.617110 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5191ed1-fe2e-4b1e-bd10-87817d36d9c2 None admin] Validating token access rules against request {{(pid=101892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:42:50.652337 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ce8862-aac8-40a8-bf2a-13eab5541f36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:42:50.653025 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ce8862-aac8-40a8-bf2a-13eab5541f36 None admin] REQUEST_METHOD: `GET` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:42:50.653352 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ce8862-aac8-40a8-bf2a-13eab5541f36 None admin] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:42:50.653627 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ce8862-aac8-40a8-bf2a-13eab5541f36 None admin] PATH_INFO: `/v3/roles` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:42:50.654372 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44ce8862-aac8-40a8-bf2a-13eab5541f36 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=101892) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:42:50.654677 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44ce8862-aac8-40a8-bf2a-13eab5541f36 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:42:50.656079 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44ce8862-aac8-40a8-bf2a-13eab5541f36 None admin] RBAC: Authorization granted {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:42:50.668307 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 220/440] 10.222.0.84 () {56 vars in 1111 bytes} [Wed May 25 14:42:50 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:42:50.668307 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f1bf38-b22a-411e-84c5-85c79e82b64c None None] REQUEST_METHOD: `GET` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:42:50.668307 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f1bf38-b22a-411e-84c5-85c79e82b64c None None] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:42:50.668307 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f1bf38-b22a-411e-84c5-85c79e82b64c None None] PATH_INFO: `/` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:42:50.668307 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 221/441] 10.222.0.84 () {54 vars in 926 bytes} [Wed May 25 14:42:50 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 14:42:50.671483 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4f1bf38-b22a-411e-84c5-85c79e82b64c None None] Authenticating user token {{(pid=101892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:42:50.685315 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b29a10d-0eac-4b53-bea4-6e9fc5287e38 None admin] Validating token access rules against request {{(pid=101893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:42:50.719738 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-604a9307-7501-4ec2-b541-bc610f8575bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:42:50.720589 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604a9307-7501-4ec2-b541-bc610f8575bd None admin] REQUEST_METHOD: `GET` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:42:50.720874 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604a9307-7501-4ec2-b541-bc610f8575bd None admin] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:42:50.721150 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604a9307-7501-4ec2-b541-bc610f8575bd None admin] PATH_INFO: `/v3/projects/ac9e4da865b34de49eecd54e4f6f34e6` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:42:50.722329 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-604a9307-7501-4ec2-b541-bc610f8575bd None admin] RBAC: Authorizing `identity:get_project(project_id=ac9e4da865b34de49eecd54e4f6f34e6)` {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:42:50.723806 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-604a9307-7501-4ec2-b541-bc610f8575bd None admin] RBAC: Authorization granted {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:42:50.725674 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 221/442] 10.222.0.84 () {56 vars in 1186 bytes} [Wed May 25 14:42:50 2022] GET /identity/v3/projects/ac9e4da865b34de49eecd54e4f6f34e6 => generated 302 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 14:42:50.726622 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73111a9-2551-4d9e-bb7a-4589babd5d91 None None] REQUEST_METHOD: `POST` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:42:50.726906 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73111a9-2551-4d9e-bb7a-4589babd5d91 None None] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:42:50.727184 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73111a9-2551-4d9e-bb7a-4589babd5d91 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:42:50.742548 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.auth.core [None req-d73111a9-2551-4d9e-bb7a-4589babd5d91 None None] MFA Rules not processed for user `05d87e87798e429aa1c10b24391f915e`. Rule list: `[]` (Enabled: `True`). {{(pid=101893) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:42:50.743769 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.fernet_utils [None req-d73111a9-2551-4d9e-bb7a-4589babd5d91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=101893) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:42:50.775144 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4f1bf38-b22a-411e-84c5-85c79e82b64c None None] Validating token access rules against request {{(pid=101892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:42:50.808002 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60956a70-a538-4f16-ba36-e1fbe700da1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:42:50.808581 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60956a70-a538-4f16-ba36-e1fbe700da1c None admin] REQUEST_METHOD: `GET` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:42:50.808871 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60956a70-a538-4f16-ba36-e1fbe700da1c None admin] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:42:50.809036 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 222/443] 10.222.0.84 () {58 vars in 1023 bytes} [Wed May 25 14:42:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 25 14:42:50.809134 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60956a70-a538-4f16-ba36-e1fbe700da1c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:42:50.809856 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d73111a9-2551-4d9e-bb7a-4589babd5d91 None None] Authenticating user token {{(pid=101893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:42:50.812001 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG dbcounter [-] [101893] Writing DB stats keystone:SELECT=100 {{(pid=101893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:42:50.835112 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG dbcounter [-] [101892] Writing DB stats keystone:SELECT=100 {{(pid=101892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:42:50.877421 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60956a70-a538-4f16-ba36-e1fbe700da1c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:42:50.878883 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60956a70-a538-4f16-ba36-e1fbe700da1c None admin] RBAC: Authorization granted {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:42:50.907711 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d73111a9-2551-4d9e-bb7a-4589babd5d91 None None] Validating token access rules against request {{(pid=101893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:42:50.940831 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ab4367-c7f5-4324-97a6-7bf2a126e2d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:42:50.941679 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ab4367-c7f5-4324-97a6-7bf2a126e2d8 None admin] REQUEST_METHOD: `GET` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:42:50.941961 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ab4367-c7f5-4324-97a6-7bf2a126e2d8 None admin] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:42:50.942236 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ab4367-c7f5-4324-97a6-7bf2a126e2d8 None admin] PATH_INFO: `/v3/groups/ea8743b893f94df9bc571308c507b491` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:42:50.943391 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7ab4367-c7f5-4324-97a6-7bf2a126e2d8 None admin] RBAC: Authorizing `identity:get_group(group_id=ea8743b893f94df9bc571308c507b491)` {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:42:50.944850 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7ab4367-c7f5-4324-97a6-7bf2a126e2d8 None admin] RBAC: Authorization granted {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:42:50.947010 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 223/444] 10.222.0.84 () {56 vars in 1180 bytes} [Wed May 25 14:42:50 2022] GET /identity/v3/groups/ea8743b893f94df9bc571308c507b491 => generated 226 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:42:50.947784 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ab4367-c7f5-4324-97a6-7bf2a126e2d8 None admin] Authenticating user token {{(pid=101893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:42:50.977309 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 222/445] 10.222.0.84 () {58 vars in 1282 bytes} [Wed May 25 14:42:50 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 25 14:42:50.978142 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60956a70-a538-4f16-ba36-e1fbe700da1c None admin] Authenticating user token {{(pid=101892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:42:51.015146 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG dbcounter [-] [101893] Writing DB stats keystone:SELECT=100 {{(pid=101893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:42:51.033147 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG dbcounter [-] [101892] Writing DB stats keystone:SELECT=100 {{(pid=101892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:42:51.045069 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ab4367-c7f5-4324-97a6-7bf2a126e2d8 None admin] Validating token access rules against request {{(pid=101893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:42:51.077387 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60956a70-a538-4f16-ba36-e1fbe700da1c None admin] Validating token access rules against request {{(pid=101892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:42:51.078590 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e96dbb5d-2741-41a8-9be8-35f4b75498e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:42:51.079383 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96dbb5d-2741-41a8-9be8-35f4b75498e9 None admin] REQUEST_METHOD: `GET` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:42:51.079699 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96dbb5d-2741-41a8-9be8-35f4b75498e9 None admin] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:42:51.079979 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96dbb5d-2741-41a8-9be8-35f4b75498e9 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:42:51.090239 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e96dbb5d-2741-41a8-9be8-35f4b75498e9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 14:42:51.097843 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application [None req-e96dbb5d-2741-41a8-9be8-35f4b75498e9 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 25 14:42:51.097843 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:42:51.097843 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 14:42:51.097843 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 14:42:51.097843 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 14:42:51.097843 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 14:42:51.097843 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 14:42:51.097843 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 14:42:51.097843 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 14:42:51.097843 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 14:42:51.097843 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 14:42:51.097843 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 14:42:51.097843 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 14:42:51.097843 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 14:42:51.097843 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 14:42:51.097843 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 14:42:51.098737 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 14:42:51.098737 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 14:42:51.098737 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 14:42:51.098737 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 14:42:51.098737 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 14:42:51.098737 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 14:42:51.098737 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 14:42:51.098737 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 14:42:51.098737 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 14:42:51.098737 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return self.get_or_create( May 25 14:42:51.098737 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 14:42:51.098737 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application with Lock( May 25 14:42:51.098737 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 14:42:51.098737 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return self._enter() May 25 14:42:51.098737 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 14:42:51.098737 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 14:42:51.099551 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 14:42:51.099551 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return self.creator() May 25 14:42:51.099551 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 14:42:51.099551 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application created_value = creator( May 25 14:42:51.099551 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 14:42:51.099551 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 14:42:51.099551 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 14:42:51.099551 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 14:42:51.099551 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 14:42:51.099551 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 14:42:51.099551 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 25 14:42:51.099551 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application May 25 14:42:51.099551 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 224/446] 10.222.0.84 () {56 vars in 1096 bytes} [Wed May 25 14:42:50 2022] GET /identity/v3/roles/admin => generated 83 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 14:42:51.100241 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e96dbb5d-2741-41a8-9be8-35f4b75498e9 None admin] Authenticating user token {{(pid=101893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:42:51.114757 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23f6a58c-dee5-4d71-8697-6ba5b536faf0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:42:51.115409 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f6a58c-dee5-4d71-8697-6ba5b536faf0 None admin] REQUEST_METHOD: `GET` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:42:51.115727 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f6a58c-dee5-4d71-8697-6ba5b536faf0 None admin] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:42:51.116001 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f6a58c-dee5-4d71-8697-6ba5b536faf0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:42:51.117361 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23f6a58c-dee5-4d71-8697-6ba5b536faf0 None admin] RBAC: Adding query filter params (group.id=ea8743b893f94df9bc571308c507b491, role.id=ff664fa0db7e4262a5accde96c3df4c3, scope.project.id=ac9e4da865b34de49eecd54e4f6f34e6) {{(pid=101892) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:42:51.117685 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23f6a58c-dee5-4d71-8697-6ba5b536faf0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:42:51.119163 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23f6a58c-dee5-4d71-8697-6ba5b536faf0 None admin] RBAC: Authorization granted {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:42:51.125196 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 223/447] 10.222.0.84 () {56 vars in 1376 bytes} [Wed May 25 14:42:50 2022] GET /identity/v3/role_assignments?group.id=ea8743b893f94df9bc571308c507b491&scope.project.id=ac9e4da865b34de49eecd54e4f6f34e6&role.id=ff664fa0db7e4262a5accde96c3df4c3 => generated 611 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:42:51.125962 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23f6a58c-dee5-4d71-8697-6ba5b536faf0 None admin] Authenticating user token {{(pid=101892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:42:51.217706 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e96dbb5d-2741-41a8-9be8-35f4b75498e9 None admin] Validating token access rules against request {{(pid=101893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:42:51.250531 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG dbcounter [-] [101893] Writing DB stats keystone:SELECT=100 {{(pid=101893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:42:51.252495 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23f6a58c-dee5-4d71-8697-6ba5b536faf0 None admin] Validating token access rules against request {{(pid=101892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:42:51.256806 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40b64d79-ddf7-4ded-8e79-e3c9366d2feb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:42:51.257726 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b64d79-ddf7-4ded-8e79-e3c9366d2feb None admin] REQUEST_METHOD: `GET` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:42:51.258018 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b64d79-ddf7-4ded-8e79-e3c9366d2feb None admin] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:42:51.258338 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b64d79-ddf7-4ded-8e79-e3c9366d2feb None admin] PATH_INFO: `/v3/projects/ac9e4da865b34de49eecd54e4f6f34e6` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:42:51.259713 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40b64d79-ddf7-4ded-8e79-e3c9366d2feb None admin] RBAC: Authorizing `identity:get_project(project_id=ac9e4da865b34de49eecd54e4f6f34e6)` {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:42:51.261338 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40b64d79-ddf7-4ded-8e79-e3c9366d2feb None admin] RBAC: Authorization granted {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:42:51.268089 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 225/448] 10.222.0.84 () {56 vars in 1186 bytes} [Wed May 25 14:42:51 2022] GET /identity/v3/projects/ac9e4da865b34de49eecd54e4f6f34e6 => generated 302 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:42:51.268989 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40b64d79-ddf7-4ded-8e79-e3c9366d2feb None admin] Authenticating user token {{(pid=101893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:42:51.272660 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG dbcounter [-] [101892] Writing DB stats keystone:SELECT=100 {{(pid=101892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:42:51.292267 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c33f017d-b252-4c87-8df7-3a966c34b937 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:42:51.292979 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c33f017d-b252-4c87-8df7-3a966c34b937 None admin] REQUEST_METHOD: `GET` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:42:51.293306 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c33f017d-b252-4c87-8df7-3a966c34b937 None admin] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:42:51.293576 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c33f017d-b252-4c87-8df7-3a966c34b937 None admin] PATH_INFO: `/v3/roles` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:42:51.294352 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c33f017d-b252-4c87-8df7-3a966c34b937 None admin] RBAC: Adding query filter params (name=admin) {{(pid=101892) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:42:51.294670 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c33f017d-b252-4c87-8df7-3a966c34b937 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:42:51.296121 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c33f017d-b252-4c87-8df7-3a966c34b937 None admin] RBAC: Authorization granted {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:42:51.310220 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 224/449] 10.222.0.84 () {56 vars in 1099 bytes} [Wed May 25 14:42:51 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:42:51.311818 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c33f017d-b252-4c87-8df7-3a966c34b937 None admin] Authenticating user token {{(pid=101892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:42:51.392826 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40b64d79-ddf7-4ded-8e79-e3c9366d2feb None admin] Validating token access rules against request {{(pid=101893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:42:51.439368 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e11375a8-26f2-44fe-bf20-1144e9a50fd8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:42:51.439643 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c33f017d-b252-4c87-8df7-3a966c34b937 None admin] Validating token access rules against request {{(pid=101892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:42:51.440270 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11375a8-26f2-44fe-bf20-1144e9a50fd8 None admin] REQUEST_METHOD: `GET` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:42:51.440553 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11375a8-26f2-44fe-bf20-1144e9a50fd8 None admin] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:42:51.443550 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11375a8-26f2-44fe-bf20-1144e9a50fd8 None admin] PATH_INFO: `/v3/groups/ea8743b893f94df9bc571308c507b491` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:42:51.443550 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e11375a8-26f2-44fe-bf20-1144e9a50fd8 None admin] RBAC: Authorizing `identity:get_group(group_id=ea8743b893f94df9bc571308c507b491)` {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:42:51.443550 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e11375a8-26f2-44fe-bf20-1144e9a50fd8 None admin] RBAC: Authorization granted {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:42:51.445643 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 226/450] 10.222.0.84 () {56 vars in 1180 bytes} [Wed May 25 14:42:51 2022] GET /identity/v3/groups/ea8743b893f94df9bc571308c507b491 => generated 226 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:42:51.450917 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e11375a8-26f2-44fe-bf20-1144e9a50fd8 None admin] Authenticating user token {{(pid=101893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:42:51.486350 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6386533f-44d2-43ac-8dd4-f945cbe9d95b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:42:51.487008 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6386533f-44d2-43ac-8dd4-f945cbe9d95b None admin] REQUEST_METHOD: `GET` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:42:51.487293 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6386533f-44d2-43ac-8dd4-f945cbe9d95b None admin] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:42:51.487600 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6386533f-44d2-43ac-8dd4-f945cbe9d95b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:42:51.529287 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG dbcounter [-] [101893] Writing DB stats keystone:SELECT=100 {{(pid=101893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:42:51.537029 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG dbcounter [-] [101892] Writing DB stats keystone:SELECT=100 {{(pid=101892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:42:51.561157 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6386533f-44d2-43ac-8dd4-f945cbe9d95b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:42:51.562618 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6386533f-44d2-43ac-8dd4-f945cbe9d95b None admin] RBAC: Authorization granted {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:42:51.564252 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e11375a8-26f2-44fe-bf20-1144e9a50fd8 None admin] Validating token access rules against request {{(pid=101893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:42:51.598294 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a454420e-7058-4a19-9d24-df9973499de8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:42:51.598952 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a454420e-7058-4a19-9d24-df9973499de8 None admin] REQUEST_METHOD: `GET` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:42:51.599240 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a454420e-7058-4a19-9d24-df9973499de8 None admin] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:42:51.599519 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a454420e-7058-4a19-9d24-df9973499de8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:42:51.600382 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a454420e-7058-4a19-9d24-df9973499de8 None admin] RBAC: Adding query filter params (group.id=ea8743b893f94df9bc571308c507b491, role.id=d3defd94f93b4e76af116df691240185, scope.project.id=ac9e4da865b34de49eecd54e4f6f34e6) {{(pid=101893) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:42:51.600702 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a454420e-7058-4a19-9d24-df9973499de8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:42:51.602824 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a454420e-7058-4a19-9d24-df9973499de8 None admin] RBAC: Authorization granted {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:42:51.608678 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 227/451] 10.222.0.84 () {56 vars in 1376 bytes} [Wed May 25 14:42:51 2022] GET /identity/v3/role_assignments?group.id=ea8743b893f94df9bc571308c507b491&scope.project.id=ac9e4da865b34de49eecd54e4f6f34e6&role.id=d3defd94f93b4e76af116df691240185 => generated 611 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 14:42:51.670652 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 225/452] 10.222.0.84 () {58 vars in 1282 bytes} [Wed May 25 14:42:51 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 359 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 25 14:42:51.676378 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a454420e-7058-4a19-9d24-df9973499de8 None admin] Authenticating user token {{(pid=101893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:42:51.786081 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a454420e-7058-4a19-9d24-df9973499de8 None admin] Validating token access rules against request {{(pid=101893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:42:51.815930 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG dbcounter [-] [101893] Writing DB stats keystone:SELECT=100 {{(pid=101893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:42:51.822442 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aa249bf-ba17-40a6-9ba9-204fec392562 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:42:51.823306 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa249bf-ba17-40a6-9ba9-204fec392562 None admin] REQUEST_METHOD: `GET` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:42:51.823639 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa249bf-ba17-40a6-9ba9-204fec392562 None admin] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:42:51.823916 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa249bf-ba17-40a6-9ba9-204fec392562 None admin] PATH_INFO: `/v3/projects/cec56f74b2fa4826a506dc7b919465be` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:42:51.825098 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aa249bf-ba17-40a6-9ba9-204fec392562 None admin] RBAC: Authorizing `identity:get_project(project_id=cec56f74b2fa4826a506dc7b919465be)` {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:42:51.826543 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aa249bf-ba17-40a6-9ba9-204fec392562 None admin] RBAC: Authorization granted {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:42:51.828243 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 228/453] 10.222.0.84 () {56 vars in 1186 bytes} [Wed May 25 14:42:51 2022] GET /identity/v3/projects/cec56f74b2fa4826a506dc7b919465be => generated 344 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:42:51.833753 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6386533f-44d2-43ac-8dd4-f945cbe9d95b None admin] Authenticating user token {{(pid=101892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:42:51.917759 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG dbcounter [-] [101892] Writing DB stats keystone:SELECT=100 {{(pid=101892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:42:51.936257 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6386533f-44d2-43ac-8dd4-f945cbe9d95b None admin] Validating token access rules against request {{(pid=101892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:42:51.971429 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba055707-5543-4f9f-b4e5-2016d571ab05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:42:51.972371 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba055707-5543-4f9f-b4e5-2016d571ab05 None admin] REQUEST_METHOD: `GET` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:42:51.972652 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba055707-5543-4f9f-b4e5-2016d571ab05 None admin] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:42:51.972926 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba055707-5543-4f9f-b4e5-2016d571ab05 None admin] PATH_INFO: `/v3/groups/4cb4d13fb87e42f383c3be884bf229aa` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:42:51.974075 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba055707-5543-4f9f-b4e5-2016d571ab05 None admin] RBAC: Authorizing `identity:get_group(group_id=4cb4d13fb87e42f383c3be884bf229aa)` {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:42:51.975513 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba055707-5543-4f9f-b4e5-2016d571ab05 None admin] RBAC: Authorization granted {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:42:51.977177 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 226/454] 10.222.0.84 () {56 vars in 1180 bytes} [Wed May 25 14:42:51 2022] GET /identity/v3/groups/4cb4d13fb87e42f383c3be884bf229aa => generated 229 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:42:51.982970 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aa249bf-ba17-40a6-9ba9-204fec392562 None admin] Authenticating user token {{(pid=101893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:42:52.079037 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aa249bf-ba17-40a6-9ba9-204fec392562 None admin] Validating token access rules against request {{(pid=101893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:42:52.111321 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a720268-541b-4a32-bae8-6bda6af45c5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:42:52.111988 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a720268-541b-4a32-bae8-6bda6af45c5f None admin] REQUEST_METHOD: `GET` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:42:52.112272 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a720268-541b-4a32-bae8-6bda6af45c5f None admin] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:42:52.112547 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a720268-541b-4a32-bae8-6bda6af45c5f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:42:52.113358 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a720268-541b-4a32-bae8-6bda6af45c5f None admin] RBAC: Adding query filter params (group.id=4cb4d13fb87e42f383c3be884bf229aa, role.id=a3b78e7d547d4d2d998b4c99a4396bba, scope.project.id=cec56f74b2fa4826a506dc7b919465be) {{(pid=101893) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:42:52.113668 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a720268-541b-4a32-bae8-6bda6af45c5f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:42:52.115085 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a720268-541b-4a32-bae8-6bda6af45c5f None admin] RBAC: Authorization granted {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:42:52.121285 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 229/455] 10.222.0.84 () {56 vars in 1376 bytes} [Wed May 25 14:42:51 2022] GET /identity/v3/role_assignments?group.id=4cb4d13fb87e42f383c3be884bf229aa&scope.project.id=cec56f74b2fa4826a506dc7b919465be&role.id=a3b78e7d547d4d2d998b4c99a4396bba => generated 611 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:42:54.936620 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d59aad-7ddd-4a45-b5a4-98a947364c94 None None] REQUEST_METHOD: `GET` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:42:54.937141 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d59aad-7ddd-4a45-b5a4-98a947364c94 None None] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:42:54.937241 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d59aad-7ddd-4a45-b5a4-98a947364c94 None None] PATH_INFO: `/` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:42:54.938789 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 227/456] 10.222.0.84 () {54 vars in 926 bytes} [Wed May 25 14:42:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 14:42:54.944487 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d9910b-6eea-4f3f-bc8b-5869f7439bd4 None None] REQUEST_METHOD: `POST` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:42:54.945426 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d9910b-6eea-4f3f-bc8b-5869f7439bd4 None None] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:42:54.945628 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d9910b-6eea-4f3f-bc8b-5869f7439bd4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:42:54.968592 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.auth.core [None req-46d9910b-6eea-4f3f-bc8b-5869f7439bd4 None None] MFA Rules not processed for user `05d87e87798e429aa1c10b24391f915e`. Rule list: `[]` (Enabled: `True`). {{(pid=101893) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:42:54.969811 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.fernet_utils [None req-46d9910b-6eea-4f3f-bc8b-5869f7439bd4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=101893) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:42:55.046506 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG dbcounter [-] [101893] Writing DB stats keystone:SELECT=100 {{(pid=101893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:42:55.061970 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 230/457] 10.222.0.84 () {58 vars in 1023 bytes} [Wed May 25 14:42:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 25 14:42:55.103743 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d59aad-7ddd-4a45-b5a4-98a947364c94 None None] Authenticating user token {{(pid=101892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:42:55.143800 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2249439f-467e-4f86-ae86-7e76d7935024 None None] REQUEST_METHOD: `GET` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:42:55.144559 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2249439f-467e-4f86-ae86-7e76d7935024 None None] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:42:55.145047 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2249439f-467e-4f86-ae86-7e76d7935024 None None] PATH_INFO: `/` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:42:55.146984 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 231/458] 10.222.0.84 () {54 vars in 926 bytes} [Wed May 25 14:42:55 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 14:42:55.153693 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ec0ca9-79bf-4fbf-a931-69b035bcba47 None None] REQUEST_METHOD: `POST` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:42:55.154273 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ec0ca9-79bf-4fbf-a931-69b035bcba47 None None] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:42:55.154747 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ec0ca9-79bf-4fbf-a931-69b035bcba47 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:42:55.192776 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.auth.core [None req-b8ec0ca9-79bf-4fbf-a931-69b035bcba47 None None] MFA Rules not processed for user `05d87e87798e429aa1c10b24391f915e`. Rule list: `[]` (Enabled: `True`). {{(pid=101893) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:42:55.194410 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.fernet_utils [None req-b8ec0ca9-79bf-4fbf-a931-69b035bcba47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=101893) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:42:55.225482 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d59aad-7ddd-4a45-b5a4-98a947364c94 None None] Validating token access rules against request {{(pid=101892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:42:55.294114 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dddf9b50-96a7-49ea-ade3-9cd746b26ef3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:42:55.294936 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dddf9b50-96a7-49ea-ade3-9cd746b26ef3 None admin] REQUEST_METHOD: `GET` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:42:55.295220 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dddf9b50-96a7-49ea-ade3-9cd746b26ef3 None admin] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:42:55.295495 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dddf9b50-96a7-49ea-ade3-9cd746b26ef3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:42:55.319457 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dddf9b50-96a7-49ea-ade3-9cd746b26ef3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:42:55.322772 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dddf9b50-96a7-49ea-ade3-9cd746b26ef3 None admin] RBAC: Authorization granted {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:42:55.332184 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG dbcounter [-] [101892] Writing DB stats keystone:SELECT=100 {{(pid=101892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:42:55.336715 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 232/459] 10.222.0.84 () {58 vars in 1023 bytes} [Wed May 25 14:42:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 25 14:42:55.338176 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83de99ed-bcba-48b8-a166-5b6abed973d8 None None] REQUEST_METHOD: `GET` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:42:55.338510 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83de99ed-bcba-48b8-a166-5b6abed973d8 None None] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:42:55.338753 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83de99ed-bcba-48b8-a166-5b6abed973d8 None None] PATH_INFO: `/` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:42:55.340381 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 233/460] 10.222.0.84 () {54 vars in 926 bytes} [Wed May 25 14:42:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 14:42:55.342434 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application [None req-dddf9b50-96a7-49ea-ade3-9cd746b26ef3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 25 14:42:55.342434 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:42:55.342434 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 14:42:55.342434 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 14:42:55.342434 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 14:42:55.342434 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 14:42:55.342434 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 14:42:55.342434 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 14:42:55.342434 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 14:42:55.342434 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 14:42:55.342434 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 14:42:55.342434 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 14:42:55.342434 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 25 14:42:55.342434 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 25 14:42:55.342434 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 25 14:42:55.343262 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 25 14:42:55.343262 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 14:42:55.343262 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 14:42:55.343262 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 14:42:55.343262 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 14:42:55.343262 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 14:42:55.343262 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application return self.get_or_create( May 25 14:42:55.343262 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 14:42:55.343262 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application with Lock( May 25 14:42:55.343262 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 14:42:55.343262 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application return self._enter() May 25 14:42:55.343262 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 14:42:55.343262 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 14:42:55.343262 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 14:42:55.343262 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application return self.creator() May 25 14:42:55.343262 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 14:42:55.343262 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application created_value = creator( May 25 14:42:55.344169 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 25 14:42:55.344169 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 25 14:42:55.344169 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 25 14:42:55.344169 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application May 25 14:42:55.344169 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 228/461] 10.222.0.84 () {56 vars in 1108 bytes} [Wed May 25 14:42:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 241 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 14:42:55.345724 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6ab690-c4c9-4ca3-9001-0f7703872762 None None] REQUEST_METHOD: `POST` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:42:55.346018 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6ab690-c4c9-4ca3-9001-0f7703872762 None None] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:42:55.346301 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6ab690-c4c9-4ca3-9001-0f7703872762 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:42:55.349380 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dddf9b50-96a7-49ea-ade3-9cd746b26ef3 None admin] Authenticating user token {{(pid=101892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:42:55.373285 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.auth.core [None req-ef6ab690-c4c9-4ca3-9001-0f7703872762 None None] MFA Rules not processed for user `05d87e87798e429aa1c10b24391f915e`. Rule list: `[]` (Enabled: `True`). {{(pid=101893) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:42:55.374739 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.fernet_utils [None req-ef6ab690-c4c9-4ca3-9001-0f7703872762 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=101893) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:42:55.455661 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 234/462] 10.222.0.84 () {58 vars in 1023 bytes} [Wed May 25 14:42:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 25 14:42:55.455661 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef6ab690-c4c9-4ca3-9001-0f7703872762 None None] Authenticating user token {{(pid=101893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:42:55.494280 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dddf9b50-96a7-49ea-ade3-9cd746b26ef3 None admin] Validating token access rules against request {{(pid=101892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:42:55.505501 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG dbcounter [-] [101893] Writing DB stats keystone:SELECT=100 {{(pid=101893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:42:55.533651 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b22f38-8acf-4e50-9f0a-b502b43db75e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:42:55.534009 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b22f38-8acf-4e50-9f0a-b502b43db75e None admin] REQUEST_METHOD: `GET` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:42:55.534295 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b22f38-8acf-4e50-9f0a-b502b43db75e None admin] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:42:55.534570 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b22f38-8acf-4e50-9f0a-b502b43db75e None admin] PATH_INFO: `/v3/domains` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:42:55.535302 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7b22f38-8acf-4e50-9f0a-b502b43db75e None admin] RBAC: Adding query filter params (name=Default) {{(pid=101892) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:42:55.535630 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7b22f38-8acf-4e50-9f0a-b502b43db75e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:42:55.537006 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7b22f38-8acf-4e50-9f0a-b502b43db75e None admin] RBAC: Authorization granted {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:42:55.551032 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 229/463] 10.222.0.84 () {56 vars in 1109 bytes} [Wed May 25 14:42:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 14:42:55.551032 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3dc1c45-2059-4231-8967-c0a0c2f76052 None None] REQUEST_METHOD: `GET` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:42:55.551032 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3dc1c45-2059-4231-8967-c0a0c2f76052 None None] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:42:55.551032 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3dc1c45-2059-4231-8967-c0a0c2f76052 None None] PATH_INFO: `/` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:42:55.553637 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 230/464] 10.222.0.84 () {54 vars in 926 bytes} [Wed May 25 14:42:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 14:42:55.553637 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3dc1c45-2059-4231-8967-c0a0c2f76052 None None] Authenticating user token {{(pid=101892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:42:55.568470 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef6ab690-c4c9-4ca3-9001-0f7703872762 None None] Validating token access rules against request {{(pid=101893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:42:55.604562 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33ad8876-e703-479f-982e-66723bb27486 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:42:55.605362 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ad8876-e703-479f-982e-66723bb27486 None admin] REQUEST_METHOD: `GET` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:42:55.605643 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ad8876-e703-479f-982e-66723bb27486 None admin] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:42:55.606152 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ad8876-e703-479f-982e-66723bb27486 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:42:55.617089 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33ad8876-e703-479f-982e-66723bb27486 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:42:55.618575 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33ad8876-e703-479f-982e-66723bb27486 None admin] RBAC: Authorization granted {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:42:55.620051 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG dbcounter [-] [101892] Writing DB stats keystone:SELECT=100 {{(pid=101892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:42:55.639022 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application [None req-33ad8876-e703-479f-982e-66723bb27486 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 25 14:42:55.639022 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:42:55.639022 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 14:42:55.639022 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 14:42:55.639022 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 14:42:55.639022 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 14:42:55.639022 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 14:42:55.639022 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 14:42:55.639022 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 14:42:55.639022 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 14:42:55.639022 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 14:42:55.639022 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 14:42:55.639022 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 25 14:42:55.639022 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 25 14:42:55.639022 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 25 14:42:55.639986 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 25 14:42:55.639986 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 14:42:55.639986 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 14:42:55.639986 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 14:42:55.639986 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 14:42:55.639986 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 14:42:55.639986 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return self.get_or_create( May 25 14:42:55.639986 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 14:42:55.639986 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application with Lock( May 25 14:42:55.639986 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 14:42:55.639986 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return self._enter() May 25 14:42:55.639986 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 14:42:55.639986 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 14:42:55.639986 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 14:42:55.639986 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return self.creator() May 25 14:42:55.639986 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 14:42:55.639986 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application created_value = creator( May 25 14:42:55.640859 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 25 14:42:55.640859 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 25 14:42:55.640859 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 25 14:42:55.640859 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application May 25 14:42:55.640859 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 235/465] 10.222.0.84 () {56 vars in 1108 bytes} [Wed May 25 14:42:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 14:42:55.641135 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33ad8876-e703-479f-982e-66723bb27486 None admin] Authenticating user token {{(pid=101893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:42:55.670841 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3dc1c45-2059-4231-8967-c0a0c2f76052 None None] Validating token access rules against request {{(pid=101892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:42:55.709814 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f008a8b-d072-45d4-92e4-417b57a95c1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:42:55.710901 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f008a8b-d072-45d4-92e4-417b57a95c1d None admin] REQUEST_METHOD: `GET` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:42:55.711011 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f008a8b-d072-45d4-92e4-417b57a95c1d None admin] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:42:55.711208 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f008a8b-d072-45d4-92e4-417b57a95c1d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:42:55.722649 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f008a8b-d072-45d4-92e4-417b57a95c1d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:42:55.724160 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f008a8b-d072-45d4-92e4-417b57a95c1d None admin] RBAC: Authorization granted {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:42:55.743247 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application [None req-3f008a8b-d072-45d4-92e4-417b57a95c1d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 25 14:42:55.743247 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:42:55.743247 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 14:42:55.743247 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 14:42:55.743247 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 14:42:55.743247 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 14:42:55.743247 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 14:42:55.743247 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 14:42:55.743247 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 14:42:55.743247 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 14:42:55.743247 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 14:42:55.743247 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 14:42:55.743247 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 25 14:42:55.743247 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 25 14:42:55.743247 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 25 14:42:55.744129 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 25 14:42:55.744129 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 14:42:55.744129 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 14:42:55.744129 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 14:42:55.744129 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 14:42:55.744129 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 14:42:55.744129 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application return self.get_or_create( May 25 14:42:55.744129 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 14:42:55.744129 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application with Lock( May 25 14:42:55.744129 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 14:42:55.744129 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application return self._enter() May 25 14:42:55.744129 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 14:42:55.744129 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 14:42:55.744129 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 14:42:55.744129 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application return self.creator() May 25 14:42:55.744129 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 14:42:55.744129 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application created_value = creator( May 25 14:42:55.744984 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 25 14:42:55.744984 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 25 14:42:55.744984 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 25 14:42:55.744984 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application May 25 14:42:55.744984 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 231/466] 10.222.0.84 () {56 vars in 1108 bytes} [Wed May 25 14:42:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 14:42:55.745784 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708143a0-e036-471d-b767-8896d917f60e None None] REQUEST_METHOD: `POST` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:42:55.745972 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708143a0-e036-471d-b767-8896d917f60e None None] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:42:55.746260 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708143a0-e036-471d-b767-8896d917f60e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:42:55.751462 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33ad8876-e703-479f-982e-66723bb27486 None admin] Validating token access rules against request {{(pid=101893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:42:55.754719 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG dbcounter [-] [101893] Writing DB stats keystone:SELECT=100 {{(pid=101893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:42:55.767949 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.auth.core [None req-708143a0-e036-471d-b767-8896d917f60e None None] MFA Rules not processed for user `05d87e87798e429aa1c10b24391f915e`. Rule list: `[]` (Enabled: `True`). {{(pid=101892) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:42:55.769176 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.fernet_utils [None req-708143a0-e036-471d-b767-8896d917f60e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=101892) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:42:55.800631 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d5f0103-7879-43e2-b563-d14e079b3ef1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:42:55.801325 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5f0103-7879-43e2-b563-d14e079b3ef1 None admin] REQUEST_METHOD: `POST` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:42:55.801610 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5f0103-7879-43e2-b563-d14e079b3ef1 None admin] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:42:55.801889 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5f0103-7879-43e2-b563-d14e079b3ef1 None admin] PATH_INFO: `/v3/users` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:42:55.802627 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d5f0103-7879-43e2-b563-d14e079b3ef1 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:42:55.804935 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d5f0103-7879-43e2-b563-d14e079b3ef1 None admin] RBAC: Authorization granted {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:42:55.846379 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 232/467] 10.222.0.84 () {58 vars in 1023 bytes} [Wed May 25 14:42:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 25 14:42:55.847144 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-708143a0-e036-471d-b767-8896d917f60e None None] Authenticating user token {{(pid=101892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:42:55.880301 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 236/468] 10.222.0.84 () {60 vars in 1132 bytes} [Wed May 25 14:42:55 2022] POST /identity/v3/users => generated 246 bytes in 239 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 14:42:55.881440 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d5f0103-7879-43e2-b563-d14e079b3ef1 None admin] Authenticating user token {{(pid=101893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:42:55.899936 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG dbcounter [-] [101892] Writing DB stats keystone:SELECT=100 {{(pid=101892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:42:55.973471 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-708143a0-e036-471d-b767-8896d917f60e None None] Validating token access rules against request {{(pid=101892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:42:56.016554 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56d47aaf-f8cb-48d9-acdc-8b88ba1fabe4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:42:56.017239 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d47aaf-f8cb-48d9-acdc-8b88ba1fabe4 None admin] REQUEST_METHOD: `GET` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:42:56.017524 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d47aaf-f8cb-48d9-acdc-8b88ba1fabe4 None admin] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:42:56.017835 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d47aaf-f8cb-48d9-acdc-8b88ba1fabe4 None admin] PATH_INFO: `/v3/domains` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:42:56.018541 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56d47aaf-f8cb-48d9-acdc-8b88ba1fabe4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=101892) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:42:56.018849 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56d47aaf-f8cb-48d9-acdc-8b88ba1fabe4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:42:56.020293 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56d47aaf-f8cb-48d9-acdc-8b88ba1fabe4 None admin] RBAC: Authorization granted {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:42:56.033551 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 233/469] 10.222.0.84 () {56 vars in 1109 bytes} [Wed May 25 14:42:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:42:56.034468 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56d47aaf-f8cb-48d9-acdc-8b88ba1fabe4 None admin] Authenticating user token {{(pid=101892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:42:56.040802 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d5f0103-7879-43e2-b563-d14e079b3ef1 None admin] Validating token access rules against request {{(pid=101893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:42:56.079758 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cd06a69-b12c-44de-86f3-ea3f643185ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:42:56.080468 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd06a69-b12c-44de-86f3-ea3f643185ba None admin] REQUEST_METHOD: `GET` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:42:56.080759 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd06a69-b12c-44de-86f3-ea3f643185ba None admin] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:42:56.081045 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd06a69-b12c-44de-86f3-ea3f643185ba None admin] PATH_INFO: `/v3/domains` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:42:56.081772 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cd06a69-b12c-44de-86f3-ea3f643185ba None admin] RBAC: Adding query filter params (name=Default) {{(pid=101893) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:42:56.082655 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cd06a69-b12c-44de-86f3-ea3f643185ba None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:42:56.083510 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cd06a69-b12c-44de-86f3-ea3f643185ba None admin] RBAC: Authorization granted {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:42:56.102897 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 237/470] 10.222.0.84 () {56 vars in 1109 bytes} [Wed May 25 14:42:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:42:56.104703 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea2cb25-b92b-4001-9a11-47b16d958191 None None] REQUEST_METHOD: `GET` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:42:56.105194 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea2cb25-b92b-4001-9a11-47b16d958191 None None] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:42:56.105743 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea2cb25-b92b-4001-9a11-47b16d958191 None None] PATH_INFO: `/` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:42:56.107273 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 238/471] 10.222.0.84 () {54 vars in 926 bytes} [Wed May 25 14:42:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 14:42:56.108181 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eea2cb25-b92b-4001-9a11-47b16d958191 None None] Authenticating user token {{(pid=101893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:42:56.134211 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG dbcounter [-] [101893] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=101893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:42:56.149309 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56d47aaf-f8cb-48d9-acdc-8b88ba1fabe4 None admin] Validating token access rules against request {{(pid=101892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:42:56.150992 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG dbcounter [-] [101892] Writing DB stats keystone:SELECT=100 {{(pid=101892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:42:56.184208 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25b021a4-35b8-4058-a1ee-1c7fe3953d0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:42:56.185137 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b021a4-35b8-4058-a1ee-1c7fe3953d0b None admin] REQUEST_METHOD: `GET` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:42:56.185421 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b021a4-35b8-4058-a1ee-1c7fe3953d0b None admin] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:42:56.185712 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b021a4-35b8-4058-a1ee-1c7fe3953d0b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:42:56.196324 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25b021a4-35b8-4058-a1ee-1c7fe3953d0b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:42:56.199452 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25b021a4-35b8-4058-a1ee-1c7fe3953d0b None admin] RBAC: Authorization granted {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:42:56.217797 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application [None req-25b021a4-35b8-4058-a1ee-1c7fe3953d0b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 25 14:42:56.217797 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:42:56.217797 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 14:42:56.217797 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 14:42:56.217797 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 14:42:56.217797 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 14:42:56.217797 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 14:42:56.217797 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 14:42:56.217797 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 14:42:56.217797 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 14:42:56.217797 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 14:42:56.217797 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 14:42:56.217797 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 25 14:42:56.217797 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 25 14:42:56.217797 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 25 14:42:56.218778 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 25 14:42:56.218778 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 14:42:56.218778 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 14:42:56.218778 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 14:42:56.218778 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 14:42:56.218778 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 14:42:56.218778 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application return self.get_or_create( May 25 14:42:56.218778 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 14:42:56.218778 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application with Lock( May 25 14:42:56.218778 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 14:42:56.218778 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application return self._enter() May 25 14:42:56.218778 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 14:42:56.218778 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 14:42:56.218778 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 14:42:56.218778 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application return self.creator() May 25 14:42:56.218778 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 14:42:56.218778 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application created_value = creator( May 25 14:42:56.219679 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 25 14:42:56.219679 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 25 14:42:56.219679 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 25 14:42:56.219679 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application May 25 14:42:56.225771 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 234/472] 10.222.0.84 () {56 vars in 1108 bytes} [Wed May 25 14:42:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 14:42:56.225771 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25b021a4-35b8-4058-a1ee-1c7fe3953d0b None admin] Authenticating user token {{(pid=101892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:42:56.231263 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eea2cb25-b92b-4001-9a11-47b16d958191 None None] Validating token access rules against request {{(pid=101893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:42:56.267526 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99adc42b-1e00-4753-95f0-bab00ac18681 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:42:56.268528 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99adc42b-1e00-4753-95f0-bab00ac18681 None admin] REQUEST_METHOD: `POST` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:42:56.268861 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99adc42b-1e00-4753-95f0-bab00ac18681 None admin] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:42:56.269143 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99adc42b-1e00-4753-95f0-bab00ac18681 None admin] PATH_INFO: `/v3/users` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:42:56.269845 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99adc42b-1e00-4753-95f0-bab00ac18681 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:42:56.271352 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99adc42b-1e00-4753-95f0-bab00ac18681 None admin] RBAC: Authorization granted {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:42:56.326455 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25b021a4-35b8-4058-a1ee-1c7fe3953d0b None admin] Validating token access rules against request {{(pid=101892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:42:56.359778 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b01f2911-e08d-414e-97e5-de9406f142fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:42:56.360441 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01f2911-e08d-414e-97e5-de9406f142fe None admin] REQUEST_METHOD: `POST` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:42:56.360726 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01f2911-e08d-414e-97e5-de9406f142fe None admin] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:42:56.361002 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01f2911-e08d-414e-97e5-de9406f142fe None admin] PATH_INFO: `/v3/users` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:42:56.361704 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b01f2911-e08d-414e-97e5-de9406f142fe None admin] RBAC: Authorizing `identity:create_user()` {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:42:56.363168 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b01f2911-e08d-414e-97e5-de9406f142fe None admin] RBAC: Authorization granted {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:42:56.385451 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 239/473] 10.222.0.84 () {60 vars in 1132 bytes} [Wed May 25 14:42:56 2022] POST /identity/v3/users => generated 248 bytes in 277 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 14:42:56.386721 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e9028d-501d-41e2-b670-96002c7475ef None None] REQUEST_METHOD: `POST` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:42:56.387013 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e9028d-501d-41e2-b670-96002c7475ef None None] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:42:56.387292 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e9028d-501d-41e2-b670-96002c7475ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:42:56.406841 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.auth.core [None req-75e9028d-501d-41e2-b670-96002c7475ef None None] MFA Rules not processed for user `05d87e87798e429aa1c10b24391f915e`. Rule list: `[]` (Enabled: `True`). {{(pid=101893) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:42:56.408187 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.fernet_utils [None req-75e9028d-501d-41e2-b670-96002c7475ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=101893) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:42:56.472454 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 235/474] 10.222.0.84 () {60 vars in 1132 bytes} [Wed May 25 14:42:56 2022] POST /identity/v3/users => generated 248 bytes in 250 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 14:42:56.472454 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b01f2911-e08d-414e-97e5-de9406f142fe None admin] Authenticating user token {{(pid=101892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:42:56.502062 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG dbcounter [-] [101892] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=101892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:42:56.532158 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 240/475] 10.222.0.84 () {58 vars in 1023 bytes} [Wed May 25 14:42:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 25 14:42:56.562519 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75e9028d-501d-41e2-b670-96002c7475ef None None] Authenticating user token {{(pid=101893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:42:56.573166 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG dbcounter [-] [101893] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=101893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:42:56.668241 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b01f2911-e08d-414e-97e5-de9406f142fe None admin] Validating token access rules against request {{(pid=101892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:42:56.718583 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e51ece51-c305-4e3f-9910-8cdf49c64815 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:42:56.719248 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51ece51-c305-4e3f-9910-8cdf49c64815 None admin] REQUEST_METHOD: `GET` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:42:56.719528 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51ece51-c305-4e3f-9910-8cdf49c64815 None admin] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:42:56.719976 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51ece51-c305-4e3f-9910-8cdf49c64815 None admin] PATH_INFO: `/v3/domains` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:42:56.720714 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e51ece51-c305-4e3f-9910-8cdf49c64815 None admin] RBAC: Adding query filter params (name=Default) {{(pid=101892) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:42:56.721047 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e51ece51-c305-4e3f-9910-8cdf49c64815 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:42:56.722383 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e51ece51-c305-4e3f-9910-8cdf49c64815 None admin] RBAC: Authorization granted {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:42:56.735741 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75e9028d-501d-41e2-b670-96002c7475ef None None] Validating token access rules against request {{(pid=101893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:42:56.739961 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 236/476] 10.222.0.84 () {56 vars in 1109 bytes} [Wed May 25 14:42:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 268 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:42:56.748709 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e51ece51-c305-4e3f-9910-8cdf49c64815 None admin] Authenticating user token {{(pid=101892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:42:56.786223 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71d7d95f-bf4d-4157-b6f6-2cf1e100b234 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:42:56.786223 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d7d95f-bf4d-4157-b6f6-2cf1e100b234 None admin] REQUEST_METHOD: `POST` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:42:56.786480 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d7d95f-bf4d-4157-b6f6-2cf1e100b234 None admin] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:42:56.786642 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d7d95f-bf4d-4157-b6f6-2cf1e100b234 None admin] PATH_INFO: `/v3/roles` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:42:56.787839 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71d7d95f-bf4d-4157-b6f6-2cf1e100b234 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:42:56.789709 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71d7d95f-bf4d-4157-b6f6-2cf1e100b234 None admin] RBAC: Authorization granted {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:42:56.825792 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.sql.core [None req-71d7d95f-bf4d-4157-b6f6-2cf1e100b234 None admin] Conflict role: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") May 25 14:42:56.825792 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] May 25 14:42:56.825792 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [parameters: {'id': '34a97d1f2fd84f1fa1b1b8c7ece48c9f', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] May 25 14:42:56.825792 dv-cinder-803823-9-smb devstack@keystone.service[101893]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=101893) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} May 25 14:42:56.831692 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG dbcounter [-] [101892] Writing DB stats keystone:SELECT=100 {{(pid=101892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:42:56.849296 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application [None req-71d7d95f-bf4d-4157-b6f6-2cf1e100b234 None admin] Conflict occurred attempting to store role - Duplicate entry found with name anotherrole.: keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. May 25 14:42:56.849296 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:42:56.849296 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context May 25 14:42:56.849296 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application self.dialect.do_execute( May 25 14:42:56.849296 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute May 25 14:42:56.849296 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) May 25 14:42:56.849296 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute May 25 14:42:56.849296 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application result = self._query(query) May 25 14:42:56.849296 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query May 25 14:42:56.849296 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application conn.query(q) May 25 14:42:56.849296 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query May 25 14:42:56.849296 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) May 25 14:42:56.849296 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result May 25 14:42:56.849296 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application result.read() May 25 14:42:56.849296 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read May 25 14:42:56.850240 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() May 25 14:42:56.850240 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet May 25 14:42:56.850240 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application packet.raise_for_error() May 25 14:42:56.850240 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error May 25 14:42:56.850240 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) May 25 14:42:56.850240 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception May 25 14:42:56.850240 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application raise errorclass(errno, errval) May 25 14:42:56.850240 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") May 25 14:42:56.850240 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application May 25 14:42:56.850240 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: May 25 14:42:56.850240 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application May 25 14:42:56.850240 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:42:56.850240 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper May 25 14:42:56.850240 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return method(*args, **kwargs) May 25 14:42:56.850240 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 33, in create_role May 25 14:42:56.850240 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return ref.to_dict() May 25 14:42:56.850240 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ May 25 14:42:56.850240 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application next(self.gen) May 25 14:42:56.852294 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope May 25 14:42:56.852294 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application yield resource May 25 14:42:56.852294 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ May 25 14:42:56.852294 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application next(self.gen) May 25 14:42:56.852294 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session May 25 14:42:56.852294 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application self.session.rollback() May 25 14:42:56.852294 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ May 25 14:42:56.852294 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application self.force_reraise() May 25 14:42:56.852294 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise May 25 14:42:56.852294 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application raise self.value May 25 14:42:56.852294 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session May 25 14:42:56.852294 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) May 25 14:42:56.852294 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction May 25 14:42:56.852294 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application session.commit() May 25 14:42:56.852294 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1435, in commit May 25 14:42:56.852294 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) May 25 14:42:56.852294 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit May 25 14:42:56.853464 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application self._prepare_impl() May 25 14:42:56.853464 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl May 25 14:42:56.853464 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application self.session.flush() May 25 14:42:56.853464 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3367, in flush May 25 14:42:56.853464 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application self._flush(objects) May 25 14:42:56.853464 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3507, in _flush May 25 14:42:56.853464 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) May 25 14:42:56.853464 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ May 25 14:42:56.853464 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application compat.raise_( May 25 14:42:56.853464 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ May 25 14:42:56.853464 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application raise exception May 25 14:42:56.853464 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3467, in _flush May 25 14:42:56.853464 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application flush_context.execute() May 25 14:42:56.853464 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute May 25 14:42:56.853464 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application rec.execute(self) May 25 14:42:56.853464 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute May 25 14:42:56.853464 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( May 25 14:42:56.854549 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj May 25 14:42:56.854549 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application _emit_insert_statements( May 25 14:42:56.854549 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements May 25 14:42:56.854549 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application c = connection._execute_20( May 25 14:42:56.854549 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 May 25 14:42:56.854549 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) May 25 14:42:56.854549 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 325, in _execute_on_connection May 25 14:42:56.854549 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return connection._execute_clauseelement( May 25 14:42:56.854549 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement May 25 14:42:56.854549 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application ret = self._execute_context( May 25 14:42:56.854549 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context May 25 14:42:56.854549 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application self._handle_dbapi_exception( May 25 14:42:56.854549 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception May 25 14:42:56.854549 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) May 25 14:42:56.854549 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ May 25 14:42:56.854549 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application raise exception May 25 14:42:56.855616 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context May 25 14:42:56.855616 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application self.dialect.do_execute( May 25 14:42:56.855616 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute May 25 14:42:56.855616 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) May 25 14:42:56.855616 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute May 25 14:42:56.855616 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application result = self._query(query) May 25 14:42:56.855616 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query May 25 14:42:56.855616 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application conn.query(q) May 25 14:42:56.855616 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query May 25 14:42:56.855616 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) May 25 14:42:56.855616 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result May 25 14:42:56.855616 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application result.read() May 25 14:42:56.855616 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read May 25 14:42:56.855616 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() May 25 14:42:56.855616 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet May 25 14:42:56.855616 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application packet.raise_for_error() May 25 14:42:56.856605 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error May 25 14:42:56.856605 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) May 25 14:42:56.856605 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception May 25 14:42:56.856605 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application raise errorclass(errno, errval) May 25 14:42:56.856605 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") May 25 14:42:56.856605 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] May 25 14:42:56.856605 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application [parameters: {'id': '34a97d1f2fd84f1fa1b1b8c7ece48c9f', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] May 25 14:42:56.856605 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) May 25 14:42:56.856605 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application May 25 14:42:56.856605 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 25 14:42:56.856605 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application May 25 14:42:56.856605 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:42:56.856605 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 14:42:56.856605 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 14:42:56.856605 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 14:42:56.856605 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 14:42:56.860575 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 14:42:56.860575 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 14:42:56.860575 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 14:42:56.860575 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 14:42:56.860575 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 14:42:56.860575 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 14:42:56.860575 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 115, in post May 25 14:42:56.860575 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application ref = PROVIDERS.role_api.create_role( May 25 14:42:56.860575 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 14:42:56.860575 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 14:42:56.860575 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1298, in create_role May 25 14:42:56.860575 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application ret = self.driver.create_role(role_id, role) May 25 14:42:56.860575 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper May 25 14:42:56.860575 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, May 25 14:42:56.860575 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. May 25 14:42:56.860575 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application May 25 14:42:56.861402 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 241/477] 10.222.0.84 () {60 vars in 1131 bytes} [Wed May 25 14:42:56 2022] POST /identity/v3/roles => generated 144 bytes in 289 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) May 25 14:42:56.863758 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71d7d95f-bf4d-4157-b6f6-2cf1e100b234 None admin] Authenticating user token {{(pid=101893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:42:56.872819 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e51ece51-c305-4e3f-9910-8cdf49c64815 None admin] Validating token access rules against request {{(pid=101892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:42:56.917322 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf81fea2-bbc3-4850-954a-32c3aa7862a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:42:56.917993 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf81fea2-bbc3-4850-954a-32c3aa7862a2 None admin] REQUEST_METHOD: `POST` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:42:56.918274 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf81fea2-bbc3-4850-954a-32c3aa7862a2 None admin] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:42:56.924594 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf81fea2-bbc3-4850-954a-32c3aa7862a2 None admin] PATH_INFO: `/v3/users` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:42:56.924594 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf81fea2-bbc3-4850-954a-32c3aa7862a2 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:42:56.924594 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf81fea2-bbc3-4850-954a-32c3aa7862a2 None admin] RBAC: Authorization granted {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:42:56.955961 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG dbcounter [-] [101893] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=101893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:42:56.989082 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71d7d95f-bf4d-4157-b6f6-2cf1e100b234 None admin] Validating token access rules against request {{(pid=101893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:42:57.026664 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21183e25-b9f6-47ee-88a0-760912d68c88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:42:57.027631 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21183e25-b9f6-47ee-88a0-760912d68c88 None admin] REQUEST_METHOD: `GET` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:42:57.027871 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21183e25-b9f6-47ee-88a0-760912d68c88 None admin] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:42:57.028148 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21183e25-b9f6-47ee-88a0-760912d68c88 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:42:57.040866 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21183e25-b9f6-47ee-88a0-760912d68c88 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 14:42:57.043210 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 237/478] 10.222.0.84 () {60 vars in 1132 bytes} [Wed May 25 14:42:56 2022] POST /identity/v3/users => generated 249 bytes in 295 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 14:42:57.049971 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application [None req-21183e25-b9f6-47ee-88a0-760912d68c88 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 25 14:42:57.049971 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:42:57.049971 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 14:42:57.049971 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 14:42:57.049971 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 14:42:57.049971 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 14:42:57.049971 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 14:42:57.049971 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 14:42:57.049971 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 14:42:57.049971 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 14:42:57.049971 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 14:42:57.049971 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 14:42:57.049971 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 14:42:57.049971 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 14:42:57.049971 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 14:42:57.049971 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 14:42:57.054924 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 14:42:57.054924 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 14:42:57.054924 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 14:42:57.054924 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 14:42:57.054924 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 14:42:57.054924 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 14:42:57.054924 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 14:42:57.054924 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 14:42:57.054924 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 14:42:57.054924 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return self.get_or_create( May 25 14:42:57.054924 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 14:42:57.054924 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application with Lock( May 25 14:42:57.054924 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 14:42:57.054924 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return self._enter() May 25 14:42:57.054924 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 14:42:57.054924 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 14:42:57.056044 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 14:42:57.056044 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return self.creator() May 25 14:42:57.056044 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 14:42:57.056044 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application created_value = creator( May 25 14:42:57.056044 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 14:42:57.056044 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 14:42:57.056044 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 14:42:57.056044 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 14:42:57.056044 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 14:42:57.056044 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 14:42:57.056044 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 25 14:42:57.056044 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application May 25 14:42:57.056044 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 242/479] 10.222.0.84 () {56 vars in 1114 bytes} [Wed May 25 14:42:56 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 14:42:57.058698 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf81fea2-bbc3-4850-954a-32c3aa7862a2 None admin] Authenticating user token {{(pid=101892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:42:57.235193 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf81fea2-bbc3-4850-954a-32c3aa7862a2 None admin] Validating token access rules against request {{(pid=101892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:42:57.271444 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG dbcounter [-] [101892] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=101892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:42:57.286079 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c86c6bee-081e-45e6-a33e-d4929151ed39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:42:57.286760 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86c6bee-081e-45e6-a33e-d4929151ed39 None admin] REQUEST_METHOD: `GET` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:42:57.287048 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86c6bee-081e-45e6-a33e-d4929151ed39 None admin] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:42:57.287325 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86c6bee-081e-45e6-a33e-d4929151ed39 None admin] PATH_INFO: `/v3/roles` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:42:57.288151 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c86c6bee-081e-45e6-a33e-d4929151ed39 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=101892) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:42:57.288999 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c86c6bee-081e-45e6-a33e-d4929151ed39 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:42:57.290398 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c86c6bee-081e-45e6-a33e-d4929151ed39 None admin] RBAC: Authorization granted {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:42:57.313591 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 238/480] 10.222.0.84 () {56 vars in 1111 bytes} [Wed May 25 14:42:57 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:42:58.390571 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6733776-e3e4-4075-b5e3-2de9454b882e None None] REQUEST_METHOD: `GET` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:42:58.391300 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6733776-e3e4-4075-b5e3-2de9454b882e None None] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:42:58.391300 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6733776-e3e4-4075-b5e3-2de9454b882e None None] PATH_INFO: `/` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:42:58.392734 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 243/481] 10.222.0.84 () {54 vars in 926 bytes} [Wed May 25 14:42:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 14:42:58.398275 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3024cd10-c544-4fd0-9d1c-85e4f2407d28 None None] REQUEST_METHOD: `POST` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:42:58.399092 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3024cd10-c544-4fd0-9d1c-85e4f2407d28 None None] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:42:58.399634 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3024cd10-c544-4fd0-9d1c-85e4f2407d28 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:42:58.424564 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.auth.core [None req-3024cd10-c544-4fd0-9d1c-85e4f2407d28 None None] MFA Rules not processed for user `05d87e87798e429aa1c10b24391f915e`. Rule list: `[]` (Enabled: `True`). {{(pid=101892) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:42:58.425771 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.fernet_utils [None req-3024cd10-c544-4fd0-9d1c-85e4f2407d28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=101892) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:42:58.494771 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 239/482] 10.222.0.84 () {58 vars in 1023 bytes} [Wed May 25 14:42:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 25 14:42:58.530342 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6733776-e3e4-4075-b5e3-2de9454b882e None None] Authenticating user token {{(pid=101893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:42:58.685581 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6733776-e3e4-4075-b5e3-2de9454b882e None None] Validating token access rules against request {{(pid=101893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:42:58.720216 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG dbcounter [-] [101893] Writing DB stats keystone:SELECT=100 {{(pid=101893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:42:58.726886 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-056ac68b-7042-4e90-a895-27ff476e4251 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:42:58.727715 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056ac68b-7042-4e90-a895-27ff476e4251 None admin] REQUEST_METHOD: `GET` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:42:58.728001 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056ac68b-7042-4e90-a895-27ff476e4251 None admin] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:42:58.728283 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056ac68b-7042-4e90-a895-27ff476e4251 None admin] PATH_INFO: `/v3/roles/service` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:42:58.748173 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-056ac68b-7042-4e90-a895-27ff476e4251 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 14:42:58.756395 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application [None req-056ac68b-7042-4e90-a895-27ff476e4251 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 25 14:42:58.756395 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:42:58.756395 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 14:42:58.756395 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 14:42:58.756395 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 14:42:58.756395 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 14:42:58.756395 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 14:42:58.756395 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 14:42:58.756395 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 14:42:58.756395 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 14:42:58.756395 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 14:42:58.756395 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 14:42:58.756395 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 14:42:58.756395 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 14:42:58.756395 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 14:42:58.756395 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 14:42:58.757423 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 14:42:58.757423 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 14:42:58.757423 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 14:42:58.757423 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 14:42:58.757423 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 14:42:58.757423 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 14:42:58.757423 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 14:42:58.757423 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 14:42:58.757423 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 14:42:58.757423 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return self.get_or_create( May 25 14:42:58.757423 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 14:42:58.757423 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application with Lock( May 25 14:42:58.757423 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 14:42:58.757423 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return self._enter() May 25 14:42:58.757423 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 14:42:58.757423 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 14:42:58.759039 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 14:42:58.759039 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return self.creator() May 25 14:42:58.759039 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 14:42:58.759039 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application created_value = creator( May 25 14:42:58.759039 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 14:42:58.759039 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 14:42:58.759039 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 14:42:58.759039 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 14:42:58.759039 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 14:42:58.759039 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 14:42:58.759039 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 25 14:42:58.759039 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application May 25 14:42:58.759039 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 244/483] 10.222.0.84 () {56 vars in 1102 bytes} [Wed May 25 14:42:58 2022] GET /identity/v3/roles/service => generated 85 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 14:42:58.763678 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3024cd10-c544-4fd0-9d1c-85e4f2407d28 None None] Authenticating user token {{(pid=101892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:42:58.886627 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3024cd10-c544-4fd0-9d1c-85e4f2407d28 None None] Validating token access rules against request {{(pid=101892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:42:58.912825 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG dbcounter [-] [101892] Writing DB stats keystone:SELECT=100 {{(pid=101892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:42:58.921958 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05fb05ec-aee0-41ad-861e-2db45a902251 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:42:58.927723 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05fb05ec-aee0-41ad-861e-2db45a902251 None admin] REQUEST_METHOD: `GET` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:42:58.927723 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05fb05ec-aee0-41ad-861e-2db45a902251 None admin] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:42:58.927723 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05fb05ec-aee0-41ad-861e-2db45a902251 None admin] PATH_INFO: `/v3/roles` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:42:58.927723 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05fb05ec-aee0-41ad-861e-2db45a902251 None admin] RBAC: Adding query filter params (name=service) {{(pid=101892) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:42:58.927723 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05fb05ec-aee0-41ad-861e-2db45a902251 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:42:58.927723 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05fb05ec-aee0-41ad-861e-2db45a902251 None admin] RBAC: Authorization granted {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:42:58.934742 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 240/484] 10.222.0.84 () {56 vars in 1103 bytes} [Wed May 25 14:42:58 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:42:58.940748 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-056ac68b-7042-4e90-a895-27ff476e4251 None admin] Authenticating user token {{(pid=101893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:42:59.101656 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-056ac68b-7042-4e90-a895-27ff476e4251 None admin] Validating token access rules against request {{(pid=101893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:42:59.144457 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52c5d6e1-deff-4a47-a642-24ead20c6028 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:42:59.145258 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c5d6e1-deff-4a47-a642-24ead20c6028 None admin] REQUEST_METHOD: `GET` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:42:59.145539 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c5d6e1-deff-4a47-a642-24ead20c6028 None admin] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:42:59.145816 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c5d6e1-deff-4a47-a642-24ead20c6028 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:42:59.165353 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52c5d6e1-deff-4a47-a642-24ead20c6028 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:42:59.166833 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52c5d6e1-deff-4a47-a642-24ead20c6028 None admin] RBAC: Authorization granted {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:42:59.188083 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application [None req-52c5d6e1-deff-4a47-a642-24ead20c6028 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 25 14:42:59.188083 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:42:59.188083 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 14:42:59.188083 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 14:42:59.188083 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 14:42:59.188083 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 14:42:59.188083 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 14:42:59.188083 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 14:42:59.188083 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 14:42:59.188083 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 14:42:59.188083 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 14:42:59.188083 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 14:42:59.188083 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 25 14:42:59.188083 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 25 14:42:59.188083 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 25 14:42:59.188992 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 25 14:42:59.188992 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 14:42:59.188992 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 14:42:59.188992 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 14:42:59.188992 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 14:42:59.188992 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 14:42:59.188992 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return self.get_or_create( May 25 14:42:59.188992 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 14:42:59.188992 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application with Lock( May 25 14:42:59.188992 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 14:42:59.188992 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return self._enter() May 25 14:42:59.188992 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 14:42:59.188992 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 14:42:59.188992 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 14:42:59.188992 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return self.creator() May 25 14:42:59.188992 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 14:42:59.188992 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application created_value = creator( May 25 14:42:59.190507 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 25 14:42:59.190507 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 25 14:42:59.190507 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 25 14:42:59.190507 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application May 25 14:42:59.190507 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 245/485] 10.222.0.84 () {56 vars in 1108 bytes} [Wed May 25 14:42:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 249 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 14:42:59.194911 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05fb05ec-aee0-41ad-861e-2db45a902251 None admin] Authenticating user token {{(pid=101892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:42:59.367248 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05fb05ec-aee0-41ad-861e-2db45a902251 None admin] Validating token access rules against request {{(pid=101892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:42:59.398391 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d204057-48ea-4c81-8ecd-2c2a601fddf6 None None] REQUEST_METHOD: `GET` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:42:59.398900 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d204057-48ea-4c81-8ecd-2c2a601fddf6 None None] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:42:59.398984 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d204057-48ea-4c81-8ecd-2c2a601fddf6 None None] PATH_INFO: `/` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:42:59.400674 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 246/486] 10.222.0.84 () {54 vars in 926 bytes} [Wed May 25 14:42:59 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 25 14:42:59.405883 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-951c43d6-fa50-44a6-b4f9-c670128c9359 None None] REQUEST_METHOD: `POST` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:42:59.406172 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-951c43d6-fa50-44a6-b4f9-c670128c9359 None None] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:42:59.406459 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-951c43d6-fa50-44a6-b4f9-c670128c9359 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:42:59.410454 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a856a15d-6343-428f-b404-b4dfb3a58de9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:42:59.411111 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a856a15d-6343-428f-b404-b4dfb3a58de9 None admin] REQUEST_METHOD: `GET` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:42:59.411393 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a856a15d-6343-428f-b404-b4dfb3a58de9 None admin] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:42:59.411693 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a856a15d-6343-428f-b404-b4dfb3a58de9 None admin] PATH_INFO: `/v3/domains` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:42:59.412413 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a856a15d-6343-428f-b404-b4dfb3a58de9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=101892) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:42:59.412719 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a856a15d-6343-428f-b404-b4dfb3a58de9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:42:59.414630 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a856a15d-6343-428f-b404-b4dfb3a58de9 None admin] RBAC: Authorization granted {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:42:59.439006 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 241/487] 10.222.0.84 () {56 vars in 1109 bytes} [Wed May 25 14:42:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:42:59.439982 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.auth.core [None req-951c43d6-fa50-44a6-b4f9-c670128c9359 None None] MFA Rules not processed for user `05d87e87798e429aa1c10b24391f915e`. Rule list: `[]` (Enabled: `True`). {{(pid=101893) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:42:59.441408 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.fernet_utils [None req-951c43d6-fa50-44a6-b4f9-c670128c9359 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=101893) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:42:59.450214 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a856a15d-6343-428f-b404-b4dfb3a58de9 None admin] Authenticating user token {{(pid=101892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:42:59.499967 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG dbcounter [-] [101893] Writing DB stats keystone:SELECT=100 {{(pid=101893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:42:59.526973 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 247/488] 10.222.0.84 () {58 vars in 1023 bytes} [Wed May 25 14:42:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 25 14:42:59.545258 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898df017-fd85-4f20-943a-7bd8b291de97 None None] REQUEST_METHOD: `GET` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:42:59.545580 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898df017-fd85-4f20-943a-7bd8b291de97 None None] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:42:59.545822 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898df017-fd85-4f20-943a-7bd8b291de97 None None] PATH_INFO: `/` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:42:59.547427 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 248/489] 10.222.0.84 () {54 vars in 926 bytes} [Wed May 25 14:42:59 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 25 14:42:59.553689 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48a10c7-15c1-42e5-b183-b303c1f9fc3f None None] REQUEST_METHOD: `POST` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:42:59.554135 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48a10c7-15c1-42e5-b183-b303c1f9fc3f None None] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:42:59.554508 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48a10c7-15c1-42e5-b183-b303c1f9fc3f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:42:59.562837 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG dbcounter [-] [101892] Writing DB stats keystone:SELECT=100 {{(pid=101892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:42:59.582607 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.auth.core [None req-d48a10c7-15c1-42e5-b183-b303c1f9fc3f None None] MFA Rules not processed for user `05d87e87798e429aa1c10b24391f915e`. Rule list: `[]` (Enabled: `True`). {{(pid=101893) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:42:59.584615 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.fernet_utils [None req-d48a10c7-15c1-42e5-b183-b303c1f9fc3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=101893) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:42:59.632467 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a856a15d-6343-428f-b404-b4dfb3a58de9 None admin] Validating token access rules against request {{(pid=101892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:42:59.668019 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 249/490] 10.222.0.84 () {58 vars in 1023 bytes} [Wed May 25 14:42:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 25 14:42:59.669240 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d48a10c7-15c1-42e5-b183-b303c1f9fc3f None None] Authenticating user token {{(pid=101893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:42:59.689628 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ce1d5d2-b35f-4cdf-8eca-226448469b9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:42:59.691440 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce1d5d2-b35f-4cdf-8eca-226448469b9c None admin] REQUEST_METHOD: `GET` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:42:59.691921 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce1d5d2-b35f-4cdf-8eca-226448469b9c None admin] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:42:59.692627 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce1d5d2-b35f-4cdf-8eca-226448469b9c None admin] PATH_INFO: `/v3/users/nova` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:42:59.703791 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ce1d5d2-b35f-4cdf-8eca-226448469b9c None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:42:59.706421 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ce1d5d2-b35f-4cdf-8eca-226448469b9c None admin] RBAC: Authorization granted {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:42:59.728737 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application [None req-9ce1d5d2-b35f-4cdf-8eca-226448469b9c None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 25 14:42:59.728737 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:42:59.728737 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 14:42:59.728737 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 14:42:59.728737 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 14:42:59.728737 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 14:42:59.728737 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 14:42:59.728737 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 14:42:59.728737 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 14:42:59.728737 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 14:42:59.728737 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 14:42:59.728737 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 14:42:59.728737 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 25 14:42:59.728737 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application return self._get_user(user_id) May 25 14:42:59.728737 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 25 14:42:59.728737 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 25 14:42:59.729904 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 14:42:59.729904 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 14:42:59.729904 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 25 14:42:59.729904 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 25 14:42:59.729904 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 25 14:42:59.729904 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 25 14:42:59.729904 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 14:42:59.729904 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 14:42:59.729904 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 14:42:59.729904 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application return self.get_or_create( May 25 14:42:59.729904 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 14:42:59.729904 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application with Lock( May 25 14:42:59.729904 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 14:42:59.729904 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application return self._enter() May 25 14:42:59.729904 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 14:42:59.729904 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 14:42:59.729904 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 14:42:59.729904 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application return self.creator() May 25 14:42:59.731034 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 14:42:59.731034 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application created_value = creator( May 25 14:42:59.731034 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 25 14:42:59.731034 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 25 14:42:59.731034 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 25 14:42:59.731034 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 25 14:42:59.731034 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 25 14:42:59.731034 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 25 14:42:59.731034 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 25 14:42:59.731034 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application May 25 14:42:59.733299 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 242/491] 10.222.0.84 () {56 vars in 1093 bytes} [Wed May 25 14:42:59 2022] GET /identity/v3/users/nova => generated 82 bytes in 283 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 14:42:59.733895 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ce1d5d2-b35f-4cdf-8eca-226448469b9c None admin] Authenticating user token {{(pid=101892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:42:59.804713 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d48a10c7-15c1-42e5-b183-b303c1f9fc3f None None] Validating token access rules against request {{(pid=101893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:42:59.807156 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG dbcounter [-] [101893] Writing DB stats keystone:SELECT=100 {{(pid=101893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:42:59.857205 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG dbcounter [-] [101892] Writing DB stats keystone:SELECT=100 {{(pid=101892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:42:59.861039 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ce1d5d2-b35f-4cdf-8eca-226448469b9c None admin] Validating token access rules against request {{(pid=101892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:42:59.866025 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd25fac0-29e0-44ce-b00a-cae53726d186 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:42:59.867457 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd25fac0-29e0-44ce-b00a-cae53726d186 None admin] REQUEST_METHOD: `GET` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:42:59.867764 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd25fac0-29e0-44ce-b00a-cae53726d186 None admin] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:42:59.868037 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd25fac0-29e0-44ce-b00a-cae53726d186 None admin] PATH_INFO: `/v3/roles/service` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:42:59.881997 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd25fac0-29e0-44ce-b00a-cae53726d186 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 14:42:59.893571 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application [None req-fd25fac0-29e0-44ce-b00a-cae53726d186 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 25 14:42:59.893571 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:42:59.893571 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 14:42:59.893571 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 14:42:59.893571 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 14:42:59.893571 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 14:42:59.893571 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 14:42:59.893571 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 14:42:59.893571 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 14:42:59.893571 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 14:42:59.893571 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 14:42:59.893571 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 14:42:59.893571 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 14:42:59.893571 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 14:42:59.893571 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 14:42:59.893571 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 14:42:59.894518 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 14:42:59.894518 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 14:42:59.894518 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 14:42:59.894518 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 14:42:59.894518 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 14:42:59.894518 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 14:42:59.894518 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 14:42:59.894518 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 14:42:59.894518 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 14:42:59.894518 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return self.get_or_create( May 25 14:42:59.894518 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 14:42:59.894518 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application with Lock( May 25 14:42:59.894518 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 14:42:59.894518 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return self._enter() May 25 14:42:59.894518 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 14:42:59.894518 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 14:42:59.895360 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 14:42:59.895360 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return self.creator() May 25 14:42:59.895360 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 14:42:59.895360 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application created_value = creator( May 25 14:42:59.895360 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 14:42:59.895360 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 14:42:59.895360 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 14:42:59.895360 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 14:42:59.895360 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 14:42:59.895360 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 14:42:59.895360 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 25 14:42:59.895360 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application May 25 14:42:59.899900 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 250/492] 10.222.0.84 () {56 vars in 1102 bytes} [Wed May 25 14:42:59 2022] GET /identity/v3/roles/service => generated 85 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 14:42:59.901294 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd25fac0-29e0-44ce-b00a-cae53726d186 None admin] Authenticating user token {{(pid=101893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:42:59.910064 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea7eddbf-6704-4210-b5fd-22fe96339deb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:42:59.912191 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea7eddbf-6704-4210-b5fd-22fe96339deb None admin] REQUEST_METHOD: `GET` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:42:59.913023 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea7eddbf-6704-4210-b5fd-22fe96339deb None admin] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:42:59.913908 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea7eddbf-6704-4210-b5fd-22fe96339deb None admin] PATH_INFO: `/v3/roles/service` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:42:59.930244 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea7eddbf-6704-4210-b5fd-22fe96339deb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 14:42:59.939369 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application [None req-ea7eddbf-6704-4210-b5fd-22fe96339deb None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 25 14:42:59.939369 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:42:59.939369 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 14:42:59.939369 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 14:42:59.939369 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 14:42:59.939369 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 14:42:59.939369 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 14:42:59.939369 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 14:42:59.939369 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 14:42:59.939369 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 14:42:59.939369 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 14:42:59.939369 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 14:42:59.939369 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 14:42:59.939369 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 14:42:59.939369 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 14:42:59.939369 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 14:42:59.940294 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 14:42:59.940294 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 14:42:59.940294 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 14:42:59.940294 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 14:42:59.940294 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 14:42:59.940294 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 14:42:59.940294 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 14:42:59.940294 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 14:42:59.940294 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 14:42:59.940294 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application return self.get_or_create( May 25 14:42:59.940294 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 14:42:59.940294 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application with Lock( May 25 14:42:59.940294 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 14:42:59.940294 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application return self._enter() May 25 14:42:59.940294 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 14:42:59.940294 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 14:42:59.941098 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 14:42:59.941098 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application return self.creator() May 25 14:42:59.941098 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 14:42:59.941098 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application created_value = creator( May 25 14:42:59.941098 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 14:42:59.941098 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 14:42:59.941098 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 14:42:59.941098 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 14:42:59.941098 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 14:42:59.941098 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 14:42:59.941098 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 25 14:42:59.941098 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application May 25 14:42:59.945710 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 243/493] 10.222.0.84 () {56 vars in 1102 bytes} [Wed May 25 14:42:59 2022] GET /identity/v3/roles/service => generated 85 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 14:42:59.947709 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea7eddbf-6704-4210-b5fd-22fe96339deb None admin] Authenticating user token {{(pid=101892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:43:00.019055 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd25fac0-29e0-44ce-b00a-cae53726d186 None admin] Validating token access rules against request {{(pid=101893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:43:00.052928 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f570129-bc3a-442d-bc3a-e2ec4eb22d24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:43:00.053593 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f570129-bc3a-442d-bc3a-e2ec4eb22d24 None admin] REQUEST_METHOD: `GET` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:43:00.054398 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f570129-bc3a-442d-bc3a-e2ec4eb22d24 None admin] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:43:00.054747 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f570129-bc3a-442d-bc3a-e2ec4eb22d24 None admin] PATH_INFO: `/v3/users` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:43:00.055598 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f570129-bc3a-442d-bc3a-e2ec4eb22d24 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=101893) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:43:00.055910 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f570129-bc3a-442d-bc3a-e2ec4eb22d24 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:43:00.057348 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f570129-bc3a-442d-bc3a-e2ec4eb22d24 None admin] RBAC: Authorization granted {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:43:00.059365 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea7eddbf-6704-4210-b5fd-22fe96339deb None admin] Validating token access rules against request {{(pid=101892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:43:00.092654 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 251/494] 10.222.0.84 () {56 vars in 1133 bytes} [Wed May 25 14:42:59 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:43:00.093005 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f9fe21-b5f2-4042-bd5c-6bd0d04d4cb5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:43:00.093477 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f570129-bc3a-442d-bc3a-e2ec4eb22d24 None admin] Authenticating user token {{(pid=101893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:43:00.093669 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f9fe21-b5f2-4042-bd5c-6bd0d04d4cb5 None admin] REQUEST_METHOD: `GET` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:43:00.093954 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f9fe21-b5f2-4042-bd5c-6bd0d04d4cb5 None admin] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:43:00.094231 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f9fe21-b5f2-4042-bd5c-6bd0d04d4cb5 None admin] PATH_INFO: `/v3/roles` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:43:00.094971 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82f9fe21-b5f2-4042-bd5c-6bd0d04d4cb5 None admin] RBAC: Adding query filter params (name=service) {{(pid=101892) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:43:00.095280 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82f9fe21-b5f2-4042-bd5c-6bd0d04d4cb5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:43:00.096691 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82f9fe21-b5f2-4042-bd5c-6bd0d04d4cb5 None admin] RBAC: Authorization granted {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:43:00.104866 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 244/495] 10.222.0.84 () {56 vars in 1103 bytes} [Wed May 25 14:42:59 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:43:00.105998 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9290746a-bd9d-412a-a867-becce1332af1 None None] REQUEST_METHOD: `GET` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:43:00.106305 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9290746a-bd9d-412a-a867-becce1332af1 None None] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:43:00.106583 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9290746a-bd9d-412a-a867-becce1332af1 None None] PATH_INFO: `/` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:43:00.107953 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 245/496] 10.222.0.84 () {54 vars in 926 bytes} [Wed May 25 14:43:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 14:43:00.108895 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcfa2be7-30a2-4aa8-a90a-b895061e0916 None None] REQUEST_METHOD: `GET` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:43:00.109220 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcfa2be7-30a2-4aa8-a90a-b895061e0916 None None] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:43:00.109685 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcfa2be7-30a2-4aa8-a90a-b895061e0916 None None] PATH_INFO: `/` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:43:00.110988 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 246/497] 10.222.0.84 () {54 vars in 926 bytes} [Wed May 25 14:43:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 14:43:00.111764 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcfa2be7-30a2-4aa8-a90a-b895061e0916 None None] Authenticating user token {{(pid=101892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:43:00.122425 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG dbcounter [-] [101893] Writing DB stats keystone:SELECT=100 {{(pid=101893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:43:00.136550 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG dbcounter [-] [101892] Writing DB stats keystone:SELECT=100 {{(pid=101892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:43:00.199704 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f570129-bc3a-442d-bc3a-e2ec4eb22d24 None admin] Validating token access rules against request {{(pid=101893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:43:00.212363 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcfa2be7-30a2-4aa8-a90a-b895061e0916 None None] Validating token access rules against request {{(pid=101892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:43:00.232882 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d78f7e2e-fea1-42fc-a77f-dfe714e93895 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:43:00.233554 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78f7e2e-fea1-42fc-a77f-dfe714e93895 None admin] REQUEST_METHOD: `GET` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:43:00.233836 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78f7e2e-fea1-42fc-a77f-dfe714e93895 None admin] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:43:00.234112 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78f7e2e-fea1-42fc-a77f-dfe714e93895 None admin] PATH_INFO: `/v3/roles` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:43:00.234857 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d78f7e2e-fea1-42fc-a77f-dfe714e93895 None admin] RBAC: Adding query filter params (name=service) {{(pid=101893) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:43:00.235164 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d78f7e2e-fea1-42fc-a77f-dfe714e93895 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:43:00.236577 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d78f7e2e-fea1-42fc-a77f-dfe714e93895 None admin] RBAC: Authorization granted {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:43:00.246440 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 252/498] 10.222.0.84 () {56 vars in 1103 bytes} [Wed May 25 14:43:00 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:43:00.246723 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f81f21-dd9d-4915-8bb8-9e70c0f70286 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:43:00.247251 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d78f7e2e-fea1-42fc-a77f-dfe714e93895 None admin] Authenticating user token {{(pid=101893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:43:00.247409 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f81f21-dd9d-4915-8bb8-9e70c0f70286 None admin] REQUEST_METHOD: `GET` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:43:00.247711 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f81f21-dd9d-4915-8bb8-9e70c0f70286 None admin] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:43:00.249630 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f81f21-dd9d-4915-8bb8-9e70c0f70286 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:43:00.325171 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68f81f21-dd9d-4915-8bb8-9e70c0f70286 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:43:00.326634 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68f81f21-dd9d-4915-8bb8-9e70c0f70286 None admin] RBAC: Authorization granted {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:43:00.352312 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG dbcounter [-] [101893] Writing DB stats keystone:SELECT=100 {{(pid=101893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:43:00.356989 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG dbcounter [-] [101892] Writing DB stats keystone:SELECT=100 {{(pid=101892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:43:00.370505 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d78f7e2e-fea1-42fc-a77f-dfe714e93895 None admin] Validating token access rules against request {{(pid=101893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:43:00.404171 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce55267f-da99-4bcd-8b57-5701732f1357 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:43:00.404965 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce55267f-da99-4bcd-8b57-5701732f1357 None admin] REQUEST_METHOD: `GET` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:43:00.405251 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce55267f-da99-4bcd-8b57-5701732f1357 None admin] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:43:00.405531 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce55267f-da99-4bcd-8b57-5701732f1357 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:43:00.416277 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce55267f-da99-4bcd-8b57-5701732f1357 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:43:00.417741 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce55267f-da99-4bcd-8b57-5701732f1357 None admin] RBAC: Authorization granted {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:43:00.432011 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 247/499] 10.222.0.84 () {58 vars in 1282 bytes} [Wed May 25 14:43:00 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 321 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 25 14:43:00.433365 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e0b78d-267d-40dc-8af7-c258f225bd95 None None] REQUEST_METHOD: `POST` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:43:00.433659 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e0b78d-267d-40dc-8af7-c258f225bd95 None None] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:43:00.433940 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e0b78d-267d-40dc-8af7-c258f225bd95 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:43:00.435198 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application [None req-ce55267f-da99-4bcd-8b57-5701732f1357 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 25 14:43:00.435198 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:43:00.435198 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 14:43:00.435198 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 14:43:00.435198 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 14:43:00.435198 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 14:43:00.435198 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 14:43:00.435198 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 14:43:00.435198 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 14:43:00.435198 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 14:43:00.435198 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 14:43:00.435198 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 14:43:00.435198 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 25 14:43:00.435198 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 25 14:43:00.435198 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 25 14:43:00.436037 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 25 14:43:00.436037 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 14:43:00.436037 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 14:43:00.436037 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 14:43:00.436037 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 14:43:00.436037 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 14:43:00.436037 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return self.get_or_create( May 25 14:43:00.436037 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 14:43:00.436037 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application with Lock( May 25 14:43:00.436037 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 14:43:00.436037 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return self._enter() May 25 14:43:00.436037 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 14:43:00.436037 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 14:43:00.436037 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 14:43:00.436037 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return self.creator() May 25 14:43:00.436037 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 14:43:00.436037 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application created_value = creator( May 25 14:43:00.436866 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 25 14:43:00.436866 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 25 14:43:00.436866 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 25 14:43:00.436866 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application May 25 14:43:00.436866 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 253/500] 10.222.0.84 () {56 vars in 1108 bytes} [Wed May 25 14:43:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 14:43:00.437870 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e75d4f-8fbe-4170-9064-30b35a200ea4 None None] REQUEST_METHOD: `POST` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:43:00.438160 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e75d4f-8fbe-4170-9064-30b35a200ea4 None None] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:43:00.438447 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e75d4f-8fbe-4170-9064-30b35a200ea4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:43:00.451487 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.auth.core [None req-53e0b78d-267d-40dc-8af7-c258f225bd95 None None] MFA Rules not processed for user `05d87e87798e429aa1c10b24391f915e`. Rule list: `[]` (Enabled: `True`). {{(pid=101892) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:43:00.452722 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.fernet_utils [None req-53e0b78d-267d-40dc-8af7-c258f225bd95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=101892) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:43:00.454398 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.auth.core [None req-a0e75d4f-8fbe-4170-9064-30b35a200ea4 None None] MFA Rules not processed for user `05d87e87798e429aa1c10b24391f915e`. Rule list: `[]` (Enabled: `True`). {{(pid=101893) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:43:00.455595 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.fernet_utils [None req-a0e75d4f-8fbe-4170-9064-30b35a200ea4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=101893) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:43:00.517802 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 248/501] 10.222.0.84 () {58 vars in 1023 bytes} [Wed May 25 14:43:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 25 14:43:00.518430 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e0b78d-267d-40dc-8af7-c258f225bd95 None None] Authenticating user token {{(pid=101892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:43:00.539592 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 254/502] 10.222.0.84 () {58 vars in 1023 bytes} [Wed May 25 14:43:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 25 14:43:00.539592 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0e75d4f-8fbe-4170-9064-30b35a200ea4 None None] Authenticating user token {{(pid=101893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:43:00.577331 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG dbcounter [-] [101892] Writing DB stats keystone:SELECT=100 {{(pid=101892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:43:00.612777 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG dbcounter [-] [101893] Writing DB stats keystone:SELECT=100 {{(pid=101893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:43:00.625450 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e0b78d-267d-40dc-8af7-c258f225bd95 None None] Validating token access rules against request {{(pid=101892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:43:00.653008 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0e75d4f-8fbe-4170-9064-30b35a200ea4 None None] Validating token access rules against request {{(pid=101893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:43:00.664193 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efa8f7a3-d813-4c82-8a12-ba7acda1ed3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:43:00.664995 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa8f7a3-d813-4c82-8a12-ba7acda1ed3d None admin] REQUEST_METHOD: `GET` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:43:00.665284 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa8f7a3-d813-4c82-8a12-ba7acda1ed3d None admin] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:43:00.665553 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa8f7a3-d813-4c82-8a12-ba7acda1ed3d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:43:00.676305 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efa8f7a3-d813-4c82-8a12-ba7acda1ed3d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:43:00.677878 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efa8f7a3-d813-4c82-8a12-ba7acda1ed3d None admin] RBAC: Authorization granted {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:43:00.690944 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e06388c2-5969-4f5b-a4fa-0c31291c91b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:43:00.691765 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06388c2-5969-4f5b-a4fa-0c31291c91b3 None admin] REQUEST_METHOD: `GET` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:43:00.692050 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06388c2-5969-4f5b-a4fa-0c31291c91b3 None admin] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:43:00.692322 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06388c2-5969-4f5b-a4fa-0c31291c91b3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:43:00.695909 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application [None req-efa8f7a3-d813-4c82-8a12-ba7acda1ed3d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 25 14:43:00.695909 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:43:00.695909 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 14:43:00.695909 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 14:43:00.695909 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 14:43:00.695909 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 14:43:00.695909 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 14:43:00.695909 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 14:43:00.695909 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 14:43:00.695909 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 14:43:00.695909 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 14:43:00.695909 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 14:43:00.695909 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 25 14:43:00.695909 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 25 14:43:00.695909 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 25 14:43:00.696988 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 25 14:43:00.696988 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 14:43:00.696988 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 14:43:00.696988 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 14:43:00.696988 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 14:43:00.696988 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 14:43:00.696988 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application return self.get_or_create( May 25 14:43:00.696988 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 14:43:00.696988 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application with Lock( May 25 14:43:00.696988 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 14:43:00.696988 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application return self._enter() May 25 14:43:00.696988 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 14:43:00.696988 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 14:43:00.696988 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 14:43:00.696988 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application return self.creator() May 25 14:43:00.696988 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 14:43:00.696988 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application created_value = creator( May 25 14:43:00.697839 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 25 14:43:00.697839 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 25 14:43:00.697839 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 25 14:43:00.697839 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application May 25 14:43:00.697839 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 249/503] 10.222.0.84 () {56 vars in 1108 bytes} [Wed May 25 14:43:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 14:43:00.697839 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efa8f7a3-d813-4c82-8a12-ba7acda1ed3d None admin] Authenticating user token {{(pid=101892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:43:00.702510 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e06388c2-5969-4f5b-a4fa-0c31291c91b3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:43:00.704116 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e06388c2-5969-4f5b-a4fa-0c31291c91b3 None admin] RBAC: Authorization granted {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:43:00.722079 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application [None req-e06388c2-5969-4f5b-a4fa-0c31291c91b3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 25 14:43:00.722079 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:43:00.722079 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 14:43:00.722079 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 14:43:00.722079 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 14:43:00.722079 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 14:43:00.722079 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 14:43:00.722079 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 14:43:00.722079 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 14:43:00.722079 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 14:43:00.722079 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 14:43:00.722079 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 14:43:00.722079 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 25 14:43:00.722079 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 25 14:43:00.722079 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 25 14:43:00.723051 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 25 14:43:00.723051 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 14:43:00.723051 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 14:43:00.723051 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 14:43:00.723051 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 14:43:00.723051 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 14:43:00.723051 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return self.get_or_create( May 25 14:43:00.723051 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 14:43:00.723051 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application with Lock( May 25 14:43:00.723051 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 14:43:00.723051 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return self._enter() May 25 14:43:00.723051 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 14:43:00.723051 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 14:43:00.723051 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 14:43:00.723051 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return self.creator() May 25 14:43:00.723051 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 14:43:00.723051 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application created_value = creator( May 25 14:43:00.723919 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 25 14:43:00.723919 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 25 14:43:00.723919 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 25 14:43:00.723919 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application May 25 14:43:00.723919 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 255/504] 10.222.0.84 () {56 vars in 1108 bytes} [Wed May 25 14:43:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 14:43:00.724439 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e06388c2-5969-4f5b-a4fa-0c31291c91b3 None admin] Authenticating user token {{(pid=101893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:43:00.800027 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efa8f7a3-d813-4c82-8a12-ba7acda1ed3d None admin] Validating token access rules against request {{(pid=101892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:43:00.802337 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG dbcounter [-] [101892] Writing DB stats keystone:SELECT=100 {{(pid=101892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:43:00.821514 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e06388c2-5969-4f5b-a4fa-0c31291c91b3 None admin] Validating token access rules against request {{(pid=101893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:43:00.832417 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c61cf928-c534-4ef5-8620-cc37b3d8bebb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:43:00.833009 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61cf928-c534-4ef5-8620-cc37b3d8bebb None admin] REQUEST_METHOD: `GET` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:43:00.833453 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61cf928-c534-4ef5-8620-cc37b3d8bebb None admin] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:43:00.833727 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61cf928-c534-4ef5-8620-cc37b3d8bebb None admin] PATH_INFO: `/v3/domains` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:43:00.834441 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c61cf928-c534-4ef5-8620-cc37b3d8bebb None admin] RBAC: Adding query filter params (name=Default) {{(pid=101892) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:43:00.834745 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c61cf928-c534-4ef5-8620-cc37b3d8bebb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:43:00.836909 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c61cf928-c534-4ef5-8620-cc37b3d8bebb None admin] RBAC: Authorization granted {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:43:00.838170 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG dbcounter [-] [101893] Writing DB stats keystone:SELECT=100 {{(pid=101893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:43:00.848543 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 250/505] 10.222.0.84 () {56 vars in 1109 bytes} [Wed May 25 14:43:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:43:00.854612 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c61cf928-c534-4ef5-8620-cc37b3d8bebb None admin] Authenticating user token {{(pid=101892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:43:00.856531 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d12ad450-9739-49fd-a559-24797ef04d5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:43:00.857333 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12ad450-9739-49fd-a559-24797ef04d5d None admin] REQUEST_METHOD: `GET` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:43:00.857624 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12ad450-9739-49fd-a559-24797ef04d5d None admin] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:43:00.857910 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12ad450-9739-49fd-a559-24797ef04d5d None admin] PATH_INFO: `/v3/roles/service` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:43:00.868031 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d12ad450-9739-49fd-a559-24797ef04d5d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 14:43:00.876000 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application [None req-d12ad450-9739-49fd-a559-24797ef04d5d None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 25 14:43:00.876000 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:43:00.876000 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 14:43:00.876000 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 14:43:00.876000 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 14:43:00.876000 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 14:43:00.876000 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 14:43:00.876000 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 14:43:00.876000 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 14:43:00.876000 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 14:43:00.876000 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 14:43:00.876000 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 14:43:00.876000 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 14:43:00.876000 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 14:43:00.876000 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 14:43:00.876000 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 14:43:00.877062 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 14:43:00.877062 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 14:43:00.877062 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 14:43:00.877062 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 14:43:00.877062 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 14:43:00.877062 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 14:43:00.877062 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 14:43:00.877062 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 14:43:00.877062 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 14:43:00.877062 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return self.get_or_create( May 25 14:43:00.877062 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 14:43:00.877062 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application with Lock( May 25 14:43:00.877062 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 14:43:00.877062 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return self._enter() May 25 14:43:00.877062 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 14:43:00.877062 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 14:43:00.877870 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 14:43:00.877870 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return self.creator() May 25 14:43:00.877870 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 14:43:00.877870 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application created_value = creator( May 25 14:43:00.877870 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 14:43:00.877870 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 14:43:00.877870 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 14:43:00.877870 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 14:43:00.877870 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 14:43:00.877870 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 14:43:00.877870 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 25 14:43:00.877870 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application May 25 14:43:00.877870 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 256/506] 10.222.0.84 () {56 vars in 1102 bytes} [Wed May 25 14:43:00 2022] GET /identity/v3/roles/service => generated 85 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 14:43:00.878598 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d12ad450-9739-49fd-a559-24797ef04d5d None admin] Authenticating user token {{(pid=101893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:43:00.956763 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c61cf928-c534-4ef5-8620-cc37b3d8bebb None admin] Validating token access rules against request {{(pid=101892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:43:00.980052 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d12ad450-9739-49fd-a559-24797ef04d5d None admin] Validating token access rules against request {{(pid=101893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:43:00.989211 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff4bb70-b8f9-41be-b84a-0c6499bb753b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:43:00.989999 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff4bb70-b8f9-41be-b84a-0c6499bb753b None admin] REQUEST_METHOD: `GET` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:43:00.990279 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff4bb70-b8f9-41be-b84a-0c6499bb753b None admin] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:43:00.990554 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff4bb70-b8f9-41be-b84a-0c6499bb753b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:43:01.001833 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fff4bb70-b8f9-41be-b84a-0c6499bb753b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:43:01.003264 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fff4bb70-b8f9-41be-b84a-0c6499bb753b None admin] RBAC: Authorization granted {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:43:01.013706 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68035220-4417-4f92-97e6-1601c4924a4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:43:01.014366 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68035220-4417-4f92-97e6-1601c4924a4e None admin] REQUEST_METHOD: `GET` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:43:01.014656 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68035220-4417-4f92-97e6-1601c4924a4e None admin] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:43:01.014935 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68035220-4417-4f92-97e6-1601c4924a4e None admin] PATH_INFO: `/v3/domains` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:43:01.015710 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68035220-4417-4f92-97e6-1601c4924a4e None admin] RBAC: Adding query filter params (name=Default) {{(pid=101893) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:43:01.016030 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68035220-4417-4f92-97e6-1601c4924a4e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:43:01.017416 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68035220-4417-4f92-97e6-1601c4924a4e None admin] RBAC: Authorization granted {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:43:01.020591 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application [None req-fff4bb70-b8f9-41be-b84a-0c6499bb753b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 25 14:43:01.020591 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:43:01.020591 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 14:43:01.020591 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 14:43:01.020591 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 14:43:01.020591 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 14:43:01.020591 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 14:43:01.020591 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 14:43:01.020591 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 14:43:01.020591 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 14:43:01.020591 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 14:43:01.020591 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 14:43:01.020591 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 25 14:43:01.020591 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 25 14:43:01.020591 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 25 14:43:01.021592 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 25 14:43:01.021592 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 14:43:01.021592 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 14:43:01.021592 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 14:43:01.021592 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 14:43:01.021592 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 14:43:01.021592 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application return self.get_or_create( May 25 14:43:01.021592 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 14:43:01.021592 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application with Lock( May 25 14:43:01.021592 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 14:43:01.021592 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application return self._enter() May 25 14:43:01.021592 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 14:43:01.021592 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 14:43:01.021592 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 14:43:01.021592 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application return self.creator() May 25 14:43:01.021592 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 14:43:01.021592 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application created_value = creator( May 25 14:43:01.022556 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 25 14:43:01.022556 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 25 14:43:01.022556 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 25 14:43:01.022556 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application May 25 14:43:01.022556 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 251/507] 10.222.0.84 () {56 vars in 1108 bytes} [Wed May 25 14:43:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 14:43:01.023523 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff4bb70-b8f9-41be-b84a-0c6499bb753b None admin] Authenticating user token {{(pid=101892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:43:01.029667 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 257/508] 10.222.0.84 () {56 vars in 1109 bytes} [Wed May 25 14:43:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:43:01.030476 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68035220-4417-4f92-97e6-1601c4924a4e None admin] Authenticating user token {{(pid=101893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:43:01.043150 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG dbcounter [-] [101892] Writing DB stats keystone:SELECT=100 {{(pid=101892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:43:01.065273 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG dbcounter [-] [101893] Writing DB stats keystone:SELECT=100 {{(pid=101893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:43:01.123039 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff4bb70-b8f9-41be-b84a-0c6499bb753b None admin] Validating token access rules against request {{(pid=101892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:43:01.131452 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68035220-4417-4f92-97e6-1601c4924a4e None admin] Validating token access rules against request {{(pid=101893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:43:01.156853 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af548a18-13f6-468e-ad3a-5dfbd5aebffa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:43:01.157509 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af548a18-13f6-468e-ad3a-5dfbd5aebffa None admin] REQUEST_METHOD: `GET` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:43:01.157797 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af548a18-13f6-468e-ad3a-5dfbd5aebffa None admin] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:43:01.158073 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af548a18-13f6-468e-ad3a-5dfbd5aebffa None admin] PATH_INFO: `/v3/domains` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:43:01.158787 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af548a18-13f6-468e-ad3a-5dfbd5aebffa None admin] RBAC: Adding query filter params (name=Default) {{(pid=101892) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:43:01.159100 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af548a18-13f6-468e-ad3a-5dfbd5aebffa None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:43:01.160563 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af548a18-13f6-468e-ad3a-5dfbd5aebffa None admin] RBAC: Authorization granted {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:43:01.165294 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92a82be8-3441-4238-b9a3-730228f3fae5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:43:01.166190 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a82be8-3441-4238-b9a3-730228f3fae5 None admin] REQUEST_METHOD: `GET` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:43:01.166479 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a82be8-3441-4238-b9a3-730228f3fae5 None admin] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:43:01.166756 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a82be8-3441-4238-b9a3-730228f3fae5 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:43:01.172124 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 252/509] 10.222.0.84 () {56 vars in 1109 bytes} [Wed May 25 14:43:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:43:01.172846 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af548a18-13f6-468e-ad3a-5dfbd5aebffa None admin] Authenticating user token {{(pid=101892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:43:01.173836 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92a82be8-3441-4238-b9a3-730228f3fae5 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:43:01.175290 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92a82be8-3441-4238-b9a3-730228f3fae5 None admin] RBAC: Authorization granted {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:43:01.191062 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application [None req-92a82be8-3441-4238-b9a3-730228f3fae5 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. May 25 14:43:01.191062 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:43:01.191062 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 14:43:01.191062 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 14:43:01.191062 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 14:43:01.191062 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 14:43:01.191062 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 14:43:01.191062 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 14:43:01.191062 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 14:43:01.191062 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 14:43:01.191062 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 14:43:01.191062 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 14:43:01.191062 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 25 14:43:01.191062 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return self._get_user(user_id) May 25 14:43:01.191062 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 25 14:43:01.191062 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 25 14:43:01.192096 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 14:43:01.192096 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 14:43:01.192096 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 25 14:43:01.192096 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 25 14:43:01.192096 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 25 14:43:01.192096 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 25 14:43:01.192096 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 14:43:01.192096 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 14:43:01.192096 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 14:43:01.192096 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return self.get_or_create( May 25 14:43:01.192096 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 14:43:01.192096 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application with Lock( May 25 14:43:01.192096 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 14:43:01.192096 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return self._enter() May 25 14:43:01.192096 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 14:43:01.192096 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 14:43:01.192096 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 14:43:01.192096 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return self.creator() May 25 14:43:01.192982 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 14:43:01.192982 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application created_value = creator( May 25 14:43:01.192982 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 25 14:43:01.192982 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 25 14:43:01.192982 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 25 14:43:01.192982 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 25 14:43:01.192982 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 25 14:43:01.192982 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 25 14:43:01.192982 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. May 25 14:43:01.192982 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application May 25 14:43:01.192982 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 258/510] 10.222.0.84 () {56 vars in 1099 bytes} [Wed May 25 14:43:01 2022] GET /identity/v3/users/cinder => generated 84 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 14:43:01.193546 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92a82be8-3441-4238-b9a3-730228f3fae5 None admin] Authenticating user token {{(pid=101893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:43:01.248967 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG dbcounter [-] [101892] Writing DB stats keystone:SELECT=100 {{(pid=101892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:43:01.272522 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af548a18-13f6-468e-ad3a-5dfbd5aebffa None admin] Validating token access rules against request {{(pid=101892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:43:01.292118 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG dbcounter [-] [101893] Writing DB stats keystone:SELECT=100 {{(pid=101893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:43:01.297826 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92a82be8-3441-4238-b9a3-730228f3fae5 None admin] Validating token access rules against request {{(pid=101893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:43:01.307493 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f477ce5-b093-40fb-b2f3-b0fc88fa5175 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:43:01.308245 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f477ce5-b093-40fb-b2f3-b0fc88fa5175 None admin] REQUEST_METHOD: `GET` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:43:01.308535 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f477ce5-b093-40fb-b2f3-b0fc88fa5175 None admin] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:43:01.308813 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f477ce5-b093-40fb-b2f3-b0fc88fa5175 None admin] PATH_INFO: `/v3/roles` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:43:01.309557 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f477ce5-b093-40fb-b2f3-b0fc88fa5175 None admin] RBAC: Adding query filter params (name=service) {{(pid=101892) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:43:01.309867 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f477ce5-b093-40fb-b2f3-b0fc88fa5175 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:43:01.311249 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f477ce5-b093-40fb-b2f3-b0fc88fa5175 None admin] RBAC: Authorization granted {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:43:01.319083 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 253/511] 10.222.0.84 () {56 vars in 1103 bytes} [Wed May 25 14:43:01 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:43:01.320443 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f477ce5-b093-40fb-b2f3-b0fc88fa5175 None admin] Authenticating user token {{(pid=101892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:43:01.333514 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47bf2581-4405-4b8f-b396-cb5364ffbf8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:43:01.334179 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47bf2581-4405-4b8f-b396-cb5364ffbf8a None admin] REQUEST_METHOD: `GET` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:43:01.334468 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47bf2581-4405-4b8f-b396-cb5364ffbf8a None admin] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:43:01.334747 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47bf2581-4405-4b8f-b396-cb5364ffbf8a None admin] PATH_INFO: `/v3/domains` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:43:01.335507 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47bf2581-4405-4b8f-b396-cb5364ffbf8a None admin] RBAC: Adding query filter params (name=Default) {{(pid=101893) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:43:01.335866 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47bf2581-4405-4b8f-b396-cb5364ffbf8a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:43:01.337271 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47bf2581-4405-4b8f-b396-cb5364ffbf8a None admin] RBAC: Authorization granted {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:43:01.348262 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 259/512] 10.222.0.84 () {56 vars in 1109 bytes} [Wed May 25 14:43:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:43:01.349048 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47bf2581-4405-4b8f-b396-cb5364ffbf8a None admin] Authenticating user token {{(pid=101893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:43:01.418466 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f477ce5-b093-40fb-b2f3-b0fc88fa5175 None admin] Validating token access rules against request {{(pid=101892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:43:01.448217 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47bf2581-4405-4b8f-b396-cb5364ffbf8a None admin] Validating token access rules against request {{(pid=101893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:43:01.450166 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f5320f0-d1cf-436b-aa79-f99e66a75899 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:43:01.450954 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5320f0-d1cf-436b-aa79-f99e66a75899 None admin] REQUEST_METHOD: `GET` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:43:01.451238 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5320f0-d1cf-436b-aa79-f99e66a75899 None admin] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:43:01.451511 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5320f0-d1cf-436b-aa79-f99e66a75899 None admin] PATH_INFO: `/v3/users/glance` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:43:01.458819 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f5320f0-d1cf-436b-aa79-f99e66a75899 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:43:01.460829 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f5320f0-d1cf-436b-aa79-f99e66a75899 None admin] RBAC: Authorization granted {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:43:01.462522 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG dbcounter [-] [101892] Writing DB stats keystone:SELECT=100 {{(pid=101892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:43:01.475082 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application [None req-0f5320f0-d1cf-436b-aa79-f99e66a75899 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. May 25 14:43:01.475082 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:43:01.475082 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 14:43:01.475082 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 14:43:01.475082 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 14:43:01.475082 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 14:43:01.475082 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 14:43:01.475082 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 14:43:01.475082 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 14:43:01.475082 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 14:43:01.475082 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 14:43:01.475082 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 14:43:01.475082 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 25 14:43:01.475082 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application return self._get_user(user_id) May 25 14:43:01.475082 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 25 14:43:01.475082 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 25 14:43:01.476959 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 14:43:01.476959 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 14:43:01.476959 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 25 14:43:01.476959 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 25 14:43:01.476959 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 25 14:43:01.476959 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 25 14:43:01.476959 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 14:43:01.476959 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 14:43:01.476959 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 14:43:01.476959 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application return self.get_or_create( May 25 14:43:01.476959 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 14:43:01.476959 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application with Lock( May 25 14:43:01.476959 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 14:43:01.476959 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application return self._enter() May 25 14:43:01.476959 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 14:43:01.476959 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 14:43:01.476959 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 14:43:01.476959 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application return self.creator() May 25 14:43:01.477874 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 14:43:01.477874 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application created_value = creator( May 25 14:43:01.477874 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 25 14:43:01.477874 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 25 14:43:01.477874 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 25 14:43:01.477874 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 25 14:43:01.477874 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 25 14:43:01.477874 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 25 14:43:01.477874 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. May 25 14:43:01.477874 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application May 25 14:43:01.477874 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 254/513] 10.222.0.84 () {56 vars in 1099 bytes} [Wed May 25 14:43:01 2022] GET /identity/v3/users/glance => generated 84 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 14:43:01.477874 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f5320f0-d1cf-436b-aa79-f99e66a75899 None admin] Authenticating user token {{(pid=101892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:43:01.486800 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-173bd63d-64ec-4b40-87a3-349430015764 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:43:01.487612 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173bd63d-64ec-4b40-87a3-349430015764 None admin] REQUEST_METHOD: `GET` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:43:01.487895 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173bd63d-64ec-4b40-87a3-349430015764 None admin] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:43:01.488169 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173bd63d-64ec-4b40-87a3-349430015764 None admin] PATH_INFO: `/v3/projects/service` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:43:01.495138 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-173bd63d-64ec-4b40-87a3-349430015764 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:43:01.496616 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-173bd63d-64ec-4b40-87a3-349430015764 None admin] RBAC: Authorization granted {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:43:01.511616 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application [None req-173bd63d-64ec-4b40-87a3-349430015764 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 25 14:43:01.511616 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:43:01.511616 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 14:43:01.511616 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 14:43:01.511616 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 14:43:01.511616 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 14:43:01.511616 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 14:43:01.511616 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 14:43:01.511616 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 14:43:01.511616 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 14:43:01.511616 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 14:43:01.511616 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 14:43:01.511616 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 25 14:43:01.511616 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return self._get_project(project_id) May 25 14:43:01.511616 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 25 14:43:01.512480 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 25 14:43:01.512480 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 14:43:01.512480 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 14:43:01.512480 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 14:43:01.512480 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 14:43:01.512480 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 14:43:01.512480 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return self.get_or_create( May 25 14:43:01.512480 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 14:43:01.512480 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application with Lock( May 25 14:43:01.512480 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 14:43:01.512480 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return self._enter() May 25 14:43:01.512480 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 14:43:01.512480 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 14:43:01.512480 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 14:43:01.512480 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return self.creator() May 25 14:43:01.512480 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 14:43:01.512480 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application created_value = creator( May 25 14:43:01.513351 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 25 14:43:01.513351 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 25 14:43:01.513351 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 25 14:43:01.513351 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 25 14:43:01.513351 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 25 14:43:01.513351 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 25 14:43:01.513351 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 25 14:43:01.513351 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application May 25 14:43:01.513351 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 260/514] 10.222.0.84 () {56 vars in 1111 bytes} [Wed May 25 14:43:01 2022] GET /identity/v3/projects/service => generated 88 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 14:43:01.513826 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-173bd63d-64ec-4b40-87a3-349430015764 None admin] Authenticating user token {{(pid=101893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:43:01.531453 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG dbcounter [-] [101893] Writing DB stats keystone:SELECT=100 {{(pid=101893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:43:01.580031 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f5320f0-d1cf-436b-aa79-f99e66a75899 None admin] Validating token access rules against request {{(pid=101892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:43:01.613538 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67fc5bb0-b096-465b-aaef-9ae2e440208c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:43:01.614200 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67fc5bb0-b096-465b-aaef-9ae2e440208c None admin] REQUEST_METHOD: `GET` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:43:01.614297 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-173bd63d-64ec-4b40-87a3-349430015764 None admin] Validating token access rules against request {{(pid=101893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:43:01.614489 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67fc5bb0-b096-465b-aaef-9ae2e440208c None admin] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:43:01.614770 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67fc5bb0-b096-465b-aaef-9ae2e440208c None admin] PATH_INFO: `/v3/users` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:43:01.615633 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67fc5bb0-b096-465b-aaef-9ae2e440208c None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=101892) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:43:01.615948 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67fc5bb0-b096-465b-aaef-9ae2e440208c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:43:01.617445 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67fc5bb0-b096-465b-aaef-9ae2e440208c None admin] RBAC: Authorization granted {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:43:01.647302 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7162846b-aac5-4dbc-8a91-d3e73abc3f01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:43:01.648807 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7162846b-aac5-4dbc-8a91-d3e73abc3f01 None admin] REQUEST_METHOD: `GET` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:43:01.649133 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7162846b-aac5-4dbc-8a91-d3e73abc3f01 None admin] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:43:01.649408 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7162846b-aac5-4dbc-8a91-d3e73abc3f01 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:43:01.653802 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 255/515] 10.222.0.84 () {56 vars in 1137 bytes} [Wed May 25 14:43:01 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:43:01.654640 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67fc5bb0-b096-465b-aaef-9ae2e440208c None admin] Authenticating user token {{(pid=101892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:43:01.660597 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7162846b-aac5-4dbc-8a91-d3e73abc3f01 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:43:01.662099 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7162846b-aac5-4dbc-8a91-d3e73abc3f01 None admin] RBAC: Authorization granted {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:43:01.680122 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application [None req-7162846b-aac5-4dbc-8a91-d3e73abc3f01 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 25 14:43:01.680122 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:43:01.680122 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 14:43:01.680122 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 14:43:01.680122 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 14:43:01.680122 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 14:43:01.680122 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 14:43:01.680122 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 14:43:01.680122 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 14:43:01.680122 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 14:43:01.680122 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 14:43:01.680122 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 14:43:01.680122 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 25 14:43:01.680122 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 25 14:43:01.680122 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 25 14:43:01.680974 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 25 14:43:01.680974 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 14:43:01.680974 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 14:43:01.680974 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 14:43:01.680974 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 14:43:01.680974 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 14:43:01.680974 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return self.get_or_create( May 25 14:43:01.680974 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 14:43:01.680974 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application with Lock( May 25 14:43:01.680974 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 14:43:01.680974 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return self._enter() May 25 14:43:01.680974 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 14:43:01.680974 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 14:43:01.680974 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 14:43:01.680974 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return self.creator() May 25 14:43:01.680974 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 14:43:01.680974 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application created_value = creator( May 25 14:43:01.681808 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 25 14:43:01.681808 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 25 14:43:01.681808 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 25 14:43:01.681808 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application May 25 14:43:01.681808 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 261/516] 10.222.0.84 () {56 vars in 1108 bytes} [Wed May 25 14:43:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 14:43:01.682081 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7162846b-aac5-4dbc-8a91-d3e73abc3f01 None admin] Authenticating user token {{(pid=101893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:43:01.714921 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG dbcounter [-] [101892] Writing DB stats keystone:SELECT=100 {{(pid=101892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:43:01.750559 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG dbcounter [-] [101893] Writing DB stats keystone:SELECT=100 {{(pid=101893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:43:01.758358 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67fc5bb0-b096-465b-aaef-9ae2e440208c None admin] Validating token access rules against request {{(pid=101892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:43:01.784190 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7162846b-aac5-4dbc-8a91-d3e73abc3f01 None admin] Validating token access rules against request {{(pid=101893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:43:01.791811 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37e6fbb9-ee7f-4488-b122-022bb9daaab1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:43:01.792480 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e6fbb9-ee7f-4488-b122-022bb9daaab1 None admin] REQUEST_METHOD: `POST` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:43:01.792757 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e6fbb9-ee7f-4488-b122-022bb9daaab1 None admin] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:43:01.793030 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e6fbb9-ee7f-4488-b122-022bb9daaab1 None admin] PATH_INFO: `/v3/users` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:43:01.793722 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37e6fbb9-ee7f-4488-b122-022bb9daaab1 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:43:01.795160 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37e6fbb9-ee7f-4488-b122-022bb9daaab1 None admin] RBAC: Authorization granted {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:43:01.823142 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f030a114-e63b-42bd-beae-dc209d8823a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:43:01.823838 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f030a114-e63b-42bd-beae-dc209d8823a6 None admin] REQUEST_METHOD: `GET` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:43:01.824135 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f030a114-e63b-42bd-beae-dc209d8823a6 None admin] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:43:01.824414 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f030a114-e63b-42bd-beae-dc209d8823a6 None admin] PATH_INFO: `/v3/users` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:43:01.825247 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f030a114-e63b-42bd-beae-dc209d8823a6 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=101893) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:43:01.825558 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f030a114-e63b-42bd-beae-dc209d8823a6 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:43:01.827082 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f030a114-e63b-42bd-beae-dc209d8823a6 None admin] RBAC: Authorization granted {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:43:01.844349 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 262/517] 10.222.0.84 () {56 vars in 1137 bytes} [Wed May 25 14:43:01 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:43:01.845132 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f030a114-e63b-42bd-beae-dc209d8823a6 None admin] Authenticating user token {{(pid=101893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:43:01.859674 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 256/518] 10.222.0.84 () {60 vars in 1132 bytes} [Wed May 25 14:43:01 2022] POST /identity/v3/users => generated 247 bytes in 205 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 14:43:01.860803 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37e6fbb9-ee7f-4488-b122-022bb9daaab1 None admin] Authenticating user token {{(pid=101892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:43:01.961520 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f030a114-e63b-42bd-beae-dc209d8823a6 None admin] Validating token access rules against request {{(pid=101893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:43:01.983739 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37e6fbb9-ee7f-4488-b122-022bb9daaab1 None admin] Validating token access rules against request {{(pid=101892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:43:01.992505 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG dbcounter [-] [101893] Writing DB stats keystone:SELECT=100 {{(pid=101893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:43:01.997623 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG dbcounter [-] [101892] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=101892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:43:02.002521 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a217695-0752-414b-868a-50f6c879245b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:43:02.009403 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a217695-0752-414b-868a-50f6c879245b None admin] REQUEST_METHOD: `GET` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:43:02.009403 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a217695-0752-414b-868a-50f6c879245b None admin] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:43:02.009403 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a217695-0752-414b-868a-50f6c879245b None admin] PATH_INFO: `/v3/projects` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:43:02.009403 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a217695-0752-414b-868a-50f6c879245b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=101893) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:43:02.009403 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a217695-0752-414b-868a-50f6c879245b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:43:02.009403 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a217695-0752-414b-868a-50f6c879245b None admin] RBAC: Authorization granted {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:43:02.021300 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f05d12b9-2358-4ab9-b4fc-9a2dc42aeed3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:43:02.021959 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05d12b9-2358-4ab9-b4fc-9a2dc42aeed3 None admin] REQUEST_METHOD: `GET` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:43:02.022247 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05d12b9-2358-4ab9-b4fc-9a2dc42aeed3 None admin] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:43:02.023100 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05d12b9-2358-4ab9-b4fc-9a2dc42aeed3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:43:02.032416 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 263/519] 10.222.0.84 () {56 vars in 1148 bytes} [Wed May 25 14:43:01 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:43:02.032416 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a217695-0752-414b-868a-50f6c879245b None admin] Authenticating user token {{(pid=101893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:43:02.101916 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f05d12b9-2358-4ab9-b4fc-9a2dc42aeed3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:43:02.103504 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f05d12b9-2358-4ab9-b4fc-9a2dc42aeed3 None admin] RBAC: Authorization granted {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:43:02.144200 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a217695-0752-414b-868a-50f6c879245b None admin] Validating token access rules against request {{(pid=101893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:43:02.180689 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06405dcf-e250-48b2-bab3-a44d59ef76a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:43:02.181357 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06405dcf-e250-48b2-bab3-a44d59ef76a2 None admin] REQUEST_METHOD: `GET` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:43:02.181638 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06405dcf-e250-48b2-bab3-a44d59ef76a2 None admin] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:43:02.181949 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06405dcf-e250-48b2-bab3-a44d59ef76a2 None admin] PATH_INFO: `/v3/domains` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:43:02.182628 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06405dcf-e250-48b2-bab3-a44d59ef76a2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=101893) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:43:02.182933 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06405dcf-e250-48b2-bab3-a44d59ef76a2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:43:02.184456 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06405dcf-e250-48b2-bab3-a44d59ef76a2 None admin] RBAC: Authorization granted {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:43:02.197718 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 264/520] 10.222.0.84 () {56 vars in 1109 bytes} [Wed May 25 14:43:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:43:02.198548 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06405dcf-e250-48b2-bab3-a44d59ef76a2 None admin] Authenticating user token {{(pid=101893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:43:02.217884 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 257/521] 10.222.0.84 () {58 vars in 1282 bytes} [Wed May 25 14:43:01 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 353 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 25 14:43:02.217884 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f05d12b9-2358-4ab9-b4fc-9a2dc42aeed3 None admin] Authenticating user token {{(pid=101892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:43:02.231154 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG dbcounter [-] [101892] Writing DB stats keystone:SELECT=100 {{(pid=101892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:43:02.257644 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG dbcounter [-] [101893] Writing DB stats keystone:SELECT=100 {{(pid=101893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:43:02.321213 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06405dcf-e250-48b2-bab3-a44d59ef76a2 None admin] Validating token access rules against request {{(pid=101893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:43:02.322667 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f05d12b9-2358-4ab9-b4fc-9a2dc42aeed3 None admin] Validating token access rules against request {{(pid=101892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:43:02.356656 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a443c7fd-5386-46fa-ab05-393f9c18020c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:43:02.356852 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd7ac2fc-98b9-448d-9fa7-f2d5b3d28c54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:43:02.357355 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7ac2fc-98b9-448d-9fa7-f2d5b3d28c54 None admin] REQUEST_METHOD: `GET` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:43:02.357476 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a443c7fd-5386-46fa-ab05-393f9c18020c None admin] REQUEST_METHOD: `GET` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:43:02.357632 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a443c7fd-5386-46fa-ab05-393f9c18020c None admin] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:43:02.357724 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7ac2fc-98b9-448d-9fa7-f2d5b3d28c54 None admin] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:43:02.357905 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a443c7fd-5386-46fa-ab05-393f9c18020c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:43:02.358001 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7ac2fc-98b9-448d-9fa7-f2d5b3d28c54 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:43:02.358759 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a443c7fd-5386-46fa-ab05-393f9c18020c None admin] RBAC: Adding query filter params (role.id=fdcb2eda27b84f44a392b7e8b59cc425, scope.project.id=a000829c658c4a7cab67f7b6353ba3fa, user.id=2aeb182e6a5b43cfb0cc347ec847c848) {{(pid=101892) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:43:02.359044 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a443c7fd-5386-46fa-ab05-393f9c18020c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:43:02.360527 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a443c7fd-5386-46fa-ab05-393f9c18020c None admin] RBAC: Authorization granted {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:43:02.366032 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 258/522] 10.222.0.84 () {56 vars in 1374 bytes} [Wed May 25 14:43:02 2022] GET /identity/v3/role_assignments?user.id=2aeb182e6a5b43cfb0cc347ec847c848&scope.project.id=a000829c658c4a7cab67f7b6353ba3fa&role.id=fdcb2eda27b84f44a392b7e8b59cc425 => generated 259 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:43:02.367353 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a443c7fd-5386-46fa-ab05-393f9c18020c None admin] Authenticating user token {{(pid=101892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:43:02.450285 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd7ac2fc-98b9-448d-9fa7-f2d5b3d28c54 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:43:02.452737 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd7ac2fc-98b9-448d-9fa7-f2d5b3d28c54 None admin] RBAC: Authorization granted {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:43:02.456906 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG dbcounter [-] [101892] Writing DB stats keystone:SELECT=100 {{(pid=101892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:43:02.483222 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a443c7fd-5386-46fa-ab05-393f9c18020c None admin] Validating token access rules against request {{(pid=101892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:43:02.506823 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG dbcounter [-] [101893] Writing DB stats keystone:SELECT=100 {{(pid=101893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:43:02.525860 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-814a71f4-e305-4013-99c8-bc8bb5fb489d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:43:02.531951 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814a71f4-e305-4013-99c8-bc8bb5fb489d None admin] REQUEST_METHOD: `GET` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:43:02.531951 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814a71f4-e305-4013-99c8-bc8bb5fb489d None admin] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:43:02.531951 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814a71f4-e305-4013-99c8-bc8bb5fb489d None admin] PATH_INFO: `/v3/users/neutron` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:43:02.536122 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-814a71f4-e305-4013-99c8-bc8bb5fb489d None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:43:02.537599 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-814a71f4-e305-4013-99c8-bc8bb5fb489d None admin] RBAC: Authorization granted {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:43:02.555635 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application [None req-814a71f4-e305-4013-99c8-bc8bb5fb489d None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. May 25 14:43:02.555635 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:43:02.555635 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 14:43:02.555635 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 14:43:02.555635 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 14:43:02.555635 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 14:43:02.555635 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 14:43:02.555635 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 14:43:02.555635 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 14:43:02.555635 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 14:43:02.555635 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 14:43:02.555635 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 14:43:02.555635 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 25 14:43:02.555635 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application return self._get_user(user_id) May 25 14:43:02.555635 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 25 14:43:02.555635 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 25 14:43:02.556701 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 14:43:02.556701 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 14:43:02.556701 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 25 14:43:02.556701 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 25 14:43:02.556701 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 25 14:43:02.556701 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 25 14:43:02.556701 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 14:43:02.556701 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 14:43:02.556701 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 14:43:02.556701 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application return self.get_or_create( May 25 14:43:02.556701 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 14:43:02.556701 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application with Lock( May 25 14:43:02.556701 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 14:43:02.556701 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application return self._enter() May 25 14:43:02.556701 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 14:43:02.556701 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 14:43:02.556701 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 14:43:02.556701 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application return self.creator() May 25 14:43:02.557609 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 14:43:02.557609 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application created_value = creator( May 25 14:43:02.557609 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 25 14:43:02.557609 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 25 14:43:02.557609 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 25 14:43:02.557609 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 25 14:43:02.557609 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 25 14:43:02.557609 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 25 14:43:02.557609 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. May 25 14:43:02.557609 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application May 25 14:43:02.558643 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 259/523] 10.222.0.84 () {56 vars in 1102 bytes} [Wed May 25 14:43:02 2022] GET /identity/v3/users/neutron => generated 85 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 14:43:02.558832 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-814a71f4-e305-4013-99c8-bc8bb5fb489d None admin] Authenticating user token {{(pid=101892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:43:02.580255 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 265/524] 10.222.0.84 () {58 vars in 1282 bytes} [Wed May 25 14:43:02 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 382 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 25 14:43:02.581438 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd7ac2fc-98b9-448d-9fa7-f2d5b3d28c54 None admin] Authenticating user token {{(pid=101893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:43:02.671104 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-814a71f4-e305-4013-99c8-bc8bb5fb489d None admin] Validating token access rules against request {{(pid=101892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:43:02.689878 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd7ac2fc-98b9-448d-9fa7-f2d5b3d28c54 None admin] Validating token access rules against request {{(pid=101893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:43:02.707079 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e7b7325-8248-4cf2-b3c8-15917f80eac2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:43:02.707927 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7b7325-8248-4cf2-b3c8-15917f80eac2 None admin] REQUEST_METHOD: `GET` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:43:02.708211 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7b7325-8248-4cf2-b3c8-15917f80eac2 None admin] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:43:02.708489 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7b7325-8248-4cf2-b3c8-15917f80eac2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:43:02.711536 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG dbcounter [-] [101892] Writing DB stats keystone:SELECT=100 {{(pid=101892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:43:02.719947 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e7b7325-8248-4cf2-b3c8-15917f80eac2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:43:02.721522 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e7b7325-8248-4cf2-b3c8-15917f80eac2 None admin] RBAC: Authorization granted {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:43:02.729426 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f2b060-c387-41f1-a9f8-c05663622371 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:43:02.730303 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f2b060-c387-41f1-a9f8-c05663622371 None admin] REQUEST_METHOD: `GET` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:43:02.755532 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f2b060-c387-41f1-a9f8-c05663622371 None admin] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:43:02.755532 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f2b060-c387-41f1-a9f8-c05663622371 None admin] PATH_INFO: `/v3/users` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:43:02.755532 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98f2b060-c387-41f1-a9f8-c05663622371 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=101893) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:43:02.755532 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98f2b060-c387-41f1-a9f8-c05663622371 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:43:02.755532 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98f2b060-c387-41f1-a9f8-c05663622371 None admin] RBAC: Authorization granted {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:43:02.755958 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application [None req-6e7b7325-8248-4cf2-b3c8-15917f80eac2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 25 14:43:02.755958 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:43:02.755958 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 14:43:02.755958 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 14:43:02.755958 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 14:43:02.755958 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 14:43:02.755958 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 14:43:02.755958 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 14:43:02.755958 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 14:43:02.755958 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 14:43:02.755958 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 14:43:02.755958 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 14:43:02.755958 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 25 14:43:02.755958 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 25 14:43:02.755958 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 25 14:43:02.756863 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 25 14:43:02.756863 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 14:43:02.756863 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 14:43:02.756863 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 14:43:02.756863 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 14:43:02.756863 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 14:43:02.756863 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application return self.get_or_create( May 25 14:43:02.756863 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 14:43:02.756863 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application with Lock( May 25 14:43:02.756863 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 14:43:02.756863 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application return self._enter() May 25 14:43:02.756863 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 14:43:02.756863 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 14:43:02.756863 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 14:43:02.756863 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application return self.creator() May 25 14:43:02.756863 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 14:43:02.756863 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application created_value = creator( May 25 14:43:02.757709 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 25 14:43:02.757709 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 25 14:43:02.757709 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 25 14:43:02.757709 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application May 25 14:43:02.757709 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 260/525] 10.222.0.84 () {56 vars in 1108 bytes} [Wed May 25 14:43:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 14:43:02.757709 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e7b7325-8248-4cf2-b3c8-15917f80eac2 None admin] Authenticating user token {{(pid=101892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:43:02.761139 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 266/526] 10.222.0.84 () {56 vars in 1139 bytes} [Wed May 25 14:43:02 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:43:02.762198 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f2b060-c387-41f1-a9f8-c05663622371 None admin] Authenticating user token {{(pid=101893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:43:02.766409 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG dbcounter [-] [101893] Writing DB stats keystone:SELECT=100 {{(pid=101893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:43:02.855805 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e7b7325-8248-4cf2-b3c8-15917f80eac2 None admin] Validating token access rules against request {{(pid=101892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:43:02.872098 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f2b060-c387-41f1-a9f8-c05663622371 None admin] Validating token access rules against request {{(pid=101893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:43:02.892629 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d6232a-7fc4-409b-b9de-23952694ba30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:43:02.893648 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d6232a-7fc4-409b-b9de-23952694ba30 None admin] REQUEST_METHOD: `GET` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:43:02.894201 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d6232a-7fc4-409b-b9de-23952694ba30 None admin] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:43:02.894637 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d6232a-7fc4-409b-b9de-23952694ba30 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:43:02.906492 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63d6232a-7fc4-409b-b9de-23952694ba30 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:43:02.908184 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63d6232a-7fc4-409b-b9de-23952694ba30 None admin] RBAC: Authorization granted {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:43:02.912841 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c71a6d49-e347-4278-9d9e-32690ee09796 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:43:02.914126 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c71a6d49-e347-4278-9d9e-32690ee09796 None admin] REQUEST_METHOD: `GET` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:43:02.914411 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c71a6d49-e347-4278-9d9e-32690ee09796 None admin] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:43:02.914742 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c71a6d49-e347-4278-9d9e-32690ee09796 None admin] PATH_INFO: `/v3/domains` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:43:02.915474 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c71a6d49-e347-4278-9d9e-32690ee09796 None admin] RBAC: Adding query filter params (name=Default) {{(pid=101893) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:43:02.915807 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c71a6d49-e347-4278-9d9e-32690ee09796 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:43:02.917246 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c71a6d49-e347-4278-9d9e-32690ee09796 None admin] RBAC: Authorization granted {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:43:02.929297 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application [None req-63d6232a-7fc4-409b-b9de-23952694ba30 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 25 14:43:02.929297 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:43:02.929297 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 14:43:02.929297 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 14:43:02.929297 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 14:43:02.929297 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 14:43:02.929297 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 14:43:02.929297 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 14:43:02.929297 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 14:43:02.929297 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 14:43:02.929297 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 14:43:02.929297 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 14:43:02.929297 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 25 14:43:02.929297 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 25 14:43:02.929297 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 25 14:43:02.930364 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 25 14:43:02.930364 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 14:43:02.930364 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 14:43:02.930364 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 14:43:02.930364 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 14:43:02.930364 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 14:43:02.930364 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application return self.get_or_create( May 25 14:43:02.930364 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 14:43:02.930364 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application with Lock( May 25 14:43:02.930364 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 14:43:02.930364 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application return self._enter() May 25 14:43:02.930364 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 14:43:02.930364 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 14:43:02.930364 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 14:43:02.930364 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application return self.creator() May 25 14:43:02.930364 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 14:43:02.930364 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application created_value = creator( May 25 14:43:02.931325 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 25 14:43:02.931325 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 25 14:43:02.931325 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 25 14:43:02.931325 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application May 25 14:43:02.937189 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 267/528] 10.222.0.84 () {56 vars in 1109 bytes} [Wed May 25 14:43:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:43:02.937189 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c71a6d49-e347-4278-9d9e-32690ee09796 None admin] Authenticating user token {{(pid=101893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:43:02.937548 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 261/528] 10.222.0.84 () {56 vars in 1108 bytes} [Wed May 25 14:43:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 14:43:02.938653 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d6232a-7fc4-409b-b9de-23952694ba30 None admin] Authenticating user token {{(pid=101892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:43:02.985413 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG dbcounter [-] [101892] Writing DB stats keystone:SELECT=100 {{(pid=101892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:43:03.003671 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG dbcounter [-] [101893] Writing DB stats keystone:SELECT=100 {{(pid=101893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:43:03.052162 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c71a6d49-e347-4278-9d9e-32690ee09796 None admin] Validating token access rules against request {{(pid=101893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:43:03.052340 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d6232a-7fc4-409b-b9de-23952694ba30 None admin] Validating token access rules against request {{(pid=101892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:43:03.083426 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9565e836-1f97-4cf2-9ad6-3e93a52b67a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:43:03.084292 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9565e836-1f97-4cf2-9ad6-3e93a52b67a3 None admin] REQUEST_METHOD: `GET` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:43:03.084704 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9565e836-1f97-4cf2-9ad6-3e93a52b67a3 None admin] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:43:03.085557 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9565e836-1f97-4cf2-9ad6-3e93a52b67a3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:43:03.086162 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dcdfb32-fe92-4c10-b59a-b63351fc2e8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:43:03.086952 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dcdfb32-fe92-4c10-b59a-b63351fc2e8c None admin] REQUEST_METHOD: `GET` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:43:03.087236 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dcdfb32-fe92-4c10-b59a-b63351fc2e8c None admin] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:43:03.087510 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dcdfb32-fe92-4c10-b59a-b63351fc2e8c None admin] PATH_INFO: `/v3/projects/service` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:43:03.094623 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dcdfb32-fe92-4c10-b59a-b63351fc2e8c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:43:03.096276 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dcdfb32-fe92-4c10-b59a-b63351fc2e8c None admin] RBAC: Authorization granted {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:43:03.114897 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application [None req-4dcdfb32-fe92-4c10-b59a-b63351fc2e8c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 25 14:43:03.114897 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:43:03.114897 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 14:43:03.114897 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 14:43:03.114897 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 14:43:03.114897 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 14:43:03.114897 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 14:43:03.114897 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 14:43:03.114897 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 14:43:03.114897 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 14:43:03.114897 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 14:43:03.114897 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 14:43:03.114897 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 25 14:43:03.114897 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application return self._get_project(project_id) May 25 14:43:03.114897 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 25 14:43:03.115840 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 25 14:43:03.115840 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 14:43:03.115840 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 14:43:03.115840 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 14:43:03.115840 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 14:43:03.115840 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 14:43:03.115840 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application return self.get_or_create( May 25 14:43:03.115840 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 14:43:03.115840 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application with Lock( May 25 14:43:03.115840 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 14:43:03.115840 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application return self._enter() May 25 14:43:03.115840 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 14:43:03.115840 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 14:43:03.115840 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 14:43:03.115840 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application return self.creator() May 25 14:43:03.115840 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 14:43:03.115840 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application created_value = creator( May 25 14:43:03.116733 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 25 14:43:03.116733 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 25 14:43:03.116733 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 25 14:43:03.116733 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 25 14:43:03.116733 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 25 14:43:03.116733 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 25 14:43:03.116733 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 25 14:43:03.116733 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application May 25 14:43:03.117669 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 262/529] 10.222.0.84 () {56 vars in 1111 bytes} [Wed May 25 14:43:02 2022] GET /identity/v3/projects/service => generated 88 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 14:43:03.118092 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dcdfb32-fe92-4c10-b59a-b63351fc2e8c None admin] Authenticating user token {{(pid=101892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:43:03.163762 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9565e836-1f97-4cf2-9ad6-3e93a52b67a3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:43:03.165360 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9565e836-1f97-4cf2-9ad6-3e93a52b67a3 None admin] RBAC: Authorization granted {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:43:03.224030 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG dbcounter [-] [101892] Writing DB stats keystone:SELECT=100 {{(pid=101892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:43:03.226920 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dcdfb32-fe92-4c10-b59a-b63351fc2e8c None admin] Validating token access rules against request {{(pid=101892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:43:03.232067 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG dbcounter [-] [101893] Writing DB stats keystone:SELECT=100 {{(pid=101893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:43:03.262767 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-939024da-e6ac-4266-8234-c6457ca8a8ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:43:03.263596 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939024da-e6ac-4266-8234-c6457ca8a8ee None admin] REQUEST_METHOD: `GET` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:43:03.263970 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939024da-e6ac-4266-8234-c6457ca8a8ee None admin] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:43:03.264322 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939024da-e6ac-4266-8234-c6457ca8a8ee None admin] PATH_INFO: `/v3/domains` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:43:03.265177 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-939024da-e6ac-4266-8234-c6457ca8a8ee None admin] RBAC: Adding query filter params (name=Default) {{(pid=101892) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:43:03.265567 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-939024da-e6ac-4266-8234-c6457ca8a8ee None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:43:03.270352 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-939024da-e6ac-4266-8234-c6457ca8a8ee None admin] RBAC: Authorization granted {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:43:03.275345 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 268/530] 10.222.0.84 () {58 vars in 1282 bytes} [Wed May 25 14:43:02 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 341 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 25 14:43:03.280630 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9565e836-1f97-4cf2-9ad6-3e93a52b67a3 None admin] Authenticating user token {{(pid=101893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:43:03.280752 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 263/531] 10.222.0.84 () {56 vars in 1109 bytes} [Wed May 25 14:43:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:43:03.284647 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-939024da-e6ac-4266-8234-c6457ca8a8ee None admin] Authenticating user token {{(pid=101892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:43:03.396881 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9565e836-1f97-4cf2-9ad6-3e93a52b67a3 None admin] Validating token access rules against request {{(pid=101893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:43:03.401657 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-939024da-e6ac-4266-8234-c6457ca8a8ee None admin] Validating token access rules against request {{(pid=101892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:43:03.433548 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-400480ed-9ab3-4f23-bff0-22e3839015a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:43:03.434556 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400480ed-9ab3-4f23-bff0-22e3839015a1 None admin] REQUEST_METHOD: `GET` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:43:03.435065 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400480ed-9ab3-4f23-bff0-22e3839015a1 None admin] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:43:03.435555 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400480ed-9ab3-4f23-bff0-22e3839015a1 None admin] PATH_INFO: `/v3/projects` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:43:03.436567 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-400480ed-9ab3-4f23-bff0-22e3839015a1 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=101893) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:43:03.437078 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-400480ed-9ab3-4f23-bff0-22e3839015a1 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:43:03.438410 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-316d3447-daed-4b0c-a53d-284e5e00ad91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:43:03.438924 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-400480ed-9ab3-4f23-bff0-22e3839015a1 None admin] RBAC: Authorization granted {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:43:03.439354 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316d3447-daed-4b0c-a53d-284e5e00ad91 None admin] REQUEST_METHOD: `GET` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:43:03.439734 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316d3447-daed-4b0c-a53d-284e5e00ad91 None admin] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:43:03.440081 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316d3447-daed-4b0c-a53d-284e5e00ad91 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:43:03.451417 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-316d3447-daed-4b0c-a53d-284e5e00ad91 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:43:03.452704 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 269/532] 10.222.0.84 () {56 vars in 1148 bytes} [Wed May 25 14:43:03 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:43:03.453172 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-316d3447-daed-4b0c-a53d-284e5e00ad91 None admin] RBAC: Authorization granted {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:43:03.454167 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-400480ed-9ab3-4f23-bff0-22e3839015a1 None admin] Authenticating user token {{(pid=101893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:43:03.480455 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application [None req-316d3447-daed-4b0c-a53d-284e5e00ad91 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 25 14:43:03.480455 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:43:03.480455 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 14:43:03.480455 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 14:43:03.480455 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 14:43:03.480455 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 14:43:03.480455 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 14:43:03.480455 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 14:43:03.480455 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 14:43:03.480455 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 14:43:03.480455 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 14:43:03.480455 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 14:43:03.480455 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 25 14:43:03.480455 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 25 14:43:03.480455 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 25 14:43:03.481688 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 25 14:43:03.481688 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 14:43:03.481688 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 14:43:03.481688 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 14:43:03.481688 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 14:43:03.481688 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 14:43:03.481688 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application return self.get_or_create( May 25 14:43:03.481688 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 14:43:03.481688 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application with Lock( May 25 14:43:03.481688 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 14:43:03.481688 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application return self._enter() May 25 14:43:03.481688 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 14:43:03.481688 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 14:43:03.481688 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 14:43:03.481688 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application return self.creator() May 25 14:43:03.481688 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 14:43:03.481688 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application created_value = creator( May 25 14:43:03.482535 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 25 14:43:03.482535 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 25 14:43:03.482535 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 25 14:43:03.482535 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application May 25 14:43:03.489914 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 264/533] 10.222.0.84 () {56 vars in 1108 bytes} [Wed May 25 14:43:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 14:43:03.489914 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-316d3447-daed-4b0c-a53d-284e5e00ad91 None admin] Authenticating user token {{(pid=101892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:43:03.492091 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG dbcounter [-] [101893] Writing DB stats keystone:SELECT=100 {{(pid=101893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:43:03.507517 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG dbcounter [-] [101892] Writing DB stats keystone:SELECT=100 {{(pid=101892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:43:03.599870 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-400480ed-9ab3-4f23-bff0-22e3839015a1 None admin] Validating token access rules against request {{(pid=101893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:43:03.615968 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-316d3447-daed-4b0c-a53d-284e5e00ad91 None admin] Validating token access rules against request {{(pid=101892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:43:03.638187 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-344aa2f3-64a1-4023-9622-a06001db4709 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:43:03.639365 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344aa2f3-64a1-4023-9622-a06001db4709 None admin] REQUEST_METHOD: `GET` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:43:03.639935 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344aa2f3-64a1-4023-9622-a06001db4709 None admin] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:43:03.640415 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344aa2f3-64a1-4023-9622-a06001db4709 None admin] PATH_INFO: `/v3/projects/service` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:43:03.648560 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-344aa2f3-64a1-4023-9622-a06001db4709 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:43:03.650453 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-344aa2f3-64a1-4023-9622-a06001db4709 None admin] RBAC: Authorization granted {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:43:03.654831 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e761196-4b65-4d43-878f-350e16afc667 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:43:03.655598 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e761196-4b65-4d43-878f-350e16afc667 None admin] REQUEST_METHOD: `GET` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:43:03.655887 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e761196-4b65-4d43-878f-350e16afc667 None admin] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:43:03.656217 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e761196-4b65-4d43-878f-350e16afc667 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:43:03.657054 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e761196-4b65-4d43-878f-350e16afc667 None admin] RBAC: Adding query filter params (role.id=fdcb2eda27b84f44a392b7e8b59cc425, scope.project.id=a000829c658c4a7cab67f7b6353ba3fa, user.id=e079f89a5e524ab6ad4183e4f690de07) {{(pid=101892) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:43:03.657370 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e761196-4b65-4d43-878f-350e16afc667 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:43:03.658937 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e761196-4b65-4d43-878f-350e16afc667 None admin] RBAC: Authorization granted {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:43:03.667300 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application [None req-344aa2f3-64a1-4023-9622-a06001db4709 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 25 14:43:03.667300 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:43:03.667300 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 14:43:03.667300 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 14:43:03.667300 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 14:43:03.667300 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 14:43:03.667300 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 14:43:03.667300 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 14:43:03.667300 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 14:43:03.667300 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 14:43:03.667300 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 14:43:03.667300 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 14:43:03.667300 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 25 14:43:03.667300 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return self._get_project(project_id) May 25 14:43:03.667300 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 25 14:43:03.668234 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 25 14:43:03.668234 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 14:43:03.668234 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 14:43:03.668234 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 14:43:03.668234 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 14:43:03.668234 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 14:43:03.668234 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return self.get_or_create( May 25 14:43:03.668234 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 14:43:03.668234 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application with Lock( May 25 14:43:03.668234 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 14:43:03.668234 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return self._enter() May 25 14:43:03.668234 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 14:43:03.668234 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 14:43:03.668234 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 14:43:03.668234 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return self.creator() May 25 14:43:03.668234 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 14:43:03.668234 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application created_value = creator( May 25 14:43:03.669087 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 25 14:43:03.669087 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 25 14:43:03.669087 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 25 14:43:03.669087 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 25 14:43:03.669087 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 25 14:43:03.669087 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 25 14:43:03.669087 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 25 14:43:03.669087 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application May 25 14:43:03.670944 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 265/534] 10.222.0.84 () {56 vars in 1374 bytes} [Wed May 25 14:43:03 2022] GET /identity/v3/role_assignments?user.id=e079f89a5e524ab6ad4183e4f690de07&scope.project.id=a000829c658c4a7cab67f7b6353ba3fa&role.id=fdcb2eda27b84f44a392b7e8b59cc425 => generated 259 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:43:03.675702 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e761196-4b65-4d43-878f-350e16afc667 None admin] Authenticating user token {{(pid=101892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:43:03.676282 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 270/535] 10.222.0.84 () {56 vars in 1111 bytes} [Wed May 25 14:43:03 2022] GET /identity/v3/projects/service => generated 88 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 14:43:03.677307 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-344aa2f3-64a1-4023-9622-a06001db4709 None admin] Authenticating user token {{(pid=101893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:43:03.786268 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG dbcounter [-] [101893] Writing DB stats keystone:SELECT=100 {{(pid=101893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:43:03.803481 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-344aa2f3-64a1-4023-9622-a06001db4709 None admin] Validating token access rules against request {{(pid=101893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:43:03.820235 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG dbcounter [-] [101892] Writing DB stats keystone:SELECT=100 {{(pid=101892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:43:03.836780 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e761196-4b65-4d43-878f-350e16afc667 None admin] Validating token access rules against request {{(pid=101892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:43:03.875370 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5e553c6-d29b-4c7e-858c-616b1425bd73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:43:03.876281 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e553c6-d29b-4c7e-858c-616b1425bd73 None admin] REQUEST_METHOD: `GET` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:43:03.876567 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e553c6-d29b-4c7e-858c-616b1425bd73 None admin] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:43:03.876846 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e553c6-d29b-4c7e-858c-616b1425bd73 None admin] PATH_INFO: `/v3/domains` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:43:03.877687 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5e553c6-d29b-4c7e-858c-616b1425bd73 None admin] RBAC: Adding query filter params (name=Default) {{(pid=101892) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:43:03.878006 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5e553c6-d29b-4c7e-858c-616b1425bd73 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:43:03.879482 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5e553c6-d29b-4c7e-858c-616b1425bd73 None admin] RBAC: Authorization granted {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:43:03.888986 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8542b2a-1427-4fc6-8b9b-c11e32c7c7d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:43:03.889677 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8542b2a-1427-4fc6-8b9b-c11e32c7c7d5 None admin] REQUEST_METHOD: `GET` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:43:03.889963 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8542b2a-1427-4fc6-8b9b-c11e32c7c7d5 None admin] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:43:03.890238 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8542b2a-1427-4fc6-8b9b-c11e32c7c7d5 None admin] PATH_INFO: `/v3/projects` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:43:03.891044 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8542b2a-1427-4fc6-8b9b-c11e32c7c7d5 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=101893) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:43:03.891359 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8542b2a-1427-4fc6-8b9b-c11e32c7c7d5 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:43:03.892855 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8542b2a-1427-4fc6-8b9b-c11e32c7c7d5 None admin] RBAC: Authorization granted {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:43:03.893671 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 266/536] 10.222.0.84 () {56 vars in 1109 bytes} [Wed May 25 14:43:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:43:03.909254 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5e553c6-d29b-4c7e-858c-616b1425bd73 None admin] Authenticating user token {{(pid=101892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:43:03.910814 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 271/537] 10.222.0.84 () {56 vars in 1148 bytes} [Wed May 25 14:43:03 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:43:03.916581 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8542b2a-1427-4fc6-8b9b-c11e32c7c7d5 None admin] Authenticating user token {{(pid=101893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:43:04.028132 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5e553c6-d29b-4c7e-858c-616b1425bd73 None admin] Validating token access rules against request {{(pid=101892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:43:04.065681 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15e20fe3-6ee1-427f-be79-907baaeef2d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:43:04.066587 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e20fe3-6ee1-427f-be79-907baaeef2d9 None admin] REQUEST_METHOD: `GET` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:43:04.066877 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e20fe3-6ee1-427f-be79-907baaeef2d9 None admin] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:43:04.067156 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e20fe3-6ee1-427f-be79-907baaeef2d9 None admin] PATH_INFO: `/v3/projects/service` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:43:04.070231 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG dbcounter [-] [101892] Writing DB stats keystone:SELECT=100 {{(pid=101892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:43:04.076252 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15e20fe3-6ee1-427f-be79-907baaeef2d9 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:43:04.077935 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15e20fe3-6ee1-427f-be79-907baaeef2d9 None admin] RBAC: Authorization granted {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:43:04.092607 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8542b2a-1427-4fc6-8b9b-c11e32c7c7d5 None admin] Validating token access rules against request {{(pid=101893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:43:04.093412 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application [None req-15e20fe3-6ee1-427f-be79-907baaeef2d9 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 25 14:43:04.093412 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:43:04.093412 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 14:43:04.093412 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 14:43:04.093412 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 14:43:04.093412 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 14:43:04.093412 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 14:43:04.093412 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 14:43:04.093412 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 14:43:04.093412 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 14:43:04.093412 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 14:43:04.093412 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 14:43:04.093412 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 25 14:43:04.093412 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application return self._get_project(project_id) May 25 14:43:04.093412 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 25 14:43:04.094251 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 25 14:43:04.094251 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 14:43:04.094251 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 14:43:04.094251 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 14:43:04.094251 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 14:43:04.094251 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 14:43:04.094251 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application return self.get_or_create( May 25 14:43:04.094251 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 14:43:04.094251 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application with Lock( May 25 14:43:04.094251 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 14:43:04.094251 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application return self._enter() May 25 14:43:04.094251 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 14:43:04.094251 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 14:43:04.094251 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 14:43:04.094251 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application return self.creator() May 25 14:43:04.094251 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 14:43:04.094251 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application created_value = creator( May 25 14:43:04.095114 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 25 14:43:04.095114 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 25 14:43:04.095114 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 25 14:43:04.095114 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 25 14:43:04.095114 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 25 14:43:04.095114 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 25 14:43:04.095114 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 25 14:43:04.095114 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application May 25 14:43:04.097453 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 267/538] 10.222.0.84 () {56 vars in 1111 bytes} [Wed May 25 14:43:03 2022] GET /identity/v3/projects/service => generated 88 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 25 14:43:04.103187 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15e20fe3-6ee1-427f-be79-907baaeef2d9 None admin] Authenticating user token {{(pid=101892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:43:04.164027 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e45fa21e-8499-4b6c-8986-fa9f4413d96c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:43:04.164970 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45fa21e-8499-4b6c-8986-fa9f4413d96c None admin] REQUEST_METHOD: `GET` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:43:04.165400 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45fa21e-8499-4b6c-8986-fa9f4413d96c None admin] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:43:04.165819 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45fa21e-8499-4b6c-8986-fa9f4413d96c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:43:04.166795 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e45fa21e-8499-4b6c-8986-fa9f4413d96c None admin] RBAC: Adding query filter params (role.id=fdcb2eda27b84f44a392b7e8b59cc425, scope.project.id=a000829c658c4a7cab67f7b6353ba3fa, user.id=971542599734491aa112b815fc4cc5c2) {{(pid=101893) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:43:04.172013 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e45fa21e-8499-4b6c-8986-fa9f4413d96c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:43:04.173485 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e45fa21e-8499-4b6c-8986-fa9f4413d96c None admin] RBAC: Authorization granted {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:43:04.185915 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 272/539] 10.222.0.84 () {56 vars in 1374 bytes} [Wed May 25 14:43:03 2022] GET /identity/v3/role_assignments?user.id=971542599734491aa112b815fc4cc5c2&scope.project.id=a000829c658c4a7cab67f7b6353ba3fa&role.id=fdcb2eda27b84f44a392b7e8b59cc425 => generated 259 bytes in 270 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:43:04.187216 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61032e3b-768f-446f-88c8-67adbb614ef1 None None] REQUEST_METHOD: `GET` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:43:04.187504 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61032e3b-768f-446f-88c8-67adbb614ef1 None None] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:43:04.187836 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61032e3b-768f-446f-88c8-67adbb614ef1 None None] PATH_INFO: `/` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:43:04.189332 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 273/540] 10.222.0.84 () {54 vars in 926 bytes} [Wed May 25 14:43:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 14:43:04.195062 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ffbdaa3-2173-44e7-bc18-0e7716bf480e None None] REQUEST_METHOD: `POST` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:43:04.195346 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ffbdaa3-2173-44e7-bc18-0e7716bf480e None None] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:43:04.195664 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ffbdaa3-2173-44e7-bc18-0e7716bf480e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:43:04.215080 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.auth.core [None req-5ffbdaa3-2173-44e7-bc18-0e7716bf480e None None] MFA Rules not processed for user `05d87e87798e429aa1c10b24391f915e`. Rule list: `[]` (Enabled: `True`). {{(pid=101893) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:43:04.216927 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.fernet_utils [None req-5ffbdaa3-2173-44e7-bc18-0e7716bf480e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=101893) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:43:04.219487 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG dbcounter [-] [101893] Writing DB stats keystone:SELECT=100 {{(pid=101893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:43:04.237123 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15e20fe3-6ee1-427f-be79-907baaeef2d9 None admin] Validating token access rules against request {{(pid=101892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:43:04.302194 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86e3a4ff-3408-4906-8220-faada5a875e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:43:04.302883 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e3a4ff-3408-4906-8220-faada5a875e9 None admin] REQUEST_METHOD: `GET` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:43:04.303168 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e3a4ff-3408-4906-8220-faada5a875e9 None admin] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:43:04.303447 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e3a4ff-3408-4906-8220-faada5a875e9 None admin] PATH_INFO: `/v3/projects` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:43:04.306210 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86e3a4ff-3408-4906-8220-faada5a875e9 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=101892) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:43:04.306526 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86e3a4ff-3408-4906-8220-faada5a875e9 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:43:04.308031 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86e3a4ff-3408-4906-8220-faada5a875e9 None admin] RBAC: Authorization granted {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:43:04.335629 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 268/541] 10.222.0.84 () {56 vars in 1148 bytes} [Wed May 25 14:43:04 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:43:04.341597 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86e3a4ff-3408-4906-8220-faada5a875e9 None admin] Authenticating user token {{(pid=101892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:43:04.359922 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 274/542] 10.222.0.84 () {58 vars in 1023 bytes} [Wed May 25 14:43:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 25 14:43:04.402171 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ffbdaa3-2173-44e7-bc18-0e7716bf480e None None] Authenticating user token {{(pid=101893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:43:04.437363 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG dbcounter [-] [101892] Writing DB stats keystone:SELECT=100 {{(pid=101892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:43:04.498633 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86e3a4ff-3408-4906-8220-faada5a875e9 None admin] Validating token access rules against request {{(pid=101892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:43:04.530933 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ffbdaa3-2173-44e7-bc18-0e7716bf480e None None] Validating token access rules against request {{(pid=101893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:43:04.555738 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed747725-3c68-46b1-ba54-4bfe6e32bb92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:43:04.556245 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed747725-3c68-46b1-ba54-4bfe6e32bb92 None admin] REQUEST_METHOD: `GET` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:43:04.556536 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed747725-3c68-46b1-ba54-4bfe6e32bb92 None admin] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:43:04.556819 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed747725-3c68-46b1-ba54-4bfe6e32bb92 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:43:04.557756 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed747725-3c68-46b1-ba54-4bfe6e32bb92 None admin] RBAC: Adding query filter params (role.id=fdcb2eda27b84f44a392b7e8b59cc425, scope.project.id=a000829c658c4a7cab67f7b6353ba3fa, user.id=9ce28b25b907473588ccb87dc4acc06a) {{(pid=101892) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:43:04.558196 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed747725-3c68-46b1-ba54-4bfe6e32bb92 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:43:04.559591 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed747725-3c68-46b1-ba54-4bfe6e32bb92 None admin] RBAC: Authorization granted {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:43:04.573005 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 269/543] 10.222.0.84 () {56 vars in 1374 bytes} [Wed May 25 14:43:04 2022] GET /identity/v3/role_assignments?user.id=9ce28b25b907473588ccb87dc4acc06a&scope.project.id=a000829c658c4a7cab67f7b6353ba3fa&role.id=fdcb2eda27b84f44a392b7e8b59cc425 => generated 259 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 14:43:04.573703 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc460a6-c91f-4464-90b7-bb1c2d8d8b02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:43:04.574746 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc460a6-c91f-4464-90b7-bb1c2d8d8b02 None admin] REQUEST_METHOD: `GET` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:43:04.575223 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc460a6-c91f-4464-90b7-bb1c2d8d8b02 None admin] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:43:04.575748 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc460a6-c91f-4464-90b7-bb1c2d8d8b02 None admin] PATH_INFO: `/v3/roles/service` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:43:04.584505 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG dbcounter [-] [101893] Writing DB stats keystone:SELECT=100 {{(pid=101893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:43:04.589637 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bc460a6-c91f-4464-90b7-bb1c2d8d8b02 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 14:43:04.597781 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application [None req-4bc460a6-c91f-4464-90b7-bb1c2d8d8b02 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 25 14:43:04.597781 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:43:04.597781 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 14:43:04.597781 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 14:43:04.597781 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 14:43:04.597781 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 14:43:04.597781 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 14:43:04.597781 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 14:43:04.597781 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 14:43:04.597781 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 14:43:04.597781 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 14:43:04.597781 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 14:43:04.597781 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 14:43:04.597781 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 14:43:04.597781 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 14:43:04.597781 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 14:43:04.608894 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 14:43:04.608894 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 14:43:04.608894 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 14:43:04.608894 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 14:43:04.608894 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 14:43:04.608894 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 14:43:04.608894 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 14:43:04.608894 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 14:43:04.608894 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 14:43:04.608894 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return self.get_or_create( May 25 14:43:04.608894 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 14:43:04.608894 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application with Lock( May 25 14:43:04.608894 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 14:43:04.608894 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return self._enter() May 25 14:43:04.608894 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 14:43:04.608894 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 14:43:04.609699 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 14:43:04.609699 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return self.creator() May 25 14:43:04.609699 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 14:43:04.609699 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application created_value = creator( May 25 14:43:04.609699 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 14:43:04.609699 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 14:43:04.609699 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 14:43:04.609699 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 14:43:04.609699 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 14:43:04.609699 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 14:43:04.609699 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 25 14:43:04.609699 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application May 25 14:43:04.609699 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 275/544] 10.222.0.84 () {56 vars in 1102 bytes} [Wed May 25 14:43:04 2022] GET /identity/v3/roles/service => generated 85 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 25 14:43:04.610406 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed747725-3c68-46b1-ba54-4bfe6e32bb92 None admin] Authenticating user token {{(pid=101892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:43:04.739341 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af27bb6e-f55e-46b6-b37d-935a5d3bb4ef None None] REQUEST_METHOD: `GET` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:43:04.739341 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af27bb6e-f55e-46b6-b37d-935a5d3bb4ef None None] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:43:04.739341 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af27bb6e-f55e-46b6-b37d-935a5d3bb4ef None None] PATH_INFO: `/` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:43:04.739341 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 276/545] 10.222.0.84 () {54 vars in 926 bytes} [Wed May 25 14:43:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 14:43:04.748841 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a006bb5-cd6b-447e-ad44-4402c9dc0fd9 None None] REQUEST_METHOD: `POST` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:43:04.749171 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a006bb5-cd6b-447e-ad44-4402c9dc0fd9 None None] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:43:04.749413 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a006bb5-cd6b-447e-ad44-4402c9dc0fd9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:43:04.774057 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.auth.core [None req-8a006bb5-cd6b-447e-ad44-4402c9dc0fd9 None None] MFA Rules not processed for user `05d87e87798e429aa1c10b24391f915e`. Rule list: `[]` (Enabled: `True`). {{(pid=101893) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:43:04.775275 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.fernet_utils [None req-8a006bb5-cd6b-447e-ad44-4402c9dc0fd9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=101893) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:43:04.789706 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed747725-3c68-46b1-ba54-4bfe6e32bb92 None admin] Validating token access rules against request {{(pid=101892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:43:04.826606 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG dbcounter [-] [101892] Writing DB stats keystone:SELECT=100 {{(pid=101892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:43:04.849943 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7deef96-6e83-4473-8311-f9f6bca4adbe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:43:04.851068 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7deef96-6e83-4473-8311-f9f6bca4adbe None admin] REQUEST_METHOD: `GET` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:43:04.851661 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7deef96-6e83-4473-8311-f9f6bca4adbe None admin] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:43:04.852145 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7deef96-6e83-4473-8311-f9f6bca4adbe None admin] PATH_INFO: `/v3/roles` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:43:04.853192 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7deef96-6e83-4473-8311-f9f6bca4adbe None admin] RBAC: Adding query filter params (name=service) {{(pid=101892) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:43:04.853708 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7deef96-6e83-4473-8311-f9f6bca4adbe None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:43:04.855439 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7deef96-6e83-4473-8311-f9f6bca4adbe None admin] RBAC: Authorization granted {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:43:04.869598 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 270/546] 10.222.0.84 () {56 vars in 1103 bytes} [Wed May 25 14:43:04 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 264 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:43:04.875985 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7deef96-6e83-4473-8311-f9f6bca4adbe None admin] Authenticating user token {{(pid=101892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:43:04.908462 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 277/547] 10.222.0.84 () {58 vars in 1023 bytes} [Wed May 25 14:43:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 25 14:43:04.932493 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a006bb5-cd6b-447e-ad44-4402c9dc0fd9 None None] Authenticating user token {{(pid=101893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:43:05.005534 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7deef96-6e83-4473-8311-f9f6bca4adbe None admin] Validating token access rules against request {{(pid=101892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:43:05.045657 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d296af1-cfe2-485b-b62a-b93645d2a0c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:43:05.046460 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d296af1-cfe2-485b-b62a-b93645d2a0c3 None admin] REQUEST_METHOD: `GET` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:43:05.046743 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d296af1-cfe2-485b-b62a-b93645d2a0c3 None admin] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:43:05.047020 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d296af1-cfe2-485b-b62a-b93645d2a0c3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:43:05.060995 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d296af1-cfe2-485b-b62a-b93645d2a0c3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:43:05.062742 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d296af1-cfe2-485b-b62a-b93645d2a0c3 None admin] RBAC: Authorization granted {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:43:05.083308 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application [None req-6d296af1-cfe2-485b-b62a-b93645d2a0c3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 25 14:43:05.083308 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:43:05.083308 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 14:43:05.083308 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 14:43:05.083308 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 14:43:05.083308 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 14:43:05.083308 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 14:43:05.083308 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 14:43:05.083308 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 14:43:05.083308 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 14:43:05.083308 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 14:43:05.083308 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 14:43:05.083308 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 25 14:43:05.083308 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 25 14:43:05.083308 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 25 14:43:05.084244 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 25 14:43:05.084244 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 14:43:05.084244 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 14:43:05.084244 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 14:43:05.084244 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 14:43:05.084244 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 14:43:05.084244 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application return self.get_or_create( May 25 14:43:05.084244 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 14:43:05.084244 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application with Lock( May 25 14:43:05.084244 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 14:43:05.084244 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application return self._enter() May 25 14:43:05.084244 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 14:43:05.084244 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 14:43:05.084244 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 14:43:05.084244 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application return self.creator() May 25 14:43:05.084244 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 14:43:05.084244 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application created_value = creator( May 25 14:43:05.085802 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 25 14:43:05.085802 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 25 14:43:05.085802 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 25 14:43:05.085802 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application May 25 14:43:05.085802 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 271/548] 10.222.0.84 () {56 vars in 1108 bytes} [Wed May 25 14:43:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 14:43:05.092524 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d296af1-cfe2-485b-b62a-b93645d2a0c3 None admin] Authenticating user token {{(pid=101892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:43:05.139690 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG dbcounter [-] [101892] Writing DB stats keystone:SELECT=100 {{(pid=101892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:43:05.149775 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a006bb5-cd6b-447e-ad44-4402c9dc0fd9 None None] Validating token access rules against request {{(pid=101893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:43:05.215940 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG dbcounter [-] [101893] Writing DB stats keystone:SELECT=100 {{(pid=101893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:43:05.233323 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d296af1-cfe2-485b-b62a-b93645d2a0c3 None admin] Validating token access rules against request {{(pid=101892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:43:05.240070 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aff3cf2-94af-433f-b618-dbcde4985d5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:43:05.240876 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aff3cf2-94af-433f-b618-dbcde4985d5e None admin] REQUEST_METHOD: `GET` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:43:05.242470 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aff3cf2-94af-433f-b618-dbcde4985d5e None admin] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:43:05.242470 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aff3cf2-94af-433f-b618-dbcde4985d5e None admin] PATH_INFO: `/v3/roles/service` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:43:05.261315 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aff3cf2-94af-433f-b618-dbcde4985d5e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 14:43:05.269113 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application [None req-6aff3cf2-94af-433f-b618-dbcde4985d5e None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 25 14:43:05.269113 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:43:05.269113 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 14:43:05.269113 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 14:43:05.269113 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 14:43:05.269113 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 14:43:05.269113 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 14:43:05.269113 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 14:43:05.269113 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 14:43:05.269113 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 14:43:05.269113 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 14:43:05.269113 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 14:43:05.269113 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 14:43:05.269113 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 14:43:05.269113 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 14:43:05.269113 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 14:43:05.270114 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 14:43:05.270114 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 14:43:05.270114 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 14:43:05.270114 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 14:43:05.270114 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 14:43:05.270114 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 14:43:05.270114 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 14:43:05.270114 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 14:43:05.270114 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 14:43:05.270114 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return self.get_or_create( May 25 14:43:05.270114 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 14:43:05.270114 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application with Lock( May 25 14:43:05.270114 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 14:43:05.270114 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return self._enter() May 25 14:43:05.270114 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 14:43:05.270114 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 14:43:05.270972 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 14:43:05.270972 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return self.creator() May 25 14:43:05.270972 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 14:43:05.270972 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application created_value = creator( May 25 14:43:05.270972 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 14:43:05.270972 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 14:43:05.270972 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 14:43:05.270972 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 14:43:05.270972 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 14:43:05.270972 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 14:43:05.270972 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 25 14:43:05.270972 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application May 25 14:43:05.276111 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 278/549] 10.222.0.84 () {56 vars in 1102 bytes} [Wed May 25 14:43:04 2022] GET /identity/v3/roles/service => generated 85 bytes in 344 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 25 14:43:05.277374 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aff3cf2-94af-433f-b618-dbcde4985d5e None admin] Authenticating user token {{(pid=101893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:43:05.298896 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a1c4d1b-16c4-44c0-a95d-52b5afa822cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:43:05.299588 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1c4d1b-16c4-44c0-a95d-52b5afa822cf None admin] REQUEST_METHOD: `GET` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:43:05.299889 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1c4d1b-16c4-44c0-a95d-52b5afa822cf None admin] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:43:05.300170 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1c4d1b-16c4-44c0-a95d-52b5afa822cf None admin] PATH_INFO: `/v3/domains` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:43:05.300904 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a1c4d1b-16c4-44c0-a95d-52b5afa822cf None admin] RBAC: Adding query filter params (name=Default) {{(pid=101892) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:43:05.301218 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a1c4d1b-16c4-44c0-a95d-52b5afa822cf None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:43:05.302603 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a1c4d1b-16c4-44c0-a95d-52b5afa822cf None admin] RBAC: Authorization granted {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:43:05.317318 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 272/550] 10.222.0.84 () {56 vars in 1109 bytes} [Wed May 25 14:43:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:43:05.323212 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a1c4d1b-16c4-44c0-a95d-52b5afa822cf None admin] Authenticating user token {{(pid=101892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:43:05.474418 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aff3cf2-94af-433f-b618-dbcde4985d5e None admin] Validating token access rules against request {{(pid=101893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:43:05.510838 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG dbcounter [-] [101892] Writing DB stats keystone:SELECT=100 {{(pid=101892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:43:05.512000 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62b9efef-5ffd-4d06-8e10-57d45a47e9e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:43:05.513059 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b9efef-5ffd-4d06-8e10-57d45a47e9e1 None admin] REQUEST_METHOD: `GET` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:43:05.513609 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b9efef-5ffd-4d06-8e10-57d45a47e9e1 None admin] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:43:05.514079 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b9efef-5ffd-4d06-8e10-57d45a47e9e1 None admin] PATH_INFO: `/v3/roles` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:43:05.515100 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62b9efef-5ffd-4d06-8e10-57d45a47e9e1 None admin] RBAC: Adding query filter params (name=service) {{(pid=101893) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:43:05.515648 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62b9efef-5ffd-4d06-8e10-57d45a47e9e1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:43:05.517255 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62b9efef-5ffd-4d06-8e10-57d45a47e9e1 None admin] RBAC: Authorization granted {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:43:05.517974 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a1c4d1b-16c4-44c0-a95d-52b5afa822cf None admin] Validating token access rules against request {{(pid=101892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:43:05.526624 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 279/551] 10.222.0.84 () {56 vars in 1103 bytes} [Wed May 25 14:43:05 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 14:43:05.532093 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62b9efef-5ffd-4d06-8e10-57d45a47e9e1 None admin] Authenticating user token {{(pid=101893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:43:05.567603 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f5b728b-c961-4742-94d0-36458809a250 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:43:05.567603 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f5b728b-c961-4742-94d0-36458809a250 None admin] REQUEST_METHOD: `GET` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:43:05.567603 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f5b728b-c961-4742-94d0-36458809a250 None admin] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:43:05.567603 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f5b728b-c961-4742-94d0-36458809a250 None admin] PATH_INFO: `/v3/users/swift` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:43:05.574179 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f5b728b-c961-4742-94d0-36458809a250 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:43:05.575853 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f5b728b-c961-4742-94d0-36458809a250 None admin] RBAC: Authorization granted {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:43:05.591857 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application [None req-2f5b728b-c961-4742-94d0-36458809a250 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. May 25 14:43:05.591857 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:43:05.591857 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 14:43:05.591857 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 14:43:05.591857 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 14:43:05.591857 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 14:43:05.591857 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 14:43:05.591857 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 14:43:05.591857 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 14:43:05.591857 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 14:43:05.591857 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 14:43:05.591857 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 14:43:05.591857 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 25 14:43:05.591857 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application return self._get_user(user_id) May 25 14:43:05.591857 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 25 14:43:05.591857 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 25 14:43:05.592804 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 14:43:05.592804 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 14:43:05.592804 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 25 14:43:05.592804 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 25 14:43:05.592804 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 25 14:43:05.592804 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 25 14:43:05.592804 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 14:43:05.592804 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 14:43:05.592804 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 14:43:05.592804 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application return self.get_or_create( May 25 14:43:05.592804 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 14:43:05.592804 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application with Lock( May 25 14:43:05.592804 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 14:43:05.592804 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application return self._enter() May 25 14:43:05.592804 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 14:43:05.592804 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 14:43:05.592804 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 14:43:05.592804 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application return self.creator() May 25 14:43:05.593779 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 14:43:05.593779 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application created_value = creator( May 25 14:43:05.593779 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 25 14:43:05.593779 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 25 14:43:05.593779 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 25 14:43:05.593779 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 25 14:43:05.593779 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 25 14:43:05.593779 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 25 14:43:05.593779 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. May 25 14:43:05.593779 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application May 25 14:43:05.598186 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 273/552] 10.222.0.84 () {56 vars in 1096 bytes} [Wed May 25 14:43:05 2022] GET /identity/v3/users/swift => generated 83 bytes in 270 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 14:43:05.600120 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f5b728b-c961-4742-94d0-36458809a250 None admin] Authenticating user token {{(pid=101892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:43:05.655880 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG dbcounter [-] [101893] Writing DB stats keystone:SELECT=100 {{(pid=101893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:43:05.715191 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f5b728b-c961-4742-94d0-36458809a250 None admin] Validating token access rules against request {{(pid=101892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:43:05.776436 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb188c39-412a-4ac7-a78a-fc9477261aeb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:43:05.777044 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb188c39-412a-4ac7-a78a-fc9477261aeb None admin] REQUEST_METHOD: `GET` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:43:05.777323 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb188c39-412a-4ac7-a78a-fc9477261aeb None admin] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:43:05.777600 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb188c39-412a-4ac7-a78a-fc9477261aeb None admin] PATH_INFO: `/v3/users` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:43:05.778471 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb188c39-412a-4ac7-a78a-fc9477261aeb None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=101892) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:43:05.778784 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb188c39-412a-4ac7-a78a-fc9477261aeb None admin] RBAC: Authorizing `identity:list_users()` {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:43:05.780310 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb188c39-412a-4ac7-a78a-fc9477261aeb None admin] RBAC: Authorization granted {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:43:05.808191 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62b9efef-5ffd-4d06-8e10-57d45a47e9e1 None admin] Validating token access rules against request {{(pid=101893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:43:05.823389 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 274/553] 10.222.0.84 () {56 vars in 1135 bytes} [Wed May 25 14:43:05 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 14:43:05.828622 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb188c39-412a-4ac7-a78a-fc9477261aeb None admin] Authenticating user token {{(pid=101892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:43:05.859518 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG dbcounter [-] [101892] Writing DB stats keystone:SELECT=100 {{(pid=101892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:43:05.869769 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5d21df8-d4ad-43f2-b62e-4d92258eab81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:43:05.870726 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d21df8-d4ad-43f2-b62e-4d92258eab81 None admin] REQUEST_METHOD: `GET` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:43:05.871005 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d21df8-d4ad-43f2-b62e-4d92258eab81 None admin] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:43:05.871280 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d21df8-d4ad-43f2-b62e-4d92258eab81 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:43:05.883011 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5d21df8-d4ad-43f2-b62e-4d92258eab81 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:43:05.884520 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5d21df8-d4ad-43f2-b62e-4d92258eab81 None admin] RBAC: Authorization granted {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:43:05.903212 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application [None req-b5d21df8-d4ad-43f2-b62e-4d92258eab81 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 25 14:43:05.903212 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:43:05.903212 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 14:43:05.903212 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 14:43:05.903212 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 14:43:05.903212 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 14:43:05.903212 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 14:43:05.903212 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 14:43:05.903212 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 14:43:05.903212 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 14:43:05.903212 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 14:43:05.903212 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 14:43:05.903212 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 25 14:43:05.903212 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 25 14:43:05.903212 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 25 14:43:05.904177 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 25 14:43:05.904177 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 14:43:05.904177 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 14:43:05.904177 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 14:43:05.904177 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 14:43:05.904177 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 14:43:05.904177 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return self.get_or_create( May 25 14:43:05.904177 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 14:43:05.904177 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application with Lock( May 25 14:43:05.904177 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 14:43:05.904177 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return self._enter() May 25 14:43:05.904177 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 14:43:05.904177 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 14:43:05.904177 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 14:43:05.904177 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return self.creator() May 25 14:43:05.904177 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 14:43:05.904177 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application created_value = creator( May 25 14:43:05.905048 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 25 14:43:05.905048 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 25 14:43:05.905048 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 25 14:43:05.905048 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application May 25 14:43:05.905048 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 280/554] 10.222.0.84 () {56 vars in 1108 bytes} [Wed May 25 14:43:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 373 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 14:43:05.909988 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5d21df8-d4ad-43f2-b62e-4d92258eab81 None admin] Authenticating user token {{(pid=101893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:43:06.046463 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5d21df8-d4ad-43f2-b62e-4d92258eab81 None admin] Validating token access rules against request {{(pid=101893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:43:06.073190 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG dbcounter [-] [101893] Writing DB stats keystone:SELECT=100 {{(pid=101893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:43:06.086670 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97039b82-8cc2-4256-8dc9-8a4a93b2eed9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:43:06.091937 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97039b82-8cc2-4256-8dc9-8a4a93b2eed9 None admin] REQUEST_METHOD: `GET` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:43:06.091937 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97039b82-8cc2-4256-8dc9-8a4a93b2eed9 None admin] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:43:06.091937 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97039b82-8cc2-4256-8dc9-8a4a93b2eed9 None admin] PATH_INFO: `/v3/domains` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:43:06.091937 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97039b82-8cc2-4256-8dc9-8a4a93b2eed9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=101893) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:43:06.091937 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97039b82-8cc2-4256-8dc9-8a4a93b2eed9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:43:06.091937 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97039b82-8cc2-4256-8dc9-8a4a93b2eed9 None admin] RBAC: Authorization granted {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:43:06.094289 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb188c39-412a-4ac7-a78a-fc9477261aeb None admin] Validating token access rules against request {{(pid=101892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:43:06.104795 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 281/555] 10.222.0.84 () {56 vars in 1109 bytes} [Wed May 25 14:43:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 14:43:06.110156 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97039b82-8cc2-4256-8dc9-8a4a93b2eed9 None admin] Authenticating user token {{(pid=101893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:43:06.172150 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1fa1e48-98f3-47c0-9aca-d1fd045aee9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:43:06.172804 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1fa1e48-98f3-47c0-9aca-d1fd045aee9a None admin] REQUEST_METHOD: `GET` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:43:06.173089 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1fa1e48-98f3-47c0-9aca-d1fd045aee9a None admin] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:43:06.173367 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1fa1e48-98f3-47c0-9aca-d1fd045aee9a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:43:06.294938 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1fa1e48-98f3-47c0-9aca-d1fd045aee9a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:43:06.295964 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97039b82-8cc2-4256-8dc9-8a4a93b2eed9 None admin] Validating token access rules against request {{(pid=101893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:43:06.299624 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1fa1e48-98f3-47c0-9aca-d1fd045aee9a None admin] RBAC: Authorization granted {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:43:06.314582 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG dbcounter [-] [101892] Writing DB stats keystone:SELECT=100 {{(pid=101892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:43:06.340112 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24b6ad81-2494-4775-996b-a8c786e310ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:43:06.340927 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b6ad81-2494-4775-996b-a8c786e310ad None admin] REQUEST_METHOD: `GET` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:43:06.341212 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b6ad81-2494-4775-996b-a8c786e310ad None admin] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:43:06.341488 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b6ad81-2494-4775-996b-a8c786e310ad None admin] PATH_INFO: `/v3/users/nova` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:43:06.350354 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24b6ad81-2494-4775-996b-a8c786e310ad None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:43:06.351998 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24b6ad81-2494-4775-996b-a8c786e310ad None admin] RBAC: Authorization granted {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:43:06.369869 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application [None req-24b6ad81-2494-4775-996b-a8c786e310ad None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 25 14:43:06.369869 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:43:06.369869 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 14:43:06.369869 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 14:43:06.369869 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 14:43:06.369869 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 14:43:06.369869 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 14:43:06.369869 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 14:43:06.369869 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 14:43:06.369869 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 14:43:06.369869 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 14:43:06.369869 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 14:43:06.369869 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 25 14:43:06.369869 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return self._get_user(user_id) May 25 14:43:06.369869 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 25 14:43:06.369869 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 25 14:43:06.371683 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 14:43:06.371683 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 14:43:06.371683 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 25 14:43:06.371683 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 25 14:43:06.371683 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 25 14:43:06.371683 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 25 14:43:06.371683 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 14:43:06.371683 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 14:43:06.371683 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 14:43:06.371683 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return self.get_or_create( May 25 14:43:06.371683 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 14:43:06.371683 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application with Lock( May 25 14:43:06.371683 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 14:43:06.371683 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return self._enter() May 25 14:43:06.371683 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 14:43:06.371683 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 14:43:06.371683 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 14:43:06.371683 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return self.creator() May 25 14:43:06.372872 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 14:43:06.372872 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application created_value = creator( May 25 14:43:06.372872 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 25 14:43:06.372872 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 25 14:43:06.372872 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 25 14:43:06.372872 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 25 14:43:06.372872 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 25 14:43:06.372872 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 25 14:43:06.372872 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 25 14:43:06.372872 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application May 25 14:43:06.372872 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 282/556] 10.222.0.84 () {56 vars in 1093 bytes} [Wed May 25 14:43:06 2022] GET /identity/v3/users/nova => generated 82 bytes in 262 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 14:43:06.372872 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f173f762-3571-411a-83da-c85304a72e90 None None] REQUEST_METHOD: `GET` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:43:06.373796 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f173f762-3571-411a-83da-c85304a72e90 None None] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:43:06.373796 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f173f762-3571-411a-83da-c85304a72e90 None None] PATH_INFO: `/` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:43:06.374946 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 283/557] 10.222.0.84 () {54 vars in 926 bytes} [Wed May 25 14:43:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 14:43:06.379043 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f173f762-3571-411a-83da-c85304a72e90 None None] Authenticating user token {{(pid=101893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:43:06.410907 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG dbcounter [-] [101893] Writing DB stats keystone:SELECT=100 {{(pid=101893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:43:06.425142 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 275/558] 10.222.0.84 () {58 vars in 1282 bytes} [Wed May 25 14:43:05 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 596 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 25 14:43:06.430330 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ccddf5-6e9f-495e-975a-3f1ab2915c25 None None] REQUEST_METHOD: `POST` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:43:06.431098 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ccddf5-6e9f-495e-975a-3f1ab2915c25 None None] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:43:06.431619 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ccddf5-6e9f-495e-975a-3f1ab2915c25 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:43:06.451293 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.auth.core [None req-a0ccddf5-6e9f-495e-975a-3f1ab2915c25 None None] MFA Rules not processed for user `05d87e87798e429aa1c10b24391f915e`. Rule list: `[]` (Enabled: `True`). {{(pid=101892) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:43:06.452995 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.fernet_utils [None req-a0ccddf5-6e9f-495e-975a-3f1ab2915c25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=101892) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:43:06.501984 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f173f762-3571-411a-83da-c85304a72e90 None None] Validating token access rules against request {{(pid=101893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:43:06.535252 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 276/559] 10.222.0.84 () {58 vars in 1023 bytes} [Wed May 25 14:43:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 25 14:43:06.541669 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0ccddf5-6e9f-495e-975a-3f1ab2915c25 None None] Authenticating user token {{(pid=101892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:43:06.544401 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e24bf47d-6755-434f-9360-2b3c9bfa32ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:43:06.545687 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24bf47d-6755-434f-9360-2b3c9bfa32ca None admin] REQUEST_METHOD: `GET` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:43:06.546102 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24bf47d-6755-434f-9360-2b3c9bfa32ca None admin] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:43:06.546536 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24bf47d-6755-434f-9360-2b3c9bfa32ca None admin] PATH_INFO: `/v3/users` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:43:06.559857 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e24bf47d-6755-434f-9360-2b3c9bfa32ca None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=101893) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:43:06.560495 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e24bf47d-6755-434f-9360-2b3c9bfa32ca None admin] RBAC: Authorizing `identity:list_users()` {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:43:06.562589 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e24bf47d-6755-434f-9360-2b3c9bfa32ca None admin] RBAC: Authorization granted {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:43:06.584366 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 284/560] 10.222.0.84 () {56 vars in 1133 bytes} [Wed May 25 14:43:06 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 14:43:06.586006 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e24bf47d-6755-434f-9360-2b3c9bfa32ca None admin] Authenticating user token {{(pid=101893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:43:06.615344 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG dbcounter [-] [101892] Writing DB stats keystone:SELECT=100 {{(pid=101892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:43:06.683614 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0ccddf5-6e9f-495e-975a-3f1ab2915c25 None None] Validating token access rules against request {{(pid=101892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:43:06.687359 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG dbcounter [-] [101893] Writing DB stats keystone:SELECT=100 {{(pid=101893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:43:06.710851 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e24bf47d-6755-434f-9360-2b3c9bfa32ca None admin] Validating token access rules against request {{(pid=101893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:43:06.721999 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afff88a2-bf88-4a6e-932f-c5c95243beff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:43:06.723819 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afff88a2-bf88-4a6e-932f-c5c95243beff None admin] REQUEST_METHOD: `GET` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:43:06.724108 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afff88a2-bf88-4a6e-932f-c5c95243beff None admin] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:43:06.724388 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afff88a2-bf88-4a6e-932f-c5c95243beff None admin] PATH_INFO: `/v3/domains/Default` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:43:06.735674 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afff88a2-bf88-4a6e-932f-c5c95243beff None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:43:06.737250 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afff88a2-bf88-4a6e-932f-c5c95243beff None admin] RBAC: Authorization granted {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:43:06.753409 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0c899bd-db29-474e-97f6-277177f7f96f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:43:06.754595 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c899bd-db29-474e-97f6-277177f7f96f None admin] REQUEST_METHOD: `GET` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:43:06.755082 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c899bd-db29-474e-97f6-277177f7f96f None admin] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:43:06.755585 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c899bd-db29-474e-97f6-277177f7f96f None admin] PATH_INFO: `/v3/roles/service` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:43:06.758110 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application [None req-afff88a2-bf88-4a6e-932f-c5c95243beff None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 25 14:43:06.758110 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:43:06.758110 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 14:43:06.758110 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 14:43:06.758110 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 14:43:06.758110 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 14:43:06.758110 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 14:43:06.758110 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 14:43:06.758110 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 14:43:06.758110 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 14:43:06.758110 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 14:43:06.758110 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 14:43:06.758110 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 25 14:43:06.758110 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 25 14:43:06.758110 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 25 14:43:06.758995 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 25 14:43:06.758995 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 14:43:06.758995 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 14:43:06.758995 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 14:43:06.758995 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 14:43:06.758995 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 14:43:06.758995 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application return self.get_or_create( May 25 14:43:06.758995 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 14:43:06.758995 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application with Lock( May 25 14:43:06.758995 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 14:43:06.758995 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application return self._enter() May 25 14:43:06.758995 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 14:43:06.758995 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 14:43:06.758995 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 14:43:06.758995 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application return self.creator() May 25 14:43:06.758995 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 14:43:06.758995 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application created_value = creator( May 25 14:43:06.759963 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 25 14:43:06.759963 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 25 14:43:06.759963 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 25 14:43:06.759963 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application May 25 14:43:06.764303 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 277/561] 10.222.0.84 () {56 vars in 1108 bytes} [Wed May 25 14:43:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 14:43:06.765518 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afff88a2-bf88-4a6e-932f-c5c95243beff None admin] Authenticating user token {{(pid=101892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:43:06.773619 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0c899bd-db29-474e-97f6-277177f7f96f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 14:43:06.784265 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application [None req-b0c899bd-db29-474e-97f6-277177f7f96f None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 25 14:43:06.784265 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:43:06.784265 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 14:43:06.784265 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 14:43:06.784265 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 14:43:06.784265 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 14:43:06.784265 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 14:43:06.784265 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 14:43:06.784265 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 14:43:06.784265 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 14:43:06.784265 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 14:43:06.784265 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 14:43:06.784265 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 14:43:06.784265 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 14:43:06.784265 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 14:43:06.784265 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 14:43:06.785361 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 14:43:06.785361 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 14:43:06.785361 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 14:43:06.785361 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 14:43:06.785361 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 14:43:06.785361 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 14:43:06.785361 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 14:43:06.785361 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 14:43:06.785361 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 14:43:06.785361 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return self.get_or_create( May 25 14:43:06.785361 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 14:43:06.785361 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application with Lock( May 25 14:43:06.785361 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 14:43:06.785361 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return self._enter() May 25 14:43:06.785361 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 14:43:06.785361 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 14:43:06.786202 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 14:43:06.786202 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return self.creator() May 25 14:43:06.786202 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 14:43:06.786202 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application created_value = creator( May 25 14:43:06.786202 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 14:43:06.786202 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 14:43:06.786202 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 14:43:06.786202 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 14:43:06.786202 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 14:43:06.786202 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 14:43:06.786202 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 25 14:43:06.786202 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application May 25 14:43:06.787736 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 285/562] 10.222.0.84 () {56 vars in 1102 bytes} [Wed May 25 14:43:06 2022] GET /identity/v3/roles/service => generated 85 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 14:43:06.788864 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0c899bd-db29-474e-97f6-277177f7f96f None admin] Authenticating user token {{(pid=101893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:43:06.876729 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG dbcounter [-] [101892] Writing DB stats keystone:SELECT=100 {{(pid=101892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:43:06.884771 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afff88a2-bf88-4a6e-932f-c5c95243beff None admin] Validating token access rules against request {{(pid=101892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:43:06.918378 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0c899bd-db29-474e-97f6-277177f7f96f None admin] Validating token access rules against request {{(pid=101893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:43:06.931072 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b7c30ca-dcd8-411c-9bb6-bdbfefce9bb1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:43:06.932800 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7c30ca-dcd8-411c-9bb6-bdbfefce9bb1 None admin] REQUEST_METHOD: `GET` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:43:06.933648 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7c30ca-dcd8-411c-9bb6-bdbfefce9bb1 None admin] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:43:06.934141 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7c30ca-dcd8-411c-9bb6-bdbfefce9bb1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:43:06.950465 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b7c30ca-dcd8-411c-9bb6-bdbfefce9bb1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:43:06.953439 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b7c30ca-dcd8-411c-9bb6-bdbfefce9bb1 None admin] RBAC: Authorization granted {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:43:06.961117 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef034f76-5dc0-44b5-b9c5-3e6ed14bbd60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:43:06.961918 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef034f76-5dc0-44b5-b9c5-3e6ed14bbd60 None admin] REQUEST_METHOD: `GET` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:43:06.962208 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef034f76-5dc0-44b5-b9c5-3e6ed14bbd60 None admin] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:43:06.962487 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef034f76-5dc0-44b5-b9c5-3e6ed14bbd60 None admin] PATH_INFO: `/v3/domains` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:43:06.963220 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef034f76-5dc0-44b5-b9c5-3e6ed14bbd60 None admin] RBAC: Adding query filter params (name=Default) {{(pid=101893) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:43:06.963532 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef034f76-5dc0-44b5-b9c5-3e6ed14bbd60 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:43:06.965083 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef034f76-5dc0-44b5-b9c5-3e6ed14bbd60 None admin] RBAC: Authorization granted {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:43:06.973376 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application [None req-1b7c30ca-dcd8-411c-9bb6-bdbfefce9bb1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 25 14:43:06.973376 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:43:06.973376 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 14:43:06.973376 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 14:43:06.973376 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 14:43:06.973376 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 14:43:06.973376 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 14:43:06.973376 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 14:43:06.973376 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 14:43:06.973376 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 14:43:06.973376 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 14:43:06.973376 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 14:43:06.973376 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 25 14:43:06.973376 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 25 14:43:06.973376 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 25 14:43:06.974253 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 25 14:43:06.974253 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 14:43:06.974253 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 14:43:06.974253 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 14:43:06.974253 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 14:43:06.974253 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 14:43:06.974253 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application return self.get_or_create( May 25 14:43:06.974253 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 14:43:06.974253 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application with Lock( May 25 14:43:06.974253 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 14:43:06.974253 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application return self._enter() May 25 14:43:06.974253 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 14:43:06.974253 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 14:43:06.974253 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 14:43:06.974253 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application return self.creator() May 25 14:43:06.974253 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 14:43:06.974253 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application created_value = creator( May 25 14:43:06.975143 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 25 14:43:06.975143 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 25 14:43:06.975143 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 25 14:43:06.975143 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application May 25 14:43:06.975143 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 278/563] 10.222.0.84 () {56 vars in 1108 bytes} [Wed May 25 14:43:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 14:43:06.976892 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b7c30ca-dcd8-411c-9bb6-bdbfefce9bb1 None admin] Authenticating user token {{(pid=101892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:43:06.978070 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG dbcounter [-] [101893] Writing DB stats keystone:SELECT=100 {{(pid=101893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:43:06.980641 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 286/564] 10.222.0.84 () {56 vars in 1109 bytes} [Wed May 25 14:43:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:43:06.982054 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f481e39-334f-4490-961f-7f7285a210f1 None None] REQUEST_METHOD: `GET` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:43:06.982239 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f481e39-334f-4490-961f-7f7285a210f1 None None] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:43:06.982500 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f481e39-334f-4490-961f-7f7285a210f1 None None] PATH_INFO: `/` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:43:06.987618 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 287/565] 10.222.0.84 () {54 vars in 926 bytes} [Wed May 25 14:43:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 14:43:06.987618 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f481e39-334f-4490-961f-7f7285a210f1 None None] Authenticating user token {{(pid=101893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:43:07.092393 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f481e39-334f-4490-961f-7f7285a210f1 None None] Validating token access rules against request {{(pid=101893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:43:07.092732 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b7c30ca-dcd8-411c-9bb6-bdbfefce9bb1 None admin] Validating token access rules against request {{(pid=101892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:43:07.129905 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f78d374a-2b2c-4e26-9268-f9420e5330f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:43:07.132162 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78d374a-2b2c-4e26-9268-f9420e5330f2 None admin] REQUEST_METHOD: `GET` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:43:07.132162 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78d374a-2b2c-4e26-9268-f9420e5330f2 None admin] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:43:07.132162 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78d374a-2b2c-4e26-9268-f9420e5330f2 None admin] PATH_INFO: `/v3/roles` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:43:07.132162 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f78d374a-2b2c-4e26-9268-f9420e5330f2 None admin] RBAC: Adding query filter params (name=service) {{(pid=101892) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:43:07.132162 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f78d374a-2b2c-4e26-9268-f9420e5330f2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:43:07.135652 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f78d374a-2b2c-4e26-9268-f9420e5330f2 None admin] RBAC: Authorization granted {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:43:07.135913 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07b23af5-4892-4750-8760-30fd1eb9424e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:43:07.135913 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b23af5-4892-4750-8760-30fd1eb9424e None admin] REQUEST_METHOD: `GET` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:43:07.135913 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b23af5-4892-4750-8760-30fd1eb9424e None admin] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:43:07.135913 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b23af5-4892-4750-8760-30fd1eb9424e None admin] PATH_INFO: `/v3/domains` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:43:07.136241 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07b23af5-4892-4750-8760-30fd1eb9424e None admin] RBAC: Adding query filter params (name=Default) {{(pid=101893) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:43:07.136474 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07b23af5-4892-4750-8760-30fd1eb9424e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:43:07.137871 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07b23af5-4892-4750-8760-30fd1eb9424e None admin] RBAC: Authorization granted {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:43:07.141733 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 279/566] 10.222.0.84 () {56 vars in 1103 bytes} [Wed May 25 14:43:06 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:43:07.142526 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f78d374a-2b2c-4e26-9268-f9420e5330f2 None admin] Authenticating user token {{(pid=101892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:43:07.149932 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 288/567] 10.222.0.84 () {56 vars in 1109 bytes} [Wed May 25 14:43:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:43:07.151165 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37772a0c-729a-4caa-bea7-36892ec2f873 None None] REQUEST_METHOD: `POST` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:43:07.151456 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37772a0c-729a-4caa-bea7-36892ec2f873 None None] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:43:07.151763 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37772a0c-729a-4caa-bea7-36892ec2f873 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:43:07.156260 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG dbcounter [-] [101892] Writing DB stats keystone:SELECT=100 {{(pid=101892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:43:07.169116 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.auth.core [None req-37772a0c-729a-4caa-bea7-36892ec2f873 None None] MFA Rules not processed for user `05d87e87798e429aa1c10b24391f915e`. Rule list: `[]` (Enabled: `True`). {{(pid=101893) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:43:07.170430 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.fernet_utils [None req-37772a0c-729a-4caa-bea7-36892ec2f873 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=101893) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:43:07.228170 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG dbcounter [-] [101893] Writing DB stats keystone:SELECT=100 {{(pid=101893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:43:07.239005 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 289/568] 10.222.0.84 () {58 vars in 1023 bytes} [Wed May 25 14:43:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 25 14:43:07.240408 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7eaafe-5e57-4836-9c19-f65829bd8207 None None] REQUEST_METHOD: `GET` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:43:07.240702 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7eaafe-5e57-4836-9c19-f65829bd8207 None None] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:43:07.241530 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7eaafe-5e57-4836-9c19-f65829bd8207 None None] PATH_INFO: `/` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:43:07.242843 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 290/569] 10.222.0.84 () {54 vars in 926 bytes} [Wed May 25 14:43:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 14:43:07.243539 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff7eaafe-5e57-4836-9c19-f65829bd8207 None None] Authenticating user token {{(pid=101893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:43:07.244635 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f78d374a-2b2c-4e26-9268-f9420e5330f2 None admin] Validating token access rules against request {{(pid=101892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:43:07.280301 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4597c593-16aa-4ac0-8592-be447f3c807c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:43:07.281089 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4597c593-16aa-4ac0-8592-be447f3c807c None admin] REQUEST_METHOD: `GET` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:43:07.281372 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4597c593-16aa-4ac0-8592-be447f3c807c None admin] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:43:07.281645 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4597c593-16aa-4ac0-8592-be447f3c807c None admin] PATH_INFO: `/v3/projects/service` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:43:07.288689 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4597c593-16aa-4ac0-8592-be447f3c807c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:43:07.290153 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4597c593-16aa-4ac0-8592-be447f3c807c None admin] RBAC: Authorization granted {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:43:07.304849 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application [None req-4597c593-16aa-4ac0-8592-be447f3c807c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 25 14:43:07.304849 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:43:07.304849 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 14:43:07.304849 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 14:43:07.304849 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 14:43:07.304849 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 14:43:07.304849 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 14:43:07.304849 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 14:43:07.304849 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 14:43:07.304849 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 14:43:07.304849 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 14:43:07.304849 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 14:43:07.304849 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 25 14:43:07.304849 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application return self._get_project(project_id) May 25 14:43:07.304849 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 25 14:43:07.305756 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 25 14:43:07.305756 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 14:43:07.305756 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 14:43:07.305756 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 14:43:07.305756 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 14:43:07.305756 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 14:43:07.305756 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application return self.get_or_create( May 25 14:43:07.305756 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 14:43:07.305756 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application with Lock( May 25 14:43:07.305756 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 14:43:07.305756 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application return self._enter() May 25 14:43:07.305756 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 14:43:07.305756 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 14:43:07.305756 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 14:43:07.305756 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application return self.creator() May 25 14:43:07.305756 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 14:43:07.305756 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application created_value = creator( May 25 14:43:07.306666 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 25 14:43:07.306666 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 25 14:43:07.306666 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 25 14:43:07.306666 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 25 14:43:07.306666 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 25 14:43:07.306666 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 25 14:43:07.306666 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 25 14:43:07.306666 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application May 25 14:43:07.306666 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 280/570] 10.222.0.84 () {56 vars in 1111 bytes} [Wed May 25 14:43:07 2022] GET /identity/v3/projects/service => generated 88 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 14:43:07.307157 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4597c593-16aa-4ac0-8592-be447f3c807c None admin] Authenticating user token {{(pid=101892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:43:07.357776 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff7eaafe-5e57-4836-9c19-f65829bd8207 None None] Validating token access rules against request {{(pid=101893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:43:07.372832 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG dbcounter [-] [101892] Writing DB stats keystone:SELECT=100 {{(pid=101892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:43:07.390667 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83972ad7-df69-4642-977d-c8975c53756f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:43:07.391417 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83972ad7-df69-4642-977d-c8975c53756f None admin] REQUEST_METHOD: `GET` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:43:07.391730 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83972ad7-df69-4642-977d-c8975c53756f None admin] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:43:07.392003 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83972ad7-df69-4642-977d-c8975c53756f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:43:07.403239 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83972ad7-df69-4642-977d-c8975c53756f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:43:07.405053 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83972ad7-df69-4642-977d-c8975c53756f None admin] RBAC: Authorization granted {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:43:07.406379 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4597c593-16aa-4ac0-8592-be447f3c807c None admin] Validating token access rules against request {{(pid=101892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:43:07.423125 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application [None req-83972ad7-df69-4642-977d-c8975c53756f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 25 14:43:07.423125 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:43:07.423125 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 14:43:07.423125 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 14:43:07.423125 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 14:43:07.423125 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 14:43:07.423125 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 14:43:07.423125 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 14:43:07.423125 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 14:43:07.423125 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 14:43:07.423125 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 14:43:07.423125 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 14:43:07.423125 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 25 14:43:07.423125 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 25 14:43:07.423125 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 25 14:43:07.424299 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 25 14:43:07.424299 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 14:43:07.424299 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 14:43:07.424299 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 14:43:07.424299 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 14:43:07.424299 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 14:43:07.424299 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return self.get_or_create( May 25 14:43:07.424299 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 14:43:07.424299 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application with Lock( May 25 14:43:07.424299 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 14:43:07.424299 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return self._enter() May 25 14:43:07.424299 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 14:43:07.424299 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 14:43:07.424299 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 14:43:07.424299 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return self.creator() May 25 14:43:07.424299 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 14:43:07.424299 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application created_value = creator( May 25 14:43:07.425345 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 25 14:43:07.425345 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 25 14:43:07.425345 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 25 14:43:07.425345 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application May 25 14:43:07.425345 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 291/571] 10.222.0.84 () {56 vars in 1108 bytes} [Wed May 25 14:43:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 14:43:07.425649 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a0a418-e0e3-4b90-8046-081478d74aec None None] REQUEST_METHOD: `POST` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:43:07.426057 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a0a418-e0e3-4b90-8046-081478d74aec None None] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:43:07.426159 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a0a418-e0e3-4b90-8046-081478d74aec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:43:07.442051 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.auth.core [None req-51a0a418-e0e3-4b90-8046-081478d74aec None None] MFA Rules not processed for user `05d87e87798e429aa1c10b24391f915e`. Rule list: `[]` (Enabled: `True`). {{(pid=101893) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:43:07.443237 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.fernet_utils [None req-51a0a418-e0e3-4b90-8046-081478d74aec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=101893) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:43:07.443693 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7593c959-1849-4b9c-8fbe-0e8160e72466 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:43:07.444524 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7593c959-1849-4b9c-8fbe-0e8160e72466 None admin] REQUEST_METHOD: `GET` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:43:07.444810 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7593c959-1849-4b9c-8fbe-0e8160e72466 None admin] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:43:07.445103 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7593c959-1849-4b9c-8fbe-0e8160e72466 None admin] PATH_INFO: `/v3/projects/service` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:43:07.451659 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7593c959-1849-4b9c-8fbe-0e8160e72466 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:43:07.453090 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7593c959-1849-4b9c-8fbe-0e8160e72466 None admin] RBAC: Authorization granted {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:43:07.467252 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application [None req-7593c959-1849-4b9c-8fbe-0e8160e72466 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 25 14:43:07.467252 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:43:07.467252 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 14:43:07.467252 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 14:43:07.467252 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 14:43:07.467252 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 14:43:07.467252 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 14:43:07.467252 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 14:43:07.467252 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 14:43:07.467252 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 14:43:07.467252 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 14:43:07.467252 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 14:43:07.467252 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 25 14:43:07.467252 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application return self._get_project(project_id) May 25 14:43:07.467252 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 25 14:43:07.468333 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 25 14:43:07.468333 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 14:43:07.468333 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 14:43:07.468333 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 14:43:07.468333 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 14:43:07.468333 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 14:43:07.468333 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application return self.get_or_create( May 25 14:43:07.468333 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 14:43:07.468333 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application with Lock( May 25 14:43:07.468333 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 14:43:07.468333 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application return self._enter() May 25 14:43:07.468333 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 14:43:07.468333 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 14:43:07.468333 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 14:43:07.468333 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application return self.creator() May 25 14:43:07.468333 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 14:43:07.468333 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application created_value = creator( May 25 14:43:07.469393 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 25 14:43:07.469393 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 25 14:43:07.469393 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 25 14:43:07.469393 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 25 14:43:07.469393 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 25 14:43:07.469393 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 25 14:43:07.469393 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 25 14:43:07.469393 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application May 25 14:43:07.469393 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 281/572] 10.222.0.84 () {56 vars in 1111 bytes} [Wed May 25 14:43:07 2022] GET /identity/v3/projects/service => generated 88 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 14:43:07.469393 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7593c959-1849-4b9c-8fbe-0e8160e72466 None admin] Authenticating user token {{(pid=101892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:43:07.480567 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG dbcounter [-] [101893] Writing DB stats keystone:SELECT=100 {{(pid=101893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:43:07.512357 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 292/573] 10.222.0.84 () {58 vars in 1023 bytes} [Wed May 25 14:43:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 25 14:43:07.513172 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51a0a418-e0e3-4b90-8046-081478d74aec None None] Authenticating user token {{(pid=101893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:43:07.576531 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7593c959-1849-4b9c-8fbe-0e8160e72466 None admin] Validating token access rules against request {{(pid=101892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:43:07.604618 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG dbcounter [-] [101892] Writing DB stats keystone:SELECT=100 {{(pid=101892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:43:07.611710 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c0bbfd1-56d1-43f6-971a-d09a5a7ecf5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:43:07.612581 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0bbfd1-56d1-43f6-971a-d09a5a7ecf5e None admin] REQUEST_METHOD: `GET` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:43:07.612864 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0bbfd1-56d1-43f6-971a-d09a5a7ecf5e None admin] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:43:07.613017 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51a0a418-e0e3-4b90-8046-081478d74aec None None] Validating token access rules against request {{(pid=101893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:43:07.613455 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0bbfd1-56d1-43f6-971a-d09a5a7ecf5e None admin] PATH_INFO: `/v3/roles/service` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:43:07.623787 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c0bbfd1-56d1-43f6-971a-d09a5a7ecf5e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 14:43:07.631718 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application [None req-9c0bbfd1-56d1-43f6-971a-d09a5a7ecf5e None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 25 14:43:07.631718 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:43:07.631718 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 14:43:07.631718 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 14:43:07.631718 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 14:43:07.631718 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 14:43:07.631718 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 14:43:07.631718 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 14:43:07.631718 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 14:43:07.631718 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 14:43:07.631718 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 14:43:07.631718 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 14:43:07.631718 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 14:43:07.631718 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 14:43:07.631718 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 14:43:07.631718 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 14:43:07.632806 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 14:43:07.632806 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 14:43:07.632806 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 14:43:07.632806 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 14:43:07.632806 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 14:43:07.632806 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 14:43:07.632806 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 14:43:07.632806 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 14:43:07.632806 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 14:43:07.632806 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application return self.get_or_create( May 25 14:43:07.632806 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 14:43:07.632806 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application with Lock( May 25 14:43:07.632806 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 14:43:07.632806 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application return self._enter() May 25 14:43:07.632806 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 14:43:07.632806 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 14:43:07.633662 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 14:43:07.633662 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application return self.creator() May 25 14:43:07.633662 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 14:43:07.633662 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application created_value = creator( May 25 14:43:07.633662 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 14:43:07.633662 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 14:43:07.633662 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 14:43:07.633662 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 14:43:07.633662 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 14:43:07.633662 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 14:43:07.633662 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 25 14:43:07.633662 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application May 25 14:43:07.633662 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 282/574] 10.222.0.84 () {56 vars in 1102 bytes} [Wed May 25 14:43:07 2022] GET /identity/v3/roles/service => generated 85 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 14:43:07.634356 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c0bbfd1-56d1-43f6-971a-d09a5a7ecf5e None admin] Authenticating user token {{(pid=101892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:43:07.648526 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a0a1ee3-0a4e-4283-b695-aadecaa9f241 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:43:07.649119 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0a1ee3-0a4e-4283-b695-aadecaa9f241 None admin] REQUEST_METHOD: `GET` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:43:07.649400 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0a1ee3-0a4e-4283-b695-aadecaa9f241 None admin] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:43:07.649672 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0a1ee3-0a4e-4283-b695-aadecaa9f241 None admin] PATH_INFO: `/v3/projects` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:43:07.650449 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a0a1ee3-0a4e-4283-b695-aadecaa9f241 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=101893) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:43:07.650758 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a0a1ee3-0a4e-4283-b695-aadecaa9f241 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:43:07.652256 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a0a1ee3-0a4e-4283-b695-aadecaa9f241 None admin] RBAC: Authorization granted {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:43:07.664321 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 293/575] 10.222.0.84 () {56 vars in 1148 bytes} [Wed May 25 14:43:07 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:43:07.665118 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a0a1ee3-0a4e-4283-b695-aadecaa9f241 None admin] Authenticating user token {{(pid=101893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:43:07.695264 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG dbcounter [-] [101893] Writing DB stats keystone:SELECT=100 {{(pid=101893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:43:07.739191 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c0bbfd1-56d1-43f6-971a-d09a5a7ecf5e None admin] Validating token access rules against request {{(pid=101892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:43:07.761935 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a0a1ee3-0a4e-4283-b695-aadecaa9f241 None admin] Validating token access rules against request {{(pid=101893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:43:07.773440 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05eddd71-5dd5-4ffc-95d9-2f01683916e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:43:07.774091 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05eddd71-5dd5-4ffc-95d9-2f01683916e7 None admin] REQUEST_METHOD: `GET` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:43:07.774374 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05eddd71-5dd5-4ffc-95d9-2f01683916e7 None admin] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:43:07.774650 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05eddd71-5dd5-4ffc-95d9-2f01683916e7 None admin] PATH_INFO: `/v3/domains` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:43:07.775366 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05eddd71-5dd5-4ffc-95d9-2f01683916e7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=101892) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:43:07.775710 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05eddd71-5dd5-4ffc-95d9-2f01683916e7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:43:07.777079 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05eddd71-5dd5-4ffc-95d9-2f01683916e7 None admin] RBAC: Authorization granted {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:43:07.788087 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 283/576] 10.222.0.84 () {56 vars in 1109 bytes} [Wed May 25 14:43:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:43:07.788863 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05eddd71-5dd5-4ffc-95d9-2f01683916e7 None admin] Authenticating user token {{(pid=101892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:43:07.800353 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2985fde5-ec61-47ad-9caf-0d55e704ae8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:43:07.801015 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2985fde5-ec61-47ad-9caf-0d55e704ae8a None admin] REQUEST_METHOD: `GET` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:43:07.801297 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2985fde5-ec61-47ad-9caf-0d55e704ae8a None admin] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:43:07.801576 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2985fde5-ec61-47ad-9caf-0d55e704ae8a None admin] PATH_INFO: `/v3/projects` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:43:07.802353 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2985fde5-ec61-47ad-9caf-0d55e704ae8a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=101893) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:43:07.802753 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2985fde5-ec61-47ad-9caf-0d55e704ae8a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:43:07.804173 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2985fde5-ec61-47ad-9caf-0d55e704ae8a None admin] RBAC: Authorization granted {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:43:07.815855 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 294/577] 10.222.0.84 () {56 vars in 1148 bytes} [Wed May 25 14:43:07 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:43:07.816634 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2985fde5-ec61-47ad-9caf-0d55e704ae8a None admin] Authenticating user token {{(pid=101893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:43:07.838221 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG dbcounter [-] [101892] Writing DB stats keystone:SELECT=100 {{(pid=101892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:43:07.892931 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05eddd71-5dd5-4ffc-95d9-2f01683916e7 None admin] Validating token access rules against request {{(pid=101892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:43:07.912633 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG dbcounter [-] [101893] Writing DB stats keystone:SELECT=100 {{(pid=101893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:43:07.920872 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2985fde5-ec61-47ad-9caf-0d55e704ae8a None admin] Validating token access rules against request {{(pid=101893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:43:07.929774 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf9d1bc-1384-41dd-8b27-2f40dbe6d35d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:43:07.930601 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf9d1bc-1384-41dd-8b27-2f40dbe6d35d None admin] REQUEST_METHOD: `GET` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:43:07.930883 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf9d1bc-1384-41dd-8b27-2f40dbe6d35d None admin] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:43:07.931159 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf9d1bc-1384-41dd-8b27-2f40dbe6d35d None admin] PATH_INFO: `/v3/roles/service` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:43:07.940971 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cf9d1bc-1384-41dd-8b27-2f40dbe6d35d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 14:43:07.949216 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application [None req-2cf9d1bc-1384-41dd-8b27-2f40dbe6d35d None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 25 14:43:07.949216 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:43:07.949216 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 14:43:07.949216 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 14:43:07.949216 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 14:43:07.949216 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 14:43:07.949216 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 14:43:07.949216 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 14:43:07.949216 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 14:43:07.949216 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 14:43:07.949216 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 14:43:07.949216 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 14:43:07.949216 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 14:43:07.949216 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 14:43:07.949216 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 14:43:07.949216 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 14:43:07.950249 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 14:43:07.950249 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 14:43:07.950249 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 14:43:07.950249 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 14:43:07.950249 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 14:43:07.950249 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 14:43:07.950249 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 14:43:07.950249 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 14:43:07.950249 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 14:43:07.950249 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application return self.get_or_create( May 25 14:43:07.950249 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 14:43:07.950249 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application with Lock( May 25 14:43:07.950249 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 14:43:07.950249 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application return self._enter() May 25 14:43:07.950249 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 14:43:07.950249 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 14:43:07.951134 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 14:43:07.951134 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application return self.creator() May 25 14:43:07.951134 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 14:43:07.951134 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application created_value = creator( May 25 14:43:07.951134 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 14:43:07.951134 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 14:43:07.951134 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 14:43:07.951134 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 14:43:07.951134 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 14:43:07.951134 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 14:43:07.951134 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 25 14:43:07.951134 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application May 25 14:43:07.951134 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 284/578] 10.222.0.84 () {56 vars in 1102 bytes} [Wed May 25 14:43:07 2022] GET /identity/v3/roles/service => generated 85 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 14:43:07.951134 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf9d1bc-1384-41dd-8b27-2f40dbe6d35d None admin] Authenticating user token {{(pid=101892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:43:07.955722 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69ff3c0e-0499-4256-b615-ef41fc82a6b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:43:07.956391 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ff3c0e-0499-4256-b615-ef41fc82a6b5 None admin] REQUEST_METHOD: `GET` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:43:07.956673 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ff3c0e-0499-4256-b615-ef41fc82a6b5 None admin] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:43:07.956950 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ff3c0e-0499-4256-b615-ef41fc82a6b5 None admin] PATH_INFO: `/v3/roles` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:43:07.957697 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69ff3c0e-0499-4256-b615-ef41fc82a6b5 None admin] RBAC: Adding query filter params (name=service) {{(pid=101893) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:43:07.958004 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69ff3c0e-0499-4256-b615-ef41fc82a6b5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:43:07.959388 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69ff3c0e-0499-4256-b615-ef41fc82a6b5 None admin] RBAC: Authorization granted {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:43:07.968195 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 295/579] 10.222.0.84 () {56 vars in 1103 bytes} [Wed May 25 14:43:07 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:43:07.968991 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69ff3c0e-0499-4256-b615-ef41fc82a6b5 None admin] Authenticating user token {{(pid=101893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:43:08.057568 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf9d1bc-1384-41dd-8b27-2f40dbe6d35d None admin] Validating token access rules against request {{(pid=101892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:43:08.066195 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG dbcounter [-] [101892] Writing DB stats keystone:SELECT=100 {{(pid=101892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:43:08.076714 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69ff3c0e-0499-4256-b615-ef41fc82a6b5 None admin] Validating token access rules against request {{(pid=101893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:43:08.091644 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fce65d57-3837-47d4-ba9b-f20809f6d902 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:43:08.092398 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce65d57-3837-47d4-ba9b-f20809f6d902 None admin] REQUEST_METHOD: `GET` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:43:08.094086 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce65d57-3837-47d4-ba9b-f20809f6d902 None admin] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:43:08.094389 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce65d57-3837-47d4-ba9b-f20809f6d902 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:43:08.095221 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fce65d57-3837-47d4-ba9b-f20809f6d902 None admin] RBAC: Adding query filter params (role.id=fdcb2eda27b84f44a392b7e8b59cc425, scope.project.id=a000829c658c4a7cab67f7b6353ba3fa, user.id=e196f0897b98455c9e164271d7d0070a) {{(pid=101892) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:43:08.095536 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fce65d57-3837-47d4-ba9b-f20809f6d902 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:43:08.097038 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fce65d57-3837-47d4-ba9b-f20809f6d902 None admin] RBAC: Authorization granted {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:43:08.105119 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 285/580] 10.222.0.84 () {56 vars in 1374 bytes} [Wed May 25 14:43:07 2022] GET /identity/v3/role_assignments?user.id=e196f0897b98455c9e164271d7d0070a&scope.project.id=a000829c658c4a7cab67f7b6353ba3fa&role.id=fdcb2eda27b84f44a392b7e8b59cc425 => generated 259 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:43:08.106112 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fce65d57-3837-47d4-ba9b-f20809f6d902 None admin] Authenticating user token {{(pid=101892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:43:08.114909 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c0d350-245c-4833-b82e-a21d03d87d16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:43:08.115798 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c0d350-245c-4833-b82e-a21d03d87d16 None admin] REQUEST_METHOD: `GET` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:43:08.116624 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c0d350-245c-4833-b82e-a21d03d87d16 None admin] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:43:08.116898 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c0d350-245c-4833-b82e-a21d03d87d16 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:43:08.126011 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7c0d350-245c-4833-b82e-a21d03d87d16 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:43:08.127496 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7c0d350-245c-4833-b82e-a21d03d87d16 None admin] RBAC: Authorization granted {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:43:08.144003 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application [None req-b7c0d350-245c-4833-b82e-a21d03d87d16 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. May 25 14:43:08.144003 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:43:08.144003 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 14:43:08.144003 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 14:43:08.144003 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 14:43:08.144003 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 14:43:08.144003 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 14:43:08.144003 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 14:43:08.144003 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 14:43:08.144003 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 14:43:08.144003 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 14:43:08.144003 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 14:43:08.144003 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 25 14:43:08.144003 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return self._get_user(user_id) May 25 14:43:08.144003 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 25 14:43:08.144003 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 25 14:43:08.145047 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 14:43:08.145047 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 14:43:08.145047 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 25 14:43:08.145047 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 25 14:43:08.145047 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 25 14:43:08.145047 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 25 14:43:08.145047 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 14:43:08.145047 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 14:43:08.145047 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 14:43:08.145047 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return self.get_or_create( May 25 14:43:08.145047 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 14:43:08.145047 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application with Lock( May 25 14:43:08.145047 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 14:43:08.145047 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return self._enter() May 25 14:43:08.145047 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 14:43:08.145047 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 14:43:08.145047 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 14:43:08.145047 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return self.creator() May 25 14:43:08.146092 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 14:43:08.146092 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application created_value = creator( May 25 14:43:08.146092 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 25 14:43:08.146092 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 25 14:43:08.146092 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 25 14:43:08.146092 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 25 14:43:08.146092 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 25 14:43:08.146092 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 25 14:43:08.146092 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. May 25 14:43:08.146092 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application May 25 14:43:08.146092 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 296/581] 10.222.0.84 () {56 vars in 1099 bytes} [Wed May 25 14:43:07 2022] GET /identity/v3/users/cinder => generated 84 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 14:43:08.146092 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c0d350-245c-4833-b82e-a21d03d87d16 None admin] Authenticating user token {{(pid=101893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:43:08.167953 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG dbcounter [-] [101893] Writing DB stats keystone:SELECT=100 {{(pid=101893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:43:08.261536 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fce65d57-3837-47d4-ba9b-f20809f6d902 None admin] Validating token access rules against request {{(pid=101892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:43:08.285354 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c0d350-245c-4833-b82e-a21d03d87d16 None admin] Validating token access rules against request {{(pid=101893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:43:08.317434 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e59064a8-503b-4eb4-ac2b-091bbb8ab019 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:43:08.317434 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e59064a8-503b-4eb4-ac2b-091bbb8ab019 None admin] REQUEST_METHOD: `PUT` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:43:08.318051 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e59064a8-503b-4eb4-ac2b-091bbb8ab019 None admin] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:43:08.318051 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e59064a8-503b-4eb4-ac2b-091bbb8ab019 None admin] PATH_INFO: `/v3/projects/a000829c658c4a7cab67f7b6353ba3fa/users/2aeb182e6a5b43cfb0cc347ec847c848/roles/fdcb2eda27b84f44a392b7e8b59cc425` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:43:08.328712 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d44087c-fbbc-4da1-9adf-448422efdf0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:43:08.329390 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d44087c-fbbc-4da1-9adf-448422efdf0b None admin] REQUEST_METHOD: `GET` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:43:08.329677 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d44087c-fbbc-4da1-9adf-448422efdf0b None admin] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:43:08.329957 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d44087c-fbbc-4da1-9adf-448422efdf0b None admin] PATH_INFO: `/v3/roles` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:43:08.330715 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d44087c-fbbc-4da1-9adf-448422efdf0b None admin] RBAC: Adding query filter params (name=service) {{(pid=101893) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:43:08.331031 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d44087c-fbbc-4da1-9adf-448422efdf0b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:43:08.332461 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d44087c-fbbc-4da1-9adf-448422efdf0b None admin] RBAC: Authorization granted {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:43:08.338394 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e59064a8-503b-4eb4-ac2b-091bbb8ab019 None admin] RBAC: Authorizing `identity:create_grant(project_id=a000829c658c4a7cab67f7b6353ba3fa, user_id=2aeb182e6a5b43cfb0cc347ec847c848, role_id=fdcb2eda27b84f44a392b7e8b59cc425)` {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:43:08.341746 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e59064a8-503b-4eb4-ac2b-091bbb8ab019 None admin] RBAC: Authorization granted {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:43:08.346063 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 297/582] 10.222.0.84 () {56 vars in 1103 bytes} [Wed May 25 14:43:08 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:43:08.346850 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d44087c-fbbc-4da1-9adf-448422efdf0b None admin] Authenticating user token {{(pid=101893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:43:08.439372 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG dbcounter [-] [101893] Writing DB stats keystone:SELECT=100 {{(pid=101893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:43:08.463597 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 286/583] 10.222.0.84 () {58 vars in 1439 bytes} [Wed May 25 14:43:08 2022] PUT /identity/v3/projects/a000829c658c4a7cab67f7b6353ba3fa/users/2aeb182e6a5b43cfb0cc347ec847c848/roles/fdcb2eda27b84f44a392b7e8b59cc425 => generated 0 bytes in 349 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 14:43:08.463597 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e59064a8-503b-4eb4-ac2b-091bbb8ab019 None admin] Authenticating user token {{(pid=101892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:43:08.480574 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d44087c-fbbc-4da1-9adf-448422efdf0b None admin] Validating token access rules against request {{(pid=101893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:43:08.490506 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG dbcounter [-] [101892] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=101892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:43:08.527767 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ed4a98-4636-4bbb-8193-ff9bdc3ad19f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:43:08.528643 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ed4a98-4636-4bbb-8193-ff9bdc3ad19f None admin] REQUEST_METHOD: `GET` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:43:08.528945 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ed4a98-4636-4bbb-8193-ff9bdc3ad19f None admin] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:43:08.529225 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ed4a98-4636-4bbb-8193-ff9bdc3ad19f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:43:08.545511 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98ed4a98-4636-4bbb-8193-ff9bdc3ad19f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:43:08.547059 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98ed4a98-4636-4bbb-8193-ff9bdc3ad19f None admin] RBAC: Authorization granted {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:43:08.573262 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application [None req-98ed4a98-4636-4bbb-8193-ff9bdc3ad19f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 25 14:43:08.573262 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:43:08.573262 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 14:43:08.573262 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 14:43:08.573262 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 14:43:08.573262 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 14:43:08.573262 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 14:43:08.573262 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 14:43:08.573262 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 14:43:08.573262 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 14:43:08.573262 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 14:43:08.573262 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 14:43:08.573262 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 25 14:43:08.573262 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 25 14:43:08.573262 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 25 14:43:08.574285 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 25 14:43:08.574285 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 14:43:08.574285 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 14:43:08.574285 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 14:43:08.574285 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 14:43:08.574285 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 14:43:08.574285 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return self.get_or_create( May 25 14:43:08.574285 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 14:43:08.574285 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application with Lock( May 25 14:43:08.574285 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 14:43:08.574285 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return self._enter() May 25 14:43:08.574285 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 14:43:08.574285 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 14:43:08.574285 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 14:43:08.574285 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return self.creator() May 25 14:43:08.574285 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 14:43:08.574285 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application created_value = creator( May 25 14:43:08.575185 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 25 14:43:08.575185 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 25 14:43:08.575185 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 25 14:43:08.575185 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application May 25 14:43:08.577425 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 298/584] 10.222.0.84 () {56 vars in 1108 bytes} [Wed May 25 14:43:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 14:43:08.583602 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ed4a98-4636-4bbb-8193-ff9bdc3ad19f None admin] Authenticating user token {{(pid=101893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:43:08.614024 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e59064a8-503b-4eb4-ac2b-091bbb8ab019 None admin] Validating token access rules against request {{(pid=101892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:43:08.657964 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1d833e5-c2f0-4368-8560-7435a40ee73a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:43:08.659731 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d833e5-c2f0-4368-8560-7435a40ee73a None admin] REQUEST_METHOD: `GET` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:43:08.660556 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d833e5-c2f0-4368-8560-7435a40ee73a None admin] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:43:08.661546 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d833e5-c2f0-4368-8560-7435a40ee73a None admin] PATH_INFO: `/v3/users` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:43:08.663676 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1d833e5-c2f0-4368-8560-7435a40ee73a None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=101892) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:43:08.664199 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1d833e5-c2f0-4368-8560-7435a40ee73a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:43:08.665973 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1d833e5-c2f0-4368-8560-7435a40ee73a None admin] RBAC: Authorization granted {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:43:08.686318 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 287/585] 10.222.0.84 () {56 vars in 1137 bytes} [Wed May 25 14:43:08 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:43:08.687494 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1d833e5-c2f0-4368-8560-7435a40ee73a None admin] Authenticating user token {{(pid=101892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:43:08.713006 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ed4a98-4636-4bbb-8193-ff9bdc3ad19f None admin] Validating token access rules against request {{(pid=101893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:43:08.753745 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG dbcounter [-] [101893] Writing DB stats keystone:SELECT=100 {{(pid=101893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:43:08.757344 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a1241e7-7524-4d0a-b1cd-ac83ae390d0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:43:08.758154 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a1241e7-7524-4d0a-b1cd-ac83ae390d0b None admin] REQUEST_METHOD: `GET` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:43:08.758437 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a1241e7-7524-4d0a-b1cd-ac83ae390d0b None admin] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:43:08.758712 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a1241e7-7524-4d0a-b1cd-ac83ae390d0b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:43:08.772912 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a1241e7-7524-4d0a-b1cd-ac83ae390d0b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:43:08.774506 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a1241e7-7524-4d0a-b1cd-ac83ae390d0b None admin] RBAC: Authorization granted {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:43:08.795316 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application [None req-7a1241e7-7524-4d0a-b1cd-ac83ae390d0b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 25 14:43:08.795316 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:43:08.795316 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 14:43:08.795316 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 14:43:08.795316 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 14:43:08.795316 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 14:43:08.795316 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 14:43:08.795316 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 14:43:08.795316 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 14:43:08.795316 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 14:43:08.795316 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 14:43:08.795316 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 14:43:08.795316 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 25 14:43:08.795316 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 25 14:43:08.795316 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 25 14:43:08.796354 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 25 14:43:08.796354 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 14:43:08.796354 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 14:43:08.796354 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 14:43:08.796354 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 14:43:08.796354 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 14:43:08.796354 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return self.get_or_create( May 25 14:43:08.796354 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 14:43:08.796354 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application with Lock( May 25 14:43:08.796354 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 14:43:08.796354 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return self._enter() May 25 14:43:08.796354 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 14:43:08.796354 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 14:43:08.796354 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 14:43:08.796354 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return self.creator() May 25 14:43:08.796354 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 14:43:08.796354 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application created_value = creator( May 25 14:43:08.797245 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 25 14:43:08.797245 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 25 14:43:08.797245 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 25 14:43:08.797245 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application May 25 14:43:08.797245 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 299/586] 10.222.0.84 () {56 vars in 1108 bytes} [Wed May 25 14:43:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 14:43:08.797537 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a1241e7-7524-4d0a-b1cd-ac83ae390d0b None admin] Authenticating user token {{(pid=101893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:43:08.802988 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG dbcounter [-] [101892] Writing DB stats keystone:SELECT=100 {{(pid=101892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:43:08.827196 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1d833e5-c2f0-4368-8560-7435a40ee73a None admin] Validating token access rules against request {{(pid=101892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:43:08.871832 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23eeae1f-9b69-478d-8596-4ae385beeaa2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:43:08.872676 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23eeae1f-9b69-478d-8596-4ae385beeaa2 None admin] REQUEST_METHOD: `GET` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:43:08.873226 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23eeae1f-9b69-478d-8596-4ae385beeaa2 None admin] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:43:08.873504 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23eeae1f-9b69-478d-8596-4ae385beeaa2 None admin] PATH_INFO: `/v3/domains` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:43:08.874239 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23eeae1f-9b69-478d-8596-4ae385beeaa2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=101892) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:43:08.874550 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23eeae1f-9b69-478d-8596-4ae385beeaa2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:43:08.875976 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23eeae1f-9b69-478d-8596-4ae385beeaa2 None admin] RBAC: Authorization granted {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:43:08.896883 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 288/587] 10.222.0.84 () {56 vars in 1109 bytes} [Wed May 25 14:43:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:43:08.898553 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23eeae1f-9b69-478d-8596-4ae385beeaa2 None admin] Authenticating user token {{(pid=101892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:43:08.916499 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a1241e7-7524-4d0a-b1cd-ac83ae390d0b None admin] Validating token access rules against request {{(pid=101893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:43:08.954588 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1770d114-7d90-4962-b5cc-9375d1cb098b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:43:08.955814 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1770d114-7d90-4962-b5cc-9375d1cb098b None admin] REQUEST_METHOD: `GET` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:43:08.956279 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1770d114-7d90-4962-b5cc-9375d1cb098b None admin] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:43:08.956754 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1770d114-7d90-4962-b5cc-9375d1cb098b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:43:08.970614 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1770d114-7d90-4962-b5cc-9375d1cb098b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:43:08.972493 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1770d114-7d90-4962-b5cc-9375d1cb098b None admin] RBAC: Authorization granted {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:43:08.992272 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application [None req-1770d114-7d90-4962-b5cc-9375d1cb098b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 25 14:43:08.992272 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:43:08.992272 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 14:43:08.992272 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 14:43:08.992272 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 14:43:08.992272 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 14:43:08.992272 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 14:43:08.992272 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 14:43:08.992272 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 14:43:08.992272 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 14:43:08.992272 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 14:43:08.992272 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 14:43:08.992272 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 25 14:43:08.992272 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 25 14:43:08.992272 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 25 14:43:08.993440 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 25 14:43:08.993440 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 14:43:08.993440 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 14:43:08.993440 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 14:43:08.993440 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 14:43:08.993440 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 14:43:08.993440 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return self.get_or_create( May 25 14:43:08.993440 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 14:43:08.993440 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application with Lock( May 25 14:43:08.993440 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 14:43:08.993440 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return self._enter() May 25 14:43:08.993440 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 14:43:08.993440 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 14:43:08.993440 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 14:43:08.993440 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return self.creator() May 25 14:43:08.993440 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 14:43:08.993440 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application created_value = creator( May 25 14:43:08.994502 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 25 14:43:08.994502 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 25 14:43:08.994502 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 25 14:43:08.994502 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application May 25 14:43:08.996196 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 300/588] 10.222.0.84 () {56 vars in 1108 bytes} [Wed May 25 14:43:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 14:43:08.997197 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1770d114-7d90-4962-b5cc-9375d1cb098b None admin] Authenticating user token {{(pid=101893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:43:09.026618 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23eeae1f-9b69-478d-8596-4ae385beeaa2 None admin] Validating token access rules against request {{(pid=101892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:43:09.037549 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG dbcounter [-] [101893] Writing DB stats keystone:SELECT=100 {{(pid=101893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:43:09.066870 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb12dead-c63b-4faa-80a0-6b348f7711aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:43:09.068418 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb12dead-c63b-4faa-80a0-6b348f7711aa None admin] REQUEST_METHOD: `GET` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:43:09.069266 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb12dead-c63b-4faa-80a0-6b348f7711aa None admin] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:43:09.069744 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb12dead-c63b-4faa-80a0-6b348f7711aa None admin] PATH_INFO: `/v3/domains` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:43:09.070639 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb12dead-c63b-4faa-80a0-6b348f7711aa None admin] RBAC: Adding query filter params (name=Default) {{(pid=101892) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:43:09.071111 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb12dead-c63b-4faa-80a0-6b348f7711aa None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:43:09.073386 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb12dead-c63b-4faa-80a0-6b348f7711aa None admin] RBAC: Authorization granted {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:43:09.089717 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG dbcounter [-] [101892] Writing DB stats keystone:SELECT=100 {{(pid=101892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:43:09.098441 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 289/589] 10.222.0.84 () {56 vars in 1109 bytes} [Wed May 25 14:43:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:43:09.099720 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb12dead-c63b-4faa-80a0-6b348f7711aa None admin] Authenticating user token {{(pid=101892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:43:09.119672 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1770d114-7d90-4962-b5cc-9375d1cb098b None admin] Validating token access rules against request {{(pid=101893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:43:09.159083 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-548d5a3a-5a0b-4533-8a64-0f1094de164c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:43:09.160286 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-548d5a3a-5a0b-4533-8a64-0f1094de164c None admin] REQUEST_METHOD: `GET` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:43:09.160845 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-548d5a3a-5a0b-4533-8a64-0f1094de164c None admin] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:43:09.161337 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-548d5a3a-5a0b-4533-8a64-0f1094de164c None admin] PATH_INFO: `/v3/users/glance` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:43:09.169946 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-548d5a3a-5a0b-4533-8a64-0f1094de164c None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:43:09.171637 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-548d5a3a-5a0b-4533-8a64-0f1094de164c None admin] RBAC: Authorization granted {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:43:09.185953 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application [None req-548d5a3a-5a0b-4533-8a64-0f1094de164c None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. May 25 14:43:09.185953 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:43:09.185953 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 14:43:09.185953 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 14:43:09.185953 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 14:43:09.185953 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 14:43:09.185953 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 14:43:09.185953 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 14:43:09.185953 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 14:43:09.185953 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 14:43:09.185953 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 14:43:09.185953 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 14:43:09.185953 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 25 14:43:09.185953 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return self._get_user(user_id) May 25 14:43:09.185953 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 25 14:43:09.185953 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 25 14:43:09.186989 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 14:43:09.186989 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 14:43:09.186989 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 25 14:43:09.186989 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 25 14:43:09.186989 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 25 14:43:09.186989 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 25 14:43:09.186989 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 14:43:09.186989 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 14:43:09.186989 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 14:43:09.186989 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return self.get_or_create( May 25 14:43:09.186989 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 14:43:09.186989 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application with Lock( May 25 14:43:09.186989 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 14:43:09.186989 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return self._enter() May 25 14:43:09.186989 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 14:43:09.186989 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 14:43:09.186989 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 14:43:09.186989 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return self.creator() May 25 14:43:09.188321 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 14:43:09.188321 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application created_value = creator( May 25 14:43:09.188321 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 25 14:43:09.188321 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 25 14:43:09.188321 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 25 14:43:09.188321 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 25 14:43:09.188321 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 25 14:43:09.188321 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 25 14:43:09.188321 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. May 25 14:43:09.188321 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application May 25 14:43:09.190635 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 301/590] 10.222.0.84 () {56 vars in 1099 bytes} [Wed May 25 14:43:08 2022] GET /identity/v3/users/glance => generated 84 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 14:43:09.191636 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-548d5a3a-5a0b-4533-8a64-0f1094de164c None admin] Authenticating user token {{(pid=101893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:43:09.229537 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb12dead-c63b-4faa-80a0-6b348f7711aa None admin] Validating token access rules against request {{(pid=101892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:43:09.281546 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c59fe36-4c81-4aef-b6ac-55fd8f02e641 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:43:09.282220 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c59fe36-4c81-4aef-b6ac-55fd8f02e641 None admin] REQUEST_METHOD: `GET` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:43:09.282509 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c59fe36-4c81-4aef-b6ac-55fd8f02e641 None admin] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:43:09.282785 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c59fe36-4c81-4aef-b6ac-55fd8f02e641 None admin] PATH_INFO: `/v3/domains` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:43:09.283510 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c59fe36-4c81-4aef-b6ac-55fd8f02e641 None admin] RBAC: Adding query filter params (name=Default) {{(pid=101892) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:43:09.283844 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c59fe36-4c81-4aef-b6ac-55fd8f02e641 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:43:09.285295 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c59fe36-4c81-4aef-b6ac-55fd8f02e641 None admin] RBAC: Authorization granted {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:43:09.305976 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 290/591] 10.222.0.84 () {56 vars in 1109 bytes} [Wed May 25 14:43:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:43:09.305976 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c59fe36-4c81-4aef-b6ac-55fd8f02e641 None admin] Authenticating user token {{(pid=101892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:43:09.326325 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG dbcounter [-] [101893] Writing DB stats keystone:SELECT=100 {{(pid=101893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:43:09.337928 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-548d5a3a-5a0b-4533-8a64-0f1094de164c None admin] Validating token access rules against request {{(pid=101893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:43:09.378902 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d215e54f-9e40-462d-aceb-a8afd546de81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:43:09.379743 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d215e54f-9e40-462d-aceb-a8afd546de81 None admin] REQUEST_METHOD: `GET` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:43:09.380033 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d215e54f-9e40-462d-aceb-a8afd546de81 None admin] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:43:09.380311 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d215e54f-9e40-462d-aceb-a8afd546de81 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:43:09.385288 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG dbcounter [-] [101892] Writing DB stats keystone:SELECT=100 {{(pid=101892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:43:09.389248 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d215e54f-9e40-462d-aceb-a8afd546de81 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:43:09.390550 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d215e54f-9e40-462d-aceb-a8afd546de81 None admin] RBAC: Authorization granted {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:43:09.405944 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application [None req-d215e54f-9e40-462d-aceb-a8afd546de81 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. May 25 14:43:09.405944 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:43:09.405944 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 14:43:09.405944 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 14:43:09.405944 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 14:43:09.405944 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 14:43:09.405944 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 14:43:09.405944 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 14:43:09.405944 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 14:43:09.405944 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 14:43:09.405944 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 14:43:09.405944 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 14:43:09.405944 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 25 14:43:09.405944 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return self._get_user(user_id) May 25 14:43:09.405944 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 25 14:43:09.405944 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 25 14:43:09.406924 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 14:43:09.406924 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 14:43:09.406924 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 25 14:43:09.406924 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 25 14:43:09.406924 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 25 14:43:09.406924 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 25 14:43:09.406924 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 14:43:09.406924 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 14:43:09.406924 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 14:43:09.406924 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return self.get_or_create( May 25 14:43:09.406924 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 14:43:09.406924 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application with Lock( May 25 14:43:09.406924 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 14:43:09.406924 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return self._enter() May 25 14:43:09.406924 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 14:43:09.406924 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 14:43:09.406924 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 14:43:09.406924 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return self.creator() May 25 14:43:09.407925 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 14:43:09.407925 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application created_value = creator( May 25 14:43:09.407925 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 25 14:43:09.407925 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 25 14:43:09.407925 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 25 14:43:09.407925 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 25 14:43:09.407925 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 25 14:43:09.407925 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 25 14:43:09.407925 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. May 25 14:43:09.407925 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application May 25 14:43:09.411770 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 302/592] 10.222.0.84 () {56 vars in 1102 bytes} [Wed May 25 14:43:09 2022] GET /identity/v3/users/neutron => generated 85 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 14:43:09.412648 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d215e54f-9e40-462d-aceb-a8afd546de81 None admin] Authenticating user token {{(pid=101893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:43:09.440128 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c59fe36-4c81-4aef-b6ac-55fd8f02e641 None admin] Validating token access rules against request {{(pid=101892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:43:09.485053 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d109ef-cc5e-4c67-88cf-4de72e1bbd6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:43:09.485784 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d109ef-cc5e-4c67-88cf-4de72e1bbd6b None admin] REQUEST_METHOD: `GET` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:43:09.486073 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d109ef-cc5e-4c67-88cf-4de72e1bbd6b None admin] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:43:09.486354 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d109ef-cc5e-4c67-88cf-4de72e1bbd6b None admin] PATH_INFO: `/v3/users` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:43:09.487445 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2d109ef-cc5e-4c67-88cf-4de72e1bbd6b None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=101892) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:43:09.487924 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2d109ef-cc5e-4c67-88cf-4de72e1bbd6b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:43:09.490274 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2d109ef-cc5e-4c67-88cf-4de72e1bbd6b None admin] RBAC: Authorization granted {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:43:09.519187 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 291/593] 10.222.0.84 () {56 vars in 1137 bytes} [Wed May 25 14:43:09 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:43:09.519187 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d109ef-cc5e-4c67-88cf-4de72e1bbd6b None admin] Authenticating user token {{(pid=101892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:43:09.547018 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d215e54f-9e40-462d-aceb-a8afd546de81 None admin] Validating token access rules against request {{(pid=101893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:43:09.592080 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc94a381-24f3-4adc-90e6-f87fdc60cd46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:43:09.592888 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc94a381-24f3-4adc-90e6-f87fdc60cd46 None admin] REQUEST_METHOD: `GET` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:43:09.593383 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc94a381-24f3-4adc-90e6-f87fdc60cd46 None admin] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:43:09.593503 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc94a381-24f3-4adc-90e6-f87fdc60cd46 None admin] PATH_INFO: `/v3/projects/service` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:43:09.600439 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc94a381-24f3-4adc-90e6-f87fdc60cd46 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:43:09.601899 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc94a381-24f3-4adc-90e6-f87fdc60cd46 None admin] RBAC: Authorization granted {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:43:09.618302 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application [None req-fc94a381-24f3-4adc-90e6-f87fdc60cd46 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 25 14:43:09.618302 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:43:09.618302 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 14:43:09.618302 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 14:43:09.618302 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 14:43:09.618302 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 14:43:09.618302 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 14:43:09.618302 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 14:43:09.618302 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 14:43:09.618302 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 14:43:09.618302 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 14:43:09.618302 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 14:43:09.618302 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 25 14:43:09.618302 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return self._get_project(project_id) May 25 14:43:09.618302 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 25 14:43:09.619211 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 25 14:43:09.619211 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 14:43:09.619211 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 14:43:09.619211 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 14:43:09.619211 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 14:43:09.619211 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 14:43:09.619211 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return self.get_or_create( May 25 14:43:09.619211 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 14:43:09.619211 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application with Lock( May 25 14:43:09.619211 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 14:43:09.619211 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return self._enter() May 25 14:43:09.619211 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 14:43:09.619211 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 14:43:09.619211 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 14:43:09.619211 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return self.creator() May 25 14:43:09.619211 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 14:43:09.619211 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application created_value = creator( May 25 14:43:09.620134 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 25 14:43:09.620134 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 25 14:43:09.620134 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 25 14:43:09.620134 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 25 14:43:09.620134 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 25 14:43:09.620134 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 25 14:43:09.620134 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 25 14:43:09.620134 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application May 25 14:43:09.620134 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 303/594] 10.222.0.84 () {56 vars in 1111 bytes} [Wed May 25 14:43:09 2022] GET /identity/v3/projects/service => generated 88 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 14:43:09.620616 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc94a381-24f3-4adc-90e6-f87fdc60cd46 None admin] Authenticating user token {{(pid=101893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:43:09.636935 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG dbcounter [-] [101893] Writing DB stats keystone:SELECT=100 {{(pid=101893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:43:09.644860 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d109ef-cc5e-4c67-88cf-4de72e1bbd6b None admin] Validating token access rules against request {{(pid=101892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:43:09.672008 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG dbcounter [-] [101892] Writing DB stats keystone:SELECT=100 {{(pid=101892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:43:09.697519 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df8cf9db-ace4-430c-88df-f5c207eeddb6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:43:09.698748 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df8cf9db-ace4-430c-88df-f5c207eeddb6 None admin] REQUEST_METHOD: `GET` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:43:09.699862 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df8cf9db-ace4-430c-88df-f5c207eeddb6 None admin] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:43:09.700112 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df8cf9db-ace4-430c-88df-f5c207eeddb6 None admin] PATH_INFO: `/v3/users` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:43:09.700978 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df8cf9db-ace4-430c-88df-f5c207eeddb6 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=101892) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:43:09.701295 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df8cf9db-ace4-430c-88df-f5c207eeddb6 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:43:09.702803 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df8cf9db-ace4-430c-88df-f5c207eeddb6 None admin] RBAC: Authorization granted {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:43:09.724039 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 292/595] 10.222.0.84 () {56 vars in 1139 bytes} [Wed May 25 14:43:09 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:43:09.725750 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df8cf9db-ace4-430c-88df-f5c207eeddb6 None admin] Authenticating user token {{(pid=101892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:43:09.742363 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc94a381-24f3-4adc-90e6-f87fdc60cd46 None admin] Validating token access rules against request {{(pid=101893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:43:09.792390 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba8b45d7-e141-45ac-8bd4-daa9c79d8a40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:43:09.794122 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8b45d7-e141-45ac-8bd4-daa9c79d8a40 None admin] REQUEST_METHOD: `GET` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:43:09.794634 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8b45d7-e141-45ac-8bd4-daa9c79d8a40 None admin] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:43:09.795103 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8b45d7-e141-45ac-8bd4-daa9c79d8a40 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:43:09.809894 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba8b45d7-e141-45ac-8bd4-daa9c79d8a40 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:43:09.811854 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba8b45d7-e141-45ac-8bd4-daa9c79d8a40 None admin] RBAC: Authorization granted {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:43:09.838781 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application [None req-ba8b45d7-e141-45ac-8bd4-daa9c79d8a40 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 25 14:43:09.838781 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:43:09.838781 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 14:43:09.838781 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 14:43:09.838781 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 14:43:09.838781 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 14:43:09.838781 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 14:43:09.838781 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 14:43:09.838781 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 14:43:09.838781 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 14:43:09.838781 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 14:43:09.838781 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 14:43:09.838781 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 25 14:43:09.838781 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 25 14:43:09.838781 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 25 14:43:09.839823 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 25 14:43:09.839823 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 14:43:09.839823 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 14:43:09.839823 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 14:43:09.839823 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 14:43:09.839823 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 14:43:09.839823 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return self.get_or_create( May 25 14:43:09.839823 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 14:43:09.839823 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application with Lock( May 25 14:43:09.839823 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 14:43:09.839823 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return self._enter() May 25 14:43:09.839823 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 14:43:09.839823 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 14:43:09.839823 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 14:43:09.839823 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return self.creator() May 25 14:43:09.839823 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 14:43:09.839823 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application created_value = creator( May 25 14:43:09.840749 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 25 14:43:09.840749 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 25 14:43:09.840749 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 25 14:43:09.840749 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application May 25 14:43:09.847425 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 304/596] 10.222.0.84 () {56 vars in 1108 bytes} [Wed May 25 14:43:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 14:43:09.849050 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba8b45d7-e141-45ac-8bd4-daa9c79d8a40 None admin] Authenticating user token {{(pid=101893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:43:09.860063 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df8cf9db-ace4-430c-88df-f5c207eeddb6 None admin] Validating token access rules against request {{(pid=101892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:43:09.903038 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c3d1e9a-6e5d-4762-9fd6-c267738931e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:43:09.903743 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3d1e9a-6e5d-4762-9fd6-c267738931e2 None admin] REQUEST_METHOD: `GET` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:43:09.904032 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3d1e9a-6e5d-4762-9fd6-c267738931e2 None admin] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:43:09.904308 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3d1e9a-6e5d-4762-9fd6-c267738931e2 None admin] PATH_INFO: `/v3/projects` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:43:09.905451 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c3d1e9a-6e5d-4762-9fd6-c267738931e2 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=101892) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:43:09.905773 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c3d1e9a-6e5d-4762-9fd6-c267738931e2 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:43:09.907525 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c3d1e9a-6e5d-4762-9fd6-c267738931e2 None admin] RBAC: Authorization granted {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:43:09.934052 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 293/597] 10.222.0.84 () {56 vars in 1148 bytes} [Wed May 25 14:43:09 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:43:09.936049 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c3d1e9a-6e5d-4762-9fd6-c267738931e2 None admin] Authenticating user token {{(pid=101892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:43:09.936870 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG dbcounter [-] [101893] Writing DB stats keystone:SELECT=100 {{(pid=101893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:43:09.983701 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG dbcounter [-] [101892] Writing DB stats keystone:SELECT=100 {{(pid=101892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:43:09.988075 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba8b45d7-e141-45ac-8bd4-daa9c79d8a40 None admin] Validating token access rules against request {{(pid=101893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:43:10.031356 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-858b2cc6-8b7e-4771-8e56-37991da1d9e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:43:10.032646 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-858b2cc6-8b7e-4771-8e56-37991da1d9e5 None admin] REQUEST_METHOD: `GET` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:43:10.033141 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-858b2cc6-8b7e-4771-8e56-37991da1d9e5 None admin] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:43:10.033622 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-858b2cc6-8b7e-4771-8e56-37991da1d9e5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:43:10.044736 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-858b2cc6-8b7e-4771-8e56-37991da1d9e5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:43:10.046714 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-858b2cc6-8b7e-4771-8e56-37991da1d9e5 None admin] RBAC: Authorization granted {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:43:10.065475 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application [None req-858b2cc6-8b7e-4771-8e56-37991da1d9e5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 25 14:43:10.065475 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:43:10.065475 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 14:43:10.065475 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 14:43:10.065475 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 14:43:10.065475 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 14:43:10.065475 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 14:43:10.065475 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 14:43:10.065475 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 14:43:10.065475 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 14:43:10.065475 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 14:43:10.065475 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 14:43:10.065475 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 25 14:43:10.065475 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 25 14:43:10.065475 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 25 14:43:10.066492 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 25 14:43:10.066492 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 14:43:10.066492 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 14:43:10.066492 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 14:43:10.066492 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 14:43:10.066492 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 14:43:10.066492 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return self.get_or_create( May 25 14:43:10.066492 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 14:43:10.066492 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application with Lock( May 25 14:43:10.066492 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 14:43:10.066492 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return self._enter() May 25 14:43:10.066492 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 14:43:10.066492 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 14:43:10.066492 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 14:43:10.066492 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return self.creator() May 25 14:43:10.066492 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 14:43:10.066492 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application created_value = creator( May 25 14:43:10.067380 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 25 14:43:10.067380 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 25 14:43:10.067380 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 25 14:43:10.067380 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application May 25 14:43:10.067632 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c3d1e9a-6e5d-4762-9fd6-c267738931e2 None admin] Validating token access rules against request {{(pid=101892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:43:10.070431 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 305/598] 10.222.0.84 () {56 vars in 1108 bytes} [Wed May 25 14:43:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 14:43:10.071424 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-858b2cc6-8b7e-4771-8e56-37991da1d9e5 None admin] Authenticating user token {{(pid=101893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:43:10.107876 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dbf5e70-c344-4699-84fa-60b67cc2cae4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:43:10.108647 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dbf5e70-c344-4699-84fa-60b67cc2cae4 None admin] REQUEST_METHOD: `GET` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:43:10.108938 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dbf5e70-c344-4699-84fa-60b67cc2cae4 None admin] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:43:10.109216 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dbf5e70-c344-4699-84fa-60b67cc2cae4 None admin] PATH_INFO: `/v3/domains` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:43:10.109940 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dbf5e70-c344-4699-84fa-60b67cc2cae4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=101892) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:43:10.110248 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dbf5e70-c344-4699-84fa-60b67cc2cae4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:43:10.111811 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dbf5e70-c344-4699-84fa-60b67cc2cae4 None admin] RBAC: Authorization granted {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:43:10.131849 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 294/599] 10.222.0.84 () {56 vars in 1109 bytes} [Wed May 25 14:43:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:43:10.131849 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dbf5e70-c344-4699-84fa-60b67cc2cae4 None admin] Authenticating user token {{(pid=101892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:43:10.190333 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-858b2cc6-8b7e-4771-8e56-37991da1d9e5 None admin] Validating token access rules against request {{(pid=101893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:43:10.212211 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG dbcounter [-] [101893] Writing DB stats keystone:SELECT=100 {{(pid=101893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:43:10.235553 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4382266b-0f03-4fd4-b428-866e443f2c75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:43:10.236487 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4382266b-0f03-4fd4-b428-866e443f2c75 None admin] REQUEST_METHOD: `PUT` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:43:10.236777 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4382266b-0f03-4fd4-b428-866e443f2c75 None admin] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:43:10.237052 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4382266b-0f03-4fd4-b428-866e443f2c75 None admin] PATH_INFO: `/v3/projects/a000829c658c4a7cab67f7b6353ba3fa/users/e079f89a5e524ab6ad4183e4f690de07/roles/fdcb2eda27b84f44a392b7e8b59cc425` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:43:10.245925 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG dbcounter [-] [101892] Writing DB stats keystone:SELECT=100 {{(pid=101892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:43:10.255338 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dbf5e70-c344-4699-84fa-60b67cc2cae4 None admin] Validating token access rules against request {{(pid=101892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:43:10.258838 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4382266b-0f03-4fd4-b428-866e443f2c75 None admin] RBAC: Authorizing `identity:create_grant(project_id=a000829c658c4a7cab67f7b6353ba3fa, user_id=e079f89a5e524ab6ad4183e4f690de07, role_id=fdcb2eda27b84f44a392b7e8b59cc425)` {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:43:10.261362 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4382266b-0f03-4fd4-b428-866e443f2c75 None admin] RBAC: Authorization granted {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:43:10.296159 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd9be9ef-5687-4d2f-914c-225069f3d4be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:43:10.296835 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9be9ef-5687-4d2f-914c-225069f3d4be None admin] REQUEST_METHOD: `GET` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:43:10.297185 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9be9ef-5687-4d2f-914c-225069f3d4be None admin] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:43:10.297531 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9be9ef-5687-4d2f-914c-225069f3d4be None admin] PATH_INFO: `/v3/domains` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:43:10.298347 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd9be9ef-5687-4d2f-914c-225069f3d4be None admin] RBAC: Adding query filter params (name=Default) {{(pid=101892) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:43:10.298723 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd9be9ef-5687-4d2f-914c-225069f3d4be None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:43:10.300131 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd9be9ef-5687-4d2f-914c-225069f3d4be None admin] RBAC: Authorization granted {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:43:10.313084 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 295/600] 10.222.0.84 () {56 vars in 1109 bytes} [Wed May 25 14:43:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:43:10.313734 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd9be9ef-5687-4d2f-914c-225069f3d4be None admin] Authenticating user token {{(pid=101892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:43:10.367917 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 306/601] 10.222.0.84 () {58 vars in 1439 bytes} [Wed May 25 14:43:10 2022] PUT /identity/v3/projects/a000829c658c4a7cab67f7b6353ba3fa/users/e079f89a5e524ab6ad4183e4f690de07/roles/fdcb2eda27b84f44a392b7e8b59cc425 => generated 0 bytes in 291 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 14:43:10.375160 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4382266b-0f03-4fd4-b428-866e443f2c75 None admin] Authenticating user token {{(pid=101893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:43:10.488496 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd9be9ef-5687-4d2f-914c-225069f3d4be None admin] Validating token access rules against request {{(pid=101892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:43:10.531023 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adf31c4f-1a1c-4f7c-b83e-59d5f5f753ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:43:10.531885 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf31c4f-1a1c-4f7c-b83e-59d5f5f753ea None admin] REQUEST_METHOD: `GET` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:43:10.532172 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf31c4f-1a1c-4f7c-b83e-59d5f5f753ea None admin] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:43:10.532453 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf31c4f-1a1c-4f7c-b83e-59d5f5f753ea None admin] PATH_INFO: `/v3/projects/service` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:43:10.540107 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adf31c4f-1a1c-4f7c-b83e-59d5f5f753ea None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:43:10.541584 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adf31c4f-1a1c-4f7c-b83e-59d5f5f753ea None admin] RBAC: Authorization granted {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:43:10.554980 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4382266b-0f03-4fd4-b428-866e443f2c75 None admin] Validating token access rules against request {{(pid=101893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:43:10.557934 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application [None req-adf31c4f-1a1c-4f7c-b83e-59d5f5f753ea None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 25 14:43:10.557934 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:43:10.557934 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 14:43:10.557934 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 14:43:10.557934 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 14:43:10.557934 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 14:43:10.557934 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 14:43:10.557934 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 14:43:10.557934 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 14:43:10.557934 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 14:43:10.557934 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 14:43:10.557934 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 14:43:10.557934 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 25 14:43:10.557934 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application return self._get_project(project_id) May 25 14:43:10.557934 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 25 14:43:10.558933 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 25 14:43:10.558933 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 14:43:10.558933 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 14:43:10.558933 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 14:43:10.558933 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 14:43:10.558933 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 14:43:10.558933 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application return self.get_or_create( May 25 14:43:10.558933 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 14:43:10.558933 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application with Lock( May 25 14:43:10.558933 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 14:43:10.558933 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application return self._enter() May 25 14:43:10.558933 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 14:43:10.558933 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 14:43:10.558933 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 14:43:10.558933 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application return self.creator() May 25 14:43:10.558933 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 14:43:10.558933 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application created_value = creator( May 25 14:43:10.559853 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 25 14:43:10.559853 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 25 14:43:10.559853 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 25 14:43:10.559853 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 25 14:43:10.559853 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 25 14:43:10.559853 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 25 14:43:10.559853 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 25 14:43:10.559853 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application May 25 14:43:10.559853 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 296/602] 10.222.0.84 () {56 vars in 1111 bytes} [Wed May 25 14:43:10 2022] GET /identity/v3/projects/service => generated 88 bytes in 246 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 14:43:10.566288 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d4f517-8587-4980-adf4-957a01f28dd2 None None] REQUEST_METHOD: `GET` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:43:10.566288 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d4f517-8587-4980-adf4-957a01f28dd2 None None] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:43:10.566288 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d4f517-8587-4980-adf4-957a01f28dd2 None None] PATH_INFO: `/` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:43:10.567353 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 297/603] 10.222.0.84 () {54 vars in 926 bytes} [Wed May 25 14:43:10 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 14:43:10.568303 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d4f517-8587-4980-adf4-957a01f28dd2 None None] Authenticating user token {{(pid=101892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:43:10.594378 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG dbcounter [-] [101892] Writing DB stats keystone:SELECT=100 {{(pid=101892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:43:10.612252 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-050798c7-4f8d-4430-b936-1027f4187a3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:43:10.612478 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050798c7-4f8d-4430-b936-1027f4187a3c None admin] REQUEST_METHOD: `GET` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:43:10.612778 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050798c7-4f8d-4430-b936-1027f4187a3c None admin] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:43:10.612978 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050798c7-4f8d-4430-b936-1027f4187a3c None admin] PATH_INFO: `/v3/projects/service` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:43:10.624210 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-050798c7-4f8d-4430-b936-1027f4187a3c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:43:10.625698 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-050798c7-4f8d-4430-b936-1027f4187a3c None admin] RBAC: Authorization granted {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:43:10.644798 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application [None req-050798c7-4f8d-4430-b936-1027f4187a3c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 25 14:43:10.644798 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:43:10.644798 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 14:43:10.644798 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 14:43:10.644798 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 14:43:10.644798 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 14:43:10.644798 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 14:43:10.644798 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 14:43:10.644798 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 14:43:10.644798 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 14:43:10.644798 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 14:43:10.644798 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 14:43:10.644798 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 25 14:43:10.644798 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return self._get_project(project_id) May 25 14:43:10.644798 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 25 14:43:10.645778 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 25 14:43:10.645778 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 14:43:10.645778 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 14:43:10.645778 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 14:43:10.645778 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 14:43:10.645778 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 14:43:10.645778 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return self.get_or_create( May 25 14:43:10.645778 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 14:43:10.645778 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application with Lock( May 25 14:43:10.645778 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 14:43:10.645778 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return self._enter() May 25 14:43:10.645778 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 14:43:10.645778 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 14:43:10.645778 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 14:43:10.645778 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return self.creator() May 25 14:43:10.645778 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 14:43:10.645778 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application created_value = creator( May 25 14:43:10.646668 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 25 14:43:10.646668 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 25 14:43:10.646668 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 25 14:43:10.646668 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 25 14:43:10.646668 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 25 14:43:10.646668 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 25 14:43:10.646668 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 25 14:43:10.646668 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application May 25 14:43:10.646668 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 307/604] 10.222.0.84 () {56 vars in 1111 bytes} [Wed May 25 14:43:10 2022] GET /identity/v3/projects/service => generated 88 bytes in 277 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 14:43:10.647659 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd4a7d2-82cd-4842-9704-10a12c34ccf3 None None] REQUEST_METHOD: `POST` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:43:10.647915 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd4a7d2-82cd-4842-9704-10a12c34ccf3 None None] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:43:10.648190 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd4a7d2-82cd-4842-9704-10a12c34ccf3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:43:10.666404 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.auth.core [None req-6cd4a7d2-82cd-4842-9704-10a12c34ccf3 None None] MFA Rules not processed for user `05d87e87798e429aa1c10b24391f915e`. Rule list: `[]` (Enabled: `True`). {{(pid=101893) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:43:10.667614 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.fernet_utils [None req-6cd4a7d2-82cd-4842-9704-10a12c34ccf3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=101893) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:43:10.693402 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG dbcounter [-] [101893] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=101893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:43:10.713149 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d4f517-8587-4980-adf4-957a01f28dd2 None None] Validating token access rules against request {{(pid=101892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:43:10.755387 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f1ec5b7-5ebf-4f49-89ba-3a8f38445bff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:43:10.756185 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1ec5b7-5ebf-4f49-89ba-3a8f38445bff None admin] REQUEST_METHOD: `GET` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:43:10.756379 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 308/605] 10.222.0.84 () {58 vars in 1023 bytes} [Wed May 25 14:43:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 25 14:43:10.756863 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1ec5b7-5ebf-4f49-89ba-3a8f38445bff None admin] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:43:10.756863 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1ec5b7-5ebf-4f49-89ba-3a8f38445bff None admin] PATH_INFO: `/v3/projects` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:43:10.758593 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cd4a7d2-82cd-4842-9704-10a12c34ccf3 None None] Authenticating user token {{(pid=101893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:43:10.758774 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f1ec5b7-5ebf-4f49-89ba-3a8f38445bff None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=101892) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:43:10.758774 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f1ec5b7-5ebf-4f49-89ba-3a8f38445bff None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:43:10.759919 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f1ec5b7-5ebf-4f49-89ba-3a8f38445bff None admin] RBAC: Authorization granted {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:43:10.787085 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 298/606] 10.222.0.84 () {56 vars in 1148 bytes} [Wed May 25 14:43:10 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:43:10.788507 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f1ec5b7-5ebf-4f49-89ba-3a8f38445bff None admin] Authenticating user token {{(pid=101892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:43:10.877299 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG dbcounter [-] [101892] Writing DB stats keystone:SELECT=100 {{(pid=101892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:43:10.889848 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cd4a7d2-82cd-4842-9704-10a12c34ccf3 None None] Validating token access rules against request {{(pid=101893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:43:10.903555 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f1ec5b7-5ebf-4f49-89ba-3a8f38445bff None admin] Validating token access rules against request {{(pid=101892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:43:10.925335 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0320ebe8-296f-4203-ad6e-bd04a2cf3c85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:43:10.926273 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0320ebe8-296f-4203-ad6e-bd04a2cf3c85 None admin] REQUEST_METHOD: `GET` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:43:10.926557 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0320ebe8-296f-4203-ad6e-bd04a2cf3c85 None admin] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:43:10.926836 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0320ebe8-296f-4203-ad6e-bd04a2cf3c85 None admin] PATH_INFO: `/v3/projects` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:43:10.927672 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0320ebe8-296f-4203-ad6e-bd04a2cf3c85 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=101893) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:43:10.927988 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0320ebe8-296f-4203-ad6e-bd04a2cf3c85 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:43:10.930002 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0320ebe8-296f-4203-ad6e-bd04a2cf3c85 None admin] RBAC: Authorization granted {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:43:10.942056 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b91ae7-86ac-4eb5-a37d-f50f0f1f2265 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:43:10.947601 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 309/607] 10.222.0.84 () {56 vars in 1148 bytes} [Wed May 25 14:43:10 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:43:10.947776 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b91ae7-86ac-4eb5-a37d-f50f0f1f2265 None admin] REQUEST_METHOD: `GET` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:43:10.947776 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b91ae7-86ac-4eb5-a37d-f50f0f1f2265 None admin] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:43:10.947776 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b91ae7-86ac-4eb5-a37d-f50f0f1f2265 None admin] PATH_INFO: `/v3/roles/service` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:43:10.948018 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0320ebe8-296f-4203-ad6e-bd04a2cf3c85 None admin] Authenticating user token {{(pid=101893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:43:10.957911 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38b91ae7-86ac-4eb5-a37d-f50f0f1f2265 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 14:43:10.962256 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG dbcounter [-] [101893] Writing DB stats keystone:SELECT=100 {{(pid=101893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:43:10.965673 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application [None req-38b91ae7-86ac-4eb5-a37d-f50f0f1f2265 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 25 14:43:10.965673 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:43:10.965673 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 14:43:10.965673 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 14:43:10.965673 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 14:43:10.965673 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 14:43:10.965673 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 14:43:10.965673 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 14:43:10.965673 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 14:43:10.965673 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 14:43:10.965673 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 14:43:10.965673 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 14:43:10.965673 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 14:43:10.965673 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 14:43:10.965673 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 14:43:10.965673 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 14:43:10.966624 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 14:43:10.966624 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 14:43:10.966624 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 14:43:10.966624 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 14:43:10.966624 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 14:43:10.966624 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 14:43:10.966624 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 14:43:10.966624 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 14:43:10.966624 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 14:43:10.966624 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application return self.get_or_create( May 25 14:43:10.966624 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 14:43:10.966624 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application with Lock( May 25 14:43:10.966624 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 14:43:10.966624 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application return self._enter() May 25 14:43:10.966624 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 14:43:10.966624 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 14:43:10.967633 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 14:43:10.967633 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application return self.creator() May 25 14:43:10.967633 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 14:43:10.967633 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application created_value = creator( May 25 14:43:10.967633 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 14:43:10.967633 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 14:43:10.967633 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 14:43:10.967633 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 14:43:10.967633 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 14:43:10.967633 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 14:43:10.967633 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 25 14:43:10.967633 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application May 25 14:43:10.967633 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 299/608] 10.222.0.84 () {56 vars in 1102 bytes} [Wed May 25 14:43:10 2022] GET /identity/v3/roles/service => generated 85 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 14:43:10.968383 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-443cb4d2-3aa6-4275-9c17-66636faf2892 None None] REQUEST_METHOD: `GET` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:43:10.968383 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-443cb4d2-3aa6-4275-9c17-66636faf2892 None None] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:43:10.969501 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-443cb4d2-3aa6-4275-9c17-66636faf2892 None None] PATH_INFO: `/` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:43:10.974451 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 300/609] 10.222.0.84 () {54 vars in 926 bytes} [Wed May 25 14:43:10 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 14:43:10.974451 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-443cb4d2-3aa6-4275-9c17-66636faf2892 None None] Authenticating user token {{(pid=101892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:43:11.057641 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0320ebe8-296f-4203-ad6e-bd04a2cf3c85 None admin] Validating token access rules against request {{(pid=101893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:43:11.087857 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-443cb4d2-3aa6-4275-9c17-66636faf2892 None None] Validating token access rules against request {{(pid=101892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:43:11.092038 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c10ada4a-c384-408b-b45d-d00856cb451d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:43:11.092952 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10ada4a-c384-408b-b45d-d00856cb451d None admin] REQUEST_METHOD: `PUT` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:43:11.093232 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10ada4a-c384-408b-b45d-d00856cb451d None admin] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:43:11.093503 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10ada4a-c384-408b-b45d-d00856cb451d None admin] PATH_INFO: `/v3/projects/a000829c658c4a7cab67f7b6353ba3fa/users/971542599734491aa112b815fc4cc5c2/roles/fdcb2eda27b84f44a392b7e8b59cc425` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:43:11.108899 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c10ada4a-c384-408b-b45d-d00856cb451d None admin] RBAC: Authorizing `identity:create_grant(project_id=a000829c658c4a7cab67f7b6353ba3fa, user_id=971542599734491aa112b815fc4cc5c2, role_id=fdcb2eda27b84f44a392b7e8b59cc425)` {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:43:11.110337 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c10ada4a-c384-408b-b45d-d00856cb451d None admin] RBAC: Authorization granted {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:43:11.124910 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-915fe1ec-5c08-4098-9f53-839429f2fcc7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:43:11.125795 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915fe1ec-5c08-4098-9f53-839429f2fcc7 None admin] REQUEST_METHOD: `PUT` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:43:11.126080 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915fe1ec-5c08-4098-9f53-839429f2fcc7 None admin] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:43:11.128827 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915fe1ec-5c08-4098-9f53-839429f2fcc7 None admin] PATH_INFO: `/v3/projects/a000829c658c4a7cab67f7b6353ba3fa/users/9ce28b25b907473588ccb87dc4acc06a/roles/fdcb2eda27b84f44a392b7e8b59cc425` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:43:11.129717 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG dbcounter [-] [101892] Writing DB stats keystone:SELECT=100 {{(pid=101892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:43:11.141582 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-915fe1ec-5c08-4098-9f53-839429f2fcc7 None admin] RBAC: Authorizing `identity:create_grant(project_id=a000829c658c4a7cab67f7b6353ba3fa, user_id=9ce28b25b907473588ccb87dc4acc06a, role_id=fdcb2eda27b84f44a392b7e8b59cc425)` {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:43:11.143025 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-915fe1ec-5c08-4098-9f53-839429f2fcc7 None admin] RBAC: Authorization granted {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:43:11.196173 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 310/610] 10.222.0.84 () {58 vars in 1439 bytes} [Wed May 25 14:43:10 2022] PUT /identity/v3/projects/a000829c658c4a7cab67f7b6353ba3fa/users/971542599734491aa112b815fc4cc5c2/roles/fdcb2eda27b84f44a392b7e8b59cc425 => generated 0 bytes in 253 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 14:43:11.197009 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c10ada4a-c384-408b-b45d-d00856cb451d None admin] Authenticating user token {{(pid=101893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:43:11.232265 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 301/611] 10.222.0.84 () {58 vars in 1439 bytes} [Wed May 25 14:43:10 2022] PUT /identity/v3/projects/a000829c658c4a7cab67f7b6353ba3fa/users/9ce28b25b907473588ccb87dc4acc06a/roles/fdcb2eda27b84f44a392b7e8b59cc425 => generated 0 bytes in 262 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 14:43:11.234094 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b94bb6-9311-42b8-843d-90980db55e80 None None] REQUEST_METHOD: `POST` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:43:11.234388 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b94bb6-9311-42b8-843d-90980db55e80 None None] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:43:11.234672 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b94bb6-9311-42b8-843d-90980db55e80 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:43:11.254683 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.auth.core [None req-a0b94bb6-9311-42b8-843d-90980db55e80 None None] MFA Rules not processed for user `05d87e87798e429aa1c10b24391f915e`. Rule list: `[]` (Enabled: `True`). {{(pid=101892) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:43:11.256118 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.fernet_utils [None req-a0b94bb6-9311-42b8-843d-90980db55e80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=101892) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:43:11.284201 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG dbcounter [-] [101893] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=101893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:43:11.326977 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c10ada4a-c384-408b-b45d-d00856cb451d None admin] Validating token access rules against request {{(pid=101893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:43:11.340334 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 302/612] 10.222.0.84 () {58 vars in 1023 bytes} [Wed May 25 14:43:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 25 14:43:11.369578 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90994290-0c22-4d9f-9fd4-3b5904bd6af2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:43:11.370320 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90994290-0c22-4d9f-9fd4-3b5904bd6af2 None admin] REQUEST_METHOD: `GET` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:43:11.370611 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90994290-0c22-4d9f-9fd4-3b5904bd6af2 None admin] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:43:11.370890 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90994290-0c22-4d9f-9fd4-3b5904bd6af2 None admin] PATH_INFO: `/v3/roles` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:43:11.371748 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90994290-0c22-4d9f-9fd4-3b5904bd6af2 None admin] RBAC: Adding query filter params (name=service) {{(pid=101893) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:43:11.372065 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90994290-0c22-4d9f-9fd4-3b5904bd6af2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:43:11.373796 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90994290-0c22-4d9f-9fd4-3b5904bd6af2 None admin] RBAC: Authorization granted {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:43:11.376608 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0b94bb6-9311-42b8-843d-90980db55e80 None None] Authenticating user token {{(pid=101892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:43:11.388121 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 311/613] 10.222.0.84 () {56 vars in 1103 bytes} [Wed May 25 14:43:11 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:43:11.390261 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90994290-0c22-4d9f-9fd4-3b5904bd6af2 None admin] Authenticating user token {{(pid=101893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:43:11.509847 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90994290-0c22-4d9f-9fd4-3b5904bd6af2 None admin] Validating token access rules against request {{(pid=101893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:43:11.526051 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0b94bb6-9311-42b8-843d-90980db55e80 None None] Validating token access rules against request {{(pid=101892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:43:11.541146 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG dbcounter [-] [101893] Writing DB stats keystone:SELECT=100 {{(pid=101893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:43:11.546913 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG dbcounter [-] [101892] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=101892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:43:11.551108 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bd4d06b-eb82-4d8f-9fc5-fa97c2085ae4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:43:11.551951 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd4d06b-eb82-4d8f-9fc5-fa97c2085ae4 None admin] REQUEST_METHOD: `GET` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:43:11.552241 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd4d06b-eb82-4d8f-9fc5-fa97c2085ae4 None admin] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:43:11.558259 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd4d06b-eb82-4d8f-9fc5-fa97c2085ae4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:43:11.564315 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bd4d06b-eb82-4d8f-9fc5-fa97c2085ae4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:43:11.566029 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bd4d06b-eb82-4d8f-9fc5-fa97c2085ae4 None admin] RBAC: Authorization granted {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:43:11.570917 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bd6881e-1c7c-4298-87b6-b9d67b8788b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:43:11.572046 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd6881e-1c7c-4298-87b6-b9d67b8788b7 None admin] REQUEST_METHOD: `GET` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:43:11.572533 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd6881e-1c7c-4298-87b6-b9d67b8788b7 None admin] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:43:11.572997 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd6881e-1c7c-4298-87b6-b9d67b8788b7 None admin] PATH_INFO: `/v3/roles/service` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:43:11.588030 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bd6881e-1c7c-4298-87b6-b9d67b8788b7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 14:43:11.592766 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application [None req-4bd4d06b-eb82-4d8f-9fc5-fa97c2085ae4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 25 14:43:11.592766 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:43:11.592766 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 14:43:11.592766 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 14:43:11.592766 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 14:43:11.592766 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 14:43:11.592766 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 14:43:11.592766 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 14:43:11.592766 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 14:43:11.592766 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 14:43:11.592766 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 14:43:11.592766 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 14:43:11.592766 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 25 14:43:11.592766 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 25 14:43:11.592766 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 25 14:43:11.593662 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 25 14:43:11.593662 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 14:43:11.593662 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 14:43:11.593662 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 14:43:11.593662 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 14:43:11.593662 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 14:43:11.593662 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return self.get_or_create( May 25 14:43:11.593662 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 14:43:11.593662 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application with Lock( May 25 14:43:11.593662 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 14:43:11.593662 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return self._enter() May 25 14:43:11.593662 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 14:43:11.593662 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 14:43:11.593662 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 14:43:11.593662 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return self.creator() May 25 14:43:11.593662 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 14:43:11.593662 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application created_value = creator( May 25 14:43:11.594576 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 25 14:43:11.594576 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 25 14:43:11.594576 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 25 14:43:11.594576 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application May 25 14:43:11.594576 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 312/614] 10.222.0.84 () {56 vars in 1108 bytes} [Wed May 25 14:43:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 25 14:43:11.596382 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bd4d06b-eb82-4d8f-9fc5-fa97c2085ae4 None admin] Authenticating user token {{(pid=101893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:43:11.600244 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application [None req-5bd6881e-1c7c-4298-87b6-b9d67b8788b7 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 25 14:43:11.600244 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:43:11.600244 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 14:43:11.600244 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 14:43:11.600244 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 14:43:11.600244 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 14:43:11.600244 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 14:43:11.600244 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 14:43:11.600244 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 14:43:11.600244 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 14:43:11.600244 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 14:43:11.600244 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 14:43:11.600244 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 14:43:11.600244 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 14:43:11.600244 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 14:43:11.600244 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 14:43:11.601427 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 14:43:11.601427 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 14:43:11.601427 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 14:43:11.601427 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 14:43:11.601427 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 14:43:11.601427 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 14:43:11.601427 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 14:43:11.601427 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 14:43:11.601427 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 14:43:11.601427 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application return self.get_or_create( May 25 14:43:11.601427 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 14:43:11.601427 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application with Lock( May 25 14:43:11.601427 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 14:43:11.601427 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application return self._enter() May 25 14:43:11.601427 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 14:43:11.601427 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 14:43:11.602316 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 14:43:11.602316 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application return self.creator() May 25 14:43:11.602316 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 14:43:11.602316 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application created_value = creator( May 25 14:43:11.602316 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 14:43:11.602316 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 14:43:11.602316 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 14:43:11.602316 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 14:43:11.602316 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 14:43:11.602316 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 14:43:11.602316 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 25 14:43:11.602316 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application May 25 14:43:11.605445 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 303/615] 10.222.0.84 () {56 vars in 1102 bytes} [Wed May 25 14:43:11 2022] GET /identity/v3/roles/service => generated 85 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 14:43:11.611230 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bd6881e-1c7c-4298-87b6-b9d67b8788b7 None admin] Authenticating user token {{(pid=101892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:43:11.714217 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bd4d06b-eb82-4d8f-9fc5-fa97c2085ae4 None admin] Validating token access rules against request {{(pid=101893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:43:11.724047 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bd6881e-1c7c-4298-87b6-b9d67b8788b7 None admin] Validating token access rules against request {{(pid=101892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:43:11.751509 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93dee8b2-344b-4eeb-9ea1-812fe5b16b59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:43:11.752327 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93dee8b2-344b-4eeb-9ea1-812fe5b16b59 None admin] REQUEST_METHOD: `GET` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:43:11.752683 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93dee8b2-344b-4eeb-9ea1-812fe5b16b59 None admin] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:43:11.753126 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93dee8b2-344b-4eeb-9ea1-812fe5b16b59 None admin] PATH_INFO: `/v3/domains` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:43:11.754207 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93dee8b2-344b-4eeb-9ea1-812fe5b16b59 None admin] RBAC: Adding query filter params (name=Default) {{(pid=101893) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:43:11.754365 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93dee8b2-344b-4eeb-9ea1-812fe5b16b59 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:43:11.755917 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93dee8b2-344b-4eeb-9ea1-812fe5b16b59 None admin] RBAC: Authorization granted {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:43:11.763051 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a31a577c-c0d2-44e0-b982-c0090a32f55b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:43:11.763989 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31a577c-c0d2-44e0-b982-c0090a32f55b None admin] REQUEST_METHOD: `GET` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:43:11.764452 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31a577c-c0d2-44e0-b982-c0090a32f55b None admin] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:43:11.764985 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31a577c-c0d2-44e0-b982-c0090a32f55b None admin] PATH_INFO: `/v3/roles` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:43:11.765957 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a31a577c-c0d2-44e0-b982-c0090a32f55b None admin] RBAC: Adding query filter params (name=service) {{(pid=101892) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:43:11.766585 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a31a577c-c0d2-44e0-b982-c0090a32f55b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:43:11.768181 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a31a577c-c0d2-44e0-b982-c0090a32f55b None admin] RBAC: Authorization granted {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:43:11.775177 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 313/616] 10.222.0.84 () {56 vars in 1109 bytes} [Wed May 25 14:43:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 14:43:11.776590 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93dee8b2-344b-4eeb-9ea1-812fe5b16b59 None admin] Authenticating user token {{(pid=101893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:43:11.778785 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 304/617] 10.222.0.84 () {56 vars in 1103 bytes} [Wed May 25 14:43:11 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 14:43:11.784582 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a31a577c-c0d2-44e0-b982-c0090a32f55b None admin] Authenticating user token {{(pid=101892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:43:11.827035 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG dbcounter [-] [101893] Writing DB stats keystone:SELECT=100 {{(pid=101893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:43:11.860127 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG dbcounter [-] [101892] Writing DB stats keystone:SELECT=100 {{(pid=101892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:43:11.884359 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93dee8b2-344b-4eeb-9ea1-812fe5b16b59 None admin] Validating token access rules against request {{(pid=101893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:43:11.920787 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0621430d-ebf8-4499-8d95-16a842c1d022 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:43:11.921659 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0621430d-ebf8-4499-8d95-16a842c1d022 None admin] REQUEST_METHOD: `GET` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:43:11.921947 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0621430d-ebf8-4499-8d95-16a842c1d022 None admin] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:43:11.922228 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0621430d-ebf8-4499-8d95-16a842c1d022 None admin] PATH_INFO: `/v3/users/swift` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:43:11.931476 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0621430d-ebf8-4499-8d95-16a842c1d022 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:43:11.932967 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0621430d-ebf8-4499-8d95-16a842c1d022 None admin] RBAC: Authorization granted {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:43:11.953361 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application [None req-0621430d-ebf8-4499-8d95-16a842c1d022 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. May 25 14:43:11.953361 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:43:11.953361 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 14:43:11.953361 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 14:43:11.953361 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 14:43:11.953361 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 14:43:11.953361 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 14:43:11.953361 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 14:43:11.953361 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 14:43:11.953361 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 14:43:11.953361 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 14:43:11.953361 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 14:43:11.953361 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 25 14:43:11.953361 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return self._get_user(user_id) May 25 14:43:11.953361 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 25 14:43:11.953361 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 25 14:43:11.954388 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 14:43:11.954388 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 14:43:11.954388 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 25 14:43:11.954388 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 25 14:43:11.954388 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 25 14:43:11.954388 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 25 14:43:11.954388 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 14:43:11.954388 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 14:43:11.954388 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 14:43:11.954388 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return self.get_or_create( May 25 14:43:11.954388 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 14:43:11.954388 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application with Lock( May 25 14:43:11.954388 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 14:43:11.954388 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return self._enter() May 25 14:43:11.954388 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 14:43:11.954388 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 14:43:11.954388 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 14:43:11.954388 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return self.creator() May 25 14:43:11.955349 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 14:43:11.955349 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application created_value = creator( May 25 14:43:11.955349 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 25 14:43:11.955349 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 25 14:43:11.955349 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 25 14:43:11.955349 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 25 14:43:11.955349 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 25 14:43:11.955349 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 25 14:43:11.955349 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. May 25 14:43:11.955349 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application May 25 14:43:11.959274 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 314/618] 10.222.0.84 () {56 vars in 1096 bytes} [Wed May 25 14:43:11 2022] GET /identity/v3/users/swift => generated 83 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 25 14:43:11.961159 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0621430d-ebf8-4499-8d95-16a842c1d022 None admin] Authenticating user token {{(pid=101893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:43:12.015761 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a31a577c-c0d2-44e0-b982-c0090a32f55b None admin] Validating token access rules against request {{(pid=101892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:43:12.068298 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0621430d-ebf8-4499-8d95-16a842c1d022 None admin] Validating token access rules against request {{(pid=101893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:43:12.073111 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG dbcounter [-] [101893] Writing DB stats keystone:SELECT=100 {{(pid=101893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:43:12.089411 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5836b34a-e9b6-480c-bebc-f385dfdf5499 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:43:12.090221 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5836b34a-e9b6-480c-bebc-f385dfdf5499 None admin] REQUEST_METHOD: `GET` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:43:12.090503 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5836b34a-e9b6-480c-bebc-f385dfdf5499 None admin] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:43:12.090775 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5836b34a-e9b6-480c-bebc-f385dfdf5499 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:43:12.113900 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5836b34a-e9b6-480c-bebc-f385dfdf5499 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:43:12.116263 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5836b34a-e9b6-480c-bebc-f385dfdf5499 None admin] RBAC: Authorization granted {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:43:12.119583 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfb9f03e-479f-4301-ad9c-9fbf89685c47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:43:12.119583 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb9f03e-479f-4301-ad9c-9fbf89685c47 None admin] REQUEST_METHOD: `GET` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:43:12.119583 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb9f03e-479f-4301-ad9c-9fbf89685c47 None admin] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:43:12.119583 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb9f03e-479f-4301-ad9c-9fbf89685c47 None admin] PATH_INFO: `/v3/users` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:43:12.119954 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfb9f03e-479f-4301-ad9c-9fbf89685c47 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=101893) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:43:12.120171 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfb9f03e-479f-4301-ad9c-9fbf89685c47 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:43:12.121757 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfb9f03e-479f-4301-ad9c-9fbf89685c47 None admin] RBAC: Authorization granted {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:43:12.145790 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 315/619] 10.222.0.84 () {56 vars in 1135 bytes} [Wed May 25 14:43:11 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 14:43:12.147097 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfb9f03e-479f-4301-ad9c-9fbf89685c47 None admin] Authenticating user token {{(pid=101893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:43:12.152530 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application [None req-5836b34a-e9b6-480c-bebc-f385dfdf5499 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 25 14:43:12.152530 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:43:12.152530 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 14:43:12.152530 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 14:43:12.152530 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 14:43:12.152530 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 14:43:12.152530 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 14:43:12.152530 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 14:43:12.152530 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 14:43:12.152530 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 14:43:12.152530 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 14:43:12.152530 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 14:43:12.152530 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 25 14:43:12.152530 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 25 14:43:12.152530 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 25 14:43:12.153426 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 25 14:43:12.153426 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 14:43:12.153426 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 14:43:12.153426 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 14:43:12.153426 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 14:43:12.153426 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 14:43:12.153426 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application return self.get_or_create( May 25 14:43:12.153426 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 14:43:12.153426 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application with Lock( May 25 14:43:12.153426 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 14:43:12.153426 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application return self._enter() May 25 14:43:12.153426 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 14:43:12.153426 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 14:43:12.153426 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 14:43:12.153426 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application return self.creator() May 25 14:43:12.153426 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 14:43:12.153426 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application created_value = creator( May 25 14:43:12.154325 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 25 14:43:12.154325 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 25 14:43:12.154325 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 25 14:43:12.154325 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application May 25 14:43:12.156732 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 305/620] 10.222.0.84 () {56 vars in 1108 bytes} [Wed May 25 14:43:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 372 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 14:43:12.161822 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5836b34a-e9b6-480c-bebc-f385dfdf5499 None admin] Authenticating user token {{(pid=101892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:43:12.263420 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfb9f03e-479f-4301-ad9c-9fbf89685c47 None admin] Validating token access rules against request {{(pid=101893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:43:12.332163 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG dbcounter [-] [101892] Writing DB stats keystone:SELECT=100 {{(pid=101892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:43:12.332478 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36553574-8e46-4a1b-a5ce-1ecc767a5d5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:43:12.333289 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36553574-8e46-4a1b-a5ce-1ecc767a5d5e None admin] REQUEST_METHOD: `GET` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:43:12.333574 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36553574-8e46-4a1b-a5ce-1ecc767a5d5e None admin] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:43:12.333852 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36553574-8e46-4a1b-a5ce-1ecc767a5d5e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:43:12.352672 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5836b34a-e9b6-480c-bebc-f385dfdf5499 None admin] Validating token access rules against request {{(pid=101892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:43:12.354979 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36553574-8e46-4a1b-a5ce-1ecc767a5d5e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:43:12.356779 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36553574-8e46-4a1b-a5ce-1ecc767a5d5e None admin] RBAC: Authorization granted {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:43:12.389550 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application [None req-36553574-8e46-4a1b-a5ce-1ecc767a5d5e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 25 14:43:12.389550 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:43:12.389550 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 14:43:12.389550 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 14:43:12.389550 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 14:43:12.389550 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 14:43:12.389550 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 14:43:12.389550 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 14:43:12.389550 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 14:43:12.389550 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 14:43:12.389550 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 14:43:12.389550 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 14:43:12.389550 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 25 14:43:12.389550 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 25 14:43:12.389550 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 25 14:43:12.390506 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 25 14:43:12.390506 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 14:43:12.390506 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 14:43:12.390506 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 14:43:12.390506 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 14:43:12.390506 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 14:43:12.390506 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return self.get_or_create( May 25 14:43:12.390506 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 14:43:12.390506 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application with Lock( May 25 14:43:12.390506 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 14:43:12.390506 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return self._enter() May 25 14:43:12.390506 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 14:43:12.390506 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 14:43:12.390506 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 14:43:12.390506 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return self.creator() May 25 14:43:12.390506 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 14:43:12.390506 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application created_value = creator( May 25 14:43:12.391400 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 25 14:43:12.391400 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 25 14:43:12.391400 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 25 14:43:12.391400 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application May 25 14:43:12.392837 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 316/621] 10.222.0.84 () {56 vars in 1108 bytes} [Wed May 25 14:43:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 246 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 14:43:12.398034 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36553574-8e46-4a1b-a5ce-1ecc767a5d5e None admin] Authenticating user token {{(pid=101893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:43:12.411951 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG dbcounter [-] [101893] Writing DB stats keystone:SELECT=100 {{(pid=101893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:43:12.416264 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a222c38-666b-4383-b374-dca5fb1ac541 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:43:12.416941 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a222c38-666b-4383-b374-dca5fb1ac541 None admin] REQUEST_METHOD: `GET` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:43:12.417228 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a222c38-666b-4383-b374-dca5fb1ac541 None admin] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:43:12.417508 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a222c38-666b-4383-b374-dca5fb1ac541 None admin] PATH_INFO: `/v3/domains` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:43:12.419251 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a222c38-666b-4383-b374-dca5fb1ac541 None admin] RBAC: Adding query filter params (name=Default) {{(pid=101892) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:43:12.419583 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a222c38-666b-4383-b374-dca5fb1ac541 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:43:12.421866 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a222c38-666b-4383-b374-dca5fb1ac541 None admin] RBAC: Authorization granted {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:43:12.447518 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 306/622] 10.222.0.84 () {56 vars in 1109 bytes} [Wed May 25 14:43:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 285 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:43:12.452327 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a222c38-666b-4383-b374-dca5fb1ac541 None admin] Authenticating user token {{(pid=101892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:43:12.567609 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36553574-8e46-4a1b-a5ce-1ecc767a5d5e None admin] Validating token access rules against request {{(pid=101893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:43:12.606653 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3421a12-11c7-4619-965b-bb86d7a927a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:43:12.608537 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3421a12-11c7-4619-965b-bb86d7a927a6 None admin] REQUEST_METHOD: `GET` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:43:12.609648 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3421a12-11c7-4619-965b-bb86d7a927a6 None admin] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:43:12.610303 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3421a12-11c7-4619-965b-bb86d7a927a6 None admin] PATH_INFO: `/v3/domains` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:43:12.612151 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3421a12-11c7-4619-965b-bb86d7a927a6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=101893) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:43:12.612863 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3421a12-11c7-4619-965b-bb86d7a927a6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:43:12.615109 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3421a12-11c7-4619-965b-bb86d7a927a6 None admin] RBAC: Authorization granted {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:43:12.622968 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a222c38-666b-4383-b374-dca5fb1ac541 None admin] Validating token access rules against request {{(pid=101892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:43:12.640196 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 317/623] 10.222.0.84 () {56 vars in 1109 bytes} [Wed May 25 14:43:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:43:12.645999 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3421a12-11c7-4619-965b-bb86d7a927a6 None admin] Authenticating user token {{(pid=101893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:43:12.700044 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b410c141-dcd7-454a-87b9-9479072a284a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:43:12.700847 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b410c141-dcd7-454a-87b9-9479072a284a None admin] REQUEST_METHOD: `GET` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:43:12.701134 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b410c141-dcd7-454a-87b9-9479072a284a None admin] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:43:12.701413 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b410c141-dcd7-454a-87b9-9479072a284a None admin] PATH_INFO: `/v3/users/nova` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:43:12.718275 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b410c141-dcd7-454a-87b9-9479072a284a None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:43:12.721695 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b410c141-dcd7-454a-87b9-9479072a284a None admin] RBAC: Authorization granted {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:43:12.740732 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application [None req-b410c141-dcd7-454a-87b9-9479072a284a None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 25 14:43:12.740732 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:43:12.740732 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 14:43:12.740732 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 14:43:12.740732 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 14:43:12.740732 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 14:43:12.740732 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 14:43:12.740732 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 14:43:12.740732 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 14:43:12.740732 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 14:43:12.740732 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 14:43:12.740732 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 14:43:12.740732 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 25 14:43:12.740732 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application return self._get_user(user_id) May 25 14:43:12.740732 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 25 14:43:12.740732 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 25 14:43:12.742135 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 14:43:12.742135 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 14:43:12.742135 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 25 14:43:12.742135 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 25 14:43:12.742135 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 25 14:43:12.742135 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 25 14:43:12.742135 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 14:43:12.742135 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 14:43:12.742135 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 14:43:12.742135 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application return self.get_or_create( May 25 14:43:12.742135 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 14:43:12.742135 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application with Lock( May 25 14:43:12.742135 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 14:43:12.742135 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application return self._enter() May 25 14:43:12.742135 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 14:43:12.742135 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 14:43:12.742135 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 14:43:12.742135 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application return self.creator() May 25 14:43:12.743109 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 14:43:12.743109 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application created_value = creator( May 25 14:43:12.743109 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 25 14:43:12.743109 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 25 14:43:12.743109 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 25 14:43:12.743109 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 25 14:43:12.743109 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 25 14:43:12.743109 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 25 14:43:12.743109 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 25 14:43:12.743109 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application May 25 14:43:12.743682 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 307/624] 10.222.0.84 () {56 vars in 1093 bytes} [Wed May 25 14:43:12 2022] GET /identity/v3/users/nova => generated 82 bytes in 291 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 14:43:12.751786 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b410c141-dcd7-454a-87b9-9479072a284a None admin] Authenticating user token {{(pid=101892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:43:12.773004 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG dbcounter [-] [101892] Writing DB stats keystone:SELECT=100 {{(pid=101892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:43:12.777276 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG dbcounter [-] [101893] Writing DB stats keystone:SELECT=100 {{(pid=101893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:43:12.845540 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3421a12-11c7-4619-965b-bb86d7a927a6 None admin] Validating token access rules against request {{(pid=101893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:43:12.884940 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b410c141-dcd7-454a-87b9-9479072a284a None admin] Validating token access rules against request {{(pid=101892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:43:12.900611 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-266bcca6-8f2d-4efc-a084-675d7f3e6e07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:43:12.901244 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266bcca6-8f2d-4efc-a084-675d7f3e6e07 None admin] REQUEST_METHOD: `GET` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:43:12.901534 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266bcca6-8f2d-4efc-a084-675d7f3e6e07 None admin] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:43:12.901813 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266bcca6-8f2d-4efc-a084-675d7f3e6e07 None admin] PATH_INFO: `/v3/projects/service` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:43:12.908786 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-266bcca6-8f2d-4efc-a084-675d7f3e6e07 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:43:12.910353 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-266bcca6-8f2d-4efc-a084-675d7f3e6e07 None admin] RBAC: Authorization granted {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:43:12.923048 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b0285ac-98b2-489a-85c4-202e75168d5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:43:12.924041 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0285ac-98b2-489a-85c4-202e75168d5f None admin] REQUEST_METHOD: `GET` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:43:12.924473 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0285ac-98b2-489a-85c4-202e75168d5f None admin] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:43:12.924916 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0285ac-98b2-489a-85c4-202e75168d5f None admin] PATH_INFO: `/v3/users` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:43:12.925969 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b0285ac-98b2-489a-85c4-202e75168d5f None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=101892) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:43:12.926426 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b0285ac-98b2-489a-85c4-202e75168d5f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:43:12.926719 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application [None req-266bcca6-8f2d-4efc-a084-675d7f3e6e07 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 25 14:43:12.926719 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:43:12.926719 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 14:43:12.926719 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 14:43:12.926719 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 14:43:12.926719 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 14:43:12.926719 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 14:43:12.926719 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 14:43:12.926719 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 14:43:12.926719 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 14:43:12.926719 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 14:43:12.926719 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 14:43:12.926719 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 25 14:43:12.926719 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return self._get_project(project_id) May 25 14:43:12.926719 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 25 14:43:12.927821 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 25 14:43:12.927821 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 14:43:12.927821 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 14:43:12.927821 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 14:43:12.927821 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 14:43:12.927821 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 14:43:12.927821 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return self.get_or_create( May 25 14:43:12.927821 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 14:43:12.927821 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application with Lock( May 25 14:43:12.927821 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 14:43:12.927821 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return self._enter() May 25 14:43:12.927821 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 14:43:12.927821 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 14:43:12.927821 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 14:43:12.927821 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return self.creator() May 25 14:43:12.927821 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 14:43:12.927821 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application created_value = creator( May 25 14:43:12.928963 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 25 14:43:12.928963 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 25 14:43:12.928963 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 25 14:43:12.928963 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 25 14:43:12.928963 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 25 14:43:12.928963 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 25 14:43:12.928963 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 25 14:43:12.928963 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application May 25 14:43:12.930889 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b0285ac-98b2-489a-85c4-202e75168d5f None admin] RBAC: Authorization granted {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:43:12.934711 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 318/625] 10.222.0.84 () {56 vars in 1111 bytes} [Wed May 25 14:43:12 2022] GET /identity/v3/projects/service => generated 88 bytes in 284 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 25 14:43:12.935865 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c27a64-a6fa-4f22-a556-ab3bab070f6e None None] REQUEST_METHOD: `GET` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:43:12.936162 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c27a64-a6fa-4f22-a556-ab3bab070f6e None None] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:43:12.936451 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c27a64-a6fa-4f22-a556-ab3bab070f6e None None] PATH_INFO: `/` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:43:12.938273 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 319/626] 10.222.0.84 () {54 vars in 926 bytes} [Wed May 25 14:43:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 14:43:12.939274 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9c27a64-a6fa-4f22-a556-ab3bab070f6e None None] Authenticating user token {{(pid=101893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:43:12.952237 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 308/627] 10.222.0.84 () {56 vars in 1133 bytes} [Wed May 25 14:43:12 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:43:12.953777 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e9579b-65e5-42ad-be1f-7b68cc04ab3a None None] REQUEST_METHOD: `POST` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:43:12.954342 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e9579b-65e5-42ad-be1f-7b68cc04ab3a None None] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:43:12.954807 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e9579b-65e5-42ad-be1f-7b68cc04ab3a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:43:12.972343 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.auth.core [None req-b5e9579b-65e5-42ad-be1f-7b68cc04ab3a None None] MFA Rules not processed for user `05d87e87798e429aa1c10b24391f915e`. Rule list: `[]` (Enabled: `True`). {{(pid=101892) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:43:12.973834 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.fernet_utils [None req-b5e9579b-65e5-42ad-be1f-7b68cc04ab3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=101892) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:43:13.039463 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG dbcounter [-] [101892] Writing DB stats keystone:SELECT=100 {{(pid=101892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:43:13.046053 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 309/628] 10.222.0.84 () {58 vars in 1023 bytes} [Wed May 25 14:43:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 25 14:43:13.046747 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9c27a64-a6fa-4f22-a556-ab3bab070f6e None None] Validating token access rules against request {{(pid=101893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:43:13.047292 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e9579b-65e5-42ad-be1f-7b68cc04ab3a None None] Authenticating user token {{(pid=101892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:43:13.081914 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fa63831-b33b-40b8-96ce-c75d6987b9b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:43:13.082681 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa63831-b33b-40b8-96ce-c75d6987b9b6 None admin] REQUEST_METHOD: `GET` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:43:13.083043 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa63831-b33b-40b8-96ce-c75d6987b9b6 None admin] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:43:13.083394 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa63831-b33b-40b8-96ce-c75d6987b9b6 None admin] PATH_INFO: `/v3/projects` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:43:13.085306 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fa63831-b33b-40b8-96ce-c75d6987b9b6 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=101893) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:43:13.085615 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fa63831-b33b-40b8-96ce-c75d6987b9b6 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:43:13.087143 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fa63831-b33b-40b8-96ce-c75d6987b9b6 None admin] RBAC: Authorization granted {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:43:13.099985 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG dbcounter [-] [101893] Writing DB stats keystone:SELECT=100 {{(pid=101893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:43:13.104057 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 320/629] 10.222.0.84 () {56 vars in 1148 bytes} [Wed May 25 14:43:12 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:43:13.105052 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fa63831-b33b-40b8-96ce-c75d6987b9b6 None admin] Authenticating user token {{(pid=101893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:43:13.154656 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e9579b-65e5-42ad-be1f-7b68cc04ab3a None None] Validating token access rules against request {{(pid=101892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:43:13.189457 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-809f3811-4763-4707-8c74-a3e426d8db5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:43:13.190441 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809f3811-4763-4707-8c74-a3e426d8db5f None admin] REQUEST_METHOD: `GET` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:43:13.190941 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809f3811-4763-4707-8c74-a3e426d8db5f None admin] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:43:13.191415 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809f3811-4763-4707-8c74-a3e426d8db5f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:43:13.212291 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fa63831-b33b-40b8-96ce-c75d6987b9b6 None admin] Validating token access rules against request {{(pid=101893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:43:13.248888 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a3f89ea-ffd0-4584-bd41-eac56889b532 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:43:13.249715 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3f89ea-ffd0-4584-bd41-eac56889b532 None admin] REQUEST_METHOD: `GET` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:43:13.250004 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3f89ea-ffd0-4584-bd41-eac56889b532 None admin] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:43:13.250340 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3f89ea-ffd0-4584-bd41-eac56889b532 None admin] PATH_INFO: `/v3/roles/service` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:43:13.260685 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG dbcounter [-] [101892] Writing DB stats keystone:SELECT=100 {{(pid=101892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:43:13.263001 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a3f89ea-ffd0-4584-bd41-eac56889b532 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 14:43:13.265292 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-809f3811-4763-4707-8c74-a3e426d8db5f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:43:13.267071 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-809f3811-4763-4707-8c74-a3e426d8db5f None admin] RBAC: Authorization granted {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:43:13.271063 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application [None req-5a3f89ea-ffd0-4584-bd41-eac56889b532 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 25 14:43:13.271063 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:43:13.271063 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 14:43:13.271063 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 14:43:13.271063 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 14:43:13.271063 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 14:43:13.271063 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 14:43:13.271063 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 14:43:13.271063 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 14:43:13.271063 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 14:43:13.271063 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 14:43:13.271063 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 14:43:13.271063 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 14:43:13.271063 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 14:43:13.271063 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 14:43:13.271063 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 14:43:13.275649 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 14:43:13.275649 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 14:43:13.275649 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 14:43:13.275649 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 14:43:13.275649 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 14:43:13.275649 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 14:43:13.275649 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 14:43:13.275649 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 14:43:13.275649 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 14:43:13.275649 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return self.get_or_create( May 25 14:43:13.275649 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 14:43:13.275649 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application with Lock( May 25 14:43:13.275649 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 14:43:13.275649 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return self._enter() May 25 14:43:13.275649 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 14:43:13.275649 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 14:43:13.276525 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 14:43:13.276525 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return self.creator() May 25 14:43:13.276525 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 14:43:13.276525 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application created_value = creator( May 25 14:43:13.276525 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 14:43:13.276525 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 14:43:13.276525 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 14:43:13.276525 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 14:43:13.276525 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 14:43:13.276525 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 14:43:13.276525 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 25 14:43:13.276525 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application May 25 14:43:13.276525 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 321/630] 10.222.0.84 () {56 vars in 1102 bytes} [Wed May 25 14:43:13 2022] GET /identity/v3/roles/service => generated 85 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 14:43:13.276525 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a3f89ea-ffd0-4584-bd41-eac56889b532 None admin] Authenticating user token {{(pid=101893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:43:13.329286 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG dbcounter [-] [101893] Writing DB stats keystone:SELECT=100 {{(pid=101893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:43:13.387378 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 310/631] 10.222.0.84 () {58 vars in 1282 bytes} [Wed May 25 14:43:13 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 340 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 25 14:43:13.388397 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-809f3811-4763-4707-8c74-a3e426d8db5f None admin] Authenticating user token {{(pid=101892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:43:13.400042 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a3f89ea-ffd0-4584-bd41-eac56889b532 None admin] Validating token access rules against request {{(pid=101893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:43:13.439010 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08021012-2171-4be4-b81c-5d432811ee3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:43:13.440123 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08021012-2171-4be4-b81c-5d432811ee3c None admin] REQUEST_METHOD: `PUT` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:43:13.440567 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08021012-2171-4be4-b81c-5d432811ee3c None admin] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:43:13.440963 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08021012-2171-4be4-b81c-5d432811ee3c None admin] PATH_INFO: `/v3/projects/a000829c658c4a7cab67f7b6353ba3fa/users/e196f0897b98455c9e164271d7d0070a/roles/fdcb2eda27b84f44a392b7e8b59cc425` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:43:13.459255 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08021012-2171-4be4-b81c-5d432811ee3c None admin] RBAC: Authorizing `identity:create_grant(project_id=a000829c658c4a7cab67f7b6353ba3fa, user_id=e196f0897b98455c9e164271d7d0070a, role_id=fdcb2eda27b84f44a392b7e8b59cc425)` {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:43:13.460991 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08021012-2171-4be4-b81c-5d432811ee3c None admin] RBAC: Authorization granted {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:43:13.488662 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG dbcounter [-] [101892] Writing DB stats keystone:SELECT=100 {{(pid=101892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:43:13.492962 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-809f3811-4763-4707-8c74-a3e426d8db5f None admin] Validating token access rules against request {{(pid=101892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:43:13.528812 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-035005ff-7ade-41b5-b219-12e2fd5b7944 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:43:13.529476 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035005ff-7ade-41b5-b219-12e2fd5b7944 None admin] REQUEST_METHOD: `GET` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:43:13.529761 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035005ff-7ade-41b5-b219-12e2fd5b7944 None admin] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:43:13.530041 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035005ff-7ade-41b5-b219-12e2fd5b7944 None admin] PATH_INFO: `/v3/roles` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:43:13.530798 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-035005ff-7ade-41b5-b219-12e2fd5b7944 None admin] RBAC: Adding query filter params (name=service) {{(pid=101892) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:43:13.531099 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-035005ff-7ade-41b5-b219-12e2fd5b7944 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:43:13.535642 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-035005ff-7ade-41b5-b219-12e2fd5b7944 None admin] RBAC: Authorization granted {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:43:13.539150 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 322/632] 10.222.0.84 () {58 vars in 1439 bytes} [Wed May 25 14:43:13 2022] PUT /identity/v3/projects/a000829c658c4a7cab67f7b6353ba3fa/users/e196f0897b98455c9e164271d7d0070a/roles/fdcb2eda27b84f44a392b7e8b59cc425 => generated 0 bytes in 259 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 14:43:13.539150 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08021012-2171-4be4-b81c-5d432811ee3c None admin] Authenticating user token {{(pid=101893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:43:13.553695 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 311/633] 10.222.0.84 () {56 vars in 1103 bytes} [Wed May 25 14:43:13 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:43:13.565533 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-035005ff-7ade-41b5-b219-12e2fd5b7944 None admin] Authenticating user token {{(pid=101892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:43:13.748258 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG dbcounter [-] [101893] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=101893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:43:13.753900 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08021012-2171-4be4-b81c-5d432811ee3c None admin] Validating token access rules against request {{(pid=101893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:43:13.797291 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-035005ff-7ade-41b5-b219-12e2fd5b7944 None admin] Validating token access rules against request {{(pid=101892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:43:13.824603 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbe133e9-8f53-4dc9-8c7d-b6158b6c4aa6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:43:13.826185 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe133e9-8f53-4dc9-8c7d-b6158b6c4aa6 None admin] REQUEST_METHOD: `GET` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:43:13.826473 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe133e9-8f53-4dc9-8c7d-b6158b6c4aa6 None admin] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:43:13.826754 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe133e9-8f53-4dc9-8c7d-b6158b6c4aa6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:43:13.843553 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbe133e9-8f53-4dc9-8c7d-b6158b6c4aa6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:43:13.845308 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbe133e9-8f53-4dc9-8c7d-b6158b6c4aa6 None admin] RBAC: Authorization granted {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:43:13.851987 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51bccbd2-7db5-41d4-bef7-beb937791c53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:43:13.853114 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51bccbd2-7db5-41d4-bef7-beb937791c53 None admin] REQUEST_METHOD: `GET` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:43:13.853619 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51bccbd2-7db5-41d4-bef7-beb937791c53 None admin] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:43:13.854119 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51bccbd2-7db5-41d4-bef7-beb937791c53 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:43:13.867452 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51bccbd2-7db5-41d4-bef7-beb937791c53 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:43:13.868031 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application [None req-fbe133e9-8f53-4dc9-8c7d-b6158b6c4aa6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 25 14:43:13.868031 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:43:13.868031 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 14:43:13.868031 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 14:43:13.868031 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 14:43:13.868031 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 14:43:13.868031 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 14:43:13.868031 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 14:43:13.868031 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 14:43:13.868031 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 14:43:13.868031 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 14:43:13.868031 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 14:43:13.868031 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 25 14:43:13.868031 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 25 14:43:13.868031 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 25 14:43:13.868943 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 25 14:43:13.868943 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 14:43:13.868943 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 14:43:13.868943 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 14:43:13.868943 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 14:43:13.868943 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 14:43:13.868943 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return self.get_or_create( May 25 14:43:13.868943 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 14:43:13.868943 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application with Lock( May 25 14:43:13.868943 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 14:43:13.868943 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return self._enter() May 25 14:43:13.868943 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 14:43:13.868943 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 14:43:13.868943 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 14:43:13.868943 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return self.creator() May 25 14:43:13.868943 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 14:43:13.868943 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application created_value = creator( May 25 14:43:13.869840 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 25 14:43:13.869840 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 25 14:43:13.869840 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 25 14:43:13.869840 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application May 25 14:43:13.869840 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 323/634] 10.222.0.84 () {56 vars in 1108 bytes} [Wed May 25 14:43:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 333 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 14:43:13.871873 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51bccbd2-7db5-41d4-bef7-beb937791c53 None admin] RBAC: Authorization granted {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:43:13.875581 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbe133e9-8f53-4dc9-8c7d-b6158b6c4aa6 None admin] Authenticating user token {{(pid=101893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:43:13.891818 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application [None req-51bccbd2-7db5-41d4-bef7-beb937791c53 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 25 14:43:13.891818 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:43:13.891818 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 14:43:13.891818 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 14:43:13.891818 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 14:43:13.891818 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 14:43:13.891818 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 14:43:13.891818 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 14:43:13.891818 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 14:43:13.891818 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 14:43:13.891818 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 14:43:13.891818 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 14:43:13.891818 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 25 14:43:13.891818 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 25 14:43:13.891818 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 25 14:43:13.892800 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 25 14:43:13.892800 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 14:43:13.892800 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 14:43:13.892800 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 14:43:13.892800 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 14:43:13.892800 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 14:43:13.892800 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application return self.get_or_create( May 25 14:43:13.892800 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 14:43:13.892800 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application with Lock( May 25 14:43:13.892800 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 14:43:13.892800 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application return self._enter() May 25 14:43:13.892800 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 14:43:13.892800 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 14:43:13.892800 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 14:43:13.892800 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application return self.creator() May 25 14:43:13.892800 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 14:43:13.892800 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application created_value = creator( May 25 14:43:13.893706 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 25 14:43:13.893706 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 25 14:43:13.893706 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 25 14:43:13.893706 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application May 25 14:43:13.896054 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 312/635] 10.222.0.84 () {56 vars in 1108 bytes} [Wed May 25 14:43:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 331 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 14:43:13.901753 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51bccbd2-7db5-41d4-bef7-beb937791c53 None admin] Authenticating user token {{(pid=101892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:43:13.919834 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG dbcounter [-] [101892] Writing DB stats keystone:SELECT=100 {{(pid=101892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:43:14.004327 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbe133e9-8f53-4dc9-8c7d-b6158b6c4aa6 None admin] Validating token access rules against request {{(pid=101893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:43:14.027959 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51bccbd2-7db5-41d4-bef7-beb937791c53 None admin] Validating token access rules against request {{(pid=101892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:43:14.042915 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96003147-48c9-4158-a849-a0975a41160c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:43:14.043602 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96003147-48c9-4158-a849-a0975a41160c None admin] REQUEST_METHOD: `GET` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:43:14.043893 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96003147-48c9-4158-a849-a0975a41160c None admin] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:43:14.044169 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96003147-48c9-4158-a849-a0975a41160c None admin] PATH_INFO: `/v3/domains` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:43:14.044895 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96003147-48c9-4158-a849-a0975a41160c None admin] RBAC: Adding query filter params (name=Default) {{(pid=101893) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:43:14.045326 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96003147-48c9-4158-a849-a0975a41160c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:43:14.046814 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96003147-48c9-4158-a849-a0975a41160c None admin] RBAC: Authorization granted {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:43:14.061561 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 324/636] 10.222.0.84 () {56 vars in 1109 bytes} [Wed May 25 14:43:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:43:14.062978 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7c7048-c90a-445e-9485-99e653239efc None None] REQUEST_METHOD: `GET` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:43:14.063277 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7c7048-c90a-445e-9485-99e653239efc None None] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:43:14.063575 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7c7048-c90a-445e-9485-99e653239efc None None] PATH_INFO: `/` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:43:14.064509 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a202e20-77a1-4e16-8c2b-9d1b2f22ddae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:43:14.064932 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 325/637] 10.222.0.84 () {54 vars in 926 bytes} [Wed May 25 14:43:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 14:43:14.065368 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a202e20-77a1-4e16-8c2b-9d1b2f22ddae None admin] REQUEST_METHOD: `GET` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:43:14.065743 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a202e20-77a1-4e16-8c2b-9d1b2f22ddae None admin] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:43:14.065979 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8bfa200-458c-4a74-a032-8cf9b003bbe8 None None] REQUEST_METHOD: `GET` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:43:14.066199 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a202e20-77a1-4e16-8c2b-9d1b2f22ddae None admin] PATH_INFO: `/v3/domains` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:43:14.066311 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8bfa200-458c-4a74-a032-8cf9b003bbe8 None None] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:43:14.066526 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8bfa200-458c-4a74-a032-8cf9b003bbe8 None None] PATH_INFO: `/` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:43:14.067172 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a202e20-77a1-4e16-8c2b-9d1b2f22ddae None admin] RBAC: Adding query filter params (name=Default) {{(pid=101892) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:43:14.069406 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a202e20-77a1-4e16-8c2b-9d1b2f22ddae None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:43:14.069546 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 326/638] 10.222.0.84 () {54 vars in 926 bytes} [Wed May 25 14:43:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 14:43:14.069730 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a202e20-77a1-4e16-8c2b-9d1b2f22ddae None admin] RBAC: Authorization granted {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:43:14.069955 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc98a3e-bc5b-48c1-9e26-52e1e3e61ecb None None] REQUEST_METHOD: `POST` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:43:14.070252 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc98a3e-bc5b-48c1-9e26-52e1e3e61ecb None None] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:43:14.070666 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc98a3e-bc5b-48c1-9e26-52e1e3e61ecb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:43:14.083074 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 313/639] 10.222.0.84 () {56 vars in 1109 bytes} [Wed May 25 14:43:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:43:14.084147 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a202e20-77a1-4e16-8c2b-9d1b2f22ddae None admin] Authenticating user token {{(pid=101892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:43:14.093722 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.auth.core [None req-fcc98a3e-bc5b-48c1-9e26-52e1e3e61ecb None None] MFA Rules not processed for user `05d87e87798e429aa1c10b24391f915e`. Rule list: `[]` (Enabled: `True`). {{(pid=101893) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:43:14.094920 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.fernet_utils [None req-fcc98a3e-bc5b-48c1-9e26-52e1e3e61ecb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=101893) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:43:14.104907 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG dbcounter [-] [101893] Writing DB stats keystone:SELECT=100 {{(pid=101893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:43:14.168769 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 327/640] 10.222.0.84 () {58 vars in 1023 bytes} [Wed May 25 14:43:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 25 14:43:14.170245 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a95334d-29e5-4d37-af6a-35020225f65b None None] REQUEST_METHOD: `POST` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:43:14.170658 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a95334d-29e5-4d37-af6a-35020225f65b None None] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:43:14.171032 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a95334d-29e5-4d37-af6a-35020225f65b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:43:14.190222 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG dbcounter [-] [101892] Writing DB stats keystone:SELECT=100 {{(pid=101892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:43:14.194348 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.auth.core [None req-9a95334d-29e5-4d37-af6a-35020225f65b None None] MFA Rules not processed for user `05d87e87798e429aa1c10b24391f915e`. Rule list: `[]` (Enabled: `True`). {{(pid=101893) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:43:14.195699 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.fernet_utils [None req-9a95334d-29e5-4d37-af6a-35020225f65b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=101893) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:43:14.223460 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a202e20-77a1-4e16-8c2b-9d1b2f22ddae None admin] Validating token access rules against request {{(pid=101892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:43:14.260128 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7375c604-a8bc-4f8e-a153-69855fb6fb90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:43:14.260874 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7375c604-a8bc-4f8e-a153-69855fb6fb90 None admin] REQUEST_METHOD: `GET` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:43:14.261161 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7375c604-a8bc-4f8e-a153-69855fb6fb90 None admin] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:43:14.261440 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7375c604-a8bc-4f8e-a153-69855fb6fb90 None admin] PATH_INFO: `/v3/projects/service` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:43:14.268274 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 328/641] 10.222.0.84 () {58 vars in 1023 bytes} [Wed May 25 14:43:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 25 14:43:14.268511 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7375c604-a8bc-4f8e-a153-69855fb6fb90 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:43:14.269533 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a95334d-29e5-4d37-af6a-35020225f65b None None] Authenticating user token {{(pid=101893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:43:14.270007 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7375c604-a8bc-4f8e-a153-69855fb6fb90 None admin] RBAC: Authorization granted {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:43:14.291602 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application [None req-7375c604-a8bc-4f8e-a153-69855fb6fb90 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 25 14:43:14.291602 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:43:14.291602 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 14:43:14.291602 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 14:43:14.291602 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 14:43:14.291602 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 14:43:14.291602 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 14:43:14.291602 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 14:43:14.291602 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 14:43:14.291602 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 14:43:14.291602 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 14:43:14.291602 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 14:43:14.291602 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 25 14:43:14.291602 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application return self._get_project(project_id) May 25 14:43:14.291602 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 25 14:43:14.296573 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 25 14:43:14.296573 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 14:43:14.296573 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 14:43:14.296573 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 14:43:14.296573 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 14:43:14.296573 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 14:43:14.296573 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application return self.get_or_create( May 25 14:43:14.296573 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 14:43:14.296573 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application with Lock( May 25 14:43:14.296573 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 14:43:14.296573 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application return self._enter() May 25 14:43:14.296573 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 14:43:14.296573 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 14:43:14.296573 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 14:43:14.296573 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application return self.creator() May 25 14:43:14.296573 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 14:43:14.296573 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application created_value = creator( May 25 14:43:14.297686 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 25 14:43:14.297686 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 25 14:43:14.297686 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 25 14:43:14.297686 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 25 14:43:14.297686 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 25 14:43:14.297686 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 25 14:43:14.297686 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 25 14:43:14.297686 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application May 25 14:43:14.297686 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 314/642] 10.222.0.84 () {56 vars in 1111 bytes} [Wed May 25 14:43:14 2022] GET /identity/v3/projects/service => generated 88 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 14:43:14.297686 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7375c604-a8bc-4f8e-a153-69855fb6fb90 None admin] Authenticating user token {{(pid=101892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:43:14.349744 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG dbcounter [-] [101893] Writing DB stats keystone:SELECT=100 {{(pid=101893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:43:14.381889 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a95334d-29e5-4d37-af6a-35020225f65b None None] Validating token access rules against request {{(pid=101893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:43:14.397707 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7375c604-a8bc-4f8e-a153-69855fb6fb90 None admin] Validating token access rules against request {{(pid=101892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:43:14.418706 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2362041-ae8d-42ea-a863-157dae6235f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:43:14.419621 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2362041-ae8d-42ea-a863-157dae6235f4 None admin] REQUEST_METHOD: `GET` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:43:14.419966 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2362041-ae8d-42ea-a863-157dae6235f4 None admin] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:43:14.420579 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2362041-ae8d-42ea-a863-157dae6235f4 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:43:14.428526 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2362041-ae8d-42ea-a863-157dae6235f4 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:43:14.429461 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG dbcounter [-] [101892] Writing DB stats keystone:SELECT=100 {{(pid=101892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:43:14.430740 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2362041-ae8d-42ea-a863-157dae6235f4 None admin] RBAC: Authorization granted {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:43:14.435157 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11ef8e3d-c420-49fc-9398-a9ad21de59f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:43:14.436131 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ef8e3d-c420-49fc-9398-a9ad21de59f2 None admin] REQUEST_METHOD: `GET` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:43:14.436503 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ef8e3d-c420-49fc-9398-a9ad21de59f2 None admin] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:43:14.436838 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ef8e3d-c420-49fc-9398-a9ad21de59f2 None admin] PATH_INFO: `/v3/roles/service` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:43:14.449256 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11ef8e3d-c420-49fc-9398-a9ad21de59f2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 14:43:14.451824 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application [None req-d2362041-ae8d-42ea-a863-157dae6235f4 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. May 25 14:43:14.451824 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:43:14.451824 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 14:43:14.451824 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 14:43:14.451824 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 14:43:14.451824 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 14:43:14.451824 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 14:43:14.451824 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 14:43:14.451824 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 14:43:14.451824 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 14:43:14.451824 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 14:43:14.451824 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 14:43:14.451824 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 25 14:43:14.451824 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return self._get_user(user_id) May 25 14:43:14.451824 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 25 14:43:14.451824 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 25 14:43:14.453048 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 14:43:14.453048 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 14:43:14.453048 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 25 14:43:14.453048 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 25 14:43:14.453048 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 25 14:43:14.453048 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 25 14:43:14.453048 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 14:43:14.453048 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 14:43:14.453048 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 14:43:14.453048 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return self.get_or_create( May 25 14:43:14.453048 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 14:43:14.453048 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application with Lock( May 25 14:43:14.453048 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 14:43:14.453048 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return self._enter() May 25 14:43:14.453048 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 14:43:14.453048 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 14:43:14.453048 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 14:43:14.453048 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return self.creator() May 25 14:43:14.454217 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 14:43:14.454217 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application created_value = creator( May 25 14:43:14.454217 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 25 14:43:14.454217 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 25 14:43:14.454217 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 25 14:43:14.454217 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 25 14:43:14.454217 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 25 14:43:14.454217 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 25 14:43:14.454217 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. May 25 14:43:14.454217 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application May 25 14:43:14.458034 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 329/643] 10.222.0.84 () {56 vars in 1099 bytes} [Wed May 25 14:43:14 2022] GET /identity/v3/users/cinder => generated 84 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 14:43:14.458695 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2362041-ae8d-42ea-a863-157dae6235f4 None admin] Authenticating user token {{(pid=101893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:43:14.460742 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application [None req-11ef8e3d-c420-49fc-9398-a9ad21de59f2 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 25 14:43:14.460742 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:43:14.460742 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 14:43:14.460742 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 14:43:14.460742 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 14:43:14.460742 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 14:43:14.460742 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 14:43:14.460742 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 14:43:14.460742 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 14:43:14.460742 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 14:43:14.460742 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 14:43:14.460742 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 14:43:14.460742 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 14:43:14.460742 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 14:43:14.460742 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 14:43:14.460742 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 14:43:14.461820 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 14:43:14.461820 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 14:43:14.461820 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 14:43:14.461820 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 14:43:14.461820 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 14:43:14.461820 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 14:43:14.461820 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 14:43:14.461820 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 14:43:14.461820 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 14:43:14.461820 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application return self.get_or_create( May 25 14:43:14.461820 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 14:43:14.461820 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application with Lock( May 25 14:43:14.461820 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 14:43:14.461820 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application return self._enter() May 25 14:43:14.461820 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 14:43:14.461820 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 14:43:14.462871 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 14:43:14.462871 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application return self.creator() May 25 14:43:14.462871 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 14:43:14.462871 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application created_value = creator( May 25 14:43:14.462871 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 14:43:14.462871 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 14:43:14.462871 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 14:43:14.462871 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 14:43:14.462871 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 14:43:14.462871 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 14:43:14.462871 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 25 14:43:14.462871 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application May 25 14:43:14.470120 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 315/644] 10.222.0.84 () {56 vars in 1102 bytes} [Wed May 25 14:43:14 2022] GET /identity/v3/roles/service => generated 85 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 14:43:14.471222 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11ef8e3d-c420-49fc-9398-a9ad21de59f2 None admin] Authenticating user token {{(pid=101892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:43:14.572064 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2362041-ae8d-42ea-a863-157dae6235f4 None admin] Validating token access rules against request {{(pid=101893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:43:14.581569 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11ef8e3d-c420-49fc-9398-a9ad21de59f2 None admin] Validating token access rules against request {{(pid=101892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:43:14.606176 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG dbcounter [-] [101893] Writing DB stats keystone:SELECT=100 {{(pid=101893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:43:14.611779 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c558b6f0-7e9b-4281-8ed9-024644ed5cbb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:43:14.612450 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c558b6f0-7e9b-4281-8ed9-024644ed5cbb None admin] REQUEST_METHOD: `GET` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:43:14.612733 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c558b6f0-7e9b-4281-8ed9-024644ed5cbb None admin] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:43:14.613079 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c558b6f0-7e9b-4281-8ed9-024644ed5cbb None admin] PATH_INFO: `/v3/projects` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:43:14.613791 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c558b6f0-7e9b-4281-8ed9-024644ed5cbb None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=101893) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:43:14.614103 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c558b6f0-7e9b-4281-8ed9-024644ed5cbb None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:43:14.615607 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c558b6f0-7e9b-4281-8ed9-024644ed5cbb None admin] RBAC: Authorization granted {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:43:14.617268 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-747b80a8-3795-4bd5-9a2f-eec31702d15e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:43:14.618121 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747b80a8-3795-4bd5-9a2f-eec31702d15e None admin] REQUEST_METHOD: `GET` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:43:14.618409 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747b80a8-3795-4bd5-9a2f-eec31702d15e None admin] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:43:14.618683 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747b80a8-3795-4bd5-9a2f-eec31702d15e None admin] PATH_INFO: `/v3/roles/service` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:43:14.632612 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 330/645] 10.222.0.84 () {56 vars in 1148 bytes} [Wed May 25 14:43:14 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:43:14.632612 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c558b6f0-7e9b-4281-8ed9-024644ed5cbb None admin] Authenticating user token {{(pid=101893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:43:14.632905 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-747b80a8-3795-4bd5-9a2f-eec31702d15e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 14:43:14.638198 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application [None req-747b80a8-3795-4bd5-9a2f-eec31702d15e None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 25 14:43:14.638198 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:43:14.638198 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 14:43:14.638198 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 14:43:14.638198 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 14:43:14.638198 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 14:43:14.638198 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 14:43:14.638198 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 14:43:14.638198 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 14:43:14.638198 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 14:43:14.638198 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 14:43:14.638198 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 14:43:14.638198 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 14:43:14.638198 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 14:43:14.638198 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 14:43:14.638198 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 14:43:14.639311 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 14:43:14.639311 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 14:43:14.639311 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 14:43:14.639311 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 14:43:14.639311 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 14:43:14.639311 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 14:43:14.639311 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 14:43:14.639311 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 14:43:14.639311 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 14:43:14.639311 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application return self.get_or_create( May 25 14:43:14.639311 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 14:43:14.639311 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application with Lock( May 25 14:43:14.639311 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 14:43:14.639311 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application return self._enter() May 25 14:43:14.639311 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 14:43:14.639311 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 14:43:14.640383 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 14:43:14.640383 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application return self.creator() May 25 14:43:14.640383 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 14:43:14.640383 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application created_value = creator( May 25 14:43:14.640383 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 14:43:14.640383 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 14:43:14.640383 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 14:43:14.640383 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 14:43:14.640383 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 14:43:14.640383 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 14:43:14.640383 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 25 14:43:14.640383 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application May 25 14:43:14.640383 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 316/646] 10.222.0.84 () {56 vars in 1102 bytes} [Wed May 25 14:43:14 2022] GET /identity/v3/roles/service => generated 85 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 14:43:14.640383 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-747b80a8-3795-4bd5-9a2f-eec31702d15e None admin] Authenticating user token {{(pid=101892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:43:14.695798 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG dbcounter [-] [101892] Writing DB stats keystone:SELECT=100 {{(pid=101892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:43:14.747197 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c558b6f0-7e9b-4281-8ed9-024644ed5cbb None admin] Validating token access rules against request {{(pid=101893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:43:14.747875 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-747b80a8-3795-4bd5-9a2f-eec31702d15e None admin] Validating token access rules against request {{(pid=101892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:43:14.783717 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dc24fa2-39e7-463b-b874-be65a41af59c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:43:14.784202 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3263ad96-139e-47fe-aed7-ed14520ef3a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:43:14.784545 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc24fa2-39e7-463b-b874-be65a41af59c None admin] REQUEST_METHOD: `GET` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:43:14.784862 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3263ad96-139e-47fe-aed7-ed14520ef3a8 None admin] REQUEST_METHOD: `GET` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:43:14.784958 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc24fa2-39e7-463b-b874-be65a41af59c None admin] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:43:14.785151 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3263ad96-139e-47fe-aed7-ed14520ef3a8 None admin] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:43:14.785246 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc24fa2-39e7-463b-b874-be65a41af59c None admin] PATH_INFO: `/v3/users` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:43:14.785434 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3263ad96-139e-47fe-aed7-ed14520ef3a8 None admin] PATH_INFO: `/v3/roles` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:43:14.786179 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3263ad96-139e-47fe-aed7-ed14520ef3a8 None admin] RBAC: Adding query filter params (name=service) {{(pid=101892) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:43:14.786277 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dc24fa2-39e7-463b-b874-be65a41af59c None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=101893) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:43:14.786492 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3263ad96-139e-47fe-aed7-ed14520ef3a8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:43:14.786584 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dc24fa2-39e7-463b-b874-be65a41af59c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:43:14.787928 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3263ad96-139e-47fe-aed7-ed14520ef3a8 None admin] RBAC: Authorization granted {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:43:14.788179 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dc24fa2-39e7-463b-b874-be65a41af59c None admin] RBAC: Authorization granted {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:43:14.800399 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 317/647] 10.222.0.84 () {56 vars in 1103 bytes} [Wed May 25 14:43:14 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:43:14.800399 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3263ad96-139e-47fe-aed7-ed14520ef3a8 None admin] Authenticating user token {{(pid=101892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:43:14.811678 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 331/648] 10.222.0.84 () {56 vars in 1137 bytes} [Wed May 25 14:43:14 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:43:14.812498 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dc24fa2-39e7-463b-b874-be65a41af59c None admin] Authenticating user token {{(pid=101893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:43:14.863692 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG dbcounter [-] [101893] Writing DB stats keystone:SELECT=100 {{(pid=101893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:43:14.911608 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3263ad96-139e-47fe-aed7-ed14520ef3a8 None admin] Validating token access rules against request {{(pid=101892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:43:14.920821 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dc24fa2-39e7-463b-b874-be65a41af59c None admin] Validating token access rules against request {{(pid=101893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:43:14.927528 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG dbcounter [-] [101892] Writing DB stats keystone:SELECT=100 {{(pid=101892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:43:14.949444 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4566347e-2d06-4762-bfaa-f9934f252ba3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:43:14.950443 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4566347e-2d06-4762-bfaa-f9934f252ba3 None admin] REQUEST_METHOD: `GET` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:43:14.950876 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4566347e-2d06-4762-bfaa-f9934f252ba3 None admin] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:43:14.951320 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4566347e-2d06-4762-bfaa-f9934f252ba3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:43:14.952554 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4566347e-2d06-4762-bfaa-f9934f252ba3 None admin] RBAC: Adding query filter params (role.id=fdcb2eda27b84f44a392b7e8b59cc425, scope.project.id=a000829c658c4a7cab67f7b6353ba3fa, user.id=2aeb182e6a5b43cfb0cc347ec847c848) {{(pid=101892) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:43:14.953036 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4566347e-2d06-4762-bfaa-f9934f252ba3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:43:14.954676 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4566347e-2d06-4762-bfaa-f9934f252ba3 None admin] RBAC: Authorization granted {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:43:14.958310 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e63a51-f33a-4fe5-982c-8e8b7e4982a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:43:14.958978 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e63a51-f33a-4fe5-982c-8e8b7e4982a5 None admin] REQUEST_METHOD: `GET` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:43:14.959843 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e63a51-f33a-4fe5-982c-8e8b7e4982a5 None admin] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:43:14.960124 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e63a51-f33a-4fe5-982c-8e8b7e4982a5 None admin] PATH_INFO: `/v3/roles` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:43:14.960870 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09e63a51-f33a-4fe5-982c-8e8b7e4982a5 None admin] RBAC: Adding query filter params (name=service) {{(pid=101893) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:43:14.961199 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09e63a51-f33a-4fe5-982c-8e8b7e4982a5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:43:14.962534 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09e63a51-f33a-4fe5-982c-8e8b7e4982a5 None admin] RBAC: Authorization granted {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:43:14.964764 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 318/649] 10.222.0.84 () {56 vars in 1374 bytes} [Wed May 25 14:43:14 2022] GET /identity/v3/role_assignments?user.id=2aeb182e6a5b43cfb0cc347ec847c848&scope.project.id=a000829c658c4a7cab67f7b6353ba3fa&role.id=fdcb2eda27b84f44a392b7e8b59cc425 => generated 608 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:43:14.965733 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4566347e-2d06-4762-bfaa-f9934f252ba3 None admin] Authenticating user token {{(pid=101892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:43:14.987313 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 332/650] 10.222.0.84 () {56 vars in 1103 bytes} [Wed May 25 14:43:14 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:43:14.988751 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e63a51-f33a-4fe5-982c-8e8b7e4982a5 None admin] Authenticating user token {{(pid=101893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:43:15.106853 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4566347e-2d06-4762-bfaa-f9934f252ba3 None admin] Validating token access rules against request {{(pid=101892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:43:15.112428 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e63a51-f33a-4fe5-982c-8e8b7e4982a5 None admin] Validating token access rules against request {{(pid=101893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:43:15.127602 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG dbcounter [-] [101893] Writing DB stats keystone:SELECT=100 {{(pid=101893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:43:15.150871 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a680064-7e4f-4b9a-87ac-a1d72a70b90e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:43:15.151585 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba739d72-6dc7-42d9-93eb-5b83e35838bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:43:15.151792 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a680064-7e4f-4b9a-87ac-a1d72a70b90e None admin] REQUEST_METHOD: `GET` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:43:15.152168 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a680064-7e4f-4b9a-87ac-a1d72a70b90e None admin] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:43:15.152696 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a680064-7e4f-4b9a-87ac-a1d72a70b90e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:43:15.153092 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba739d72-6dc7-42d9-93eb-5b83e35838bb None admin] REQUEST_METHOD: `GET` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:43:15.154207 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba739d72-6dc7-42d9-93eb-5b83e35838bb None admin] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:43:15.154637 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba739d72-6dc7-42d9-93eb-5b83e35838bb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:43:15.169590 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba739d72-6dc7-42d9-93eb-5b83e35838bb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:43:15.171407 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba739d72-6dc7-42d9-93eb-5b83e35838bb None admin] RBAC: Authorization granted {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:43:15.192040 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application [None req-ba739d72-6dc7-42d9-93eb-5b83e35838bb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 25 14:43:15.192040 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:43:15.192040 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 14:43:15.192040 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 14:43:15.192040 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 14:43:15.192040 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 14:43:15.192040 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 14:43:15.192040 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 14:43:15.192040 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 14:43:15.192040 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 14:43:15.192040 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 14:43:15.192040 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 14:43:15.192040 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 25 14:43:15.192040 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 25 14:43:15.192040 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 25 14:43:15.193011 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 25 14:43:15.193011 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 14:43:15.193011 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 14:43:15.193011 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 14:43:15.193011 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 14:43:15.193011 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 14:43:15.193011 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application return self.get_or_create( May 25 14:43:15.193011 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 14:43:15.193011 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application with Lock( May 25 14:43:15.193011 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 14:43:15.193011 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application return self._enter() May 25 14:43:15.193011 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 14:43:15.193011 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 14:43:15.193011 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 14:43:15.193011 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application return self.creator() May 25 14:43:15.193011 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 14:43:15.193011 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application created_value = creator( May 25 14:43:15.194492 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 25 14:43:15.194492 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 25 14:43:15.194492 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 25 14:43:15.194492 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application May 25 14:43:15.196384 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 319/651] 10.222.0.84 () {56 vars in 1108 bytes} [Wed May 25 14:43:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 14:43:15.197325 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba739d72-6dc7-42d9-93eb-5b83e35838bb None admin] Authenticating user token {{(pid=101892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:43:15.231546 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG dbcounter [-] [101892] Writing DB stats keystone:SELECT=100 {{(pid=101892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:43:15.242045 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a680064-7e4f-4b9a-87ac-a1d72a70b90e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:43:15.243999 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a680064-7e4f-4b9a-87ac-a1d72a70b90e None admin] RBAC: Authorization granted {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:43:15.313352 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba739d72-6dc7-42d9-93eb-5b83e35838bb None admin] Validating token access rules against request {{(pid=101892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:43:15.362066 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d77588e6-1c9a-41ce-bc9c-f47031ec5706 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:43:15.362778 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77588e6-1c9a-41ce-bc9c-f47031ec5706 None admin] REQUEST_METHOD: `GET` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:43:15.363059 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77588e6-1c9a-41ce-bc9c-f47031ec5706 None admin] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:43:15.363291 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 333/652] 10.222.0.84 () {58 vars in 1282 bytes} [Wed May 25 14:43:14 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 375 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 25 14:43:15.363385 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77588e6-1c9a-41ce-bc9c-f47031ec5706 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:43:15.364316 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a680064-7e4f-4b9a-87ac-a1d72a70b90e None admin] Authenticating user token {{(pid=101893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:43:15.376477 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d77588e6-1c9a-41ce-bc9c-f47031ec5706 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:43:15.378462 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d77588e6-1c9a-41ce-bc9c-f47031ec5706 None admin] RBAC: Authorization granted {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:43:15.382608 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG dbcounter [-] [101893] Writing DB stats keystone:SELECT=100 {{(pid=101893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:43:15.403041 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application [None req-d77588e6-1c9a-41ce-bc9c-f47031ec5706 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 25 14:43:15.403041 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:43:15.403041 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 14:43:15.403041 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 14:43:15.403041 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 14:43:15.403041 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 14:43:15.403041 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 14:43:15.403041 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 14:43:15.403041 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 14:43:15.403041 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 14:43:15.403041 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 14:43:15.403041 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 14:43:15.403041 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 25 14:43:15.403041 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 25 14:43:15.403041 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 25 14:43:15.404096 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 25 14:43:15.404096 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 14:43:15.404096 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 14:43:15.404096 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 14:43:15.404096 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 14:43:15.404096 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 14:43:15.404096 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application return self.get_or_create( May 25 14:43:15.404096 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 14:43:15.404096 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application with Lock( May 25 14:43:15.404096 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 14:43:15.404096 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application return self._enter() May 25 14:43:15.404096 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 14:43:15.404096 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 14:43:15.404096 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 14:43:15.404096 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application return self.creator() May 25 14:43:15.404096 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 14:43:15.404096 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application created_value = creator( May 25 14:43:15.405022 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 25 14:43:15.405022 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 25 14:43:15.405022 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 25 14:43:15.405022 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application May 25 14:43:15.405499 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 320/653] 10.222.0.84 () {56 vars in 1108 bytes} [Wed May 25 14:43:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 14:43:15.406282 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d77588e6-1c9a-41ce-bc9c-f47031ec5706 None admin] Authenticating user token {{(pid=101892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:43:15.485410 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a680064-7e4f-4b9a-87ac-a1d72a70b90e None admin] Validating token access rules against request {{(pid=101893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:43:15.516659 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG dbcounter [-] [101892] Writing DB stats keystone:SELECT=100 {{(pid=101892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:43:15.534907 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13e87a5b-7a9e-4a3c-bfdb-a20cd743dfd8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:43:15.535847 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e87a5b-7a9e-4a3c-bfdb-a20cd743dfd8 None admin] REQUEST_METHOD: `GET` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:43:15.536299 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e87a5b-7a9e-4a3c-bfdb-a20cd743dfd8 None admin] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:43:15.536717 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e87a5b-7a9e-4a3c-bfdb-a20cd743dfd8 None admin] PATH_INFO: `/v3/domains` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:43:15.536842 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d77588e6-1c9a-41ce-bc9c-f47031ec5706 None admin] Validating token access rules against request {{(pid=101892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:43:15.537841 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13e87a5b-7a9e-4a3c-bfdb-a20cd743dfd8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=101893) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:43:15.538295 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13e87a5b-7a9e-4a3c-bfdb-a20cd743dfd8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:43:15.540873 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13e87a5b-7a9e-4a3c-bfdb-a20cd743dfd8 None admin] RBAC: Authorization granted {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:43:15.565193 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 334/654] 10.222.0.84 () {56 vars in 1109 bytes} [Wed May 25 14:43:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:43:15.565193 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13e87a5b-7a9e-4a3c-bfdb-a20cd743dfd8 None admin] Authenticating user token {{(pid=101893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:43:15.585029 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52f3a2f6-32d8-434a-9802-bdf495b57baf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:43:15.585970 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f3a2f6-32d8-434a-9802-bdf495b57baf None admin] REQUEST_METHOD: `GET` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:43:15.586353 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f3a2f6-32d8-434a-9802-bdf495b57baf None admin] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:43:15.586728 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f3a2f6-32d8-434a-9802-bdf495b57baf None admin] PATH_INFO: `/v3/domains/Default` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:43:15.598284 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52f3a2f6-32d8-434a-9802-bdf495b57baf None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:43:15.599781 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52f3a2f6-32d8-434a-9802-bdf495b57baf None admin] RBAC: Authorization granted {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:43:15.618316 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application [None req-52f3a2f6-32d8-434a-9802-bdf495b57baf None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 25 14:43:15.618316 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:43:15.618316 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 14:43:15.618316 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 14:43:15.618316 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 14:43:15.618316 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 14:43:15.618316 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 14:43:15.618316 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 14:43:15.618316 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 14:43:15.618316 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 14:43:15.618316 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 14:43:15.618316 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 14:43:15.618316 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 25 14:43:15.618316 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 25 14:43:15.618316 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 25 14:43:15.619445 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 25 14:43:15.619445 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 14:43:15.619445 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 14:43:15.619445 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 14:43:15.619445 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 14:43:15.619445 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 14:43:15.619445 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application return self.get_or_create( May 25 14:43:15.619445 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 14:43:15.619445 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application with Lock( May 25 14:43:15.619445 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 14:43:15.619445 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application return self._enter() May 25 14:43:15.619445 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 14:43:15.619445 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 14:43:15.619445 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 14:43:15.619445 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application return self.creator() May 25 14:43:15.619445 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 14:43:15.619445 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application created_value = creator( May 25 14:43:15.620423 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 25 14:43:15.620423 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 25 14:43:15.620423 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 25 14:43:15.620423 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application May 25 14:43:15.620423 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 321/655] 10.222.0.84 () {56 vars in 1108 bytes} [Wed May 25 14:43:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 14:43:15.620718 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52f3a2f6-32d8-434a-9802-bdf495b57baf None admin] Authenticating user token {{(pid=101892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:43:15.657266 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG dbcounter [-] [101893] Writing DB stats keystone:SELECT=100 {{(pid=101893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:43:15.698633 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13e87a5b-7a9e-4a3c-bfdb-a20cd743dfd8 None admin] Validating token access rules against request {{(pid=101893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:43:15.733366 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52f3a2f6-32d8-434a-9802-bdf495b57baf None admin] Validating token access rules against request {{(pid=101892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:43:15.743323 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ec86c2a-ad88-4e85-b593-cb6e79d34bd9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:43:15.744042 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec86c2a-ad88-4e85-b593-cb6e79d34bd9 None admin] REQUEST_METHOD: `GET` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:43:15.744748 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec86c2a-ad88-4e85-b593-cb6e79d34bd9 None admin] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:43:15.745032 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec86c2a-ad88-4e85-b593-cb6e79d34bd9 None admin] PATH_INFO: `/v3/domains` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:43:15.745755 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ec86c2a-ad88-4e85-b593-cb6e79d34bd9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=101893) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:43:15.746063 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ec86c2a-ad88-4e85-b593-cb6e79d34bd9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:43:15.748417 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ec86c2a-ad88-4e85-b593-cb6e79d34bd9 None admin] RBAC: Authorization granted {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:43:15.767703 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 335/656] 10.222.0.84 () {56 vars in 1109 bytes} [Wed May 25 14:43:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:43:15.768808 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ec86c2a-ad88-4e85-b593-cb6e79d34bd9 None admin] Authenticating user token {{(pid=101893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:43:15.777956 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87c7112c-f662-4e70-b48f-0c9c61cf2d11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:43:15.778757 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c7112c-f662-4e70-b48f-0c9c61cf2d11 None admin] REQUEST_METHOD: `GET` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:43:15.779040 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c7112c-f662-4e70-b48f-0c9c61cf2d11 None admin] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:43:15.779314 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c7112c-f662-4e70-b48f-0c9c61cf2d11 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:43:15.781674 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG dbcounter [-] [101892] Writing DB stats keystone:SELECT=100 {{(pid=101892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:43:15.789694 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87c7112c-f662-4e70-b48f-0c9c61cf2d11 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:43:15.791290 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87c7112c-f662-4e70-b48f-0c9c61cf2d11 None admin] RBAC: Authorization granted {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:43:15.809287 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application [None req-87c7112c-f662-4e70-b48f-0c9c61cf2d11 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. May 25 14:43:15.809287 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:43:15.809287 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 14:43:15.809287 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 14:43:15.809287 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 14:43:15.809287 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 14:43:15.809287 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 14:43:15.809287 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 14:43:15.809287 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 14:43:15.809287 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 14:43:15.809287 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 14:43:15.809287 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 14:43:15.809287 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 25 14:43:15.809287 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application return self._get_user(user_id) May 25 14:43:15.809287 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 25 14:43:15.809287 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 25 14:43:15.810752 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 14:43:15.810752 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 14:43:15.810752 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 25 14:43:15.810752 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 25 14:43:15.810752 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 25 14:43:15.810752 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 25 14:43:15.810752 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 14:43:15.810752 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 14:43:15.810752 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 14:43:15.810752 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application return self.get_or_create( May 25 14:43:15.810752 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 14:43:15.810752 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application with Lock( May 25 14:43:15.810752 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 14:43:15.810752 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application return self._enter() May 25 14:43:15.810752 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 14:43:15.810752 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 14:43:15.810752 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 14:43:15.810752 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application return self.creator() May 25 14:43:15.811745 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 14:43:15.811745 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application created_value = creator( May 25 14:43:15.811745 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 25 14:43:15.811745 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 25 14:43:15.811745 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 25 14:43:15.811745 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 25 14:43:15.811745 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 25 14:43:15.811745 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 25 14:43:15.811745 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. May 25 14:43:15.811745 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application May 25 14:43:15.814359 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 322/657] 10.222.0.84 () {56 vars in 1102 bytes} [Wed May 25 14:43:15 2022] GET /identity/v3/users/neutron => generated 85 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 14:43:15.820366 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87c7112c-f662-4e70-b48f-0c9c61cf2d11 None admin] Authenticating user token {{(pid=101892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:43:15.910103 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ec86c2a-ad88-4e85-b593-cb6e79d34bd9 None admin] Validating token access rules against request {{(pid=101893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:43:15.943194 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG dbcounter [-] [101893] Writing DB stats keystone:SELECT=100 {{(pid=101893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:43:15.949798 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5e74a75-6973-4900-97ac-07744c07788c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:43:15.950097 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87c7112c-f662-4e70-b48f-0c9c61cf2d11 None admin] Validating token access rules against request {{(pid=101892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:43:15.950937 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e74a75-6973-4900-97ac-07744c07788c None admin] REQUEST_METHOD: `GET` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:43:15.951421 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e74a75-6973-4900-97ac-07744c07788c None admin] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:43:15.952075 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e74a75-6973-4900-97ac-07744c07788c None admin] PATH_INFO: `/v3/domains` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:43:15.959035 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5e74a75-6973-4900-97ac-07744c07788c None admin] RBAC: Adding query filter params (name=Default) {{(pid=101893) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:43:15.959035 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5e74a75-6973-4900-97ac-07744c07788c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:43:15.959035 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5e74a75-6973-4900-97ac-07744c07788c None admin] RBAC: Authorization granted {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:43:15.969867 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 336/658] 10.222.0.84 () {56 vars in 1109 bytes} [Wed May 25 14:43:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:43:15.970980 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5e74a75-6973-4900-97ac-07744c07788c None admin] Authenticating user token {{(pid=101893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:43:15.990536 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-680fa5e2-8c20-4c3a-9627-1877a3b04b93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:43:15.991972 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680fa5e2-8c20-4c3a-9627-1877a3b04b93 None admin] REQUEST_METHOD: `GET` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:43:15.992460 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680fa5e2-8c20-4c3a-9627-1877a3b04b93 None admin] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:43:15.992933 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680fa5e2-8c20-4c3a-9627-1877a3b04b93 None admin] PATH_INFO: `/v3/users/glance` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:43:16.004316 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-680fa5e2-8c20-4c3a-9627-1877a3b04b93 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:43:16.008851 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-680fa5e2-8c20-4c3a-9627-1877a3b04b93 None admin] RBAC: Authorization granted {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:43:16.038235 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application [None req-680fa5e2-8c20-4c3a-9627-1877a3b04b93 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. May 25 14:43:16.038235 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:43:16.038235 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 14:43:16.038235 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 14:43:16.038235 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 14:43:16.038235 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 14:43:16.038235 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 14:43:16.038235 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 14:43:16.038235 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 14:43:16.038235 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 14:43:16.038235 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 14:43:16.038235 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 14:43:16.038235 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 25 14:43:16.038235 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application return self._get_user(user_id) May 25 14:43:16.038235 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 25 14:43:16.038235 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 25 14:43:16.039280 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 14:43:16.039280 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 14:43:16.039280 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 25 14:43:16.039280 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 25 14:43:16.039280 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 25 14:43:16.039280 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 25 14:43:16.039280 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 14:43:16.039280 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 14:43:16.039280 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 14:43:16.039280 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application return self.get_or_create( May 25 14:43:16.039280 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 14:43:16.039280 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application with Lock( May 25 14:43:16.039280 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 14:43:16.039280 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application return self._enter() May 25 14:43:16.039280 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 14:43:16.039280 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 14:43:16.039280 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 14:43:16.039280 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application return self.creator() May 25 14:43:16.040261 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 14:43:16.040261 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application created_value = creator( May 25 14:43:16.040261 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 25 14:43:16.040261 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 25 14:43:16.040261 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 25 14:43:16.040261 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 25 14:43:16.040261 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 25 14:43:16.040261 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 25 14:43:16.040261 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. May 25 14:43:16.040261 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application May 25 14:43:16.042598 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 323/659] 10.222.0.84 () {56 vars in 1099 bytes} [Wed May 25 14:43:15 2022] GET /identity/v3/users/glance => generated 84 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 14:43:16.043592 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-680fa5e2-8c20-4c3a-9627-1877a3b04b93 None admin] Authenticating user token {{(pid=101892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:43:16.089661 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5e74a75-6973-4900-97ac-07744c07788c None admin] Validating token access rules against request {{(pid=101893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:43:16.106000 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG dbcounter [-] [101892] Writing DB stats keystone:SELECT=100 {{(pid=101892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:43:16.125405 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10038944-0d86-4afd-95ae-1718ced4f57c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:43:16.126093 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10038944-0d86-4afd-95ae-1718ced4f57c None admin] REQUEST_METHOD: `GET` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:43:16.126358 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10038944-0d86-4afd-95ae-1718ced4f57c None admin] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:43:16.126635 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10038944-0d86-4afd-95ae-1718ced4f57c None admin] PATH_INFO: `/v3/users` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:43:16.127471 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10038944-0d86-4afd-95ae-1718ced4f57c None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=101893) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:43:16.127825 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10038944-0d86-4afd-95ae-1718ced4f57c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:43:16.129281 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10038944-0d86-4afd-95ae-1718ced4f57c None admin] RBAC: Authorization granted {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:43:16.157469 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 337/660] 10.222.0.84 () {56 vars in 1139 bytes} [Wed May 25 14:43:15 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:43:16.158885 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206d003a-bce9-480c-b672-aa4ec3f81bda None None] REQUEST_METHOD: `GET` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:43:16.159175 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206d003a-bce9-480c-b672-aa4ec3f81bda None None] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:43:16.159451 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206d003a-bce9-480c-b672-aa4ec3f81bda None None] PATH_INFO: `/` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:43:16.164508 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-680fa5e2-8c20-4c3a-9627-1877a3b04b93 None admin] Validating token access rules against request {{(pid=101892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:43:16.165007 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 338/661] 10.222.0.84 () {54 vars in 926 bytes} [Wed May 25 14:43:16 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 14:43:16.165850 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-206d003a-bce9-480c-b672-aa4ec3f81bda None None] Authenticating user token {{(pid=101893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:43:16.205835 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a812b8-bae2-43db-b8a1-22efc14f0864 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:43:16.206964 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a812b8-bae2-43db-b8a1-22efc14f0864 None admin] REQUEST_METHOD: `GET` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:43:16.207425 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a812b8-bae2-43db-b8a1-22efc14f0864 None admin] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:43:16.207893 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a812b8-bae2-43db-b8a1-22efc14f0864 None admin] PATH_INFO: `/v3/projects/service` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:43:16.215486 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7a812b8-bae2-43db-b8a1-22efc14f0864 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:43:16.217142 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7a812b8-bae2-43db-b8a1-22efc14f0864 None admin] RBAC: Authorization granted {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:43:16.226008 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG dbcounter [-] [101893] Writing DB stats keystone:SELECT=100 {{(pid=101893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:43:16.231344 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application [None req-d7a812b8-bae2-43db-b8a1-22efc14f0864 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 25 14:43:16.231344 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:43:16.231344 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 14:43:16.231344 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 14:43:16.231344 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 14:43:16.231344 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 14:43:16.231344 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 14:43:16.231344 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 14:43:16.231344 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 14:43:16.231344 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 14:43:16.231344 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 14:43:16.231344 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 14:43:16.231344 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 25 14:43:16.231344 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application return self._get_project(project_id) May 25 14:43:16.231344 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 25 14:43:16.232408 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 25 14:43:16.232408 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 14:43:16.232408 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 14:43:16.232408 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 14:43:16.232408 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 14:43:16.232408 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 14:43:16.232408 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application return self.get_or_create( May 25 14:43:16.232408 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 14:43:16.232408 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application with Lock( May 25 14:43:16.232408 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 14:43:16.232408 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application return self._enter() May 25 14:43:16.232408 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 14:43:16.232408 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 14:43:16.232408 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 14:43:16.232408 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application return self.creator() May 25 14:43:16.232408 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 14:43:16.232408 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application created_value = creator( May 25 14:43:16.233436 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 25 14:43:16.233436 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 25 14:43:16.233436 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 25 14:43:16.233436 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 25 14:43:16.233436 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 25 14:43:16.233436 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 25 14:43:16.233436 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 25 14:43:16.233436 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application May 25 14:43:16.233436 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 324/662] 10.222.0.84 () {56 vars in 1111 bytes} [Wed May 25 14:43:16 2022] GET /identity/v3/projects/service => generated 88 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 14:43:16.233436 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a812b8-bae2-43db-b8a1-22efc14f0864 None admin] Authenticating user token {{(pid=101892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:43:16.286457 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-206d003a-bce9-480c-b672-aa4ec3f81bda None None] Validating token access rules against request {{(pid=101893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:43:16.323392 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d042fd6b-3a2e-4068-8187-24bd40bc1903 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:43:16.324097 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d042fd6b-3a2e-4068-8187-24bd40bc1903 None admin] REQUEST_METHOD: `GET` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:43:16.324365 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d042fd6b-3a2e-4068-8187-24bd40bc1903 None admin] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:43:16.324727 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d042fd6b-3a2e-4068-8187-24bd40bc1903 None admin] PATH_INFO: `/v3/users` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:43:16.325470 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d042fd6b-3a2e-4068-8187-24bd40bc1903 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=101893) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:43:16.325841 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d042fd6b-3a2e-4068-8187-24bd40bc1903 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:43:16.327281 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d042fd6b-3a2e-4068-8187-24bd40bc1903 None admin] RBAC: Authorization granted {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:43:16.337462 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a812b8-bae2-43db-b8a1-22efc14f0864 None admin] Validating token access rules against request {{(pid=101892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:43:16.349862 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 339/663] 10.222.0.84 () {56 vars in 1137 bytes} [Wed May 25 14:43:16 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:43:16.349862 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52d21fb-6dc0-4f20-82f5-ba0f6e7e63fa None None] REQUEST_METHOD: `POST` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:43:16.349862 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52d21fb-6dc0-4f20-82f5-ba0f6e7e63fa None None] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:43:16.349862 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52d21fb-6dc0-4f20-82f5-ba0f6e7e63fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:43:16.356714 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG dbcounter [-] [101892] Writing DB stats keystone:SELECT=100 {{(pid=101892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:43:16.363839 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.auth.core [None req-b52d21fb-6dc0-4f20-82f5-ba0f6e7e63fa None None] MFA Rules not processed for user `05d87e87798e429aa1c10b24391f915e`. Rule list: `[]` (Enabled: `True`). {{(pid=101893) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:43:16.365027 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.fernet_utils [None req-b52d21fb-6dc0-4f20-82f5-ba0f6e7e63fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=101893) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:43:16.380192 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-076ccd19-812d-4856-9367-9917f8a74e12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:43:16.380846 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076ccd19-812d-4856-9367-9917f8a74e12 None admin] REQUEST_METHOD: `GET` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:43:16.381669 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076ccd19-812d-4856-9367-9917f8a74e12 None admin] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:43:16.381951 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076ccd19-812d-4856-9367-9917f8a74e12 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:43:16.447921 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 340/664] 10.222.0.84 () {58 vars in 1023 bytes} [Wed May 25 14:43:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 25 14:43:16.448597 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b52d21fb-6dc0-4f20-82f5-ba0f6e7e63fa None None] Authenticating user token {{(pid=101893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:43:16.450577 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-076ccd19-812d-4856-9367-9917f8a74e12 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:43:16.452151 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-076ccd19-812d-4856-9367-9917f8a74e12 None admin] RBAC: Authorization granted {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:43:16.507676 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG dbcounter [-] [101893] Writing DB stats keystone:SELECT=100 {{(pid=101893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:43:16.557040 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 325/665] 10.222.0.84 () {58 vars in 1282 bytes} [Wed May 25 14:43:16 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 324 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 25 14:43:16.560572 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-076ccd19-812d-4856-9367-9917f8a74e12 None admin] Authenticating user token {{(pid=101892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:43:16.576318 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG dbcounter [-] [101892] Writing DB stats keystone:SELECT=100 {{(pid=101892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:43:16.583188 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b52d21fb-6dc0-4f20-82f5-ba0f6e7e63fa None None] Validating token access rules against request {{(pid=101893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:43:16.619467 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c807007-dd45-41b2-8985-8654020720fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:43:16.620481 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c807007-dd45-41b2-8985-8654020720fc None admin] REQUEST_METHOD: `GET` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:43:16.620865 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c807007-dd45-41b2-8985-8654020720fc None admin] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:43:16.621236 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c807007-dd45-41b2-8985-8654020720fc None admin] PATH_INFO: `/v3/projects` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:43:16.622111 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c807007-dd45-41b2-8985-8654020720fc None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=101893) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:43:16.622771 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c807007-dd45-41b2-8985-8654020720fc None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:43:16.624344 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c807007-dd45-41b2-8985-8654020720fc None admin] RBAC: Authorization granted {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:43:16.641669 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 341/666] 10.222.0.84 () {56 vars in 1148 bytes} [Wed May 25 14:43:16 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:43:16.641669 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c807007-dd45-41b2-8985-8654020720fc None admin] Authenticating user token {{(pid=101893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:43:16.669134 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-076ccd19-812d-4856-9367-9917f8a74e12 None admin] Validating token access rules against request {{(pid=101892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:43:16.706166 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c73c893b-336d-4295-af82-b4b9b85f3826 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:43:16.706734 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73c893b-336d-4295-af82-b4b9b85f3826 None admin] REQUEST_METHOD: `GET` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:43:16.707014 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73c893b-336d-4295-af82-b4b9b85f3826 None admin] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:43:16.707284 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73c893b-336d-4295-af82-b4b9b85f3826 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:43:16.738095 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG dbcounter [-] [101893] Writing DB stats keystone:SELECT=100 {{(pid=101893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:43:16.743264 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c807007-dd45-41b2-8985-8654020720fc None admin] Validating token access rules against request {{(pid=101893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:43:16.777968 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1276890-a20e-4f01-8007-9cb85663dc75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:43:16.778301 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c73c893b-336d-4295-af82-b4b9b85f3826 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:43:16.778792 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1276890-a20e-4f01-8007-9cb85663dc75 None admin] REQUEST_METHOD: `GET` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:43:16.779077 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1276890-a20e-4f01-8007-9cb85663dc75 None admin] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:43:16.779351 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1276890-a20e-4f01-8007-9cb85663dc75 None admin] PATH_INFO: `/v3/roles/service` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:43:16.780161 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c73c893b-336d-4295-af82-b4b9b85f3826 None admin] RBAC: Authorization granted {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:43:16.792008 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1276890-a20e-4f01-8007-9cb85663dc75 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 14:43:16.796454 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG dbcounter [-] [101892] Writing DB stats keystone:SELECT=100 {{(pid=101892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:43:16.800069 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application [None req-b1276890-a20e-4f01-8007-9cb85663dc75 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 25 14:43:16.800069 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:43:16.800069 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 14:43:16.800069 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 14:43:16.800069 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 14:43:16.800069 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 14:43:16.800069 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 14:43:16.800069 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 14:43:16.800069 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 14:43:16.800069 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 14:43:16.800069 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 14:43:16.800069 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 14:43:16.800069 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 14:43:16.800069 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 14:43:16.800069 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 14:43:16.800069 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 14:43:16.800984 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 14:43:16.800984 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 14:43:16.800984 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 14:43:16.800984 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 14:43:16.800984 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 14:43:16.800984 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 14:43:16.800984 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 14:43:16.800984 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 14:43:16.800984 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 14:43:16.800984 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return self.get_or_create( May 25 14:43:16.800984 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 14:43:16.800984 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application with Lock( May 25 14:43:16.800984 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 14:43:16.800984 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return self._enter() May 25 14:43:16.800984 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 14:43:16.800984 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 14:43:16.808083 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 14:43:16.808083 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return self.creator() May 25 14:43:16.808083 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 14:43:16.808083 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application created_value = creator( May 25 14:43:16.808083 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 14:43:16.808083 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 14:43:16.808083 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 14:43:16.808083 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 14:43:16.808083 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 14:43:16.808083 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 14:43:16.808083 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 25 14:43:16.808083 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application May 25 14:43:16.808083 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 342/667] 10.222.0.84 () {56 vars in 1102 bytes} [Wed May 25 14:43:16 2022] GET /identity/v3/roles/service => generated 85 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 14:43:16.808083 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1276890-a20e-4f01-8007-9cb85663dc75 None admin] Authenticating user token {{(pid=101893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:43:16.894945 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 326/668] 10.222.0.84 () {58 vars in 1282 bytes} [Wed May 25 14:43:16 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 333 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 25 14:43:16.894945 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c73c893b-336d-4295-af82-b4b9b85f3826 None admin] Authenticating user token {{(pid=101892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:43:16.917479 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1276890-a20e-4f01-8007-9cb85663dc75 None admin] Validating token access rules against request {{(pid=101893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:43:16.953240 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ed5107-792c-43ed-b149-3c49b2093bd7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:43:16.954138 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ed5107-792c-43ed-b149-3c49b2093bd7 None admin] REQUEST_METHOD: `GET` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:43:16.954555 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ed5107-792c-43ed-b149-3c49b2093bd7 None admin] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:43:16.954813 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ed5107-792c-43ed-b149-3c49b2093bd7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:43:16.966576 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1ed5107-792c-43ed-b149-3c49b2093bd7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:43:16.968083 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1ed5107-792c-43ed-b149-3c49b2093bd7 None admin] RBAC: Authorization granted {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:43:16.986887 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application [None req-e1ed5107-792c-43ed-b149-3c49b2093bd7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 25 14:43:16.986887 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:43:16.986887 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 14:43:16.986887 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 14:43:16.986887 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 14:43:16.986887 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 14:43:16.986887 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 14:43:16.986887 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 14:43:16.986887 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 14:43:16.986887 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 14:43:16.986887 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 14:43:16.986887 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 14:43:16.986887 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 25 14:43:16.986887 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 25 14:43:16.986887 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 25 14:43:16.988115 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 25 14:43:16.988115 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 14:43:16.988115 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 14:43:16.988115 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 14:43:16.988115 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 14:43:16.988115 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 14:43:16.988115 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return self.get_or_create( May 25 14:43:16.988115 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 14:43:16.988115 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application with Lock( May 25 14:43:16.988115 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 14:43:16.988115 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return self._enter() May 25 14:43:16.988115 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 14:43:16.988115 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 14:43:16.988115 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 14:43:16.988115 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return self.creator() May 25 14:43:16.988115 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 14:43:16.988115 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application created_value = creator( May 25 14:43:16.989008 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 25 14:43:16.989008 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 25 14:43:16.989008 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 25 14:43:16.989008 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application May 25 14:43:16.989008 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 343/669] 10.222.0.84 () {56 vars in 1108 bytes} [Wed May 25 14:43:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 14:43:16.989008 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ed5107-792c-43ed-b149-3c49b2093bd7 None admin] Authenticating user token {{(pid=101893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:43:16.996819 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c73c893b-336d-4295-af82-b4b9b85f3826 None admin] Validating token access rules against request {{(pid=101892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:43:17.002763 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG dbcounter [-] [101893] Writing DB stats keystone:SELECT=100 {{(pid=101893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:43:17.012511 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG dbcounter [-] [101892] Writing DB stats keystone:SELECT=100 {{(pid=101892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:43:17.032861 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a5f00a-1231-4056-9b76-5cd208dd96f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:43:17.033517 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a5f00a-1231-4056-9b76-5cd208dd96f6 None admin] REQUEST_METHOD: `GET` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:43:17.033805 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a5f00a-1231-4056-9b76-5cd208dd96f6 None admin] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:43:17.034082 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a5f00a-1231-4056-9b76-5cd208dd96f6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:43:17.035281 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0a5f00a-1231-4056-9b76-5cd208dd96f6 None admin] RBAC: Adding query filter params (role.id=fdcb2eda27b84f44a392b7e8b59cc425, scope.project.id=a000829c658c4a7cab67f7b6353ba3fa, user.id=e079f89a5e524ab6ad4183e4f690de07) {{(pid=101892) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:43:17.035631 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0a5f00a-1231-4056-9b76-5cd208dd96f6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:43:17.037057 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0a5f00a-1231-4056-9b76-5cd208dd96f6 None admin] RBAC: Authorization granted {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:43:17.043617 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 327/670] 10.222.0.84 () {56 vars in 1374 bytes} [Wed May 25 14:43:16 2022] GET /identity/v3/role_assignments?user.id=e079f89a5e524ab6ad4183e4f690de07&scope.project.id=a000829c658c4a7cab67f7b6353ba3fa&role.id=fdcb2eda27b84f44a392b7e8b59cc425 => generated 608 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:43:17.048820 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a5f00a-1231-4056-9b76-5cd208dd96f6 None admin] Authenticating user token {{(pid=101892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:43:17.123263 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ed5107-792c-43ed-b149-3c49b2093bd7 None admin] Validating token access rules against request {{(pid=101893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:43:17.171533 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9246d213-fa3b-483e-9fcc-3f7830f095a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:43:17.172078 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a5f00a-1231-4056-9b76-5cd208dd96f6 None admin] Validating token access rules against request {{(pid=101892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:43:17.172833 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9246d213-fa3b-483e-9fcc-3f7830f095a2 None admin] REQUEST_METHOD: `GET` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:43:17.173316 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9246d213-fa3b-483e-9fcc-3f7830f095a2 None admin] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:43:17.174035 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9246d213-fa3b-483e-9fcc-3f7830f095a2 None admin] PATH_INFO: `/v3/roles` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:43:17.176125 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9246d213-fa3b-483e-9fcc-3f7830f095a2 None admin] RBAC: Adding query filter params (name=service) {{(pid=101893) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:43:17.176728 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9246d213-fa3b-483e-9fcc-3f7830f095a2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:43:17.178946 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9246d213-fa3b-483e-9fcc-3f7830f095a2 None admin] RBAC: Authorization granted {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:43:17.192483 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 344/671] 10.222.0.84 () {56 vars in 1103 bytes} [Wed May 25 14:43:16 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:43:17.194325 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9246d213-fa3b-483e-9fcc-3f7830f095a2 None admin] Authenticating user token {{(pid=101893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:43:17.219480 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca2c652-b853-4b2e-a0ec-7653654be197 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:43:17.220252 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca2c652-b853-4b2e-a0ec-7653654be197 None admin] REQUEST_METHOD: `GET` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:43:17.220553 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca2c652-b853-4b2e-a0ec-7653654be197 None admin] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:43:17.220902 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca2c652-b853-4b2e-a0ec-7653654be197 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:43:17.233531 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ca2c652-b853-4b2e-a0ec-7653654be197 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:43:17.235044 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ca2c652-b853-4b2e-a0ec-7653654be197 None admin] RBAC: Authorization granted {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:43:17.255697 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application [None req-0ca2c652-b853-4b2e-a0ec-7653654be197 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 25 14:43:17.255697 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:43:17.255697 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 14:43:17.255697 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 14:43:17.255697 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 14:43:17.255697 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 14:43:17.255697 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 14:43:17.255697 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 14:43:17.255697 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 14:43:17.255697 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 14:43:17.255697 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 14:43:17.255697 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 14:43:17.255697 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 25 14:43:17.255697 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 25 14:43:17.255697 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 25 14:43:17.257416 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 25 14:43:17.257416 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 14:43:17.257416 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 14:43:17.257416 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 14:43:17.257416 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 14:43:17.257416 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 14:43:17.257416 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application return self.get_or_create( May 25 14:43:17.257416 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 14:43:17.257416 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application with Lock( May 25 14:43:17.257416 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 14:43:17.257416 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application return self._enter() May 25 14:43:17.257416 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 14:43:17.257416 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 14:43:17.257416 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 14:43:17.257416 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application return self.creator() May 25 14:43:17.257416 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 14:43:17.257416 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application created_value = creator( May 25 14:43:17.258520 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 25 14:43:17.258520 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 25 14:43:17.258520 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 25 14:43:17.258520 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application May 25 14:43:17.258520 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 328/672] 10.222.0.84 () {56 vars in 1108 bytes} [Wed May 25 14:43:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 14:43:17.258941 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca2c652-b853-4b2e-a0ec-7653654be197 None admin] Authenticating user token {{(pid=101892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:43:17.300374 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG dbcounter [-] [101892] Writing DB stats keystone:SELECT=100 {{(pid=101892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:43:17.302244 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG dbcounter [-] [101893] Writing DB stats keystone:SELECT=100 {{(pid=101893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:43:17.386997 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca2c652-b853-4b2e-a0ec-7653654be197 None admin] Validating token access rules against request {{(pid=101892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:43:17.424440 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c53d65c-c5be-4e85-a6da-184fd00e362b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:43:17.425281 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c53d65c-c5be-4e85-a6da-184fd00e362b None admin] REQUEST_METHOD: `GET` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:43:17.425566 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c53d65c-c5be-4e85-a6da-184fd00e362b None admin] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:43:17.425840 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c53d65c-c5be-4e85-a6da-184fd00e362b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:43:17.438258 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c53d65c-c5be-4e85-a6da-184fd00e362b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:43:17.439881 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c53d65c-c5be-4e85-a6da-184fd00e362b None admin] RBAC: Authorization granted {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:43:17.456159 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9246d213-fa3b-483e-9fcc-3f7830f095a2 None admin] Validating token access rules against request {{(pid=101893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:43:17.458059 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application [None req-8c53d65c-c5be-4e85-a6da-184fd00e362b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 25 14:43:17.458059 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:43:17.458059 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 14:43:17.458059 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 14:43:17.458059 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 14:43:17.458059 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 14:43:17.458059 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 14:43:17.458059 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 14:43:17.458059 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 14:43:17.458059 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 14:43:17.458059 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 14:43:17.458059 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 14:43:17.458059 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 25 14:43:17.458059 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 25 14:43:17.458059 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 25 14:43:17.458950 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 25 14:43:17.458950 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 14:43:17.458950 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 14:43:17.458950 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 14:43:17.458950 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 14:43:17.458950 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 14:43:17.458950 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application return self.get_or_create( May 25 14:43:17.458950 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 14:43:17.458950 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application with Lock( May 25 14:43:17.458950 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 14:43:17.458950 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application return self._enter() May 25 14:43:17.458950 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 14:43:17.458950 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 14:43:17.458950 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 14:43:17.458950 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application return self.creator() May 25 14:43:17.458950 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 14:43:17.458950 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application created_value = creator( May 25 14:43:17.461056 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 25 14:43:17.461056 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 25 14:43:17.461056 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 25 14:43:17.461056 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application May 25 14:43:17.461056 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 329/673] 10.222.0.84 () {56 vars in 1108 bytes} [Wed May 25 14:43:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 14:43:17.461056 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c53d65c-c5be-4e85-a6da-184fd00e362b None admin] Authenticating user token {{(pid=101892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:43:17.496196 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67481921-12ef-460e-9616-ab079f878789 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:43:17.496779 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67481921-12ef-460e-9616-ab079f878789 None admin] REQUEST_METHOD: `GET` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:43:17.497085 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67481921-12ef-460e-9616-ab079f878789 None admin] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:43:17.497595 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67481921-12ef-460e-9616-ab079f878789 None admin] PATH_INFO: `/v3/domains` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:43:17.498326 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67481921-12ef-460e-9616-ab079f878789 None admin] RBAC: Adding query filter params (name=Default) {{(pid=101893) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:43:17.498633 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67481921-12ef-460e-9616-ab079f878789 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:43:17.500026 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67481921-12ef-460e-9616-ab079f878789 None admin] RBAC: Authorization granted {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:43:17.513258 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 345/674] 10.222.0.84 () {56 vars in 1109 bytes} [Wed May 25 14:43:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 320 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:43:17.514542 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a6e0b1-6561-45df-9a10-8671371dcdb2 None None] REQUEST_METHOD: `GET` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:43:17.514841 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a6e0b1-6561-45df-9a10-8671371dcdb2 None None] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:43:17.515118 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a6e0b1-6561-45df-9a10-8671371dcdb2 None None] PATH_INFO: `/` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:43:17.520512 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 346/675] 10.222.0.84 () {54 vars in 926 bytes} [Wed May 25 14:43:17 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 14:43:17.521360 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a6e0b1-6561-45df-9a10-8671371dcdb2 None None] Authenticating user token {{(pid=101893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:43:17.562798 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG dbcounter [-] [101892] Writing DB stats keystone:SELECT=100 {{(pid=101892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:43:17.581277 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c53d65c-c5be-4e85-a6da-184fd00e362b None admin] Validating token access rules against request {{(pid=101892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:43:17.617072 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81bfa748-0ffe-4000-b94d-ec63639397de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:43:17.617737 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81bfa748-0ffe-4000-b94d-ec63639397de None admin] REQUEST_METHOD: `GET` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:43:17.618013 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81bfa748-0ffe-4000-b94d-ec63639397de None admin] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:43:17.618284 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81bfa748-0ffe-4000-b94d-ec63639397de None admin] PATH_INFO: `/v3/domains` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:43:17.618993 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81bfa748-0ffe-4000-b94d-ec63639397de None admin] RBAC: Adding query filter params (name=Default) {{(pid=101892) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:43:17.619293 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81bfa748-0ffe-4000-b94d-ec63639397de None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:43:17.620706 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81bfa748-0ffe-4000-b94d-ec63639397de None admin] RBAC: Authorization granted {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:43:17.638404 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 330/676] 10.222.0.84 () {56 vars in 1109 bytes} [Wed May 25 14:43:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:43:17.638404 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81bfa748-0ffe-4000-b94d-ec63639397de None admin] Authenticating user token {{(pid=101892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:43:17.647201 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a6e0b1-6561-45df-9a10-8671371dcdb2 None None] Validating token access rules against request {{(pid=101893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:43:17.680107 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG dbcounter [-] [101893] Writing DB stats keystone:SELECT=100 {{(pid=101893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:43:17.685521 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-133a2487-d774-4bdb-9cf0-911ba80b6d66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:43:17.686267 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133a2487-d774-4bdb-9cf0-911ba80b6d66 None admin] REQUEST_METHOD: `GET` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:43:17.686524 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133a2487-d774-4bdb-9cf0-911ba80b6d66 None admin] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:43:17.686802 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133a2487-d774-4bdb-9cf0-911ba80b6d66 None admin] PATH_INFO: `/v3/domains` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:43:17.687525 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-133a2487-d774-4bdb-9cf0-911ba80b6d66 None admin] RBAC: Adding query filter params (name=Default) {{(pid=101893) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:43:17.687866 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-133a2487-d774-4bdb-9cf0-911ba80b6d66 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:43:17.689241 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-133a2487-d774-4bdb-9cf0-911ba80b6d66 None admin] RBAC: Authorization granted {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:43:17.701512 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 347/677] 10.222.0.84 () {56 vars in 1109 bytes} [Wed May 25 14:43:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:43:17.702795 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3218fbe-3d61-4c26-8e5f-b623d5c91c07 None None] REQUEST_METHOD: `POST` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:43:17.703083 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3218fbe-3d61-4c26-8e5f-b623d5c91c07 None None] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:43:17.703362 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3218fbe-3d61-4c26-8e5f-b623d5c91c07 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:43:17.720305 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.auth.core [None req-f3218fbe-3d61-4c26-8e5f-b623d5c91c07 None None] MFA Rules not processed for user `05d87e87798e429aa1c10b24391f915e`. Rule list: `[]` (Enabled: `True`). {{(pid=101893) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:43:17.721738 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.fernet_utils [None req-f3218fbe-3d61-4c26-8e5f-b623d5c91c07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=101893) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:43:17.745353 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81bfa748-0ffe-4000-b94d-ec63639397de None admin] Validating token access rules against request {{(pid=101892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:43:17.784909 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77ca046d-0b0d-4ce3-8225-aed2272de8fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:43:17.785816 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ca046d-0b0d-4ce3-8225-aed2272de8fe None admin] REQUEST_METHOD: `GET` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:43:17.786155 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ca046d-0b0d-4ce3-8225-aed2272de8fe None admin] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:43:17.786426 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ca046d-0b0d-4ce3-8225-aed2272de8fe None admin] PATH_INFO: `/v3/projects/service` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:43:17.795713 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 348/678] 10.222.0.84 () {58 vars in 1023 bytes} [Wed May 25 14:43:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 25 14:43:17.795713 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3218fbe-3d61-4c26-8e5f-b623d5c91c07 None None] Authenticating user token {{(pid=101893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:43:17.797248 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77ca046d-0b0d-4ce3-8225-aed2272de8fe None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:43:17.798869 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77ca046d-0b0d-4ce3-8225-aed2272de8fe None admin] RBAC: Authorization granted {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:43:17.814878 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application [None req-77ca046d-0b0d-4ce3-8225-aed2272de8fe None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 25 14:43:17.814878 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:43:17.814878 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 14:43:17.814878 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 14:43:17.814878 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 14:43:17.814878 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 14:43:17.814878 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 14:43:17.814878 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 14:43:17.814878 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 14:43:17.814878 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 14:43:17.814878 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 14:43:17.814878 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 14:43:17.814878 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 25 14:43:17.814878 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application return self._get_project(project_id) May 25 14:43:17.814878 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 25 14:43:17.815995 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 25 14:43:17.815995 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 14:43:17.815995 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 14:43:17.815995 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 14:43:17.815995 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 14:43:17.815995 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 14:43:17.815995 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application return self.get_or_create( May 25 14:43:17.815995 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 14:43:17.815995 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application with Lock( May 25 14:43:17.815995 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 14:43:17.815995 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application return self._enter() May 25 14:43:17.815995 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 14:43:17.815995 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 14:43:17.815995 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 14:43:17.815995 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application return self.creator() May 25 14:43:17.815995 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 14:43:17.815995 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application created_value = creator( May 25 14:43:17.822518 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 25 14:43:17.822518 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 25 14:43:17.822518 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 25 14:43:17.822518 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 25 14:43:17.822518 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 25 14:43:17.822518 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 25 14:43:17.822518 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 25 14:43:17.822518 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application May 25 14:43:17.822518 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 331/679] 10.222.0.84 () {56 vars in 1111 bytes} [Wed May 25 14:43:17 2022] GET /identity/v3/projects/service => generated 88 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 14:43:17.822518 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77ca046d-0b0d-4ce3-8225-aed2272de8fe None admin] Authenticating user token {{(pid=101892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:43:17.823999 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG dbcounter [-] [101892] Writing DB stats keystone:SELECT=100 {{(pid=101892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:43:17.900584 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3218fbe-3d61-4c26-8e5f-b623d5c91c07 None None] Validating token access rules against request {{(pid=101893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:43:17.924835 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG dbcounter [-] [101893] Writing DB stats keystone:SELECT=100 {{(pid=101893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:43:17.925774 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77ca046d-0b0d-4ce3-8225-aed2272de8fe None admin] Validating token access rules against request {{(pid=101892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:43:17.937050 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a75654-55b8-471e-b2de-bcf88e1026c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:43:17.938082 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a75654-55b8-471e-b2de-bcf88e1026c5 None admin] REQUEST_METHOD: `GET` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:43:17.938523 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a75654-55b8-471e-b2de-bcf88e1026c5 None admin] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:43:17.938953 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a75654-55b8-471e-b2de-bcf88e1026c5 None admin] PATH_INFO: `/v3/projects/service` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:43:17.946143 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68a75654-55b8-471e-b2de-bcf88e1026c5 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:43:17.947777 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68a75654-55b8-471e-b2de-bcf88e1026c5 None admin] RBAC: Authorization granted {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:43:17.961205 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fbef69a-106d-4b97-8b40-8cb6efd98936 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:43:17.962001 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fbef69a-106d-4b97-8b40-8cb6efd98936 None admin] REQUEST_METHOD: `GET` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:43:17.962286 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fbef69a-106d-4b97-8b40-8cb6efd98936 None admin] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:43:17.962563 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fbef69a-106d-4b97-8b40-8cb6efd98936 None admin] PATH_INFO: `/v3/users/swift` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:43:17.962842 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application [None req-68a75654-55b8-471e-b2de-bcf88e1026c5 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 25 14:43:17.962842 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:43:17.962842 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 14:43:17.962842 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 14:43:17.962842 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 14:43:17.962842 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 14:43:17.962842 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 14:43:17.962842 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 14:43:17.962842 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 14:43:17.962842 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 14:43:17.962842 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 14:43:17.962842 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 14:43:17.962842 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 25 14:43:17.962842 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return self._get_project(project_id) May 25 14:43:17.962842 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 25 14:43:17.963860 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 25 14:43:17.963860 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 14:43:17.963860 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 14:43:17.963860 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 14:43:17.963860 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 14:43:17.963860 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 14:43:17.963860 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return self.get_or_create( May 25 14:43:17.963860 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 14:43:17.963860 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application with Lock( May 25 14:43:17.963860 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 14:43:17.963860 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return self._enter() May 25 14:43:17.963860 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 14:43:17.963860 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 14:43:17.963860 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 14:43:17.963860 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return self.creator() May 25 14:43:17.963860 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 14:43:17.963860 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application created_value = creator( May 25 14:43:17.964959 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 25 14:43:17.964959 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 25 14:43:17.964959 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 25 14:43:17.964959 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 25 14:43:17.964959 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 25 14:43:17.964959 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 25 14:43:17.964959 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 25 14:43:17.964959 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application May 25 14:43:17.971532 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 349/680] 10.222.0.84 () {56 vars in 1111 bytes} [Wed May 25 14:43:17 2022] GET /identity/v3/projects/service => generated 88 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 14:43:17.971860 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fbef69a-106d-4b97-8b40-8cb6efd98936 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:43:17.972736 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a75654-55b8-471e-b2de-bcf88e1026c5 None admin] Authenticating user token {{(pid=101893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:43:17.973314 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fbef69a-106d-4b97-8b40-8cb6efd98936 None admin] RBAC: Authorization granted {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:43:17.988647 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application [None req-7fbef69a-106d-4b97-8b40-8cb6efd98936 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. May 25 14:43:17.988647 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:43:17.988647 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 14:43:17.988647 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 14:43:17.988647 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 14:43:17.988647 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 14:43:17.988647 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 14:43:17.988647 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 14:43:17.988647 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 14:43:17.988647 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 14:43:17.988647 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 14:43:17.988647 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 14:43:17.988647 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 25 14:43:17.988647 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application return self._get_user(user_id) May 25 14:43:17.988647 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 25 14:43:17.988647 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 25 14:43:17.989783 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 14:43:17.989783 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 14:43:17.989783 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 25 14:43:17.989783 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 25 14:43:17.989783 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 25 14:43:17.989783 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 25 14:43:17.989783 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 14:43:17.989783 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 14:43:17.989783 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 14:43:17.989783 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application return self.get_or_create( May 25 14:43:17.989783 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 14:43:17.989783 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application with Lock( May 25 14:43:17.989783 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 14:43:17.989783 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application return self._enter() May 25 14:43:17.989783 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 14:43:17.989783 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 14:43:17.989783 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 14:43:17.989783 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application return self.creator() May 25 14:43:17.990786 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 14:43:17.990786 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application created_value = creator( May 25 14:43:17.990786 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 25 14:43:17.990786 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 25 14:43:17.990786 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 25 14:43:17.990786 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 25 14:43:17.990786 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 25 14:43:17.990786 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 25 14:43:17.990786 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. May 25 14:43:17.990786 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application May 25 14:43:17.990786 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 332/681] 10.222.0.84 () {56 vars in 1096 bytes} [Wed May 25 14:43:17 2022] GET /identity/v3/users/swift => generated 83 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 14:43:17.991478 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fbef69a-106d-4b97-8b40-8cb6efd98936 None admin] Authenticating user token {{(pid=101892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:43:18.059774 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG dbcounter [-] [101892] Writing DB stats keystone:SELECT=100 {{(pid=101892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:43:18.091768 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a75654-55b8-471e-b2de-bcf88e1026c5 None admin] Validating token access rules against request {{(pid=101893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:43:18.101341 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fbef69a-106d-4b97-8b40-8cb6efd98936 None admin] Validating token access rules against request {{(pid=101892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:43:18.129630 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5428a39-7b58-4f25-a843-10e3b40d2ccf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:43:18.130433 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5428a39-7b58-4f25-a843-10e3b40d2ccf None admin] REQUEST_METHOD: `GET` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:43:18.130714 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5428a39-7b58-4f25-a843-10e3b40d2ccf None admin] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:43:18.130990 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5428a39-7b58-4f25-a843-10e3b40d2ccf None admin] PATH_INFO: `/v3/roles/admin` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:43:18.135680 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c2b0895-c79a-49db-98d5-5400d362a311 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:43:18.136636 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2b0895-c79a-49db-98d5-5400d362a311 None admin] REQUEST_METHOD: `GET` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:43:18.137118 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2b0895-c79a-49db-98d5-5400d362a311 None admin] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:43:18.137539 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2b0895-c79a-49db-98d5-5400d362a311 None admin] PATH_INFO: `/v3/projects` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:43:18.138479 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c2b0895-c79a-49db-98d5-5400d362a311 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=101892) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:43:18.138932 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c2b0895-c79a-49db-98d5-5400d362a311 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:43:18.140522 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c2b0895-c79a-49db-98d5-5400d362a311 None admin] RBAC: Authorization granted {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:43:18.141437 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5428a39-7b58-4f25-a843-10e3b40d2ccf None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 14:43:18.149601 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application [None req-b5428a39-7b58-4f25-a843-10e3b40d2ccf None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 25 14:43:18.149601 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:43:18.149601 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 14:43:18.149601 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 14:43:18.149601 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 14:43:18.149601 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 14:43:18.149601 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 14:43:18.149601 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 14:43:18.149601 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 14:43:18.149601 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 14:43:18.149601 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 14:43:18.149601 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 14:43:18.149601 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 14:43:18.149601 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 14:43:18.149601 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 14:43:18.149601 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 14:43:18.150728 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 14:43:18.150728 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 14:43:18.150728 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 14:43:18.150728 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 14:43:18.150728 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 14:43:18.150728 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 14:43:18.150728 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 14:43:18.150728 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 14:43:18.150728 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 14:43:18.150728 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return self.get_or_create( May 25 14:43:18.150728 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 14:43:18.150728 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application with Lock( May 25 14:43:18.150728 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 14:43:18.150728 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return self._enter() May 25 14:43:18.150728 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 14:43:18.150728 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 14:43:18.151626 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 14:43:18.151626 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return self.creator() May 25 14:43:18.151626 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 14:43:18.151626 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application created_value = creator( May 25 14:43:18.151626 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 14:43:18.151626 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 14:43:18.151626 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 14:43:18.151626 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 14:43:18.151626 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 14:43:18.151626 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 14:43:18.151626 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 25 14:43:18.151626 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application May 25 14:43:18.151626 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 350/682] 10.222.0.84 () {56 vars in 1096 bytes} [Wed May 25 14:43:17 2022] GET /identity/v3/roles/admin => generated 83 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 14:43:18.152332 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5428a39-7b58-4f25-a843-10e3b40d2ccf None admin] Authenticating user token {{(pid=101893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:43:18.164665 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 333/683] 10.222.0.84 () {56 vars in 1148 bytes} [Wed May 25 14:43:17 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:43:18.165256 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c2b0895-c79a-49db-98d5-5400d362a311 None admin] Authenticating user token {{(pid=101892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:43:18.198151 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG dbcounter [-] [101893] Writing DB stats keystone:SELECT=100 {{(pid=101893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:43:18.258832 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5428a39-7b58-4f25-a843-10e3b40d2ccf None admin] Validating token access rules against request {{(pid=101893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:43:18.269122 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c2b0895-c79a-49db-98d5-5400d362a311 None admin] Validating token access rules against request {{(pid=101892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:43:18.294816 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7e77e70-4631-46f6-a7b4-0276dd518763 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:43:18.295477 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e77e70-4631-46f6-a7b4-0276dd518763 None admin] REQUEST_METHOD: `GET` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:43:18.295819 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e77e70-4631-46f6-a7b4-0276dd518763 None admin] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:43:18.296093 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e77e70-4631-46f6-a7b4-0276dd518763 None admin] PATH_INFO: `/v3/projects` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:43:18.296690 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG dbcounter [-] [101892] Writing DB stats keystone:SELECT=100 {{(pid=101892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:43:18.296881 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7e77e70-4631-46f6-a7b4-0276dd518763 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=101893) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:43:18.297190 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7e77e70-4631-46f6-a7b4-0276dd518763 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:43:18.298627 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7e77e70-4631-46f6-a7b4-0276dd518763 None admin] RBAC: Authorization granted {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:43:18.309166 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0678f83c-95d0-40ba-b546-71989229f32c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:43:18.310199 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0678f83c-95d0-40ba-b546-71989229f32c None admin] REQUEST_METHOD: `GET` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:43:18.310662 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0678f83c-95d0-40ba-b546-71989229f32c None admin] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:43:18.311043 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 351/684] 10.222.0.84 () {56 vars in 1148 bytes} [Wed May 25 14:43:18 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:43:18.311332 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0678f83c-95d0-40ba-b546-71989229f32c None admin] PATH_INFO: `/v3/users` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:43:18.311904 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7e77e70-4631-46f6-a7b4-0276dd518763 None admin] Authenticating user token {{(pid=101893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:43:18.312721 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0678f83c-95d0-40ba-b546-71989229f32c None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=101892) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:43:18.313194 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0678f83c-95d0-40ba-b546-71989229f32c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:43:18.315053 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0678f83c-95d0-40ba-b546-71989229f32c None admin] RBAC: Authorization granted {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:43:18.335342 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 334/685] 10.222.0.84 () {56 vars in 1135 bytes} [Wed May 25 14:43:18 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:43:18.336495 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0678f83c-95d0-40ba-b546-71989229f32c None admin] Authenticating user token {{(pid=101892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:43:18.425366 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7e77e70-4631-46f6-a7b4-0276dd518763 None admin] Validating token access rules against request {{(pid=101893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:43:18.427145 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG dbcounter [-] [101893] Writing DB stats keystone:SELECT=100 {{(pid=101893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:43:18.444268 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0678f83c-95d0-40ba-b546-71989229f32c None admin] Validating token access rules against request {{(pid=101892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:43:18.461429 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cd3cb86-6c75-4d0e-8ac5-09e7275e24a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:43:18.462179 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd3cb86-6c75-4d0e-8ac5-09e7275e24a3 None admin] REQUEST_METHOD: `GET` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:43:18.462467 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd3cb86-6c75-4d0e-8ac5-09e7275e24a3 None admin] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:43:18.462745 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd3cb86-6c75-4d0e-8ac5-09e7275e24a3 None admin] PATH_INFO: `/v3/roles` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:43:18.463587 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cd3cb86-6c75-4d0e-8ac5-09e7275e24a3 None admin] RBAC: Adding query filter params (name=admin) {{(pid=101893) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:43:18.463873 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cd3cb86-6c75-4d0e-8ac5-09e7275e24a3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:43:18.465527 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cd3cb86-6c75-4d0e-8ac5-09e7275e24a3 None admin] RBAC: Authorization granted {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:43:18.478553 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 352/686] 10.222.0.84 () {56 vars in 1099 bytes} [Wed May 25 14:43:18 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:43:18.478553 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cd3cb86-6c75-4d0e-8ac5-09e7275e24a3 None admin] Authenticating user token {{(pid=101893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:43:18.492690 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aee8154-abc2-4844-bc18-e75c9f6dea6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:43:18.493567 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aee8154-abc2-4844-bc18-e75c9f6dea6a None admin] REQUEST_METHOD: `GET` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:43:18.494150 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aee8154-abc2-4844-bc18-e75c9f6dea6a None admin] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:43:18.494858 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aee8154-abc2-4844-bc18-e75c9f6dea6a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:43:18.495991 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aee8154-abc2-4844-bc18-e75c9f6dea6a None admin] RBAC: Adding query filter params (role.id=fdcb2eda27b84f44a392b7e8b59cc425, scope.project.id=a000829c658c4a7cab67f7b6353ba3fa, user.id=9ce28b25b907473588ccb87dc4acc06a) {{(pid=101892) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:43:18.496462 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aee8154-abc2-4844-bc18-e75c9f6dea6a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:43:18.498837 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aee8154-abc2-4844-bc18-e75c9f6dea6a None admin] RBAC: Authorization granted {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:43:18.515753 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 335/687] 10.222.0.84 () {56 vars in 1374 bytes} [Wed May 25 14:43:18 2022] GET /identity/v3/role_assignments?user.id=9ce28b25b907473588ccb87dc4acc06a&scope.project.id=a000829c658c4a7cab67f7b6353ba3fa&role.id=fdcb2eda27b84f44a392b7e8b59cc425 => generated 608 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:43:18.515753 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aee8154-abc2-4844-bc18-e75c9f6dea6a None admin] Authenticating user token {{(pid=101892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:43:18.582470 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG dbcounter [-] [101892] Writing DB stats keystone:SELECT=100 {{(pid=101892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:43:18.600650 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cd3cb86-6c75-4d0e-8ac5-09e7275e24a3 None admin] Validating token access rules against request {{(pid=101893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:43:18.639702 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f77fa989-7cfa-4721-b011-631b596cd629 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:43:18.640538 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f77fa989-7cfa-4721-b011-631b596cd629 None admin] REQUEST_METHOD: `GET` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:43:18.640918 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f77fa989-7cfa-4721-b011-631b596cd629 None admin] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:43:18.641460 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f77fa989-7cfa-4721-b011-631b596cd629 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:43:18.642330 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f77fa989-7cfa-4721-b011-631b596cd629 None admin] RBAC: Adding query filter params (role.id=fdcb2eda27b84f44a392b7e8b59cc425, scope.project.id=a000829c658c4a7cab67f7b6353ba3fa, user.id=971542599734491aa112b815fc4cc5c2) {{(pid=101893) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:43:18.642789 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f77fa989-7cfa-4721-b011-631b596cd629 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:43:18.644627 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f77fa989-7cfa-4721-b011-631b596cd629 None admin] RBAC: Authorization granted {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:43:18.644838 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aee8154-abc2-4844-bc18-e75c9f6dea6a None admin] Validating token access rules against request {{(pid=101892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:43:18.651913 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 353/688] 10.222.0.84 () {56 vars in 1374 bytes} [Wed May 25 14:43:18 2022] GET /identity/v3/role_assignments?user.id=971542599734491aa112b815fc4cc5c2&scope.project.id=a000829c658c4a7cab67f7b6353ba3fa&role.id=fdcb2eda27b84f44a392b7e8b59cc425 => generated 608 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:43:18.652989 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f77fa989-7cfa-4721-b011-631b596cd629 None admin] Authenticating user token {{(pid=101893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:43:18.687067 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG dbcounter [-] [101893] Writing DB stats keystone:SELECT=100 {{(pid=101893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:43:18.713877 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39c4bfe5-9ad9-4649-963f-f0ef69dfec16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:43:18.714519 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c4bfe5-9ad9-4649-963f-f0ef69dfec16 None admin] REQUEST_METHOD: `GET` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:43:18.715714 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c4bfe5-9ad9-4649-963f-f0ef69dfec16 None admin] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:43:18.715714 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c4bfe5-9ad9-4649-963f-f0ef69dfec16 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:43:18.775216 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f77fa989-7cfa-4721-b011-631b596cd629 None admin] Validating token access rules against request {{(pid=101893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:43:18.812570 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39c4bfe5-9ad9-4649-963f-f0ef69dfec16 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:43:18.813744 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-708580ab-5f39-4403-80f6-f7b2e8bbeefe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:43:18.814028 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39c4bfe5-9ad9-4649-963f-f0ef69dfec16 None admin] RBAC: Authorization granted {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:43:18.814602 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708580ab-5f39-4403-80f6-f7b2e8bbeefe None admin] REQUEST_METHOD: `GET` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:43:18.814886 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708580ab-5f39-4403-80f6-f7b2e8bbeefe None admin] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:43:18.815184 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708580ab-5f39-4403-80f6-f7b2e8bbeefe None admin] PATH_INFO: `/v3/domains/Default` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:43:18.827670 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-708580ab-5f39-4403-80f6-f7b2e8bbeefe None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:43:18.829093 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-708580ab-5f39-4403-80f6-f7b2e8bbeefe None admin] RBAC: Authorization granted {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:43:18.857415 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application [None req-708580ab-5f39-4403-80f6-f7b2e8bbeefe None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 25 14:43:18.857415 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:43:18.857415 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 14:43:18.857415 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 14:43:18.857415 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 14:43:18.857415 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 14:43:18.857415 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 14:43:18.857415 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 14:43:18.857415 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 14:43:18.857415 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 14:43:18.857415 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 14:43:18.857415 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 14:43:18.857415 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 25 14:43:18.857415 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 25 14:43:18.857415 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 25 14:43:18.858411 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 25 14:43:18.858411 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 14:43:18.858411 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 14:43:18.858411 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 14:43:18.858411 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 14:43:18.858411 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 14:43:18.858411 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return self.get_or_create( May 25 14:43:18.858411 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 14:43:18.858411 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application with Lock( May 25 14:43:18.858411 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 14:43:18.858411 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return self._enter() May 25 14:43:18.858411 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 14:43:18.858411 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 14:43:18.858411 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 14:43:18.858411 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return self.creator() May 25 14:43:18.858411 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 14:43:18.858411 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application created_value = creator( May 25 14:43:18.859766 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 25 14:43:18.859766 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 25 14:43:18.859766 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 25 14:43:18.859766 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application May 25 14:43:18.859766 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 354/689] 10.222.0.84 () {56 vars in 1108 bytes} [Wed May 25 14:43:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 14:43:18.873144 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-708580ab-5f39-4403-80f6-f7b2e8bbeefe None admin] Authenticating user token {{(pid=101893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:43:18.898795 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG dbcounter [-] [101892] Writing DB stats keystone:SELECT=100 {{(pid=101892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:43:19.000818 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG dbcounter [-] [101893] Writing DB stats keystone:SELECT=100 {{(pid=101893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:43:19.025031 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-708580ab-5f39-4403-80f6-f7b2e8bbeefe None admin] Validating token access rules against request {{(pid=101893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:43:19.065774 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2be308e9-e299-4c74-8728-1d8365ea81e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:43:19.066456 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be308e9-e299-4c74-8728-1d8365ea81e3 None admin] REQUEST_METHOD: `GET` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:43:19.067695 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be308e9-e299-4c74-8728-1d8365ea81e3 None admin] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:43:19.067695 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be308e9-e299-4c74-8728-1d8365ea81e3 None admin] PATH_INFO: `/v3/domains` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:43:19.068974 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2be308e9-e299-4c74-8728-1d8365ea81e3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=101893) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:43:19.070300 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2be308e9-e299-4c74-8728-1d8365ea81e3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:43:19.070843 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2be308e9-e299-4c74-8728-1d8365ea81e3 None admin] RBAC: Authorization granted {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:43:19.075553 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 336/690] 10.222.0.84 () {58 vars in 1282 bytes} [Wed May 25 14:43:18 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 568 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 25 14:43:19.081158 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39c4bfe5-9ad9-4649-963f-f0ef69dfec16 None admin] Authenticating user token {{(pid=101892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:43:19.087672 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 355/691] 10.222.0.84 () {56 vars in 1109 bytes} [Wed May 25 14:43:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 14:43:19.093035 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2be308e9-e299-4c74-8728-1d8365ea81e3 None admin] Authenticating user token {{(pid=101893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:43:19.218878 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2be308e9-e299-4c74-8728-1d8365ea81e3 None admin] Validating token access rules against request {{(pid=101893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:43:19.261666 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22d3a07c-2cb2-4ea7-ac86-93d2051cdce1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:43:19.262473 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d3a07c-2cb2-4ea7-ac86-93d2051cdce1 None admin] REQUEST_METHOD: `GET` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:43:19.262755 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d3a07c-2cb2-4ea7-ac86-93d2051cdce1 None admin] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:43:19.263036 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d3a07c-2cb2-4ea7-ac86-93d2051cdce1 None admin] PATH_INFO: `/v3/users/nova` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:43:19.278717 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39c4bfe5-9ad9-4649-963f-f0ef69dfec16 None admin] Validating token access rules against request {{(pid=101892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:43:19.281029 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22d3a07c-2cb2-4ea7-ac86-93d2051cdce1 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:43:19.282508 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22d3a07c-2cb2-4ea7-ac86-93d2051cdce1 None admin] RBAC: Authorization granted {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:43:19.292327 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG dbcounter [-] [101893] Writing DB stats keystone:SELECT=100 {{(pid=101893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:43:19.310469 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application [None req-22d3a07c-2cb2-4ea7-ac86-93d2051cdce1 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 25 14:43:19.310469 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:43:19.310469 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 14:43:19.310469 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 14:43:19.310469 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 14:43:19.310469 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 14:43:19.310469 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 14:43:19.310469 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 14:43:19.310469 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 14:43:19.310469 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 14:43:19.310469 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 14:43:19.310469 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 14:43:19.310469 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 25 14:43:19.310469 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return self._get_user(user_id) May 25 14:43:19.310469 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 25 14:43:19.310469 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 25 14:43:19.316909 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 14:43:19.316909 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 14:43:19.316909 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 25 14:43:19.316909 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 25 14:43:19.316909 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 25 14:43:19.316909 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 25 14:43:19.316909 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 14:43:19.316909 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 14:43:19.316909 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 14:43:19.316909 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return self.get_or_create( May 25 14:43:19.316909 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 14:43:19.316909 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application with Lock( May 25 14:43:19.316909 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 14:43:19.316909 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return self._enter() May 25 14:43:19.316909 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 14:43:19.316909 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 14:43:19.316909 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 14:43:19.316909 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return self.creator() May 25 14:43:19.317977 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 14:43:19.317977 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application created_value = creator( May 25 14:43:19.317977 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 25 14:43:19.317977 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 25 14:43:19.317977 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 25 14:43:19.317977 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 25 14:43:19.317977 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 25 14:43:19.317977 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 25 14:43:19.317977 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 25 14:43:19.317977 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application May 25 14:43:19.326985 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 356/692] 10.222.0.84 () {56 vars in 1093 bytes} [Wed May 25 14:43:19 2022] GET /identity/v3/users/nova => generated 82 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 14:43:19.331627 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22d3a07c-2cb2-4ea7-ac86-93d2051cdce1 None admin] Authenticating user token {{(pid=101893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:43:19.356736 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f6fb23a-c414-4a28-9acc-9af100388789 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:43:19.357560 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6fb23a-c414-4a28-9acc-9af100388789 None admin] REQUEST_METHOD: `GET` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:43:19.357843 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6fb23a-c414-4a28-9acc-9af100388789 None admin] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:43:19.363609 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6fb23a-c414-4a28-9acc-9af100388789 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:43:19.387590 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f6fb23a-c414-4a28-9acc-9af100388789 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:43:19.387590 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f6fb23a-c414-4a28-9acc-9af100388789 None admin] RBAC: Authorization granted {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:43:19.407585 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG dbcounter [-] [101892] Writing DB stats keystone:SELECT=100 {{(pid=101892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:43:19.442493 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application [None req-0f6fb23a-c414-4a28-9acc-9af100388789 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 25 14:43:19.442493 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:43:19.442493 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 14:43:19.442493 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 14:43:19.442493 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 14:43:19.442493 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 14:43:19.442493 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 14:43:19.442493 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 14:43:19.442493 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 14:43:19.442493 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 14:43:19.442493 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 14:43:19.442493 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 14:43:19.442493 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 25 14:43:19.442493 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 25 14:43:19.442493 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 25 14:43:19.445292 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 25 14:43:19.445292 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 14:43:19.445292 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 14:43:19.445292 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 14:43:19.445292 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 14:43:19.445292 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 14:43:19.445292 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application return self.get_or_create( May 25 14:43:19.445292 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 14:43:19.445292 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application with Lock( May 25 14:43:19.445292 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 14:43:19.445292 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application return self._enter() May 25 14:43:19.445292 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 14:43:19.445292 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 14:43:19.445292 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 14:43:19.445292 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application return self.creator() May 25 14:43:19.445292 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 14:43:19.445292 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application created_value = creator( May 25 14:43:19.447454 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 25 14:43:19.447454 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 25 14:43:19.447454 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 25 14:43:19.447454 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application May 25 14:43:19.447454 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 337/693] 10.222.0.84 () {56 vars in 1108 bytes} [Wed May 25 14:43:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 364 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 25 14:43:19.453615 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f6fb23a-c414-4a28-9acc-9af100388789 None admin] Authenticating user token {{(pid=101892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:43:19.551142 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22d3a07c-2cb2-4ea7-ac86-93d2051cdce1 None admin] Validating token access rules against request {{(pid=101893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:43:19.607934 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6674f52d-715c-4a4a-a546-5a62239a5b93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:43:19.608967 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6674f52d-715c-4a4a-a546-5a62239a5b93 None admin] REQUEST_METHOD: `GET` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:43:19.609254 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6674f52d-715c-4a4a-a546-5a62239a5b93 None admin] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:43:19.609533 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6674f52d-715c-4a4a-a546-5a62239a5b93 None admin] PATH_INFO: `/v3/users` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:43:19.610961 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6674f52d-715c-4a4a-a546-5a62239a5b93 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=101893) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:43:19.611275 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6674f52d-715c-4a4a-a546-5a62239a5b93 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:43:19.612922 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6674f52d-715c-4a4a-a546-5a62239a5b93 None admin] RBAC: Authorization granted {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:43:19.634809 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f6fb23a-c414-4a28-9acc-9af100388789 None admin] Validating token access rules against request {{(pid=101892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:43:19.639651 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 357/694] 10.222.0.84 () {56 vars in 1133 bytes} [Wed May 25 14:43:19 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 305 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:43:19.641127 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27181d9d-21f8-4357-a6ab-4aa80ed223e5 None None] REQUEST_METHOD: `GET` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:43:19.641411 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27181d9d-21f8-4357-a6ab-4aa80ed223e5 None None] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:43:19.641683 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27181d9d-21f8-4357-a6ab-4aa80ed223e5 None None] PATH_INFO: `/` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:43:19.643060 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 358/695] 10.222.0.84 () {54 vars in 926 bytes} [Wed May 25 14:43:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 14:43:19.644471 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27181d9d-21f8-4357-a6ab-4aa80ed223e5 None None] Authenticating user token {{(pid=101893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:43:19.687403 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46e4264e-695c-488f-8fbb-efeb0f4a8cb9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:43:19.688071 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e4264e-695c-488f-8fbb-efeb0f4a8cb9 None admin] REQUEST_METHOD: `GET` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:43:19.688354 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e4264e-695c-488f-8fbb-efeb0f4a8cb9 None admin] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:43:19.688625 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e4264e-695c-488f-8fbb-efeb0f4a8cb9 None admin] PATH_INFO: `/v3/domains` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:43:19.689343 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46e4264e-695c-488f-8fbb-efeb0f4a8cb9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=101892) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:43:19.689646 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46e4264e-695c-488f-8fbb-efeb0f4a8cb9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:43:19.691013 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46e4264e-695c-488f-8fbb-efeb0f4a8cb9 None admin] RBAC: Authorization granted {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:43:19.703900 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 338/696] 10.222.0.84 () {56 vars in 1109 bytes} [Wed May 25 14:43:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:43:19.705157 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986ca61b-575a-4d08-9deb-6c32cc6110ba None None] REQUEST_METHOD: `POST` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:43:19.705442 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986ca61b-575a-4d08-9deb-6c32cc6110ba None None] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:43:19.705720 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986ca61b-575a-4d08-9deb-6c32cc6110ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:43:19.723519 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.auth.core [None req-986ca61b-575a-4d08-9deb-6c32cc6110ba None None] MFA Rules not processed for user `05d87e87798e429aa1c10b24391f915e`. Rule list: `[]` (Enabled: `True`). {{(pid=101892) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:43:19.725317 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.fernet_utils [None req-986ca61b-575a-4d08-9deb-6c32cc6110ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=101892) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:43:19.726958 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG dbcounter [-] [101893] Writing DB stats keystone:SELECT=100 {{(pid=101893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:43:19.780832 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG dbcounter [-] [101892] Writing DB stats keystone:SELECT=100 {{(pid=101892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:43:19.785202 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27181d9d-21f8-4357-a6ab-4aa80ed223e5 None None] Validating token access rules against request {{(pid=101893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:43:19.803968 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 339/697] 10.222.0.84 () {58 vars in 1023 bytes} [Wed May 25 14:43:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 25 14:43:19.804897 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-986ca61b-575a-4d08-9deb-6c32cc6110ba None None] Authenticating user token {{(pid=101892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:43:19.826829 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-317ce27e-a3b2-4085-80ef-94d012f11dd0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:43:19.827974 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317ce27e-a3b2-4085-80ef-94d012f11dd0 None admin] REQUEST_METHOD: `GET` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:43:19.828601 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317ce27e-a3b2-4085-80ef-94d012f11dd0 None admin] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:43:19.829054 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317ce27e-a3b2-4085-80ef-94d012f11dd0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:43:19.919845 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-317ce27e-a3b2-4085-80ef-94d012f11dd0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:43:19.922246 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-317ce27e-a3b2-4085-80ef-94d012f11dd0 None admin] RBAC: Authorization granted {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:43:19.927066 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-986ca61b-575a-4d08-9deb-6c32cc6110ba None None] Validating token access rules against request {{(pid=101892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:43:19.972736 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa63816d-fcf4-478c-bc4b-bf9c8d99b088 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:43:19.974249 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa63816d-fcf4-478c-bc4b-bf9c8d99b088 None admin] REQUEST_METHOD: `GET` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:43:19.975479 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa63816d-fcf4-478c-bc4b-bf9c8d99b088 None admin] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:43:19.975926 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa63816d-fcf4-478c-bc4b-bf9c8d99b088 None admin] PATH_INFO: `/v3/projects/service` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:43:19.985537 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa63816d-fcf4-478c-bc4b-bf9c8d99b088 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:43:19.987140 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG dbcounter [-] [101893] Writing DB stats keystone:SELECT=100 {{(pid=101893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:43:19.988930 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa63816d-fcf4-478c-bc4b-bf9c8d99b088 None admin] RBAC: Authorization granted {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:43:20.007261 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application [None req-fa63816d-fcf4-478c-bc4b-bf9c8d99b088 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 25 14:43:20.007261 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:43:20.007261 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 14:43:20.007261 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 14:43:20.007261 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 14:43:20.007261 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 14:43:20.007261 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 14:43:20.007261 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 14:43:20.007261 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 14:43:20.007261 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 14:43:20.007261 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 14:43:20.007261 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 14:43:20.007261 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 25 14:43:20.007261 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application return self._get_project(project_id) May 25 14:43:20.007261 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 25 14:43:20.008398 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 25 14:43:20.008398 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 14:43:20.008398 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 14:43:20.008398 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 14:43:20.008398 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 14:43:20.008398 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 14:43:20.008398 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application return self.get_or_create( May 25 14:43:20.008398 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 14:43:20.008398 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application with Lock( May 25 14:43:20.008398 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 14:43:20.008398 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application return self._enter() May 25 14:43:20.008398 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 14:43:20.008398 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 14:43:20.008398 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 14:43:20.008398 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application return self.creator() May 25 14:43:20.008398 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 14:43:20.008398 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application created_value = creator( May 25 14:43:20.009375 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 25 14:43:20.009375 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 25 14:43:20.009375 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 25 14:43:20.009375 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 25 14:43:20.009375 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 25 14:43:20.009375 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 25 14:43:20.009375 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 25 14:43:20.009375 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application May 25 14:43:20.011688 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 340/698] 10.222.0.84 () {56 vars in 1111 bytes} [Wed May 25 14:43:19 2022] GET /identity/v3/projects/service => generated 88 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 14:43:20.012706 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa63816d-fcf4-478c-bc4b-bf9c8d99b088 None admin] Authenticating user token {{(pid=101892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:43:20.039131 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 359/699] 10.222.0.84 () {58 vars in 1282 bytes} [Wed May 25 14:43:19 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 391 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 25 14:43:20.039131 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-317ce27e-a3b2-4085-80ef-94d012f11dd0 None admin] Authenticating user token {{(pid=101893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:43:20.082269 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG dbcounter [-] [101892] Writing DB stats keystone:SELECT=100 {{(pid=101892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:43:20.138603 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa63816d-fcf4-478c-bc4b-bf9c8d99b088 None admin] Validating token access rules against request {{(pid=101892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:43:20.152400 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-317ce27e-a3b2-4085-80ef-94d012f11dd0 None admin] Validating token access rules against request {{(pid=101893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:43:20.173816 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d65ac67a-e34a-4574-9850-b01a9ee21e9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:43:20.174865 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65ac67a-e34a-4574-9850-b01a9ee21e9e None admin] REQUEST_METHOD: `GET` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:43:20.175373 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65ac67a-e34a-4574-9850-b01a9ee21e9e None admin] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:43:20.175882 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65ac67a-e34a-4574-9850-b01a9ee21e9e None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:43:20.176725 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d65ac67a-e34a-4574-9850-b01a9ee21e9e None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:43:20.178302 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d65ac67a-e34a-4574-9850-b01a9ee21e9e None admin] RBAC: Authorization granted {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:43:20.189416 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff188cf-a7e7-4f68-b0ae-5c81d0e574a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:43:20.190072 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff188cf-a7e7-4f68-b0ae-5c81d0e574a4 None admin] REQUEST_METHOD: `GET` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:43:20.190353 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff188cf-a7e7-4f68-b0ae-5c81d0e574a4 None admin] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:43:20.190625 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff188cf-a7e7-4f68-b0ae-5c81d0e574a4 None admin] PATH_INFO: `/v3/projects` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:43:20.191405 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bff188cf-a7e7-4f68-b0ae-5c81d0e574a4 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=101893) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:43:20.191779 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bff188cf-a7e7-4f68-b0ae-5c81d0e574a4 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:43:20.193223 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bff188cf-a7e7-4f68-b0ae-5c81d0e574a4 None admin] RBAC: Authorization granted {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:43:20.195105 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application [None req-d65ac67a-e34a-4574-9850-b01a9ee21e9e None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. May 25 14:43:20.195105 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:43:20.195105 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 25 14:43:20.195105 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 25 14:43:20.195105 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 25 14:43:20.195105 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 25 14:43:20.195105 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 25 14:43:20.195105 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 25 14:43:20.195105 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. May 25 14:43:20.195105 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application May 25 14:43:20.195105 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 25 14:43:20.195105 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application May 25 14:43:20.195105 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:43:20.195105 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 14:43:20.195105 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 14:43:20.195105 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 14:43:20.196101 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 14:43:20.196101 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 14:43:20.196101 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 14:43:20.196101 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 14:43:20.196101 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 14:43:20.196101 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 14:43:20.196101 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 14:43:20.196101 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 25 14:43:20.196101 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application return self._get_service(service_id) May 25 14:43:20.196101 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 25 14:43:20.196101 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 25 14:43:20.196101 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 14:43:20.196101 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 14:43:20.196101 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 14:43:20.196101 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 14:43:20.196101 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 14:43:20.196954 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application return self.get_or_create( May 25 14:43:20.196954 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 14:43:20.196954 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application with Lock( May 25 14:43:20.196954 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 14:43:20.196954 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application return self._enter() May 25 14:43:20.196954 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 14:43:20.196954 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 14:43:20.196954 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 14:43:20.196954 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application return self.creator() May 25 14:43:20.196954 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 14:43:20.196954 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application created_value = creator( May 25 14:43:20.196954 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 25 14:43:20.196954 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 25 14:43:20.196954 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. May 25 14:43:20.196954 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application May 25 14:43:20.199527 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 341/700] 10.222.0.84 () {56 vars in 1129 bytes} [Wed May 25 14:43:20 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 14:43:20.200575 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d65ac67a-e34a-4574-9850-b01a9ee21e9e None admin] Authenticating user token {{(pid=101892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:43:20.212348 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 360/701] 10.222.0.84 () {56 vars in 1148 bytes} [Wed May 25 14:43:20 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:43:20.213292 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff188cf-a7e7-4f68-b0ae-5c81d0e574a4 None admin] Authenticating user token {{(pid=101893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:43:20.234587 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG dbcounter [-] [101893] Writing DB stats keystone:SELECT=100 {{(pid=101893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:43:20.306281 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d65ac67a-e34a-4574-9850-b01a9ee21e9e None admin] Validating token access rules against request {{(pid=101892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:43:20.317486 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG dbcounter [-] [101892] Writing DB stats keystone:SELECT=100 {{(pid=101892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:43:20.327110 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff188cf-a7e7-4f68-b0ae-5c81d0e574a4 None admin] Validating token access rules against request {{(pid=101893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:43:20.342096 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ceff04e-8a1c-46bc-b4cc-fe3db7b0c19d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:43:20.343186 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ceff04e-8a1c-46bc-b4cc-fe3db7b0c19d None admin] REQUEST_METHOD: `GET` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:43:20.343713 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ceff04e-8a1c-46bc-b4cc-fe3db7b0c19d None admin] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:43:20.344188 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ceff04e-8a1c-46bc-b4cc-fe3db7b0c19d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:43:20.356025 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ceff04e-8a1c-46bc-b4cc-fe3db7b0c19d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:43:20.357832 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ceff04e-8a1c-46bc-b4cc-fe3db7b0c19d None admin] RBAC: Authorization granted {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:43:20.364005 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-132e0a34-9971-4e86-99b6-52f9851a1b10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:43:20.364670 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132e0a34-9971-4e86-99b6-52f9851a1b10 None admin] REQUEST_METHOD: `GET` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:43:20.364949 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132e0a34-9971-4e86-99b6-52f9851a1b10 None admin] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:43:20.365259 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132e0a34-9971-4e86-99b6-52f9851a1b10 None admin] PATH_INFO: `/v3/services` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:43:20.366020 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-132e0a34-9971-4e86-99b6-52f9851a1b10 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=101893) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:43:20.366329 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-132e0a34-9971-4e86-99b6-52f9851a1b10 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:43:20.367848 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-132e0a34-9971-4e86-99b6-52f9851a1b10 None admin] RBAC: Authorization granted {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:43:20.377859 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 361/702] 10.222.0.84 () {56 vars in 1124 bytes} [Wed May 25 14:43:20 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:43:20.378501 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application [None req-5ceff04e-8a1c-46bc-b4cc-fe3db7b0c19d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 25 14:43:20.378501 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:43:20.378501 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 14:43:20.378501 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 14:43:20.378501 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 14:43:20.378501 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 14:43:20.378501 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 14:43:20.378501 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 14:43:20.378501 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 14:43:20.378501 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 14:43:20.378501 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 14:43:20.378501 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 14:43:20.378501 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 25 14:43:20.378501 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 25 14:43:20.378501 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 25 14:43:20.379372 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 25 14:43:20.379372 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 14:43:20.379372 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 14:43:20.379372 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 14:43:20.379372 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 14:43:20.379372 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 14:43:20.379372 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application return self.get_or_create( May 25 14:43:20.379372 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 14:43:20.379372 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application with Lock( May 25 14:43:20.379372 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 14:43:20.379372 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application return self._enter() May 25 14:43:20.379372 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 14:43:20.379372 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 14:43:20.379372 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 14:43:20.379372 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application return self.creator() May 25 14:43:20.379372 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 14:43:20.379372 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application created_value = creator( May 25 14:43:20.380331 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 25 14:43:20.380331 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 25 14:43:20.380331 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 25 14:43:20.380331 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application May 25 14:43:20.380553 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-132e0a34-9971-4e86-99b6-52f9851a1b10 None admin] Authenticating user token {{(pid=101893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:43:20.382269 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 342/703] 10.222.0.84 () {56 vars in 1108 bytes} [Wed May 25 14:43:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 14:43:20.383238 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ceff04e-8a1c-46bc-b4cc-fe3db7b0c19d None admin] Authenticating user token {{(pid=101892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:43:20.478472 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG dbcounter [-] [101893] Writing DB stats keystone:SELECT=100 {{(pid=101893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:43:20.487337 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ceff04e-8a1c-46bc-b4cc-fe3db7b0c19d None admin] Validating token access rules against request {{(pid=101892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:43:20.499647 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-132e0a34-9971-4e86-99b6-52f9851a1b10 None admin] Validating token access rules against request {{(pid=101893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:43:20.523887 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddb12244-d5f1-49b6-abf6-0a4e20987e7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:43:20.524458 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb12244-d5f1-49b6-abf6-0a4e20987e7c None admin] REQUEST_METHOD: `GET` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:43:20.524888 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb12244-d5f1-49b6-abf6-0a4e20987e7c None admin] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:43:20.525265 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb12244-d5f1-49b6-abf6-0a4e20987e7c None admin] PATH_INFO: `/v3/services` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:43:20.526070 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddb12244-d5f1-49b6-abf6-0a4e20987e7c None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=101892) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:43:20.526477 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddb12244-d5f1-49b6-abf6-0a4e20987e7c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:43:20.527973 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddb12244-d5f1-49b6-abf6-0a4e20987e7c None admin] RBAC: Authorization granted {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:43:20.539588 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 343/704] 10.222.0.84 () {56 vars in 1124 bytes} [Wed May 25 14:43:20 2022] GET /identity/v3/services?type=block-storage => generated 130 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:43:20.539588 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddb12244-d5f1-49b6-abf6-0a4e20987e7c None admin] Authenticating user token {{(pid=101892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:43:20.550029 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e19085ef-f53e-45bf-acb7-ae4d0910bad1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:43:20.550944 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e19085ef-f53e-45bf-acb7-ae4d0910bad1 None admin] REQUEST_METHOD: `GET` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:43:20.551394 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e19085ef-f53e-45bf-acb7-ae4d0910bad1 None admin] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:43:20.551857 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e19085ef-f53e-45bf-acb7-ae4d0910bad1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:43:20.552997 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e19085ef-f53e-45bf-acb7-ae4d0910bad1 None admin] RBAC: Adding query filter params (role.id=fdcb2eda27b84f44a392b7e8b59cc425, scope.project.id=a000829c658c4a7cab67f7b6353ba3fa, user.id=e196f0897b98455c9e164271d7d0070a) {{(pid=101893) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:43:20.553554 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e19085ef-f53e-45bf-acb7-ae4d0910bad1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:43:20.555173 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e19085ef-f53e-45bf-acb7-ae4d0910bad1 None admin] RBAC: Authorization granted {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:43:20.572720 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG dbcounter [-] [101892] Writing DB stats keystone:SELECT=100 {{(pid=101892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:43:20.574549 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 362/705] 10.222.0.84 () {56 vars in 1374 bytes} [Wed May 25 14:43:20 2022] GET /identity/v3/role_assignments?user.id=e196f0897b98455c9e164271d7d0070a&scope.project.id=a000829c658c4a7cab67f7b6353ba3fa&role.id=fdcb2eda27b84f44a392b7e8b59cc425 => generated 608 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:43:20.656685 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddb12244-d5f1-49b6-abf6-0a4e20987e7c None admin] Validating token access rules against request {{(pid=101892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:43:20.820114 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-450a736b-d59d-4d61-b824-4da7d3e4305c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:43:20.820703 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-450a736b-d59d-4d61-b824-4da7d3e4305c None admin] REQUEST_METHOD: `GET` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:43:20.820985 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-450a736b-d59d-4d61-b824-4da7d3e4305c None admin] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:43:20.821260 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-450a736b-d59d-4d61-b824-4da7d3e4305c None admin] PATH_INFO: `/v3/domains` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:43:20.821991 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-450a736b-d59d-4d61-b824-4da7d3e4305c None admin] RBAC: Adding query filter params (name=Default) {{(pid=101892) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:43:20.822297 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-450a736b-d59d-4d61-b824-4da7d3e4305c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:43:20.823719 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-450a736b-d59d-4d61-b824-4da7d3e4305c None admin] RBAC: Authorization granted {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:43:20.837147 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 344/706] 10.222.0.84 () {56 vars in 1109 bytes} [Wed May 25 14:43:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 302 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:43:20.842733 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e19085ef-f53e-45bf-acb7-ae4d0910bad1 None admin] Authenticating user token {{(pid=101893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:43:20.966899 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e19085ef-f53e-45bf-acb7-ae4d0910bad1 None admin] Validating token access rules against request {{(pid=101893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:43:21.006205 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f797872-4489-4b5c-a285-ad8363c47b78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:43:21.007007 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f797872-4489-4b5c-a285-ad8363c47b78 None admin] REQUEST_METHOD: `GET` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:43:21.007292 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f797872-4489-4b5c-a285-ad8363c47b78 None admin] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:43:21.007582 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f797872-4489-4b5c-a285-ad8363c47b78 None admin] PATH_INFO: `/v3/projects/service` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:43:21.015319 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f797872-4489-4b5c-a285-ad8363c47b78 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:43:21.016820 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f797872-4489-4b5c-a285-ad8363c47b78 None admin] RBAC: Authorization granted {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:43:21.031935 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application [None req-9f797872-4489-4b5c-a285-ad8363c47b78 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 25 14:43:21.031935 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:43:21.031935 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 14:43:21.031935 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 14:43:21.031935 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 14:43:21.031935 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 14:43:21.031935 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 14:43:21.031935 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 14:43:21.031935 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 14:43:21.031935 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 14:43:21.031935 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 14:43:21.031935 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 14:43:21.031935 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 25 14:43:21.031935 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return self._get_project(project_id) May 25 14:43:21.031935 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 25 14:43:21.032892 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 25 14:43:21.032892 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 14:43:21.032892 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 14:43:21.032892 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 14:43:21.032892 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 14:43:21.032892 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 14:43:21.032892 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return self.get_or_create( May 25 14:43:21.032892 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 14:43:21.032892 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application with Lock( May 25 14:43:21.032892 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 14:43:21.032892 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return self._enter() May 25 14:43:21.032892 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 14:43:21.032892 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 14:43:21.032892 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 14:43:21.032892 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return self.creator() May 25 14:43:21.032892 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 14:43:21.032892 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application created_value = creator( May 25 14:43:21.033786 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 25 14:43:21.033786 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 25 14:43:21.033786 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 25 14:43:21.033786 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 25 14:43:21.033786 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 25 14:43:21.033786 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 25 14:43:21.033786 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 25 14:43:21.033786 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application May 25 14:43:21.033786 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 363/707] 10.222.0.84 () {56 vars in 1111 bytes} [Wed May 25 14:43:20 2022] GET /identity/v3/projects/service => generated 88 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 14:43:21.042239 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-450a736b-d59d-4d61-b824-4da7d3e4305c None admin] Authenticating user token {{(pid=101892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:43:21.085414 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01f8342-0ea0-4855-9452-431b94c56243 None None] REQUEST_METHOD: `GET` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:43:21.085931 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01f8342-0ea0-4855-9452-431b94c56243 None None] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:43:21.085931 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01f8342-0ea0-4855-9452-431b94c56243 None None] PATH_INFO: `/` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:43:21.087661 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 364/708] 10.222.0.84 () {54 vars in 926 bytes} [Wed May 25 14:43:21 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 25 14:43:21.092582 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3d187e-b791-486d-98db-abe525ced106 None None] REQUEST_METHOD: `POST` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:43:21.092869 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3d187e-b791-486d-98db-abe525ced106 None None] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:43:21.093150 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3d187e-b791-486d-98db-abe525ced106 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:43:21.107747 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG dbcounter [-] [101893] Writing DB stats keystone:SELECT=100 {{(pid=101893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:43:21.115153 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.auth.core [None req-ea3d187e-b791-486d-98db-abe525ced106 None None] MFA Rules not processed for user `05d87e87798e429aa1c10b24391f915e`. Rule list: `[]` (Enabled: `True`). {{(pid=101893) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:43:21.116415 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.fernet_utils [None req-ea3d187e-b791-486d-98db-abe525ced106 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=101893) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:43:21.144612 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG dbcounter [-] [101892] Writing DB stats keystone:SELECT=100 {{(pid=101892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:43:21.178424 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-450a736b-d59d-4d61-b824-4da7d3e4305c None admin] Validating token access rules against request {{(pid=101892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:43:21.207861 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 365/709] 10.222.0.84 () {58 vars in 1023 bytes} [Wed May 25 14:43:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 25 14:43:21.221452 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a43a9e-8c23-4952-9bae-f089b636ee77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:43:21.222520 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a43a9e-8c23-4952-9bae-f089b636ee77 None admin] REQUEST_METHOD: `GET` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:43:21.223004 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a43a9e-8c23-4952-9bae-f089b636ee77 None admin] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:43:21.223781 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a43a9e-8c23-4952-9bae-f089b636ee77 None admin] PATH_INFO: `/v3/projects` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:43:21.225358 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7a43a9e-8c23-4952-9bae-f089b636ee77 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=101892) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:43:21.225914 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7a43a9e-8c23-4952-9bae-f089b636ee77 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:43:21.227721 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7a43a9e-8c23-4952-9bae-f089b636ee77 None admin] RBAC: Authorization granted {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:43:21.229767 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea3d187e-b791-486d-98db-abe525ced106 None None] Authenticating user token {{(pid=101893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:43:21.245731 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 345/710] 10.222.0.84 () {56 vars in 1148 bytes} [Wed May 25 14:43:21 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:43:21.253525 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a43a9e-8c23-4952-9bae-f089b636ee77 None admin] Authenticating user token {{(pid=101892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:43:21.374831 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea3d187e-b791-486d-98db-abe525ced106 None None] Validating token access rules against request {{(pid=101893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:43:21.409151 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a43a9e-8c23-4952-9bae-f089b636ee77 None admin] Validating token access rules against request {{(pid=101892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:43:21.416130 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb9392f-4c8e-49cc-812c-d48a1165029c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:43:21.417216 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb9392f-4c8e-49cc-812c-d48a1165029c None admin] REQUEST_METHOD: `GET` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:43:21.417713 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb9392f-4c8e-49cc-812c-d48a1165029c None admin] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:43:21.418147 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb9392f-4c8e-49cc-812c-d48a1165029c None admin] PATH_INFO: `/v3/services/network` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:43:21.418951 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cb9392f-4c8e-49cc-812c-d48a1165029c None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:43:21.420521 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cb9392f-4c8e-49cc-812c-d48a1165029c None admin] RBAC: Authorization granted {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:43:21.424936 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG dbcounter [-] [101893] Writing DB stats keystone:SELECT=100 {{(pid=101893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:43:21.436744 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application [None req-3cb9392f-4c8e-49cc-812c-d48a1165029c None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. May 25 14:43:21.436744 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:43:21.436744 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 25 14:43:21.436744 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 25 14:43:21.436744 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 25 14:43:21.436744 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 25 14:43:21.436744 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 25 14:43:21.436744 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 25 14:43:21.436744 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. May 25 14:43:21.436744 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application May 25 14:43:21.436744 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 25 14:43:21.436744 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application May 25 14:43:21.436744 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:43:21.436744 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 14:43:21.436744 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 14:43:21.436744 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 14:43:21.436744 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 14:43:21.437780 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 14:43:21.437780 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 14:43:21.437780 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 14:43:21.437780 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 14:43:21.437780 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 14:43:21.437780 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 14:43:21.437780 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 25 14:43:21.437780 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return self._get_service(service_id) May 25 14:43:21.437780 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 25 14:43:21.437780 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 25 14:43:21.437780 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 14:43:21.437780 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 14:43:21.437780 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 14:43:21.437780 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 14:43:21.437780 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 14:43:21.437780 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return self.get_or_create( May 25 14:43:21.438659 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 14:43:21.438659 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application with Lock( May 25 14:43:21.438659 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 14:43:21.438659 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return self._enter() May 25 14:43:21.438659 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 14:43:21.438659 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 14:43:21.438659 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 14:43:21.438659 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return self.creator() May 25 14:43:21.438659 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 14:43:21.438659 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application created_value = creator( May 25 14:43:21.438659 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 25 14:43:21.438659 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 25 14:43:21.438659 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. May 25 14:43:21.438659 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application May 25 14:43:21.446270 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 366/711] 10.222.0.84 () {56 vars in 1111 bytes} [Wed May 25 14:43:21 2022] GET /identity/v3/services/network => generated 88 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 14:43:21.449323 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb9392f-4c8e-49cc-812c-d48a1165029c None admin] Authenticating user token {{(pid=101893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:43:21.449577 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-191dc94f-3818-48fd-a666-01dbdbebfd90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:43:21.450229 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-191dc94f-3818-48fd-a666-01dbdbebfd90 None admin] REQUEST_METHOD: `GET` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:43:21.450514 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-191dc94f-3818-48fd-a666-01dbdbebfd90 None admin] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:43:21.450781 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-191dc94f-3818-48fd-a666-01dbdbebfd90 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:43:21.451811 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-191dc94f-3818-48fd-a666-01dbdbebfd90 None admin] RBAC: Adding query filter params (role.id=a3b78e7d547d4d2d998b4c99a4396bba, scope.project.id=a000829c658c4a7cab67f7b6353ba3fa, user.id=2aeb182e6a5b43cfb0cc347ec847c848) {{(pid=101892) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:43:21.452136 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-191dc94f-3818-48fd-a666-01dbdbebfd90 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:43:21.454433 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-191dc94f-3818-48fd-a666-01dbdbebfd90 None admin] RBAC: Authorization granted {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:43:21.460905 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 346/712] 10.222.0.84 () {56 vars in 1374 bytes} [Wed May 25 14:43:21 2022] GET /identity/v3/role_assignments?user.id=2aeb182e6a5b43cfb0cc347ec847c848&scope.project.id=a000829c658c4a7cab67f7b6353ba3fa&role.id=a3b78e7d547d4d2d998b4c99a4396bba => generated 259 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:43:21.465713 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a523c26e-069f-448b-9bf0-f0afdbfb0fb3 None None] REQUEST_METHOD: `GET` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:43:21.469484 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a523c26e-069f-448b-9bf0-f0afdbfb0fb3 None None] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:43:21.470103 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a523c26e-069f-448b-9bf0-f0afdbfb0fb3 None None] PATH_INFO: `/` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:43:21.475867 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 347/713] 10.222.0.84 () {54 vars in 926 bytes} [Wed May 25 14:43:21 2022] GET /identity => generated 270 bytes in 11 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 14:43:21.485521 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ccf5b9-e7ed-475b-bbac-138429abb40d None None] REQUEST_METHOD: `POST` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:43:21.486186 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ccf5b9-e7ed-475b-bbac-138429abb40d None None] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:43:21.486670 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ccf5b9-e7ed-475b-bbac-138429abb40d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:43:21.522973 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.auth.core [None req-f5ccf5b9-e7ed-475b-bbac-138429abb40d None None] MFA Rules not processed for user `05d87e87798e429aa1c10b24391f915e`. Rule list: `[]` (Enabled: `True`). {{(pid=101892) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:43:21.526353 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.fernet_utils [None req-f5ccf5b9-e7ed-475b-bbac-138429abb40d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=101892) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:43:21.535916 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG dbcounter [-] [101892] Writing DB stats keystone:SELECT=100 {{(pid=101892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:43:21.632399 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 348/714] 10.222.0.84 () {58 vars in 1023 bytes} [Wed May 25 14:43:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 25 14:43:21.668621 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5ccf5b9-e7ed-475b-bbac-138429abb40d None None] Authenticating user token {{(pid=101892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:43:21.706643 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb9392f-4c8e-49cc-812c-d48a1165029c None admin] Validating token access rules against request {{(pid=101893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:43:21.769919 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae1e6dc-bcb7-491b-81e3-736bd026c947 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:43:21.771027 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae1e6dc-bcb7-491b-81e3-736bd026c947 None admin] REQUEST_METHOD: `GET` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:43:21.772041 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae1e6dc-bcb7-491b-81e3-736bd026c947 None admin] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:43:21.772468 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae1e6dc-bcb7-491b-81e3-736bd026c947 None admin] PATH_INFO: `/v3/services` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:43:21.773328 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ae1e6dc-bcb7-491b-81e3-736bd026c947 None admin] RBAC: Adding query filter params (name=network) {{(pid=101893) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:43:21.773837 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ae1e6dc-bcb7-491b-81e3-736bd026c947 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:43:21.775490 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ae1e6dc-bcb7-491b-81e3-736bd026c947 None admin] RBAC: Authorization granted {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:43:21.783719 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5ccf5b9-e7ed-475b-bbac-138429abb40d None None] Validating token access rules against request {{(pid=101892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:43:21.786250 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 367/715] 10.222.0.84 () {56 vars in 1112 bytes} [Wed May 25 14:43:21 2022] GET /identity/v3/services?name=network => generated 124 bytes in 339 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:43:21.792910 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae1e6dc-bcb7-491b-81e3-736bd026c947 None admin] Authenticating user token {{(pid=101893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:43:21.818980 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b27e5f-e1fd-4419-8372-f912ff3b1108 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:43:21.819879 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b27e5f-e1fd-4419-8372-f912ff3b1108 None admin] REQUEST_METHOD: `GET` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:43:21.820164 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b27e5f-e1fd-4419-8372-f912ff3b1108 None admin] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:43:21.820436 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b27e5f-e1fd-4419-8372-f912ff3b1108 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:43:21.837630 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG dbcounter [-] [101892] Writing DB stats keystone:SELECT=100 {{(pid=101892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:43:21.842110 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73b27e5f-e1fd-4419-8372-f912ff3b1108 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:43:21.843581 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73b27e5f-e1fd-4419-8372-f912ff3b1108 None admin] RBAC: Authorization granted {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:43:21.876481 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application [None req-73b27e5f-e1fd-4419-8372-f912ff3b1108 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 25 14:43:21.876481 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:43:21.876481 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 14:43:21.876481 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 14:43:21.876481 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 14:43:21.876481 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 14:43:21.876481 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 14:43:21.876481 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 14:43:21.876481 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 14:43:21.876481 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 14:43:21.876481 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 14:43:21.876481 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 14:43:21.876481 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 25 14:43:21.876481 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 25 14:43:21.876481 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 25 14:43:21.877474 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 25 14:43:21.877474 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 14:43:21.877474 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 14:43:21.877474 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 14:43:21.877474 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 14:43:21.877474 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 14:43:21.877474 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application return self.get_or_create( May 25 14:43:21.877474 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 14:43:21.877474 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application with Lock( May 25 14:43:21.877474 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 14:43:21.877474 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application return self._enter() May 25 14:43:21.877474 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 14:43:21.877474 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 14:43:21.877474 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 14:43:21.877474 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application return self.creator() May 25 14:43:21.877474 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 14:43:21.877474 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application created_value = creator( May 25 14:43:21.878417 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 25 14:43:21.878417 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 25 14:43:21.878417 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 25 14:43:21.878417 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application May 25 14:43:21.888688 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 349/716] 10.222.0.84 () {56 vars in 1108 bytes} [Wed May 25 14:43:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 25 14:43:21.889528 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b27e5f-e1fd-4419-8372-f912ff3b1108 None admin] Authenticating user token {{(pid=101892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:43:21.921974 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG dbcounter [-] [101893] Writing DB stats keystone:SELECT=100 {{(pid=101893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:43:21.970186 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae1e6dc-bcb7-491b-81e3-736bd026c947 None admin] Validating token access rules against request {{(pid=101893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:43:22.008778 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb75d741-3bc3-497d-a054-15b458df810b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:43:22.009460 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb75d741-3bc3-497d-a054-15b458df810b None admin] REQUEST_METHOD: `GET` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:43:22.009746 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb75d741-3bc3-497d-a054-15b458df810b None admin] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:43:22.010028 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb75d741-3bc3-497d-a054-15b458df810b None admin] PATH_INFO: `/v3/services` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:43:22.010741 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb75d741-3bc3-497d-a054-15b458df810b None admin] RBAC: Adding query filter params (type=network) {{(pid=101893) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:43:22.011050 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb75d741-3bc3-497d-a054-15b458df810b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:43:22.012458 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb75d741-3bc3-497d-a054-15b458df810b None admin] RBAC: Authorization granted {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:43:22.019062 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 368/717] 10.222.0.84 () {56 vars in 1112 bytes} [Wed May 25 14:43:21 2022] GET /identity/v3/services?type=network => generated 124 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:43:22.082966 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b27e5f-e1fd-4419-8372-f912ff3b1108 None admin] Validating token access rules against request {{(pid=101892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:43:22.120887 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85f8d38f-8d30-4485-bc3c-5d43fe856b78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:43:22.121449 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f8d38f-8d30-4485-bc3c-5d43fe856b78 None admin] REQUEST_METHOD: `GET` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:43:22.121731 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f8d38f-8d30-4485-bc3c-5d43fe856b78 None admin] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:43:22.122007 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f8d38f-8d30-4485-bc3c-5d43fe856b78 None admin] PATH_INFO: `/v3/domains` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:43:22.123007 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85f8d38f-8d30-4485-bc3c-5d43fe856b78 None admin] RBAC: Adding query filter params (name=Default) {{(pid=101892) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:43:22.123316 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85f8d38f-8d30-4485-bc3c-5d43fe856b78 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:43:22.124843 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85f8d38f-8d30-4485-bc3c-5d43fe856b78 None admin] RBAC: Authorization granted {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:43:22.139305 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 350/718] 10.222.0.84 () {56 vars in 1109 bytes} [Wed May 25 14:43:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:43:22.144542 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb75d741-3bc3-497d-a054-15b458df810b None admin] Authenticating user token {{(pid=101893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:43:22.257845 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb75d741-3bc3-497d-a054-15b458df810b None admin] Validating token access rules against request {{(pid=101893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:43:22.285299 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG dbcounter [-] [101893] Writing DB stats keystone:SELECT=100 {{(pid=101893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:43:22.293033 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bf329df-5e8f-4a67-8712-27d6edaf1909 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:43:22.293709 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf329df-5e8f-4a67-8712-27d6edaf1909 None admin] REQUEST_METHOD: `POST` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:43:22.293989 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf329df-5e8f-4a67-8712-27d6edaf1909 None admin] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:43:22.294260 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf329df-5e8f-4a67-8712-27d6edaf1909 None admin] PATH_INFO: `/v3/users` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:43:22.294951 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bf329df-5e8f-4a67-8712-27d6edaf1909 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:43:22.296418 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bf329df-5e8f-4a67-8712-27d6edaf1909 None admin] RBAC: Authorization granted {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:43:22.374559 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 369/719] 10.222.0.84 () {60 vars in 1132 bytes} [Wed May 25 14:43:22 2022] POST /identity/v3/users => generated 254 bytes in 231 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 14:43:23.206868 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-837f25c4-23c9-4a82-8ce4-fcda17cd3ad8 None None] REQUEST_METHOD: `GET` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:43:23.207394 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-837f25c4-23c9-4a82-8ce4-fcda17cd3ad8 None None] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:43:23.207475 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-837f25c4-23c9-4a82-8ce4-fcda17cd3ad8 None None] PATH_INFO: `/` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:43:23.209068 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 351/720] 10.222.0.84 () {54 vars in 926 bytes} [Wed May 25 14:43:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 14:43:23.214568 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126828db-d292-408e-b0df-30d4432745d4 None None] REQUEST_METHOD: `POST` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:43:23.214974 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126828db-d292-408e-b0df-30d4432745d4 None None] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:43:23.215170 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126828db-d292-408e-b0df-30d4432745d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:43:23.241130 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.auth.core [None req-126828db-d292-408e-b0df-30d4432745d4 None None] MFA Rules not processed for user `05d87e87798e429aa1c10b24391f915e`. Rule list: `[]` (Enabled: `True`). {{(pid=101893) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:43:23.242336 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.fernet_utils [None req-126828db-d292-408e-b0df-30d4432745d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=101893) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:43:23.334034 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 370/721] 10.222.0.84 () {58 vars in 1023 bytes} [Wed May 25 14:43:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 25 14:43:23.368872 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-837f25c4-23c9-4a82-8ce4-fcda17cd3ad8 None None] Authenticating user token {{(pid=101892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:43:23.434716 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG dbcounter [-] [101892] Writing DB stats keystone:SELECT=100 {{(pid=101892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:43:23.483894 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-837f25c4-23c9-4a82-8ce4-fcda17cd3ad8 None None] Validating token access rules against request {{(pid=101892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:43:23.519404 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4e2820d-4f63-4398-ac2e-6ac33b491734 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:43:23.520225 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e2820d-4f63-4398-ac2e-6ac33b491734 None admin] REQUEST_METHOD: `POST` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:43:23.520514 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e2820d-4f63-4398-ac2e-6ac33b491734 None admin] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:43:23.520791 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e2820d-4f63-4398-ac2e-6ac33b491734 None admin] PATH_INFO: `/v3/services` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:43:23.522158 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4e2820d-4f63-4398-ac2e-6ac33b491734 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:43:23.523593 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4e2820d-4f63-4398-ac2e-6ac33b491734 None admin] RBAC: Authorization granted {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:43:23.671789 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 352/722] 10.222.0.84 () {60 vars in 1141 bytes} [Wed May 25 14:43:23 2022] POST /identity/v3/services => generated 251 bytes in 303 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 14:43:23.865504 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20503eb4-6b03-4cd0-873d-acd7ea2d39ce None None] REQUEST_METHOD: `GET` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:43:23.865922 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20503eb4-6b03-4cd0-873d-acd7ea2d39ce None None] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:43:23.866043 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20503eb4-6b03-4cd0-873d-acd7ea2d39ce None None] PATH_INFO: `/` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:43:23.867771 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 371/723] 10.222.0.84 () {54 vars in 926 bytes} [Wed May 25 14:43:23 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 14:43:23.873473 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b21824-2145-4930-96b1-3f14e15efbb1 None None] REQUEST_METHOD: `POST` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:43:23.873764 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b21824-2145-4930-96b1-3f14e15efbb1 None None] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:43:23.874030 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b21824-2145-4930-96b1-3f14e15efbb1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:43:23.896863 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.auth.core [None req-b4b21824-2145-4930-96b1-3f14e15efbb1 None None] MFA Rules not processed for user `05d87e87798e429aa1c10b24391f915e`. Rule list: `[]` (Enabled: `True`). {{(pid=101892) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:43:23.898159 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.fernet_utils [None req-b4b21824-2145-4930-96b1-3f14e15efbb1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=101892) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:43:23.985841 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 353/724] 10.222.0.84 () {58 vars in 1023 bytes} [Wed May 25 14:43:23 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 25 14:43:24.010791 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20503eb4-6b03-4cd0-873d-acd7ea2d39ce None None] Authenticating user token {{(pid=101893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:43:24.128862 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20503eb4-6b03-4cd0-873d-acd7ea2d39ce None None] Validating token access rules against request {{(pid=101893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:43:24.145980 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG dbcounter [-] [101893] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=101893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:43:24.162795 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9a745b-3633-412a-b18a-e4c4ef1f397f None None] REQUEST_METHOD: `GET` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:43:24.163366 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9a745b-3633-412a-b18a-e4c4ef1f397f None None] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:43:24.171465 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9a745b-3633-412a-b18a-e4c4ef1f397f None None] PATH_INFO: `/` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:43:24.171465 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 354/725] 10.222.0.84 () {54 vars in 926 bytes} [Wed May 25 14:43:24 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 14:43:24.171703 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3045df6-3375-4236-8030-2d7ccb099755 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:43:24.171703 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3045df6-3375-4236-8030-2d7ccb099755 None admin] REQUEST_METHOD: `GET` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:43:24.171703 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3045df6-3375-4236-8030-2d7ccb099755 None admin] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:43:24.171703 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3045df6-3375-4236-8030-2d7ccb099755 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:43:24.173731 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e94ebaa-7bc4-467c-bbde-97d90fbe9ccc None None] REQUEST_METHOD: `POST` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:43:24.174168 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e94ebaa-7bc4-467c-bbde-97d90fbe9ccc None None] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:43:24.174551 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e94ebaa-7bc4-467c-bbde-97d90fbe9ccc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:43:24.183973 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3045df6-3375-4236-8030-2d7ccb099755 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 14:43:24.192672 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application [None req-e3045df6-3375-4236-8030-2d7ccb099755 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 25 14:43:24.192672 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:43:24.192672 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 14:43:24.192672 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 14:43:24.192672 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 14:43:24.192672 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 14:43:24.192672 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 14:43:24.192672 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 14:43:24.192672 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 14:43:24.192672 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 14:43:24.192672 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 14:43:24.192672 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 14:43:24.192672 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 14:43:24.192672 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 14:43:24.192672 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 14:43:24.192672 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 14:43:24.194599 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 14:43:24.194599 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 14:43:24.194599 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 14:43:24.194599 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 14:43:24.194599 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 14:43:24.194599 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 14:43:24.194599 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 14:43:24.194599 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 14:43:24.194599 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 14:43:24.194599 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return self.get_or_create( May 25 14:43:24.194599 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 14:43:24.194599 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application with Lock( May 25 14:43:24.194599 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 14:43:24.194599 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return self._enter() May 25 14:43:24.194599 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 14:43:24.194599 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 14:43:24.195689 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 14:43:24.195689 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return self.creator() May 25 14:43:24.195689 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 14:43:24.195689 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application created_value = creator( May 25 14:43:24.195689 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 14:43:24.195689 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 14:43:24.195689 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 14:43:24.195689 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 14:43:24.195689 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 14:43:24.195689 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 14:43:24.195689 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 25 14:43:24.195689 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application May 25 14:43:24.203410 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 372/726] 10.222.0.84 () {56 vars in 1096 bytes} [Wed May 25 14:43:24 2022] GET /identity/v3/roles/admin => generated 83 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 14:43:24.204305 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.auth.core [None req-1e94ebaa-7bc4-467c-bbde-97d90fbe9ccc None None] MFA Rules not processed for user `05d87e87798e429aa1c10b24391f915e`. Rule list: `[]` (Enabled: `True`). {{(pid=101892) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:43:24.204636 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3045df6-3375-4236-8030-2d7ccb099755 None admin] Authenticating user token {{(pid=101893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:43:24.206436 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.fernet_utils [None req-1e94ebaa-7bc4-467c-bbde-97d90fbe9ccc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=101892) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:43:24.247636 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG dbcounter [-] [101892] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=101892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:43:24.322894 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3045df6-3375-4236-8030-2d7ccb099755 None admin] Validating token access rules against request {{(pid=101893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:43:24.358338 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37b06492-96a5-4bca-af0a-3ac3e91a3125 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:43:24.359013 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b06492-96a5-4bca-af0a-3ac3e91a3125 None admin] REQUEST_METHOD: `GET` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:43:24.359298 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b06492-96a5-4bca-af0a-3ac3e91a3125 None admin] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:43:24.359599 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b06492-96a5-4bca-af0a-3ac3e91a3125 None admin] PATH_INFO: `/v3/roles` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:43:24.360512 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37b06492-96a5-4bca-af0a-3ac3e91a3125 None admin] RBAC: Adding query filter params (name=admin) {{(pid=101893) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:43:24.360829 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37b06492-96a5-4bca-af0a-3ac3e91a3125 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:43:24.362467 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37b06492-96a5-4bca-af0a-3ac3e91a3125 None admin] RBAC: Authorization granted {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:43:24.373149 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 373/727] 10.222.0.84 () {56 vars in 1099 bytes} [Wed May 25 14:43:24 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:43:24.377972 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 355/728] 10.222.0.84 () {58 vars in 1023 bytes} [Wed May 25 14:43:24 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 25 14:43:24.378762 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37b06492-96a5-4bca-af0a-3ac3e91a3125 None admin] Authenticating user token {{(pid=101893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:43:24.412820 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e94ebaa-7bc4-467c-bbde-97d90fbe9ccc None None] Authenticating user token {{(pid=101892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:43:24.431902 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG dbcounter [-] [101893] Writing DB stats keystone:SELECT=100 {{(pid=101893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:43:24.534844 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37b06492-96a5-4bca-af0a-3ac3e91a3125 None admin] Validating token access rules against request {{(pid=101893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:43:24.580225 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a0359fc-ab1b-4a33-9d1e-91f4fd391a22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:43:24.581041 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a0359fc-ab1b-4a33-9d1e-91f4fd391a22 None admin] REQUEST_METHOD: `GET` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:43:24.581325 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a0359fc-ab1b-4a33-9d1e-91f4fd391a22 None admin] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:43:24.581601 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a0359fc-ab1b-4a33-9d1e-91f4fd391a22 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:43:24.596519 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a0359fc-ab1b-4a33-9d1e-91f4fd391a22 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:43:24.600446 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a0359fc-ab1b-4a33-9d1e-91f4fd391a22 None admin] RBAC: Authorization granted {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:43:24.624980 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application [None req-7a0359fc-ab1b-4a33-9d1e-91f4fd391a22 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 25 14:43:24.624980 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:43:24.624980 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 14:43:24.624980 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 14:43:24.624980 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 14:43:24.624980 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 14:43:24.624980 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 14:43:24.624980 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 14:43:24.624980 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 14:43:24.624980 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 14:43:24.624980 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 14:43:24.624980 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 14:43:24.624980 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 25 14:43:24.624980 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 25 14:43:24.624980 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 25 14:43:24.625965 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 25 14:43:24.625965 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 14:43:24.625965 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 14:43:24.625965 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 14:43:24.625965 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 14:43:24.625965 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 14:43:24.625965 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return self.get_or_create( May 25 14:43:24.625965 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 14:43:24.625965 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application with Lock( May 25 14:43:24.625965 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 14:43:24.625965 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return self._enter() May 25 14:43:24.625965 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 14:43:24.625965 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 14:43:24.625965 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 14:43:24.625965 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return self.creator() May 25 14:43:24.625965 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 14:43:24.625965 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application created_value = creator( May 25 14:43:24.626932 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 25 14:43:24.626932 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 25 14:43:24.626932 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 25 14:43:24.626932 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application May 25 14:43:24.626932 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 374/729] 10.222.0.84 () {56 vars in 1108 bytes} [Wed May 25 14:43:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 248 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 14:43:24.629810 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e94ebaa-7bc4-467c-bbde-97d90fbe9ccc None None] Validating token access rules against request {{(pid=101892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:43:24.632415 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a0359fc-ab1b-4a33-9d1e-91f4fd391a22 None admin] Authenticating user token {{(pid=101893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:43:24.666255 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0585b708-f58b-41c0-b08e-167b5a8eaa3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:43:24.666937 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0585b708-f58b-41c0-b08e-167b5a8eaa3a None admin] REQUEST_METHOD: `GET` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:43:24.667259 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0585b708-f58b-41c0-b08e-167b5a8eaa3a None admin] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:43:24.667540 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0585b708-f58b-41c0-b08e-167b5a8eaa3a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:43:24.678168 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0585b708-f58b-41c0-b08e-167b5a8eaa3a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 14:43:24.685899 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application [None req-0585b708-f58b-41c0-b08e-167b5a8eaa3a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 25 14:43:24.685899 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:43:24.685899 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 14:43:24.685899 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 14:43:24.685899 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 14:43:24.685899 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 14:43:24.685899 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 14:43:24.685899 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 14:43:24.685899 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 14:43:24.685899 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 14:43:24.685899 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 14:43:24.685899 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 14:43:24.685899 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 14:43:24.685899 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 14:43:24.685899 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 14:43:24.685899 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 14:43:24.686852 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 14:43:24.686852 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 14:43:24.686852 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 14:43:24.686852 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 14:43:24.686852 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 14:43:24.686852 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 14:43:24.686852 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 14:43:24.686852 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 14:43:24.686852 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 14:43:24.686852 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application return self.get_or_create( May 25 14:43:24.686852 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 14:43:24.686852 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application with Lock( May 25 14:43:24.686852 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 14:43:24.686852 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application return self._enter() May 25 14:43:24.686852 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 14:43:24.686852 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 14:43:24.687725 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 14:43:24.687725 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application return self.creator() May 25 14:43:24.687725 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 14:43:24.687725 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application created_value = creator( May 25 14:43:24.687725 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 14:43:24.687725 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 14:43:24.687725 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 14:43:24.687725 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 14:43:24.687725 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 14:43:24.687725 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 14:43:24.687725 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 25 14:43:24.687725 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application May 25 14:43:24.687725 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 356/730] 10.222.0.84 () {56 vars in 1096 bytes} [Wed May 25 14:43:24 2022] GET /identity/v3/roles/admin => generated 83 bytes in 276 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 25 14:43:24.693388 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0585b708-f58b-41c0-b08e-167b5a8eaa3a None admin] Authenticating user token {{(pid=101892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:43:24.748139 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG dbcounter [-] [101892] Writing DB stats keystone:SELECT=100 {{(pid=101892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:43:24.787586 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG dbcounter [-] [101893] Writing DB stats keystone:SELECT=100 {{(pid=101893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:43:24.802570 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a0359fc-ab1b-4a33-9d1e-91f4fd391a22 None admin] Validating token access rules against request {{(pid=101893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:43:24.827136 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0585b708-f58b-41c0-b08e-167b5a8eaa3a None admin] Validating token access rules against request {{(pid=101892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:43:24.844565 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8728548-36de-49b6-88bb-0b0efcc9ca82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:43:24.845236 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8728548-36de-49b6-88bb-0b0efcc9ca82 None admin] REQUEST_METHOD: `GET` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:43:24.845522 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8728548-36de-49b6-88bb-0b0efcc9ca82 None admin] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:43:24.845803 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8728548-36de-49b6-88bb-0b0efcc9ca82 None admin] PATH_INFO: `/v3/domains` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:43:24.846539 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8728548-36de-49b6-88bb-0b0efcc9ca82 None admin] RBAC: Adding query filter params (name=Default) {{(pid=101893) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:43:24.846847 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8728548-36de-49b6-88bb-0b0efcc9ca82 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:43:24.848281 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8728548-36de-49b6-88bb-0b0efcc9ca82 None admin] RBAC: Authorization granted {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:43:24.861712 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 375/731] 10.222.0.84 () {56 vars in 1109 bytes} [Wed May 25 14:43:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 14:43:24.863129 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c06977-588e-4013-a011-1dc6c123aa8a None None] REQUEST_METHOD: `GET` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:43:24.863424 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c06977-588e-4013-a011-1dc6c123aa8a None None] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:43:24.863734 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c06977-588e-4013-a011-1dc6c123aa8a None None] PATH_INFO: `/` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:43:24.869453 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 376/732] 10.222.0.84 () {54 vars in 926 bytes} [Wed May 25 14:43:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 14:43:24.870256 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76c06977-588e-4013-a011-1dc6c123aa8a None None] Authenticating user token {{(pid=101893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:43:24.871190 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-788c7cd1-eaae-4de7-89c4-21788ff19ead None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:43:24.871947 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788c7cd1-eaae-4de7-89c4-21788ff19ead None admin] REQUEST_METHOD: `GET` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:43:24.872557 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788c7cd1-eaae-4de7-89c4-21788ff19ead None admin] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:43:24.872900 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788c7cd1-eaae-4de7-89c4-21788ff19ead None admin] PATH_INFO: `/v3/roles` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:43:24.874000 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-788c7cd1-eaae-4de7-89c4-21788ff19ead None admin] RBAC: Adding query filter params (name=admin) {{(pid=101892) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:43:24.874398 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-788c7cd1-eaae-4de7-89c4-21788ff19ead None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:43:24.876684 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-788c7cd1-eaae-4de7-89c4-21788ff19ead None admin] RBAC: Authorization granted {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:43:24.888136 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 357/733] 10.222.0.84 () {56 vars in 1099 bytes} [Wed May 25 14:43:24 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 14:43:24.893021 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ecaec2-d86a-4524-8d42-d76b945285a5 None None] REQUEST_METHOD: `POST` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:43:24.893317 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ecaec2-d86a-4524-8d42-d76b945285a5 None None] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:43:24.893598 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ecaec2-d86a-4524-8d42-d76b945285a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:43:24.918224 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.auth.core [None req-34ecaec2-d86a-4524-8d42-d76b945285a5 None None] MFA Rules not processed for user `05d87e87798e429aa1c10b24391f915e`. Rule list: `[]` (Enabled: `True`). {{(pid=101892) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:43:24.919759 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.fernet_utils [None req-34ecaec2-d86a-4524-8d42-d76b945285a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=101892) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:43:24.995366 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76c06977-588e-4013-a011-1dc6c123aa8a None None] Validating token access rules against request {{(pid=101893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:43:25.019776 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 358/734] 10.222.0.84 () {58 vars in 1023 bytes} [Wed May 25 14:43:24 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 25 14:43:25.020667 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34ecaec2-d86a-4524-8d42-d76b945285a5 None None] Authenticating user token {{(pid=101892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:43:25.038547 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e99dfb3c-e74f-4c85-85d8-d52ec17ce62e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:43:25.040067 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99dfb3c-e74f-4c85-85d8-d52ec17ce62e None admin] REQUEST_METHOD: `GET` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:43:25.040578 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99dfb3c-e74f-4c85-85d8-d52ec17ce62e None admin] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:43:25.041050 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99dfb3c-e74f-4c85-85d8-d52ec17ce62e None admin] PATH_INFO: `/v3/users/swift` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:43:25.049656 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e99dfb3c-e74f-4c85-85d8-d52ec17ce62e None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:43:25.051872 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e99dfb3c-e74f-4c85-85d8-d52ec17ce62e None admin] RBAC: Authorization granted {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:43:25.060578 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG dbcounter [-] [101892] Writing DB stats keystone:SELECT=100 {{(pid=101892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:43:25.073036 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application [None req-e99dfb3c-e74f-4c85-85d8-d52ec17ce62e None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. May 25 14:43:25.073036 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:43:25.073036 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 14:43:25.073036 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 14:43:25.073036 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 14:43:25.073036 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 14:43:25.073036 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 14:43:25.073036 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 14:43:25.073036 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 14:43:25.073036 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 14:43:25.073036 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 14:43:25.073036 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 14:43:25.073036 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 25 14:43:25.073036 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return self._get_user(user_id) May 25 14:43:25.073036 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 25 14:43:25.073036 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 25 14:43:25.073982 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 14:43:25.073982 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 14:43:25.073982 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 25 14:43:25.073982 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 25 14:43:25.073982 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 25 14:43:25.073982 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 25 14:43:25.073982 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 14:43:25.073982 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 14:43:25.073982 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 14:43:25.073982 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return self.get_or_create( May 25 14:43:25.073982 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 14:43:25.073982 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application with Lock( May 25 14:43:25.073982 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 14:43:25.073982 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return self._enter() May 25 14:43:25.073982 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 14:43:25.073982 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 14:43:25.073982 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 14:43:25.073982 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return self.creator() May 25 14:43:25.074923 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 14:43:25.074923 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application created_value = creator( May 25 14:43:25.074923 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 25 14:43:25.074923 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 25 14:43:25.074923 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 25 14:43:25.074923 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 25 14:43:25.074923 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 25 14:43:25.074923 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 25 14:43:25.074923 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. May 25 14:43:25.074923 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application May 25 14:43:25.078054 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 377/735] 10.222.0.84 () {56 vars in 1096 bytes} [Wed May 25 14:43:24 2022] GET /identity/v3/users/swift => generated 83 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 14:43:25.079097 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e99dfb3c-e74f-4c85-85d8-d52ec17ce62e None admin] Authenticating user token {{(pid=101893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:43:25.093570 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG dbcounter [-] [101893] Writing DB stats keystone:SELECT=100 {{(pid=101893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:43:25.153989 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34ecaec2-d86a-4524-8d42-d76b945285a5 None None] Validating token access rules against request {{(pid=101892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:43:25.192815 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e99dfb3c-e74f-4c85-85d8-d52ec17ce62e None admin] Validating token access rules against request {{(pid=101893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:43:25.195916 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e334d75-8a58-4f4b-b2b1-877d4b5dcb36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:43:25.197050 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e334d75-8a58-4f4b-b2b1-877d4b5dcb36 None admin] REQUEST_METHOD: `GET` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:43:25.197404 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e334d75-8a58-4f4b-b2b1-877d4b5dcb36 None admin] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:43:25.197776 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e334d75-8a58-4f4b-b2b1-877d4b5dcb36 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:43:25.209993 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e334d75-8a58-4f4b-b2b1-877d4b5dcb36 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:43:25.211672 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e334d75-8a58-4f4b-b2b1-877d4b5dcb36 None admin] RBAC: Authorization granted {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:43:25.232847 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad0dc34-3110-4df9-a334-11a7aafa4aa0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:43:25.235378 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application [None req-1e334d75-8a58-4f4b-b2b1-877d4b5dcb36 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 25 14:43:25.235378 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:43:25.235378 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 14:43:25.235378 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 14:43:25.235378 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 14:43:25.235378 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 14:43:25.235378 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 14:43:25.235378 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 14:43:25.235378 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 14:43:25.235378 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 14:43:25.235378 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 14:43:25.235378 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 14:43:25.235378 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 25 14:43:25.235378 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 25 14:43:25.235378 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 25 14:43:25.236289 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 25 14:43:25.236289 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 14:43:25.236289 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 14:43:25.236289 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 14:43:25.236289 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 14:43:25.236289 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 14:43:25.236289 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application return self.get_or_create( May 25 14:43:25.236289 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 14:43:25.236289 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application with Lock( May 25 14:43:25.236289 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 14:43:25.236289 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application return self._enter() May 25 14:43:25.236289 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 14:43:25.236289 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 14:43:25.236289 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 14:43:25.236289 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application return self.creator() May 25 14:43:25.236289 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 14:43:25.236289 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application created_value = creator( May 25 14:43:25.237178 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 25 14:43:25.237178 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 25 14:43:25.237178 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 25 14:43:25.237178 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application May 25 14:43:25.237489 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad0dc34-3110-4df9-a334-11a7aafa4aa0 None admin] REQUEST_METHOD: `POST` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:43:25.237489 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad0dc34-3110-4df9-a334-11a7aafa4aa0 None admin] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:43:25.237489 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad0dc34-3110-4df9-a334-11a7aafa4aa0 None admin] PATH_INFO: `/v3/services` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:43:25.237489 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ad0dc34-3110-4df9-a334-11a7aafa4aa0 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:43:25.237730 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 359/736] 10.222.0.84 () {56 vars in 1108 bytes} [Wed May 25 14:43:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 14:43:25.237800 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ad0dc34-3110-4df9-a334-11a7aafa4aa0 None admin] RBAC: Authorization granted {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:43:25.237868 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e334d75-8a58-4f4b-b2b1-877d4b5dcb36 None admin] Authenticating user token {{(pid=101892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:43:25.345282 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 378/737] 10.222.0.84 () {60 vars in 1141 bytes} [Wed May 25 14:43:25 2022] POST /identity/v3/services => generated 240 bytes in 266 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 14:43:25.346014 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad0dc34-3110-4df9-a334-11a7aafa4aa0 None admin] Authenticating user token {{(pid=101893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:43:25.402337 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG dbcounter [-] [101892] Writing DB stats keystone:SELECT=100 {{(pid=101892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:43:25.442686 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e334d75-8a58-4f4b-b2b1-877d4b5dcb36 None admin] Validating token access rules against request {{(pid=101892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:43:25.446034 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG dbcounter [-] [101893] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=101893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:43:25.489669 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d0984c-1e02-4338-bd43-3fdf5ccfb7af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:43:25.490985 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d0984c-1e02-4338-bd43-3fdf5ccfb7af None admin] REQUEST_METHOD: `GET` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:43:25.491341 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d0984c-1e02-4338-bd43-3fdf5ccfb7af None admin] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:43:25.491773 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d0984c-1e02-4338-bd43-3fdf5ccfb7af None admin] PATH_INFO: `/v3/users` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:43:25.492817 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5d0984c-1e02-4338-bd43-3fdf5ccfb7af None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=101892) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:43:25.493218 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5d0984c-1e02-4338-bd43-3fdf5ccfb7af None admin] RBAC: Authorizing `identity:list_users()` {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:43:25.493329 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad0dc34-3110-4df9-a334-11a7aafa4aa0 None admin] Validating token access rules against request {{(pid=101893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:43:25.494819 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5d0984c-1e02-4338-bd43-3fdf5ccfb7af None admin] RBAC: Authorization granted {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:43:25.516757 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 360/738] 10.222.0.84 () {56 vars in 1135 bytes} [Wed May 25 14:43:25 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 280 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:43:25.518335 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eeca12b-6270-40ce-99c3-b6e51d745333 None None] REQUEST_METHOD: `GET` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:43:25.518699 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eeca12b-6270-40ce-99c3-b6e51d745333 None None] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:43:25.519055 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eeca12b-6270-40ce-99c3-b6e51d745333 None None] PATH_INFO: `/` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:43:25.520408 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 361/739] 10.222.0.84 () {54 vars in 926 bytes} [Wed May 25 14:43:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 14:43:25.526169 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eeca12b-6270-40ce-99c3-b6e51d745333 None None] Authenticating user token {{(pid=101892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:43:25.543387 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d446453f-322e-4fbe-b0b5-f2d47740b3cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:43:25.544103 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d446453f-322e-4fbe-b0b5-f2d47740b3cf None admin] REQUEST_METHOD: `GET` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:43:25.544821 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d446453f-322e-4fbe-b0b5-f2d47740b3cf None admin] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:43:25.545104 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d446453f-322e-4fbe-b0b5-f2d47740b3cf None admin] PATH_INFO: `/v3/domains` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:43:25.546133 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d446453f-322e-4fbe-b0b5-f2d47740b3cf None admin] RBAC: Adding query filter params (name=Default) {{(pid=101893) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:43:25.546449 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d446453f-322e-4fbe-b0b5-f2d47740b3cf None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:43:25.548075 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d446453f-322e-4fbe-b0b5-f2d47740b3cf None admin] RBAC: Authorization granted {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:43:25.562251 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 379/740] 10.222.0.84 () {56 vars in 1109 bytes} [Wed May 25 14:43:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:43:25.564409 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c2f776-c934-44da-b988-860c4b55366a None None] REQUEST_METHOD: `POST` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:43:25.564711 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c2f776-c934-44da-b988-860c4b55366a None None] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:43:25.564989 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c2f776-c934-44da-b988-860c4b55366a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:43:25.586086 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.auth.core [None req-c0c2f776-c934-44da-b988-860c4b55366a None None] MFA Rules not processed for user `05d87e87798e429aa1c10b24391f915e`. Rule list: `[]` (Enabled: `True`). {{(pid=101893) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:43:25.587747 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.fernet_utils [None req-c0c2f776-c934-44da-b988-860c4b55366a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=101893) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:43:25.665244 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eeca12b-6270-40ce-99c3-b6e51d745333 None None] Validating token access rules against request {{(pid=101892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:43:25.676026 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 380/741] 10.222.0.84 () {58 vars in 1023 bytes} [Wed May 25 14:43:25 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 25 14:43:25.677048 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0c2f776-c934-44da-b988-860c4b55366a None None] Authenticating user token {{(pid=101893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:43:25.705428 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG dbcounter [-] [101892] Writing DB stats keystone:SELECT=100 {{(pid=101892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:43:25.715425 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee739f80-8d78-4a3d-bf83-838ca5195d2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:43:25.717191 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee739f80-8d78-4a3d-bf83-838ca5195d2d None admin] REQUEST_METHOD: `GET` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:43:25.720853 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee739f80-8d78-4a3d-bf83-838ca5195d2d None admin] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:43:25.720853 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee739f80-8d78-4a3d-bf83-838ca5195d2d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:43:25.742025 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG dbcounter [-] [101893] Writing DB stats keystone:SELECT=100 {{(pid=101893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:43:25.799129 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0c2f776-c934-44da-b988-860c4b55366a None None] Validating token access rules against request {{(pid=101893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:43:25.801096 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee739f80-8d78-4a3d-bf83-838ca5195d2d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:43:25.803023 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee739f80-8d78-4a3d-bf83-838ca5195d2d None admin] RBAC: Authorization granted {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:43:25.845019 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b958cfc-847f-4ee0-b6b6-8575b0df9c9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:43:25.846674 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b958cfc-847f-4ee0-b6b6-8575b0df9c9b None admin] REQUEST_METHOD: `GET` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:43:25.847179 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b958cfc-847f-4ee0-b6b6-8575b0df9c9b None admin] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:43:25.847672 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b958cfc-847f-4ee0-b6b6-8575b0df9c9b None admin] PATH_INFO: `/v3/users/nova` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:43:25.858248 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b958cfc-847f-4ee0-b6b6-8575b0df9c9b None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:43:25.860305 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b958cfc-847f-4ee0-b6b6-8575b0df9c9b None admin] RBAC: Authorization granted {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:43:25.882604 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application [None req-8b958cfc-847f-4ee0-b6b6-8575b0df9c9b None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 25 14:43:25.882604 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:43:25.882604 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 14:43:25.882604 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 14:43:25.882604 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 14:43:25.882604 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 14:43:25.882604 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 14:43:25.882604 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 14:43:25.882604 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 14:43:25.882604 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 14:43:25.882604 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 14:43:25.882604 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 14:43:25.882604 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 25 14:43:25.882604 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return self._get_user(user_id) May 25 14:43:25.882604 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 25 14:43:25.882604 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 25 14:43:25.883655 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 14:43:25.883655 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 14:43:25.883655 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 25 14:43:25.883655 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 25 14:43:25.883655 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 25 14:43:25.883655 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 25 14:43:25.883655 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 14:43:25.883655 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 14:43:25.883655 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 14:43:25.883655 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return self.get_or_create( May 25 14:43:25.883655 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 14:43:25.883655 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application with Lock( May 25 14:43:25.883655 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 14:43:25.883655 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return self._enter() May 25 14:43:25.883655 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 14:43:25.883655 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 14:43:25.883655 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 14:43:25.883655 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return self.creator() May 25 14:43:25.884607 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 14:43:25.884607 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application created_value = creator( May 25 14:43:25.884607 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 25 14:43:25.884607 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 25 14:43:25.884607 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 25 14:43:25.884607 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 25 14:43:25.884607 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 25 14:43:25.884607 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 25 14:43:25.884607 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 25 14:43:25.884607 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application May 25 14:43:25.887741 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 381/742] 10.222.0.84 () {56 vars in 1093 bytes} [Wed May 25 14:43:25 2022] GET /identity/v3/users/nova => generated 82 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 14:43:25.889135 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b958cfc-847f-4ee0-b6b6-8575b0df9c9b None admin] Authenticating user token {{(pid=101893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:43:25.919696 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 362/743] 10.222.0.84 () {58 vars in 1282 bytes} [Wed May 25 14:43:25 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 390 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) May 25 14:43:25.920699 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee739f80-8d78-4a3d-bf83-838ca5195d2d None admin] Authenticating user token {{(pid=101892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:43:25.952197 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG dbcounter [-] [101892] Writing DB stats keystone:SELECT=100 {{(pid=101892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:43:26.026550 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b958cfc-847f-4ee0-b6b6-8575b0df9c9b None admin] Validating token access rules against request {{(pid=101893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:43:26.033232 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee739f80-8d78-4a3d-bf83-838ca5195d2d None admin] Validating token access rules against request {{(pid=101892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:43:26.050511 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG dbcounter [-] [101893] Writing DB stats keystone:SELECT=100 {{(pid=101893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:43:26.072337 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19e95d35-0b71-4959-afec-4129725c8c50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:43:26.073188 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e95d35-0b71-4959-afec-4129725c8c50 None admin] REQUEST_METHOD: `GET` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:43:26.073567 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e95d35-0b71-4959-afec-4129725c8c50 None admin] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:43:26.073945 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e95d35-0b71-4959-afec-4129725c8c50 None admin] PATH_INFO: `/v3/users` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:43:26.074072 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ffcb136-f9b2-475b-9853-426a8961bcd6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:43:26.075019 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19e95d35-0b71-4959-afec-4129725c8c50 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=101892) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:43:26.075187 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ffcb136-f9b2-475b-9853-426a8961bcd6 None admin] REQUEST_METHOD: `GET` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:43:26.075523 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19e95d35-0b71-4959-afec-4129725c8c50 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:43:26.075784 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ffcb136-f9b2-475b-9853-426a8961bcd6 None admin] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:43:26.076217 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ffcb136-f9b2-475b-9853-426a8961bcd6 None admin] PATH_INFO: `/v3/roles/service` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:43:26.077240 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19e95d35-0b71-4959-afec-4129725c8c50 None admin] RBAC: Authorization granted {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:43:26.090694 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ffcb136-f9b2-475b-9853-426a8961bcd6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 14:43:26.097214 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 363/744] 10.222.0.84 () {56 vars in 1133 bytes} [Wed May 25 14:43:25 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:43:26.098220 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19e95d35-0b71-4959-afec-4129725c8c50 None admin] Authenticating user token {{(pid=101892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:43:26.100598 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application [None req-5ffcb136-f9b2-475b-9853-426a8961bcd6 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 25 14:43:26.100598 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:43:26.100598 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 14:43:26.100598 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 14:43:26.100598 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 14:43:26.100598 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 14:43:26.100598 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 14:43:26.100598 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 14:43:26.100598 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 14:43:26.100598 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 14:43:26.100598 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 14:43:26.100598 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 14:43:26.100598 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 14:43:26.100598 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 14:43:26.100598 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 14:43:26.100598 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 14:43:26.101730 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 14:43:26.101730 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 14:43:26.101730 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 14:43:26.101730 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 14:43:26.101730 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 14:43:26.101730 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 14:43:26.101730 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 14:43:26.101730 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 14:43:26.101730 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 14:43:26.101730 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return self.get_or_create( May 25 14:43:26.101730 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 14:43:26.101730 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application with Lock( May 25 14:43:26.101730 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 14:43:26.101730 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return self._enter() May 25 14:43:26.101730 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 14:43:26.101730 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 14:43:26.102754 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 14:43:26.102754 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return self.creator() May 25 14:43:26.102754 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 14:43:26.102754 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application created_value = creator( May 25 14:43:26.102754 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 14:43:26.102754 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 14:43:26.102754 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 14:43:26.102754 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 14:43:26.102754 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 14:43:26.102754 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 14:43:26.102754 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 25 14:43:26.102754 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application May 25 14:43:26.105969 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 382/745] 10.222.0.84 () {56 vars in 1102 bytes} [Wed May 25 14:43:25 2022] GET /identity/v3/roles/service => generated 85 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 14:43:26.106886 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ffcb136-f9b2-475b-9853-426a8961bcd6 None admin] Authenticating user token {{(pid=101893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:43:26.221964 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG dbcounter [-] [101892] Writing DB stats keystone:SELECT=100 {{(pid=101892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:43:26.222201 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ffcb136-f9b2-475b-9853-426a8961bcd6 None admin] Validating token access rules against request {{(pid=101893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:43:26.245119 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19e95d35-0b71-4959-afec-4129725c8c50 None admin] Validating token access rules against request {{(pid=101892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:43:26.264883 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4479dce-6461-4c9e-b81d-da24e644887a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:43:26.265846 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4479dce-6461-4c9e-b81d-da24e644887a None admin] REQUEST_METHOD: `GET` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:43:26.266230 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4479dce-6461-4c9e-b81d-da24e644887a None admin] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:43:26.266602 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4479dce-6461-4c9e-b81d-da24e644887a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:43:26.279926 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4479dce-6461-4c9e-b81d-da24e644887a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:43:26.281827 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4479dce-6461-4c9e-b81d-da24e644887a None admin] RBAC: Authorization granted {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:43:26.294817 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc9e350-8214-4639-9aba-612d548d9fa9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:43:26.295890 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc9e350-8214-4639-9aba-612d548d9fa9 None admin] REQUEST_METHOD: `GET` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:43:26.296346 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc9e350-8214-4639-9aba-612d548d9fa9 None admin] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:43:26.296763 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc9e350-8214-4639-9aba-612d548d9fa9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:43:26.302483 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application [None req-a4479dce-6461-4c9e-b81d-da24e644887a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 25 14:43:26.302483 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:43:26.302483 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 14:43:26.302483 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 14:43:26.302483 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 14:43:26.302483 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 14:43:26.302483 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 14:43:26.302483 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 14:43:26.302483 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 14:43:26.302483 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 14:43:26.302483 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 14:43:26.302483 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 14:43:26.302483 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 25 14:43:26.302483 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 25 14:43:26.302483 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 25 14:43:26.303616 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 25 14:43:26.303616 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 14:43:26.303616 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 14:43:26.303616 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 14:43:26.303616 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 14:43:26.303616 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 14:43:26.303616 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return self.get_or_create( May 25 14:43:26.303616 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 14:43:26.303616 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application with Lock( May 25 14:43:26.303616 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 14:43:26.303616 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return self._enter() May 25 14:43:26.303616 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 14:43:26.303616 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 14:43:26.303616 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 14:43:26.303616 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return self.creator() May 25 14:43:26.303616 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 14:43:26.303616 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application created_value = creator( May 25 14:43:26.304754 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 25 14:43:26.304754 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 25 14:43:26.304754 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 25 14:43:26.304754 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application May 25 14:43:26.305932 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 383/746] 10.222.0.84 () {56 vars in 1108 bytes} [Wed May 25 14:43:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 14:43:26.307382 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4479dce-6461-4c9e-b81d-da24e644887a None admin] Authenticating user token {{(pid=101893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:43:26.312546 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fc9e350-8214-4639-9aba-612d548d9fa9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:43:26.314264 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fc9e350-8214-4639-9aba-612d548d9fa9 None admin] RBAC: Authorization granted {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:43:26.338571 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application [None req-7fc9e350-8214-4639-9aba-612d548d9fa9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 25 14:43:26.338571 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:43:26.338571 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 14:43:26.338571 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 14:43:26.338571 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 14:43:26.338571 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 14:43:26.338571 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 14:43:26.338571 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 14:43:26.338571 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 14:43:26.338571 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 14:43:26.338571 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 14:43:26.338571 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 14:43:26.338571 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 25 14:43:26.338571 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 25 14:43:26.338571 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 25 14:43:26.339831 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 25 14:43:26.339831 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 14:43:26.339831 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 14:43:26.339831 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 14:43:26.339831 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 14:43:26.339831 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 14:43:26.339831 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application return self.get_or_create( May 25 14:43:26.339831 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 14:43:26.339831 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application with Lock( May 25 14:43:26.339831 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 14:43:26.339831 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application return self._enter() May 25 14:43:26.339831 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 14:43:26.339831 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 14:43:26.339831 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 14:43:26.339831 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application return self.creator() May 25 14:43:26.339831 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 14:43:26.339831 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application created_value = creator( May 25 14:43:26.340732 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 25 14:43:26.340732 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 25 14:43:26.340732 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 25 14:43:26.340732 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application May 25 14:43:26.343639 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 364/747] 10.222.0.84 () {56 vars in 1108 bytes} [Wed May 25 14:43:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 243 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 14:43:26.344656 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc9e350-8214-4639-9aba-612d548d9fa9 None admin] Authenticating user token {{(pid=101892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:43:26.353815 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG dbcounter [-] [101893] Writing DB stats keystone:SELECT=100 {{(pid=101893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:43:26.431207 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4479dce-6461-4c9e-b81d-da24e644887a None admin] Validating token access rules against request {{(pid=101893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:43:26.468635 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa6b31d0-f79e-4172-a7f3-41741796d52c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:43:26.469527 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6b31d0-f79e-4172-a7f3-41741796d52c None admin] REQUEST_METHOD: `GET` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:43:26.469965 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6b31d0-f79e-4172-a7f3-41741796d52c None admin] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:43:26.470245 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6b31d0-f79e-4172-a7f3-41741796d52c None admin] PATH_INFO: `/v3/roles` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:43:26.470985 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa6b31d0-f79e-4172-a7f3-41741796d52c None admin] RBAC: Adding query filter params (name=service) {{(pid=101893) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:43:26.471291 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa6b31d0-f79e-4172-a7f3-41741796d52c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:43:26.471536 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc9e350-8214-4639-9aba-612d548d9fa9 None admin] Validating token access rules against request {{(pid=101892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:43:26.472690 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa6b31d0-f79e-4172-a7f3-41741796d52c None admin] RBAC: Authorization granted {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:43:26.484842 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 384/748] 10.222.0.84 () {56 vars in 1103 bytes} [Wed May 25 14:43:26 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:43:26.484842 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa6b31d0-f79e-4172-a7f3-41741796d52c None admin] Authenticating user token {{(pid=101893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:43:26.513503 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3735a47a-9ecf-42b5-983f-a6247e70f7ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:43:26.514504 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3735a47a-9ecf-42b5-983f-a6247e70f7ab None admin] REQUEST_METHOD: `GET` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:43:26.514953 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3735a47a-9ecf-42b5-983f-a6247e70f7ab None admin] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:43:26.515432 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3735a47a-9ecf-42b5-983f-a6247e70f7ab None admin] PATH_INFO: `/v3/domains` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:43:26.516486 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3735a47a-9ecf-42b5-983f-a6247e70f7ab None admin] RBAC: Adding query filter params (name=Default) {{(pid=101892) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:43:26.517070 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3735a47a-9ecf-42b5-983f-a6247e70f7ab None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:43:26.518641 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3735a47a-9ecf-42b5-983f-a6247e70f7ab None admin] RBAC: Authorization granted {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:43:26.521981 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG dbcounter [-] [101892] Writing DB stats keystone:SELECT=100 {{(pid=101892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:43:26.538043 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 365/749] 10.222.0.84 () {56 vars in 1109 bytes} [Wed May 25 14:43:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:43:26.538043 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a6eb86-296a-4548-943b-0110271973a4 None None] REQUEST_METHOD: `GET` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:43:26.538043 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a6eb86-296a-4548-943b-0110271973a4 None None] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:43:26.538043 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a6eb86-296a-4548-943b-0110271973a4 None None] PATH_INFO: `/` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:43:26.538043 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 366/750] 10.222.0.84 () {54 vars in 926 bytes} [Wed May 25 14:43:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 14:43:26.538043 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a6eb86-296a-4548-943b-0110271973a4 None None] Authenticating user token {{(pid=101892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:43:26.593058 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG dbcounter [-] [101893] Writing DB stats keystone:SELECT=100 {{(pid=101893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:43:26.603290 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa6b31d0-f79e-4172-a7f3-41741796d52c None admin] Validating token access rules against request {{(pid=101893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:43:26.639503 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26ef18f1-6b7f-4f0d-a3be-db12d56142aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:43:26.640196 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ef18f1-6b7f-4f0d-a3be-db12d56142aa None admin] REQUEST_METHOD: `GET` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:43:26.640480 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ef18f1-6b7f-4f0d-a3be-db12d56142aa None admin] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:43:26.640754 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ef18f1-6b7f-4f0d-a3be-db12d56142aa None admin] PATH_INFO: `/v3/domains` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:43:26.641485 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26ef18f1-6b7f-4f0d-a3be-db12d56142aa None admin] RBAC: Adding query filter params (name=Default) {{(pid=101893) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:43:26.641789 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26ef18f1-6b7f-4f0d-a3be-db12d56142aa None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:43:26.643170 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26ef18f1-6b7f-4f0d-a3be-db12d56142aa None admin] RBAC: Authorization granted {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:43:26.655607 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a6eb86-296a-4548-943b-0110271973a4 None None] Validating token access rules against request {{(pid=101892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:43:26.660394 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 385/751] 10.222.0.84 () {56 vars in 1109 bytes} [Wed May 25 14:43:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:43:26.661287 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26ef18f1-6b7f-4f0d-a3be-db12d56142aa None admin] Authenticating user token {{(pid=101893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:43:26.690895 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee81ba57-c6bf-4f29-b559-7288a7e6d84e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:43:26.691719 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee81ba57-c6bf-4f29-b559-7288a7e6d84e None admin] REQUEST_METHOD: `GET` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:43:26.692002 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee81ba57-c6bf-4f29-b559-7288a7e6d84e None admin] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:43:26.692276 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee81ba57-c6bf-4f29-b559-7288a7e6d84e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:43:26.705452 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee81ba57-c6bf-4f29-b559-7288a7e6d84e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:43:26.706935 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee81ba57-c6bf-4f29-b559-7288a7e6d84e None admin] RBAC: Authorization granted {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:43:26.724728 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application [None req-ee81ba57-c6bf-4f29-b559-7288a7e6d84e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 25 14:43:26.724728 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:43:26.724728 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 14:43:26.724728 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 14:43:26.724728 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 14:43:26.724728 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 14:43:26.724728 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 14:43:26.724728 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 14:43:26.724728 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 14:43:26.724728 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 14:43:26.724728 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 14:43:26.724728 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 14:43:26.724728 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 25 14:43:26.724728 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 25 14:43:26.724728 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 25 14:43:26.725814 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 25 14:43:26.725814 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 14:43:26.725814 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 14:43:26.725814 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 14:43:26.725814 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 14:43:26.725814 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 14:43:26.725814 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application return self.get_or_create( May 25 14:43:26.725814 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 14:43:26.725814 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application with Lock( May 25 14:43:26.725814 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 14:43:26.725814 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application return self._enter() May 25 14:43:26.725814 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 14:43:26.725814 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 14:43:26.725814 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 14:43:26.725814 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application return self.creator() May 25 14:43:26.725814 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 14:43:26.725814 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application created_value = creator( May 25 14:43:26.726757 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 25 14:43:26.726757 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 25 14:43:26.726757 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 25 14:43:26.726757 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application May 25 14:43:26.726757 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 367/752] 10.222.0.84 () {56 vars in 1108 bytes} [Wed May 25 14:43:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 14:43:26.727486 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331162db-1d16-4a56-bdd2-fd03eb76d6a6 None None] REQUEST_METHOD: `POST` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:43:26.727486 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331162db-1d16-4a56-bdd2-fd03eb76d6a6 None None] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:43:26.727757 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331162db-1d16-4a56-bdd2-fd03eb76d6a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:43:26.744100 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.auth.core [None req-331162db-1d16-4a56-bdd2-fd03eb76d6a6 None None] MFA Rules not processed for user `05d87e87798e429aa1c10b24391f915e`. Rule list: `[]` (Enabled: `True`). {{(pid=101892) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:43:26.745281 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.fernet_utils [None req-331162db-1d16-4a56-bdd2-fd03eb76d6a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=101892) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:43:26.771711 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26ef18f1-6b7f-4f0d-a3be-db12d56142aa None admin] Validating token access rules against request {{(pid=101893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:43:26.790404 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG dbcounter [-] [101892] Writing DB stats keystone:SELECT=100 {{(pid=101892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:43:26.808038 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f11ef13b-1372-421b-a6a8-b0a6f5e7f7ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:43:26.808964 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11ef13b-1372-421b-a6a8-b0a6f5e7f7ba None admin] REQUEST_METHOD: `GET` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:43:26.809341 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11ef13b-1372-421b-a6a8-b0a6f5e7f7ba None admin] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:43:26.809680 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11ef13b-1372-421b-a6a8-b0a6f5e7f7ba None admin] PATH_INFO: `/v3/projects/service` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:43:26.819733 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 368/753] 10.222.0.84 () {58 vars in 1023 bytes} [Wed May 25 14:43:26 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 25 14:43:26.819733 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-331162db-1d16-4a56-bdd2-fd03eb76d6a6 None None] Authenticating user token {{(pid=101892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:43:26.829240 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f11ef13b-1372-421b-a6a8-b0a6f5e7f7ba None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:43:26.831197 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f11ef13b-1372-421b-a6a8-b0a6f5e7f7ba None admin] RBAC: Authorization granted {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:43:26.847664 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application [None req-f11ef13b-1372-421b-a6a8-b0a6f5e7f7ba None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 25 14:43:26.847664 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:43:26.847664 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 14:43:26.847664 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 14:43:26.847664 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 14:43:26.847664 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 14:43:26.847664 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 14:43:26.847664 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 14:43:26.847664 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 14:43:26.847664 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 14:43:26.847664 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 14:43:26.847664 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 14:43:26.847664 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 25 14:43:26.847664 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return self._get_project(project_id) May 25 14:43:26.847664 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 25 14:43:26.848772 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 25 14:43:26.848772 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 14:43:26.848772 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 14:43:26.848772 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 14:43:26.848772 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 14:43:26.848772 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 14:43:26.848772 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return self.get_or_create( May 25 14:43:26.848772 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 14:43:26.848772 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application with Lock( May 25 14:43:26.848772 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 14:43:26.848772 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return self._enter() May 25 14:43:26.848772 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 14:43:26.848772 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 14:43:26.848772 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 14:43:26.848772 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return self.creator() May 25 14:43:26.848772 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 14:43:26.848772 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application created_value = creator( May 25 14:43:26.849919 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 25 14:43:26.849919 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 25 14:43:26.849919 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 25 14:43:26.849919 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 25 14:43:26.849919 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 25 14:43:26.849919 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 25 14:43:26.849919 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 25 14:43:26.849919 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application May 25 14:43:26.853548 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 386/754] 10.222.0.84 () {56 vars in 1111 bytes} [Wed May 25 14:43:26 2022] GET /identity/v3/projects/service => generated 88 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 14:43:26.854342 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f11ef13b-1372-421b-a6a8-b0a6f5e7f7ba None admin] Authenticating user token {{(pid=101893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:43:26.870243 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG dbcounter [-] [101893] Writing DB stats keystone:SELECT=100 {{(pid=101893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:43:26.921458 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-331162db-1d16-4a56-bdd2-fd03eb76d6a6 None None] Validating token access rules against request {{(pid=101892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:43:26.959043 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f11ef13b-1372-421b-a6a8-b0a6f5e7f7ba None admin] Validating token access rules against request {{(pid=101893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:43:26.959458 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61a6bb72-88ed-4952-991a-be619881c79c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:43:26.960341 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a6bb72-88ed-4952-991a-be619881c79c None admin] REQUEST_METHOD: `GET` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:43:26.960624 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a6bb72-88ed-4952-991a-be619881c79c None admin] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:43:26.960899 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a6bb72-88ed-4952-991a-be619881c79c None admin] PATH_INFO: `/v3/projects/service` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:43:26.967624 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61a6bb72-88ed-4952-991a-be619881c79c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:43:26.969053 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61a6bb72-88ed-4952-991a-be619881c79c None admin] RBAC: Authorization granted {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:43:26.982626 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application [None req-61a6bb72-88ed-4952-991a-be619881c79c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 25 14:43:26.982626 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:43:26.982626 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 14:43:26.982626 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 14:43:26.982626 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 14:43:26.982626 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 14:43:26.982626 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 14:43:26.982626 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 14:43:26.982626 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 14:43:26.982626 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 14:43:26.982626 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 14:43:26.982626 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 14:43:26.982626 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 25 14:43:26.982626 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application return self._get_project(project_id) May 25 14:43:26.982626 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 25 14:43:26.983702 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 25 14:43:26.983702 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 14:43:26.983702 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 14:43:26.983702 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 14:43:26.983702 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 14:43:26.983702 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 14:43:26.983702 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application return self.get_or_create( May 25 14:43:26.983702 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 14:43:26.983702 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application with Lock( May 25 14:43:26.983702 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 14:43:26.983702 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application return self._enter() May 25 14:43:26.983702 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 14:43:26.983702 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 14:43:26.983702 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 14:43:26.983702 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application return self.creator() May 25 14:43:26.983702 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 14:43:26.983702 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application created_value = creator( May 25 14:43:26.984613 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 25 14:43:26.984613 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 25 14:43:26.984613 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 25 14:43:26.984613 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 25 14:43:26.984613 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 25 14:43:26.984613 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 25 14:43:26.984613 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 25 14:43:26.984613 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application May 25 14:43:26.984613 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 369/755] 10.222.0.84 () {56 vars in 1111 bytes} [Wed May 25 14:43:26 2022] GET /identity/v3/projects/service => generated 88 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 14:43:26.984613 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61a6bb72-88ed-4952-991a-be619881c79c None admin] Authenticating user token {{(pid=101892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:43:26.999826 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f82536c-165f-4d39-aa9f-7dea831f59cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:43:27.000640 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f82536c-165f-4d39-aa9f-7dea831f59cc None admin] REQUEST_METHOD: `GET` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:43:27.001015 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f82536c-165f-4d39-aa9f-7dea831f59cc None admin] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:43:27.001387 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f82536c-165f-4d39-aa9f-7dea831f59cc None admin] PATH_INFO: `/v3/domains` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:43:27.002219 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f82536c-165f-4d39-aa9f-7dea831f59cc None admin] RBAC: Adding query filter params (name=Default) {{(pid=101893) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:43:27.002622 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f82536c-165f-4d39-aa9f-7dea831f59cc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:43:27.004117 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f82536c-165f-4d39-aa9f-7dea831f59cc None admin] RBAC: Authorization granted {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:43:27.016469 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 387/756] 10.222.0.84 () {56 vars in 1109 bytes} [Wed May 25 14:43:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:43:27.017265 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f82536c-165f-4d39-aa9f-7dea831f59cc None admin] Authenticating user token {{(pid=101893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:43:27.033804 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG dbcounter [-] [101892] Writing DB stats keystone:SELECT=100 {{(pid=101892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:43:27.093737 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG dbcounter [-] [101893] Writing DB stats keystone:SELECT=100 {{(pid=101893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:43:27.103862 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61a6bb72-88ed-4952-991a-be619881c79c None admin] Validating token access rules against request {{(pid=101892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:43:27.125719 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f82536c-165f-4d39-aa9f-7dea831f59cc None admin] Validating token access rules against request {{(pid=101893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:43:27.140154 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5622f24b-63ed-414b-8850-f06fcdd3ff83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:43:27.140957 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5622f24b-63ed-414b-8850-f06fcdd3ff83 None admin] REQUEST_METHOD: `GET` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:43:27.141411 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5622f24b-63ed-414b-8850-f06fcdd3ff83 None admin] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:43:27.141526 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5622f24b-63ed-414b-8850-f06fcdd3ff83 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:43:27.142175 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5622f24b-63ed-414b-8850-f06fcdd3ff83 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:43:27.143526 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5622f24b-63ed-414b-8850-f06fcdd3ff83 None admin] RBAC: Authorization granted {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:43:27.155627 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application [None req-5622f24b-63ed-414b-8850-f06fcdd3ff83 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. May 25 14:43:27.155627 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:43:27.155627 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 25 14:43:27.155627 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 25 14:43:27.155627 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 25 14:43:27.155627 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 25 14:43:27.155627 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 25 14:43:27.155627 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 25 14:43:27.155627 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. May 25 14:43:27.155627 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application May 25 14:43:27.155627 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 25 14:43:27.155627 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application May 25 14:43:27.155627 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:43:27.155627 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 14:43:27.155627 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 14:43:27.155627 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 14:43:27.156753 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 14:43:27.156753 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 14:43:27.156753 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 14:43:27.156753 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 14:43:27.156753 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 14:43:27.156753 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 14:43:27.156753 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 14:43:27.156753 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 25 14:43:27.156753 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application return self._get_service(service_id) May 25 14:43:27.156753 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 25 14:43:27.156753 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 25 14:43:27.156753 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 14:43:27.156753 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 14:43:27.156753 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 14:43:27.156753 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 14:43:27.156753 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 14:43:27.157814 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application return self.get_or_create( May 25 14:43:27.157814 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 14:43:27.157814 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application with Lock( May 25 14:43:27.157814 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 14:43:27.157814 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application return self._enter() May 25 14:43:27.157814 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 14:43:27.157814 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 14:43:27.157814 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 14:43:27.157814 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application return self.creator() May 25 14:43:27.157814 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 14:43:27.157814 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application created_value = creator( May 25 14:43:27.157814 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 25 14:43:27.157814 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 25 14:43:27.157814 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. May 25 14:43:27.157814 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application May 25 14:43:27.161859 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 370/757] 10.222.0.84 () {56 vars in 1129 bytes} [Wed May 25 14:43:26 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 14:43:27.162440 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5622f24b-63ed-414b-8850-f06fcdd3ff83 None admin] Authenticating user token {{(pid=101892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:43:27.164924 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aea0a0e2-b5f2-4630-8d03-c6178ba8b968 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:43:27.165693 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea0a0e2-b5f2-4630-8d03-c6178ba8b968 None admin] REQUEST_METHOD: `GET` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:43:27.166079 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea0a0e2-b5f2-4630-8d03-c6178ba8b968 None admin] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:43:27.166449 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea0a0e2-b5f2-4630-8d03-c6178ba8b968 None admin] PATH_INFO: `/v3/projects` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:43:27.167340 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aea0a0e2-b5f2-4630-8d03-c6178ba8b968 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=101893) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:43:27.167792 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aea0a0e2-b5f2-4630-8d03-c6178ba8b968 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:43:27.169321 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aea0a0e2-b5f2-4630-8d03-c6178ba8b968 None admin] RBAC: Authorization granted {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:43:27.182568 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 388/758] 10.222.0.84 () {56 vars in 1148 bytes} [Wed May 25 14:43:27 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:43:27.183502 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aea0a0e2-b5f2-4630-8d03-c6178ba8b968 None admin] Authenticating user token {{(pid=101893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:43:27.280035 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5622f24b-63ed-414b-8850-f06fcdd3ff83 None admin] Validating token access rules against request {{(pid=101892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:43:27.281961 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG dbcounter [-] [101892] Writing DB stats keystone:SELECT=100 {{(pid=101892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:43:27.285520 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aea0a0e2-b5f2-4630-8d03-c6178ba8b968 None admin] Validating token access rules against request {{(pid=101893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:43:27.315019 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG dbcounter [-] [101893] Writing DB stats keystone:SELECT=100 {{(pid=101893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:43:27.317465 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-928b69f3-6db7-4a3c-956c-eb030a0c1100 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:43:27.318256 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-928b69f3-6db7-4a3c-956c-eb030a0c1100 None admin] REQUEST_METHOD: `GET` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:43:27.318539 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-928b69f3-6db7-4a3c-956c-eb030a0c1100 None admin] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:43:27.318820 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-928b69f3-6db7-4a3c-956c-eb030a0c1100 None admin] PATH_INFO: `/v3/projects` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:43:27.319709 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-928b69f3-6db7-4a3c-956c-eb030a0c1100 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=101892) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:43:27.320327 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-928b69f3-6db7-4a3c-956c-eb030a0c1100 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:43:27.320451 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccd5fdec-9f65-4f96-9b28-19bc8520fe15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:43:27.321024 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd5fdec-9f65-4f96-9b28-19bc8520fe15 None admin] REQUEST_METHOD: `GET` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:43:27.321299 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd5fdec-9f65-4f96-9b28-19bc8520fe15 None admin] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:43:27.321571 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd5fdec-9f65-4f96-9b28-19bc8520fe15 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:43:27.321817 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-928b69f3-6db7-4a3c-956c-eb030a0c1100 None admin] RBAC: Authorization granted {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:43:27.329200 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccd5fdec-9f65-4f96-9b28-19bc8520fe15 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:43:27.330711 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccd5fdec-9f65-4f96-9b28-19bc8520fe15 None admin] RBAC: Authorization granted {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:43:27.335774 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 371/759] 10.222.0.84 () {56 vars in 1148 bytes} [Wed May 25 14:43:27 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:43:27.336599 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-928b69f3-6db7-4a3c-956c-eb030a0c1100 None admin] Authenticating user token {{(pid=101892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:43:27.351991 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application [None req-ccd5fdec-9f65-4f96-9b28-19bc8520fe15 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. May 25 14:43:27.351991 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:43:27.351991 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 14:43:27.351991 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 14:43:27.351991 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 14:43:27.351991 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 14:43:27.351991 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 14:43:27.351991 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 14:43:27.351991 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 14:43:27.351991 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 14:43:27.351991 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 14:43:27.351991 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 14:43:27.351991 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 25 14:43:27.351991 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return self._get_user(user_id) May 25 14:43:27.351991 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 25 14:43:27.351991 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 25 14:43:27.352985 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 14:43:27.352985 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 14:43:27.352985 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 25 14:43:27.352985 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 25 14:43:27.352985 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 25 14:43:27.352985 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 25 14:43:27.352985 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 14:43:27.352985 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 14:43:27.352985 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 14:43:27.352985 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return self.get_or_create( May 25 14:43:27.352985 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 14:43:27.352985 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application with Lock( May 25 14:43:27.352985 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 14:43:27.352985 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return self._enter() May 25 14:43:27.352985 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 14:43:27.352985 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 14:43:27.352985 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 14:43:27.352985 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return self.creator() May 25 14:43:27.354384 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 14:43:27.354384 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application created_value = creator( May 25 14:43:27.354384 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 25 14:43:27.354384 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 25 14:43:27.354384 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 25 14:43:27.354384 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 25 14:43:27.354384 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 25 14:43:27.354384 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 25 14:43:27.354384 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. May 25 14:43:27.354384 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application May 25 14:43:27.354384 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 389/760] 10.222.0.84 () {56 vars in 1117 bytes} [Wed May 25 14:43:27 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 14:43:27.354384 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccd5fdec-9f65-4f96-9b28-19bc8520fe15 None admin] Authenticating user token {{(pid=101893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:43:27.441982 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-928b69f3-6db7-4a3c-956c-eb030a0c1100 None admin] Validating token access rules against request {{(pid=101892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:43:27.460597 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccd5fdec-9f65-4f96-9b28-19bc8520fe15 None admin] Validating token access rules against request {{(pid=101893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:43:27.476353 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a669d16d-9601-49c5-b659-9b812a2cdab4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:43:27.477022 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a669d16d-9601-49c5-b659-9b812a2cdab4 None admin] REQUEST_METHOD: `GET` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:43:27.477297 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a669d16d-9601-49c5-b659-9b812a2cdab4 None admin] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:43:27.477577 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a669d16d-9601-49c5-b659-9b812a2cdab4 None admin] PATH_INFO: `/v3/services` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:43:27.478275 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a669d16d-9601-49c5-b659-9b812a2cdab4 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=101892) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:43:27.478584 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a669d16d-9601-49c5-b659-9b812a2cdab4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:43:27.479984 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a669d16d-9601-49c5-b659-9b812a2cdab4 None admin] RBAC: Authorization granted {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:43:27.484874 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 372/761] 10.222.0.84 () {56 vars in 1124 bytes} [Wed May 25 14:43:27 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:43:27.485573 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a669d16d-9601-49c5-b659-9b812a2cdab4 None admin] Authenticating user token {{(pid=101892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:43:27.501747 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc753e22-89a8-43a5-9426-74dd81788f18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:43:27.502635 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc753e22-89a8-43a5-9426-74dd81788f18 None admin] REQUEST_METHOD: `PUT` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:43:27.502917 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc753e22-89a8-43a5-9426-74dd81788f18 None admin] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:43:27.503188 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc753e22-89a8-43a5-9426-74dd81788f18 None admin] PATH_INFO: `/v3/projects/a000829c658c4a7cab67f7b6353ba3fa/users/2aeb182e6a5b43cfb0cc347ec847c848/roles/a3b78e7d547d4d2d998b4c99a4396bba` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:43:27.505208 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc753e22-89a8-43a5-9426-74dd81788f18 None admin] RBAC: Authorizing `identity:create_grant(project_id=a000829c658c4a7cab67f7b6353ba3fa, user_id=2aeb182e6a5b43cfb0cc347ec847c848, role_id=a3b78e7d547d4d2d998b4c99a4396bba)` {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:43:27.507477 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc753e22-89a8-43a5-9426-74dd81788f18 None admin] RBAC: Authorization granted {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:43:27.516267 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG dbcounter [-] [101892] Writing DB stats keystone:SELECT=100 {{(pid=101892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:43:27.593290 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a669d16d-9601-49c5-b659-9b812a2cdab4 None admin] Validating token access rules against request {{(pid=101892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:43:27.625953 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ab92d35-9399-49b1-bddc-b6b2ab79a7ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:43:27.626532 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab92d35-9399-49b1-bddc-b6b2ab79a7ce None admin] REQUEST_METHOD: `GET` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:43:27.626810 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab92d35-9399-49b1-bddc-b6b2ab79a7ce None admin] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:43:27.627087 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab92d35-9399-49b1-bddc-b6b2ab79a7ce None admin] PATH_INFO: `/v3/role_assignments` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:43:27.627932 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ab92d35-9399-49b1-bddc-b6b2ab79a7ce None admin] RBAC: Adding query filter params (role.id=a3b78e7d547d4d2d998b4c99a4396bba, scope.project.id=a000829c658c4a7cab67f7b6353ba3fa, user.id=e196f0897b98455c9e164271d7d0070a) {{(pid=101892) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:43:27.628238 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ab92d35-9399-49b1-bddc-b6b2ab79a7ce None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:43:27.629646 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ab92d35-9399-49b1-bddc-b6b2ab79a7ce None admin] RBAC: Authorization granted {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:43:27.639924 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 390/762] 10.222.0.84 () {58 vars in 1439 bytes} [Wed May 25 14:43:27 2022] PUT /identity/v3/projects/a000829c658c4a7cab67f7b6353ba3fa/users/2aeb182e6a5b43cfb0cc347ec847c848/roles/a3b78e7d547d4d2d998b4c99a4396bba => generated 0 bytes in 278 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 14:43:27.639924 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc753e22-89a8-43a5-9426-74dd81788f18 None admin] Authenticating user token {{(pid=101893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:43:27.645699 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 373/763] 10.222.0.84 () {56 vars in 1374 bytes} [Wed May 25 14:43:27 2022] GET /identity/v3/role_assignments?user.id=e196f0897b98455c9e164271d7d0070a&scope.project.id=a000829c658c4a7cab67f7b6353ba3fa&role.id=a3b78e7d547d4d2d998b4c99a4396bba => generated 259 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:43:27.646697 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ab92d35-9399-49b1-bddc-b6b2ab79a7ce None admin] Authenticating user token {{(pid=101892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:43:27.756789 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG dbcounter [-] [101893] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=101893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:43:27.800241 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG dbcounter [-] [101892] Writing DB stats keystone:SELECT=100 {{(pid=101892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:43:27.815406 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ab92d35-9399-49b1-bddc-b6b2ab79a7ce None admin] Validating token access rules against request {{(pid=101892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:43:27.818664 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc753e22-89a8-43a5-9426-74dd81788f18 None admin] Validating token access rules against request {{(pid=101893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:43:27.862679 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32e841f5-0a70-4f34-aae9-fb92c07764cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:43:27.863375 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e841f5-0a70-4f34-aae9-fb92c07764cd None admin] REQUEST_METHOD: `GET` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:43:27.863699 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e841f5-0a70-4f34-aae9-fb92c07764cd None admin] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:43:27.863979 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e841f5-0a70-4f34-aae9-fb92c07764cd None admin] PATH_INFO: `/v3/users` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:43:27.865383 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32e841f5-0a70-4f34-aae9-fb92c07764cd None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=101893) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:43:27.865699 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32e841f5-0a70-4f34-aae9-fb92c07764cd None admin] RBAC: Authorizing `identity:list_users()` {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:43:27.867168 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32e841f5-0a70-4f34-aae9-fb92c07764cd None admin] RBAC: Authorization granted {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:43:27.867545 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeb4a7bf-166e-44a8-a3b2-aba746b74f15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:43:27.868802 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb4a7bf-166e-44a8-a3b2-aba746b74f15 None admin] REQUEST_METHOD: `GET` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:43:27.868802 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb4a7bf-166e-44a8-a3b2-aba746b74f15 None admin] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:43:27.868802 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb4a7bf-166e-44a8-a3b2-aba746b74f15 None admin] PATH_INFO: `/v3/services` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:43:27.869741 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeb4a7bf-166e-44a8-a3b2-aba746b74f15 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=101892) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:43:27.870921 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeb4a7bf-166e-44a8-a3b2-aba746b74f15 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:43:27.872675 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeb4a7bf-166e-44a8-a3b2-aba746b74f15 None admin] RBAC: Authorization granted {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:43:27.881797 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 374/764] 10.222.0.84 () {56 vars in 1124 bytes} [Wed May 25 14:43:27 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:43:27.883367 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5e96fa-4384-48be-8390-65e8e2a93f2c None None] REQUEST_METHOD: `GET` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:43:27.883828 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5e96fa-4384-48be-8390-65e8e2a93f2c None None] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:43:27.884274 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5e96fa-4384-48be-8390-65e8e2a93f2c None None] PATH_INFO: `/` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:43:27.885838 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 375/765] 10.222.0.84 () {54 vars in 926 bytes} [Wed May 25 14:43:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 14:43:27.886949 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c5e96fa-4384-48be-8390-65e8e2a93f2c None None] Authenticating user token {{(pid=101892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:43:27.888909 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 391/766] 10.222.0.84 () {56 vars in 1149 bytes} [Wed May 25 14:43:27 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 257 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:43:27.892903 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf17f8fa-b301-4c69-94a8-fd30abfe45a5 None None] REQUEST_METHOD: `POST` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:43:27.893314 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf17f8fa-b301-4c69-94a8-fd30abfe45a5 None None] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:43:27.893699 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf17f8fa-b301-4c69-94a8-fd30abfe45a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:43:27.912027 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.auth.core [None req-cf17f8fa-b301-4c69-94a8-fd30abfe45a5 None None] MFA Rules not processed for user `05d87e87798e429aa1c10b24391f915e`. Rule list: `[]` (Enabled: `True`). {{(pid=101893) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:43:27.913293 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.fernet_utils [None req-cf17f8fa-b301-4c69-94a8-fd30abfe45a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=101893) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:43:27.991001 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 392/767] 10.222.0.84 () {58 vars in 1023 bytes} [Wed May 25 14:43:27 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 25 14:43:27.991908 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf17f8fa-b301-4c69-94a8-fd30abfe45a5 None None] Authenticating user token {{(pid=101893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:43:28.025304 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c5e96fa-4384-48be-8390-65e8e2a93f2c None None] Validating token access rules against request {{(pid=101892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:43:28.056863 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG dbcounter [-] [101893] Writing DB stats keystone:SELECT=100 {{(pid=101893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:43:28.066187 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f28498cc-68b3-43e1-9896-949cd12f1f70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:43:28.067682 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28498cc-68b3-43e1-9896-949cd12f1f70 None admin] REQUEST_METHOD: `GET` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:43:28.068026 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28498cc-68b3-43e1-9896-949cd12f1f70 None admin] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:43:28.068314 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28498cc-68b3-43e1-9896-949cd12f1f70 None admin] PATH_INFO: `/v3/endpoints` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:43:28.069136 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f28498cc-68b3-43e1-9896-949cd12f1f70 None admin] RBAC: Adding query filter params (interface=public, service_id=3cdf7ad4a7884255ac703289c70b013b, region_id=RegionOne) {{(pid=101892) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:43:28.069455 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f28498cc-68b3-43e1-9896-949cd12f1f70 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:43:28.070849 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f28498cc-68b3-43e1-9896-949cd12f1f70 None admin] RBAC: Authorization granted {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:43:28.081756 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 376/768] 10.222.0.84 () {56 vars in 1251 bytes} [Wed May 25 14:43:27 2022] GET /identity/v3/endpoints?service_id=3cdf7ad4a7884255ac703289c70b013b&interface=public®ion_id=RegionOne => generated 194 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:43:28.082981 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f28498cc-68b3-43e1-9896-949cd12f1f70 None admin] Authenticating user token {{(pid=101892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:43:28.099587 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf17f8fa-b301-4c69-94a8-fd30abfe45a5 None None] Validating token access rules against request {{(pid=101893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:43:28.107705 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG dbcounter [-] [101892] Writing DB stats keystone:SELECT=100 {{(pid=101892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:43:28.137953 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-274205ed-5682-4c1a-bdd2-daac95c15649 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:43:28.138881 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274205ed-5682-4c1a-bdd2-daac95c15649 None admin] REQUEST_METHOD: `GET` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:43:28.139307 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274205ed-5682-4c1a-bdd2-daac95c15649 None admin] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:43:28.139899 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274205ed-5682-4c1a-bdd2-daac95c15649 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:43:28.217547 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f28498cc-68b3-43e1-9896-949cd12f1f70 None admin] Validating token access rules against request {{(pid=101892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:43:28.224906 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-274205ed-5682-4c1a-bdd2-daac95c15649 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:43:28.226702 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-274205ed-5682-4c1a-bdd2-daac95c15649 None admin] RBAC: Authorization granted {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:43:28.258700 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e83490a-86dd-4ef9-ae11-ad096c879582 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:43:28.260358 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e83490a-86dd-4ef9-ae11-ad096c879582 None admin] REQUEST_METHOD: `GET` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:43:28.260789 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e83490a-86dd-4ef9-ae11-ad096c879582 None admin] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:43:28.261209 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e83490a-86dd-4ef9-ae11-ad096c879582 None admin] PATH_INFO: `/v3/services/network` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:43:28.262164 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e83490a-86dd-4ef9-ae11-ad096c879582 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:43:28.264649 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e83490a-86dd-4ef9-ae11-ad096c879582 None admin] RBAC: Authorization granted {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:43:28.280100 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application [None req-4e83490a-86dd-4ef9-ae11-ad096c879582 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. May 25 14:43:28.280100 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:43:28.280100 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 25 14:43:28.280100 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 25 14:43:28.280100 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 25 14:43:28.280100 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 25 14:43:28.280100 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 25 14:43:28.280100 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 25 14:43:28.280100 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. May 25 14:43:28.280100 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application May 25 14:43:28.280100 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 25 14:43:28.280100 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application May 25 14:43:28.280100 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:43:28.280100 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 14:43:28.280100 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 14:43:28.280100 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 14:43:28.280100 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 14:43:28.281368 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 14:43:28.281368 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 14:43:28.281368 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 14:43:28.281368 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 14:43:28.281368 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 14:43:28.281368 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 14:43:28.281368 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 25 14:43:28.281368 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application return self._get_service(service_id) May 25 14:43:28.281368 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 25 14:43:28.281368 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 25 14:43:28.281368 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 14:43:28.281368 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 14:43:28.281368 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 14:43:28.281368 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 14:43:28.281368 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 14:43:28.281368 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application return self.get_or_create( May 25 14:43:28.282415 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 14:43:28.282415 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application with Lock( May 25 14:43:28.282415 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 14:43:28.282415 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application return self._enter() May 25 14:43:28.282415 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 14:43:28.282415 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 14:43:28.282415 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 14:43:28.282415 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application return self.creator() May 25 14:43:28.282415 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 14:43:28.282415 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application created_value = creator( May 25 14:43:28.282415 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 25 14:43:28.282415 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 25 14:43:28.282415 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. May 25 14:43:28.282415 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application May 25 14:43:28.283325 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG dbcounter [-] [101893] Writing DB stats keystone:SELECT=100 {{(pid=101893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:43:28.290463 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 377/769] 10.222.0.84 () {56 vars in 1111 bytes} [Wed May 25 14:43:28 2022] GET /identity/v3/services/network => generated 88 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 14:43:28.290463 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e83490a-86dd-4ef9-ae11-ad096c879582 None admin] Authenticating user token {{(pid=101892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:43:28.353330 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 393/770] 10.222.0.84 () {58 vars in 1282 bytes} [Wed May 25 14:43:27 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 362 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 25 14:43:28.355437 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-274205ed-5682-4c1a-bdd2-daac95c15649 None admin] Authenticating user token {{(pid=101893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:43:28.378464 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG dbcounter [-] [101892] Writing DB stats keystone:SELECT=100 {{(pid=101892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:43:28.397812 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e83490a-86dd-4ef9-ae11-ad096c879582 None admin] Validating token access rules against request {{(pid=101892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:43:28.435430 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cf9b555-3f04-4d39-97c1-beeddad6a0b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:43:28.436433 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf9b555-3f04-4d39-97c1-beeddad6a0b1 None admin] REQUEST_METHOD: `GET` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:43:28.437148 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf9b555-3f04-4d39-97c1-beeddad6a0b1 None admin] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:43:28.437558 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf9b555-3f04-4d39-97c1-beeddad6a0b1 None admin] PATH_INFO: `/v3/services` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:43:28.438631 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cf9b555-3f04-4d39-97c1-beeddad6a0b1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:43:28.440155 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cf9b555-3f04-4d39-97c1-beeddad6a0b1 None admin] RBAC: Authorization granted {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:43:28.447921 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 378/771] 10.222.0.84 () {56 vars in 1087 bytes} [Wed May 25 14:43:28 2022] GET /identity/v3/services => generated 772 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:43:28.448671 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cf9b555-3f04-4d39-97c1-beeddad6a0b1 None admin] Authenticating user token {{(pid=101892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:43:28.509809 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-274205ed-5682-4c1a-bdd2-daac95c15649 None admin] Validating token access rules against request {{(pid=101893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:43:28.590467 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f63ecd5-8ab9-42dd-a0e9-ea4467ecbbfa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:43:28.591158 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f63ecd5-8ab9-42dd-a0e9-ea4467ecbbfa None admin] REQUEST_METHOD: `GET` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:43:28.594267 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f63ecd5-8ab9-42dd-a0e9-ea4467ecbbfa None admin] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:43:28.594582 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f63ecd5-8ab9-42dd-a0e9-ea4467ecbbfa None admin] PATH_INFO: `/v3/services` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:43:28.595342 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f63ecd5-8ab9-42dd-a0e9-ea4467ecbbfa None admin] RBAC: Adding query filter params (name=network) {{(pid=101893) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:43:28.595683 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f63ecd5-8ab9-42dd-a0e9-ea4467ecbbfa None admin] RBAC: Authorizing `identity:list_services()` {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:43:28.597282 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f63ecd5-8ab9-42dd-a0e9-ea4467ecbbfa None admin] RBAC: Authorization granted {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:43:28.608806 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 394/772] 10.222.0.84 () {56 vars in 1112 bytes} [Wed May 25 14:43:28 2022] GET /identity/v3/services?name=network => generated 124 bytes in 254 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:43:28.616719 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f63ecd5-8ab9-42dd-a0e9-ea4467ecbbfa None admin] Authenticating user token {{(pid=101893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:43:28.632049 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG dbcounter [-] [101893] Writing DB stats keystone:SELECT=100 {{(pid=101893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:43:28.649861 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cf9b555-3f04-4d39-97c1-beeddad6a0b1 None admin] Validating token access rules against request {{(pid=101892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:43:28.695060 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abd648d8-e29f-40a7-8f85-0de562f92535 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:43:28.696342 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd648d8-e29f-40a7-8f85-0de562f92535 None admin] REQUEST_METHOD: `GET` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:43:28.696639 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd648d8-e29f-40a7-8f85-0de562f92535 None admin] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:43:28.697167 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd648d8-e29f-40a7-8f85-0de562f92535 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:43:28.714552 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abd648d8-e29f-40a7-8f85-0de562f92535 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:43:28.716581 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abd648d8-e29f-40a7-8f85-0de562f92535 None admin] RBAC: Authorization granted {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:43:28.728056 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG dbcounter [-] [101892] Writing DB stats keystone:SELECT=100 {{(pid=101892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:43:28.742233 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application [None req-abd648d8-e29f-40a7-8f85-0de562f92535 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 25 14:43:28.742233 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:43:28.742233 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 14:43:28.742233 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 14:43:28.742233 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 14:43:28.742233 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 14:43:28.742233 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 14:43:28.742233 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 14:43:28.742233 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 14:43:28.742233 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 14:43:28.742233 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 14:43:28.742233 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 14:43:28.742233 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 25 14:43:28.742233 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 25 14:43:28.742233 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 25 14:43:28.743151 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 25 14:43:28.743151 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 14:43:28.743151 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 14:43:28.743151 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 14:43:28.743151 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 14:43:28.743151 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 14:43:28.743151 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application return self.get_or_create( May 25 14:43:28.743151 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 14:43:28.743151 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application with Lock( May 25 14:43:28.743151 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 14:43:28.743151 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application return self._enter() May 25 14:43:28.743151 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 14:43:28.743151 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 14:43:28.743151 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 14:43:28.743151 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application return self.creator() May 25 14:43:28.743151 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 14:43:28.743151 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application created_value = creator( May 25 14:43:28.744319 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 25 14:43:28.744319 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 25 14:43:28.744319 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 25 14:43:28.744319 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application May 25 14:43:28.744903 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f63ecd5-8ab9-42dd-a0e9-ea4467ecbbfa None admin] Validating token access rules against request {{(pid=101893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:43:28.745005 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 379/773] 10.222.0.84 () {56 vars in 1108 bytes} [Wed May 25 14:43:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 295 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 14:43:28.756015 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abd648d8-e29f-40a7-8f85-0de562f92535 None admin] Authenticating user token {{(pid=101892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:43:28.811520 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f2a63e-faf4-4a86-92c6-6ead5e5d073c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:43:28.812227 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f2a63e-faf4-4a86-92c6-6ead5e5d073c None admin] REQUEST_METHOD: `GET` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:43:28.812511 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f2a63e-faf4-4a86-92c6-6ead5e5d073c None admin] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:43:28.812788 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f2a63e-faf4-4a86-92c6-6ead5e5d073c None admin] PATH_INFO: `/v3/services` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:43:28.813508 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09f2a63e-faf4-4a86-92c6-6ead5e5d073c None admin] RBAC: Adding query filter params (type=network) {{(pid=101893) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:43:28.813820 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09f2a63e-faf4-4a86-92c6-6ead5e5d073c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:43:28.815207 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09f2a63e-faf4-4a86-92c6-6ead5e5d073c None admin] RBAC: Authorization granted {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:43:28.821573 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 395/774] 10.222.0.84 () {56 vars in 1112 bytes} [Wed May 25 14:43:28 2022] GET /identity/v3/services?type=network => generated 350 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 14:43:28.827623 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f2a63e-faf4-4a86-92c6-6ead5e5d073c None admin] Authenticating user token {{(pid=101893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:43:28.897584 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abd648d8-e29f-40a7-8f85-0de562f92535 None admin] Validating token access rules against request {{(pid=101892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:43:28.941271 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e92a51-35ce-40cb-a1b6-14379ec86254 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:43:28.945364 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e92a51-35ce-40cb-a1b6-14379ec86254 None admin] REQUEST_METHOD: `GET` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:43:28.945655 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e92a51-35ce-40cb-a1b6-14379ec86254 None admin] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:43:28.945953 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e92a51-35ce-40cb-a1b6-14379ec86254 None admin] PATH_INFO: `/v3/domains` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:43:28.954033 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90e92a51-35ce-40cb-a1b6-14379ec86254 None admin] RBAC: Adding query filter params (name=Default) {{(pid=101892) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:43:28.954409 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90e92a51-35ce-40cb-a1b6-14379ec86254 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:43:28.955856 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90e92a51-35ce-40cb-a1b6-14379ec86254 None admin] RBAC: Authorization granted {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:43:28.960022 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG dbcounter [-] [101893] Writing DB stats keystone:SELECT=100 {{(pid=101893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:43:28.971257 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 380/775] 10.222.0.84 () {56 vars in 1109 bytes} [Wed May 25 14:43:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:43:28.976774 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e92a51-35ce-40cb-a1b6-14379ec86254 None admin] Authenticating user token {{(pid=101892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:43:29.033856 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f2a63e-faf4-4a86-92c6-6ead5e5d073c None admin] Validating token access rules against request {{(pid=101893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:43:29.093483 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaad694e-1032-4e46-b86b-3e73d0bfe81c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:43:29.094561 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaad694e-1032-4e46-b86b-3e73d0bfe81c None admin] REQUEST_METHOD: `GET` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:43:29.095102 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaad694e-1032-4e46-b86b-3e73d0bfe81c None admin] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:43:29.095603 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaad694e-1032-4e46-b86b-3e73d0bfe81c None admin] PATH_INFO: `/v3/endpoints` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:43:29.097045 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaad694e-1032-4e46-b86b-3e73d0bfe81c None admin] RBAC: Adding query filter params (interface=public, service_id=db9f222842d542d3b1dea1a78140805f, region_id=RegionOne) {{(pid=101893) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:43:29.097562 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaad694e-1032-4e46-b86b-3e73d0bfe81c None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:43:29.099836 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaad694e-1032-4e46-b86b-3e73d0bfe81c None admin] RBAC: Authorization granted {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:43:29.108271 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 396/776] 10.222.0.84 () {56 vars in 1251 bytes} [Wed May 25 14:43:28 2022] GET /identity/v3/endpoints?service_id=db9f222842d542d3b1dea1a78140805f&interface=public®ion_id=RegionOne => generated 194 bytes in 281 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:43:29.113326 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaad694e-1032-4e46-b86b-3e73d0bfe81c None admin] Authenticating user token {{(pid=101893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:43:29.115617 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG dbcounter [-] [101892] Writing DB stats keystone:SELECT=100 {{(pid=101892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:43:29.201527 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e92a51-35ce-40cb-a1b6-14379ec86254 None admin] Validating token access rules against request {{(pid=101892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:43:29.237883 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28c15ff2-3960-475b-b4e6-dd7cc0d60337 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:43:29.239022 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c15ff2-3960-475b-b4e6-dd7cc0d60337 None admin] REQUEST_METHOD: `GET` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:43:29.240197 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c15ff2-3960-475b-b4e6-dd7cc0d60337 None admin] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:43:29.240661 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c15ff2-3960-475b-b4e6-dd7cc0d60337 None admin] PATH_INFO: `/v3/projects/service` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:43:29.248835 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28c15ff2-3960-475b-b4e6-dd7cc0d60337 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:43:29.250390 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28c15ff2-3960-475b-b4e6-dd7cc0d60337 None admin] RBAC: Authorization granted {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:43:29.265751 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application [None req-28c15ff2-3960-475b-b4e6-dd7cc0d60337 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 25 14:43:29.265751 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:43:29.265751 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 14:43:29.265751 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 14:43:29.265751 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 14:43:29.265751 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 14:43:29.265751 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 14:43:29.265751 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 14:43:29.265751 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 14:43:29.265751 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 14:43:29.265751 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 14:43:29.265751 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 14:43:29.265751 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 25 14:43:29.265751 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application return self._get_project(project_id) May 25 14:43:29.265751 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 25 14:43:29.266850 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 25 14:43:29.266850 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 14:43:29.266850 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 14:43:29.266850 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 14:43:29.266850 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 14:43:29.266850 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 14:43:29.266850 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application return self.get_or_create( May 25 14:43:29.266850 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 14:43:29.266850 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application with Lock( May 25 14:43:29.266850 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 14:43:29.266850 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application return self._enter() May 25 14:43:29.266850 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 14:43:29.266850 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 14:43:29.266850 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 14:43:29.266850 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application return self.creator() May 25 14:43:29.266850 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 14:43:29.266850 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application created_value = creator( May 25 14:43:29.267988 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 25 14:43:29.267988 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 25 14:43:29.267988 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 25 14:43:29.267988 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 25 14:43:29.267988 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 25 14:43:29.267988 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 25 14:43:29.267988 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 25 14:43:29.267988 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application May 25 14:43:29.270539 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 381/777] 10.222.0.84 () {56 vars in 1111 bytes} [Wed May 25 14:43:28 2022] GET /identity/v3/projects/service => generated 88 bytes in 293 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 14:43:29.275887 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28c15ff2-3960-475b-b4e6-dd7cc0d60337 None admin] Authenticating user token {{(pid=101892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:43:29.312346 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaad694e-1032-4e46-b86b-3e73d0bfe81c None admin] Validating token access rules against request {{(pid=101893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:43:29.386690 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG dbcounter [-] [101893] Writing DB stats keystone:SELECT=100 {{(pid=101893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:43:29.397347 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d74a53d-1035-462e-b3cb-47716653b699 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:43:29.398028 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d74a53d-1035-462e-b3cb-47716653b699 None admin] REQUEST_METHOD: `GET` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:43:29.398314 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d74a53d-1035-462e-b3cb-47716653b699 None admin] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:43:29.398592 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d74a53d-1035-462e-b3cb-47716653b699 None admin] PATH_INFO: `/v3/services` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:43:29.399278 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d74a53d-1035-462e-b3cb-47716653b699 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:43:29.400833 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d74a53d-1035-462e-b3cb-47716653b699 None admin] RBAC: Authorization granted {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:43:29.413592 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28c15ff2-3960-475b-b4e6-dd7cc0d60337 None admin] Validating token access rules against request {{(pid=101892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:43:29.414584 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 397/778] 10.222.0.84 () {56 vars in 1087 bytes} [Wed May 25 14:43:29 2022] GET /identity/v3/services => generated 772 bytes in 301 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:43:29.435685 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG dbcounter [-] [101892] Writing DB stats keystone:SELECT=100 {{(pid=101892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:43:29.458903 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb57680-3863-451c-90a9-8c95a07dd761 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:43:29.458903 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb57680-3863-451c-90a9-8c95a07dd761 None admin] REQUEST_METHOD: `GET` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:43:29.458903 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb57680-3863-451c-90a9-8c95a07dd761 None admin] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:43:29.458903 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb57680-3863-451c-90a9-8c95a07dd761 None admin] PATH_INFO: `/v3/projects` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:43:29.459374 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbb57680-3863-451c-90a9-8c95a07dd761 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=101892) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:43:29.459374 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbb57680-3863-451c-90a9-8c95a07dd761 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:43:29.459374 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbb57680-3863-451c-90a9-8c95a07dd761 None admin] RBAC: Authorization granted {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:43:29.473660 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 382/779] 10.222.0.84 () {56 vars in 1148 bytes} [Wed May 25 14:43:29 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:43:29.479894 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d74a53d-1035-462e-b3cb-47716653b699 None admin] Authenticating user token {{(pid=101893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:43:29.604858 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d74a53d-1035-462e-b3cb-47716653b699 None admin] Validating token access rules against request {{(pid=101893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:43:29.665627 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05309215-a143-4099-a436-08e228361a5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:43:29.666758 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05309215-a143-4099-a436-08e228361a5f None admin] REQUEST_METHOD: `GET` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:43:29.667255 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05309215-a143-4099-a436-08e228361a5f None admin] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:43:29.667755 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05309215-a143-4099-a436-08e228361a5f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:43:29.668827 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05309215-a143-4099-a436-08e228361a5f None admin] RBAC: Adding query filter params (role.id=fdcb2eda27b84f44a392b7e8b59cc425, scope.project.id=a000829c658c4a7cab67f7b6353ba3fa, user.id=049a7ab3f95f460e908f79cc321176fd) {{(pid=101893) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:43:29.669344 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05309215-a143-4099-a436-08e228361a5f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:43:29.670993 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05309215-a143-4099-a436-08e228361a5f None admin] RBAC: Authorization granted {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:43:29.680715 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 398/780] 10.222.0.84 () {56 vars in 1374 bytes} [Wed May 25 14:43:29 2022] GET /identity/v3/role_assignments?user.id=049a7ab3f95f460e908f79cc321176fd&scope.project.id=a000829c658c4a7cab67f7b6353ba3fa&role.id=fdcb2eda27b84f44a392b7e8b59cc425 => generated 259 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 14:43:30.140517 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6e6575-8ed1-46e5-8b53-e53b226b95d9 None None] REQUEST_METHOD: `GET` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:43:30.141041 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6e6575-8ed1-46e5-8b53-e53b226b95d9 None None] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:43:30.141041 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6e6575-8ed1-46e5-8b53-e53b226b95d9 None None] PATH_INFO: `/` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:43:30.142681 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 383/781] 10.222.0.84 () {54 vars in 926 bytes} [Wed May 25 14:43:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 14:43:30.148213 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bbd8e99-321b-4a93-b056-106c9d091716 None None] REQUEST_METHOD: `POST` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:43:30.148504 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bbd8e99-321b-4a93-b056-106c9d091716 None None] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:43:30.148782 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bbd8e99-321b-4a93-b056-106c9d091716 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:43:30.176608 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.auth.core [None req-2bbd8e99-321b-4a93-b056-106c9d091716 None None] MFA Rules not processed for user `05d87e87798e429aa1c10b24391f915e`. Rule list: `[]` (Enabled: `True`). {{(pid=101893) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:43:30.178342 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.fernet_utils [None req-2bbd8e99-321b-4a93-b056-106c9d091716 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=101893) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:43:30.252459 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG dbcounter [-] [101893] Writing DB stats keystone:SELECT=100 {{(pid=101893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:43:30.263855 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 399/782] 10.222.0.84 () {58 vars in 1023 bytes} [Wed May 25 14:43:30 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 25 14:43:30.279271 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b85fe5-ec8e-463d-9670-22c2dade73ae None None] REQUEST_METHOD: `GET` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:43:30.279574 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b85fe5-ec8e-463d-9670-22c2dade73ae None None] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:43:30.279870 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b85fe5-ec8e-463d-9670-22c2dade73ae None None] PATH_INFO: `/` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:43:30.281402 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 384/783] 10.222.0.84 () {54 vars in 926 bytes} [Wed May 25 14:43:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 14:43:30.287026 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9661bea-1a82-4170-a056-d076b6786ae8 None None] REQUEST_METHOD: `POST` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:43:30.287317 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9661bea-1a82-4170-a056-d076b6786ae8 None None] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:43:30.287752 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9661bea-1a82-4170-a056-d076b6786ae8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:43:30.305221 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28b85fe5-ec8e-463d-9670-22c2dade73ae None None] Authenticating user token {{(pid=101892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:43:30.305406 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.auth.core [None req-c9661bea-1a82-4170-a056-d076b6786ae8 None None] MFA Rules not processed for user `05d87e87798e429aa1c10b24391f915e`. Rule list: `[]` (Enabled: `True`). {{(pid=101893) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:43:30.306470 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.fernet_utils [None req-c9661bea-1a82-4170-a056-d076b6786ae8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=101893) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:43:30.377656 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 400/784] 10.222.0.84 () {58 vars in 1023 bytes} [Wed May 25 14:43:30 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 25 14:43:30.402169 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9661bea-1a82-4170-a056-d076b6786ae8 None None] Authenticating user token {{(pid=101893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:43:30.451419 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28b85fe5-ec8e-463d-9670-22c2dade73ae None None] Validating token access rules against request {{(pid=101892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:43:30.489155 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7a5ab52-d9f8-41f0-90f5-78da347b0372 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:43:30.490912 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a5ab52-d9f8-41f0-90f5-78da347b0372 None admin] REQUEST_METHOD: `GET` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:43:30.491547 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a5ab52-d9f8-41f0-90f5-78da347b0372 None admin] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:43:30.492082 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a5ab52-d9f8-41f0-90f5-78da347b0372 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:43:30.505661 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9661bea-1a82-4170-a056-d076b6786ae8 None None] Validating token access rules against request {{(pid=101893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:43:30.509014 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7a5ab52-d9f8-41f0-90f5-78da347b0372 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 14:43:30.525349 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application [None req-a7a5ab52-d9f8-41f0-90f5-78da347b0372 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 25 14:43:30.525349 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:43:30.525349 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 14:43:30.525349 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 14:43:30.525349 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 14:43:30.525349 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 14:43:30.525349 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 14:43:30.525349 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 14:43:30.525349 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 14:43:30.525349 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 14:43:30.525349 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 14:43:30.525349 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 14:43:30.525349 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 14:43:30.525349 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 14:43:30.525349 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 14:43:30.525349 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 14:43:30.526324 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 14:43:30.526324 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 14:43:30.526324 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 14:43:30.526324 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 14:43:30.526324 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 14:43:30.526324 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 14:43:30.526324 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 14:43:30.526324 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 14:43:30.526324 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 14:43:30.526324 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application return self.get_or_create( May 25 14:43:30.526324 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 14:43:30.526324 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application with Lock( May 25 14:43:30.526324 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 14:43:30.526324 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application return self._enter() May 25 14:43:30.526324 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 14:43:30.526324 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 14:43:30.527171 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 14:43:30.527171 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application return self.creator() May 25 14:43:30.527171 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 14:43:30.527171 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application created_value = creator( May 25 14:43:30.527171 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 14:43:30.527171 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 14:43:30.527171 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 14:43:30.527171 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 14:43:30.527171 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 14:43:30.527171 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 14:43:30.527171 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 25 14:43:30.527171 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application May 25 14:43:30.527171 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 385/785] 10.222.0.84 () {56 vars in 1096 bytes} [Wed May 25 14:43:30 2022] GET /identity/v3/roles/admin => generated 83 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 14:43:30.536464 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7a5ab52-d9f8-41f0-90f5-78da347b0372 None admin] Authenticating user token {{(pid=101892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:43:30.549499 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG dbcounter [-] [101893] Writing DB stats keystone:SELECT=100 {{(pid=101893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:43:30.580839 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b5b2cfe-e069-4a07-9020-670dd5108146 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:43:30.581918 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5b2cfe-e069-4a07-9020-670dd5108146 None admin] REQUEST_METHOD: `GET` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:43:30.582379 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5b2cfe-e069-4a07-9020-670dd5108146 None admin] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:43:30.582829 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5b2cfe-e069-4a07-9020-670dd5108146 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:43:30.597421 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b5b2cfe-e069-4a07-9020-670dd5108146 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 14:43:30.613886 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application [None req-6b5b2cfe-e069-4a07-9020-670dd5108146 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 25 14:43:30.613886 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:43:30.613886 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 14:43:30.613886 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 14:43:30.613886 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 14:43:30.613886 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 14:43:30.613886 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 14:43:30.613886 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 14:43:30.613886 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 14:43:30.613886 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 14:43:30.613886 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 14:43:30.613886 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 14:43:30.613886 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 14:43:30.613886 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 14:43:30.613886 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 14:43:30.613886 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 14:43:30.615400 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 14:43:30.615400 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 14:43:30.615400 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 14:43:30.615400 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 14:43:30.615400 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 14:43:30.615400 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 14:43:30.615400 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 14:43:30.615400 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 14:43:30.615400 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 14:43:30.615400 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return self.get_or_create( May 25 14:43:30.615400 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 14:43:30.615400 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application with Lock( May 25 14:43:30.615400 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 14:43:30.615400 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return self._enter() May 25 14:43:30.615400 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 14:43:30.615400 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 14:43:30.616314 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 14:43:30.616314 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return self.creator() May 25 14:43:30.616314 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 14:43:30.616314 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application created_value = creator( May 25 14:43:30.616314 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 14:43:30.616314 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 14:43:30.616314 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 14:43:30.616314 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 14:43:30.616314 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 14:43:30.616314 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 14:43:30.616314 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 25 14:43:30.616314 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application May 25 14:43:30.623638 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG dbcounter [-] [101892] Writing DB stats keystone:SELECT=100 {{(pid=101892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:43:30.628475 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 401/786] 10.222.0.84 () {56 vars in 1096 bytes} [Wed May 25 14:43:30 2022] GET /identity/v3/roles/admin => generated 83 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 25 14:43:30.633347 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b5b2cfe-e069-4a07-9020-670dd5108146 None admin] Authenticating user token {{(pid=101893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:43:30.705834 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7a5ab52-d9f8-41f0-90f5-78da347b0372 None admin] Validating token access rules against request {{(pid=101892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:43:30.768987 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44d9dfa7-c9c0-4eff-8f49-ed84acaddbff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:43:30.769675 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d9dfa7-c9c0-4eff-8f49-ed84acaddbff None admin] REQUEST_METHOD: `GET` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:43:30.769959 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d9dfa7-c9c0-4eff-8f49-ed84acaddbff None admin] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:43:30.770236 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d9dfa7-c9c0-4eff-8f49-ed84acaddbff None admin] PATH_INFO: `/v3/roles` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:43:30.771039 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44d9dfa7-c9c0-4eff-8f49-ed84acaddbff None admin] RBAC: Adding query filter params (name=admin) {{(pid=101892) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:43:30.771349 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44d9dfa7-c9c0-4eff-8f49-ed84acaddbff None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:43:30.772769 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44d9dfa7-c9c0-4eff-8f49-ed84acaddbff None admin] RBAC: Authorization granted {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:43:30.787498 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 386/787] 10.222.0.84 () {56 vars in 1099 bytes} [Wed May 25 14:43:30 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:43:30.796555 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44d9dfa7-c9c0-4eff-8f49-ed84acaddbff None admin] Authenticating user token {{(pid=101892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:43:30.823599 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b5b2cfe-e069-4a07-9020-670dd5108146 None admin] Validating token access rules against request {{(pid=101893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:43:30.885855 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18d8f1c4-e449-4c55-8c8a-1ba6e3dd19d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:43:30.886550 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d8f1c4-e449-4c55-8c8a-1ba6e3dd19d9 None admin] REQUEST_METHOD: `GET` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:43:30.886838 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d8f1c4-e449-4c55-8c8a-1ba6e3dd19d9 None admin] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:43:30.887117 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d8f1c4-e449-4c55-8c8a-1ba6e3dd19d9 None admin] PATH_INFO: `/v3/roles` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:43:30.887919 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18d8f1c4-e449-4c55-8c8a-1ba6e3dd19d9 None admin] RBAC: Adding query filter params (name=admin) {{(pid=101893) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:43:30.888234 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18d8f1c4-e449-4c55-8c8a-1ba6e3dd19d9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:43:30.889679 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18d8f1c4-e449-4c55-8c8a-1ba6e3dd19d9 None admin] RBAC: Authorization granted {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:43:30.908373 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 402/788] 10.222.0.84 () {56 vars in 1099 bytes} [Wed May 25 14:43:30 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 275 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:43:30.915836 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18d8f1c4-e449-4c55-8c8a-1ba6e3dd19d9 None admin] Authenticating user token {{(pid=101893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:43:30.977704 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG dbcounter [-] [101892] Writing DB stats keystone:SELECT=100 {{(pid=101892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:43:30.988931 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44d9dfa7-c9c0-4eff-8f49-ed84acaddbff None admin] Validating token access rules against request {{(pid=101892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:43:30.999978 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG dbcounter [-] [101893] Writing DB stats keystone:SELECT=100 {{(pid=101893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:43:31.057178 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b50ef808-973c-431d-994f-56c529e3833b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:43:31.058360 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50ef808-973c-431d-994f-56c529e3833b None admin] REQUEST_METHOD: `GET` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:43:31.058879 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50ef808-973c-431d-994f-56c529e3833b None admin] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:43:31.059365 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50ef808-973c-431d-994f-56c529e3833b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:43:31.081966 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b50ef808-973c-431d-994f-56c529e3833b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:43:31.083927 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b50ef808-973c-431d-994f-56c529e3833b None admin] RBAC: Authorization granted {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:43:31.113801 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18d8f1c4-e449-4c55-8c8a-1ba6e3dd19d9 None admin] Validating token access rules against request {{(pid=101893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:43:31.116395 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application [None req-b50ef808-973c-431d-994f-56c529e3833b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 25 14:43:31.116395 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:43:31.116395 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 14:43:31.116395 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 14:43:31.116395 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 14:43:31.116395 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 14:43:31.116395 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 14:43:31.116395 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 14:43:31.116395 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 14:43:31.116395 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 14:43:31.116395 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 14:43:31.116395 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 14:43:31.116395 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 25 14:43:31.116395 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 25 14:43:31.116395 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 25 14:43:31.117337 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 25 14:43:31.117337 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 14:43:31.117337 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 14:43:31.117337 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 14:43:31.117337 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 14:43:31.117337 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 14:43:31.117337 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application return self.get_or_create( May 25 14:43:31.117337 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 14:43:31.117337 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application with Lock( May 25 14:43:31.117337 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 14:43:31.117337 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application return self._enter() May 25 14:43:31.117337 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 14:43:31.117337 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 14:43:31.117337 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 14:43:31.117337 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application return self.creator() May 25 14:43:31.117337 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 14:43:31.117337 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application created_value = creator( May 25 14:43:31.118269 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 25 14:43:31.118269 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 25 14:43:31.118269 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 25 14:43:31.118269 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application May 25 14:43:31.120682 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 387/789] 10.222.0.84 () {56 vars in 1108 bytes} [Wed May 25 14:43:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 324 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 14:43:31.127128 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83fe312-e13d-4ebd-80b4-3c9c777018e0 None None] REQUEST_METHOD: `GET` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:43:31.128026 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83fe312-e13d-4ebd-80b4-3c9c777018e0 None None] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:43:31.128563 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83fe312-e13d-4ebd-80b4-3c9c777018e0 None None] PATH_INFO: `/` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:43:31.130338 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 388/790] 10.222.0.84 () {54 vars in 926 bytes} [Wed May 25 14:43:31 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 14:43:31.131029 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e83fe312-e13d-4ebd-80b4-3c9c777018e0 None None] Authenticating user token {{(pid=101892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:43:31.163087 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f25df5-d829-45cb-8907-77739a7a74a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:43:31.164268 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f25df5-d829-45cb-8907-77739a7a74a5 None admin] REQUEST_METHOD: `GET` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:43:31.164755 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f25df5-d829-45cb-8907-77739a7a74a5 None admin] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:43:31.165205 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f25df5-d829-45cb-8907-77739a7a74a5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:43:31.177885 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56f25df5-d829-45cb-8907-77739a7a74a5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:43:31.179601 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56f25df5-d829-45cb-8907-77739a7a74a5 None admin] RBAC: Authorization granted {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:43:31.198540 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application [None req-56f25df5-d829-45cb-8907-77739a7a74a5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 25 14:43:31.198540 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:43:31.198540 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 14:43:31.198540 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 14:43:31.198540 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 14:43:31.198540 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 14:43:31.198540 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 14:43:31.198540 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 14:43:31.198540 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 14:43:31.198540 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 14:43:31.198540 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 14:43:31.198540 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 14:43:31.198540 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 25 14:43:31.198540 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 25 14:43:31.198540 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 25 14:43:31.199606 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 25 14:43:31.199606 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 14:43:31.199606 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 14:43:31.199606 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 14:43:31.199606 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 14:43:31.199606 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 14:43:31.199606 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return self.get_or_create( May 25 14:43:31.199606 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 14:43:31.199606 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application with Lock( May 25 14:43:31.199606 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 14:43:31.199606 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return self._enter() May 25 14:43:31.199606 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 14:43:31.199606 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 14:43:31.199606 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 14:43:31.199606 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return self.creator() May 25 14:43:31.199606 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 14:43:31.199606 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application created_value = creator( May 25 14:43:31.200926 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 25 14:43:31.200926 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 25 14:43:31.200926 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 25 14:43:31.200926 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application May 25 14:43:31.200926 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 403/791] 10.222.0.84 () {56 vars in 1108 bytes} [Wed May 25 14:43:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 285 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 14:43:31.201306 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb0eba9-3d7a-4948-983d-18e335c1f1d8 None None] REQUEST_METHOD: `POST` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:43:31.201596 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb0eba9-3d7a-4948-983d-18e335c1f1d8 None None] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:43:31.201914 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb0eba9-3d7a-4948-983d-18e335c1f1d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:43:31.220516 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.auth.core [None req-dcb0eba9-3d7a-4948-983d-18e335c1f1d8 None None] MFA Rules not processed for user `05d87e87798e429aa1c10b24391f915e`. Rule list: `[]` (Enabled: `True`). {{(pid=101893) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:43:31.221724 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.fernet_utils [None req-dcb0eba9-3d7a-4948-983d-18e335c1f1d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=101893) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:43:31.270238 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e83fe312-e13d-4ebd-80b4-3c9c777018e0 None None] Validating token access rules against request {{(pid=101892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:43:31.296043 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 404/792] 10.222.0.84 () {58 vars in 1023 bytes} [Wed May 25 14:43:31 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 25 14:43:31.296911 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcb0eba9-3d7a-4948-983d-18e335c1f1d8 None None] Authenticating user token {{(pid=101893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:43:31.316055 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bd32219-84b6-4d30-8d0d-04d96ec376d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:43:31.317306 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd32219-84b6-4d30-8d0d-04d96ec376d4 None admin] REQUEST_METHOD: `GET` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:43:31.317760 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd32219-84b6-4d30-8d0d-04d96ec376d4 None admin] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:43:31.318178 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd32219-84b6-4d30-8d0d-04d96ec376d4 None admin] PATH_INFO: `/v3/domains` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:43:31.319541 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bd32219-84b6-4d30-8d0d-04d96ec376d4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=101892) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:43:31.320038 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bd32219-84b6-4d30-8d0d-04d96ec376d4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:43:31.322032 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bd32219-84b6-4d30-8d0d-04d96ec376d4 None admin] RBAC: Authorization granted {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:43:31.322690 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG dbcounter [-] [101893] Writing DB stats keystone:SELECT=100 {{(pid=101893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:43:31.338925 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 389/793] 10.222.0.84 () {56 vars in 1109 bytes} [Wed May 25 14:43:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:43:31.340557 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bd32219-84b6-4d30-8d0d-04d96ec376d4 None admin] Authenticating user token {{(pid=101892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:43:31.363323 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG dbcounter [-] [101892] Writing DB stats keystone:SELECT=100 {{(pid=101892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:43:31.424881 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcb0eba9-3d7a-4948-983d-18e335c1f1d8 None None] Validating token access rules against request {{(pid=101893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:43:31.456330 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bd32219-84b6-4d30-8d0d-04d96ec376d4 None admin] Validating token access rules against request {{(pid=101892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:43:31.475512 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a29e4c-841b-4e69-8382-3bb3feda8a4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:43:31.476833 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a29e4c-841b-4e69-8382-3bb3feda8a4c None admin] REQUEST_METHOD: `GET` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:43:31.477296 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a29e4c-841b-4e69-8382-3bb3feda8a4c None admin] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:43:31.477747 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a29e4c-841b-4e69-8382-3bb3feda8a4c None admin] PATH_INFO: `/v3/domains` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:43:31.478640 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5a29e4c-841b-4e69-8382-3bb3feda8a4c None admin] RBAC: Adding query filter params (name=Default) {{(pid=101893) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:43:31.479584 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5a29e4c-841b-4e69-8382-3bb3feda8a4c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:43:31.481651 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5a29e4c-841b-4e69-8382-3bb3feda8a4c None admin] RBAC: Authorization granted {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:43:31.493449 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfcd9ee1-afcd-4227-bbe1-c2c1c6447064 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:43:31.494256 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfcd9ee1-afcd-4227-bbe1-c2c1c6447064 None admin] REQUEST_METHOD: `GET` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:43:31.494704 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfcd9ee1-afcd-4227-bbe1-c2c1c6447064 None admin] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:43:31.495013 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfcd9ee1-afcd-4227-bbe1-c2c1c6447064 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:43:31.495773 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfcd9ee1-afcd-4227-bbe1-c2c1c6447064 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:43:31.497515 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfcd9ee1-afcd-4227-bbe1-c2c1c6447064 None admin] RBAC: Authorization granted {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:43:31.497992 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 405/794] 10.222.0.84 () {56 vars in 1109 bytes} [Wed May 25 14:43:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:43:31.499094 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a29e4c-841b-4e69-8382-3bb3feda8a4c None admin] Authenticating user token {{(pid=101893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:43:31.515750 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application [None req-bfcd9ee1-afcd-4227-bbe1-c2c1c6447064 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. May 25 14:43:31.515750 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:43:31.515750 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 25 14:43:31.515750 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 25 14:43:31.515750 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 25 14:43:31.515750 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 25 14:43:31.515750 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 25 14:43:31.515750 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 25 14:43:31.515750 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. May 25 14:43:31.515750 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application May 25 14:43:31.515750 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 25 14:43:31.515750 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application May 25 14:43:31.515750 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:43:31.515750 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 14:43:31.515750 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 14:43:31.515750 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 14:43:31.516778 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 14:43:31.516778 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 14:43:31.516778 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 14:43:31.516778 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 14:43:31.516778 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 14:43:31.516778 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 14:43:31.516778 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 14:43:31.516778 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 25 14:43:31.516778 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application return self._get_service(service_id) May 25 14:43:31.516778 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 25 14:43:31.516778 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 25 14:43:31.516778 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 14:43:31.516778 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 14:43:31.516778 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 14:43:31.516778 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 14:43:31.516778 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 14:43:31.517633 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application return self.get_or_create( May 25 14:43:31.517633 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 14:43:31.517633 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application with Lock( May 25 14:43:31.517633 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 14:43:31.517633 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application return self._enter() May 25 14:43:31.517633 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 14:43:31.517633 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 14:43:31.517633 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 14:43:31.517633 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application return self.creator() May 25 14:43:31.517633 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 14:43:31.517633 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application created_value = creator( May 25 14:43:31.517633 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 25 14:43:31.517633 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 25 14:43:31.517633 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. May 25 14:43:31.517633 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application May 25 14:43:31.521659 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 390/795] 10.222.0.84 () {56 vars in 1129 bytes} [Wed May 25 14:43:31 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 14:43:31.522654 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfcd9ee1-afcd-4227-bbe1-c2c1c6447064 None admin] Authenticating user token {{(pid=101892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:43:31.609159 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG dbcounter [-] [101892] Writing DB stats keystone:SELECT=100 {{(pid=101892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:43:31.620242 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG dbcounter [-] [101893] Writing DB stats keystone:SELECT=100 {{(pid=101893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:43:31.632853 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfcd9ee1-afcd-4227-bbe1-c2c1c6447064 None admin] Validating token access rules against request {{(pid=101892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:43:31.648641 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a29e4c-841b-4e69-8382-3bb3feda8a4c None admin] Validating token access rules against request {{(pid=101893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:43:31.671536 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-207a264f-23c7-42b0-8eaf-1715b7f6f60b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:43:31.672645 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-207a264f-23c7-42b0-8eaf-1715b7f6f60b None admin] REQUEST_METHOD: `GET` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:43:31.673102 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-207a264f-23c7-42b0-8eaf-1715b7f6f60b None admin] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:43:31.673478 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-207a264f-23c7-42b0-8eaf-1715b7f6f60b None admin] PATH_INFO: `/v3/users/nova` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:43:31.681986 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-207a264f-23c7-42b0-8eaf-1715b7f6f60b None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:43:31.683845 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-207a264f-23c7-42b0-8eaf-1715b7f6f60b None admin] RBAC: Authorization granted {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:43:31.692435 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bea1122-7ae3-43b0-afdb-e3fd23d04500 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:43:31.693995 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bea1122-7ae3-43b0-afdb-e3fd23d04500 None admin] REQUEST_METHOD: `GET` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:43:31.694425 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bea1122-7ae3-43b0-afdb-e3fd23d04500 None admin] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:43:31.694842 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bea1122-7ae3-43b0-afdb-e3fd23d04500 None admin] PATH_INFO: `/v3/users/swift` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:43:31.700534 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application [None req-207a264f-23c7-42b0-8eaf-1715b7f6f60b None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 25 14:43:31.700534 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:43:31.700534 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 14:43:31.700534 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 14:43:31.700534 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 14:43:31.700534 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 14:43:31.700534 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 14:43:31.700534 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 14:43:31.700534 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 14:43:31.700534 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 14:43:31.700534 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 14:43:31.700534 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 14:43:31.700534 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 25 14:43:31.700534 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application return self._get_user(user_id) May 25 14:43:31.700534 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 25 14:43:31.700534 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 25 14:43:31.701695 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 14:43:31.701695 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 14:43:31.701695 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 25 14:43:31.701695 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 25 14:43:31.701695 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 25 14:43:31.701695 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 25 14:43:31.701695 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 14:43:31.701695 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 14:43:31.701695 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 14:43:31.701695 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application return self.get_or_create( May 25 14:43:31.701695 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 14:43:31.701695 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application with Lock( May 25 14:43:31.701695 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 14:43:31.701695 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application return self._enter() May 25 14:43:31.701695 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 14:43:31.701695 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 14:43:31.701695 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 14:43:31.701695 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application return self.creator() May 25 14:43:31.702870 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 14:43:31.702870 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application created_value = creator( May 25 14:43:31.702870 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 25 14:43:31.702870 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 25 14:43:31.702870 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 25 14:43:31.702870 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 25 14:43:31.702870 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 25 14:43:31.702870 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 25 14:43:31.702870 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 25 14:43:31.702870 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application May 25 14:43:31.706103 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bea1122-7ae3-43b0-afdb-e3fd23d04500 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:43:31.707836 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bea1122-7ae3-43b0-afdb-e3fd23d04500 None admin] RBAC: Authorization granted {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:43:31.707950 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 391/796] 10.222.0.84 () {56 vars in 1093 bytes} [Wed May 25 14:43:31 2022] GET /identity/v3/users/nova => generated 82 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 14:43:31.709480 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-207a264f-23c7-42b0-8eaf-1715b7f6f60b None admin] Authenticating user token {{(pid=101892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:43:31.726735 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application [None req-5bea1122-7ae3-43b0-afdb-e3fd23d04500 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. May 25 14:43:31.726735 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:43:31.726735 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 14:43:31.726735 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 14:43:31.726735 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 14:43:31.726735 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 14:43:31.726735 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 14:43:31.726735 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 14:43:31.726735 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 14:43:31.726735 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 14:43:31.726735 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 14:43:31.726735 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 14:43:31.726735 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 25 14:43:31.726735 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return self._get_user(user_id) May 25 14:43:31.726735 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 25 14:43:31.726735 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 25 14:43:31.727766 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 14:43:31.727766 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 14:43:31.727766 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 25 14:43:31.727766 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 25 14:43:31.727766 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 25 14:43:31.727766 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 25 14:43:31.727766 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 14:43:31.727766 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 14:43:31.727766 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 14:43:31.727766 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return self.get_or_create( May 25 14:43:31.727766 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 14:43:31.727766 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application with Lock( May 25 14:43:31.727766 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 14:43:31.727766 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return self._enter() May 25 14:43:31.727766 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 14:43:31.727766 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 14:43:31.727766 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 14:43:31.727766 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return self.creator() May 25 14:43:31.728778 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 14:43:31.728778 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application created_value = creator( May 25 14:43:31.728778 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 25 14:43:31.728778 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 25 14:43:31.728778 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 25 14:43:31.728778 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 25 14:43:31.728778 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 25 14:43:31.728778 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 25 14:43:31.728778 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. May 25 14:43:31.728778 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application May 25 14:43:31.731764 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 406/797] 10.222.0.84 () {56 vars in 1096 bytes} [Wed May 25 14:43:31 2022] GET /identity/v3/users/swift => generated 83 bytes in 233 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 14:43:31.733047 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bea1122-7ae3-43b0-afdb-e3fd23d04500 None admin] Authenticating user token {{(pid=101893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:43:31.822005 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-207a264f-23c7-42b0-8eaf-1715b7f6f60b None admin] Validating token access rules against request {{(pid=101892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:43:31.854915 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bea1122-7ae3-43b0-afdb-e3fd23d04500 None admin] Validating token access rules against request {{(pid=101893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:43:31.856776 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f5e26af-7fc9-4048-8a15-3da0c79574df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:43:31.857517 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5e26af-7fc9-4048-8a15-3da0c79574df None admin] REQUEST_METHOD: `GET` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:43:31.857899 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5e26af-7fc9-4048-8a15-3da0c79574df None admin] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:43:31.858275 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5e26af-7fc9-4048-8a15-3da0c79574df None admin] PATH_INFO: `/v3/services` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:43:31.859082 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f5e26af-7fc9-4048-8a15-3da0c79574df None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=101892) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:43:31.859488 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f5e26af-7fc9-4048-8a15-3da0c79574df None admin] RBAC: Authorizing `identity:list_services()` {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:43:31.860984 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f5e26af-7fc9-4048-8a15-3da0c79574df None admin] RBAC: Authorization granted {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:43:31.863182 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG dbcounter [-] [101892] Writing DB stats keystone:SELECT=100 {{(pid=101892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:43:31.867019 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 392/798] 10.222.0.84 () {56 vars in 1124 bytes} [Wed May 25 14:43:31 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:43:31.867976 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f5e26af-7fc9-4048-8a15-3da0c79574df None admin] Authenticating user token {{(pid=101892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:43:31.898721 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2744f39-34b5-4bbe-88e7-55c7684266c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:43:31.899492 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2744f39-34b5-4bbe-88e7-55c7684266c3 None admin] REQUEST_METHOD: `GET` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:43:31.899811 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2744f39-34b5-4bbe-88e7-55c7684266c3 None admin] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:43:31.900091 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2744f39-34b5-4bbe-88e7-55c7684266c3 None admin] PATH_INFO: `/v3/users` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:43:31.900990 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2744f39-34b5-4bbe-88e7-55c7684266c3 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=101893) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:43:31.901304 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2744f39-34b5-4bbe-88e7-55c7684266c3 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:43:31.902899 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2744f39-34b5-4bbe-88e7-55c7684266c3 None admin] RBAC: Authorization granted {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:43:31.927938 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 407/799] 10.222.0.84 () {56 vars in 1133 bytes} [Wed May 25 14:43:31 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:43:31.929097 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2744f39-34b5-4bbe-88e7-55c7684266c3 None admin] Authenticating user token {{(pid=101893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:43:31.931983 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG dbcounter [-] [101893] Writing DB stats keystone:SELECT=100 {{(pid=101893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:43:31.972348 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f5e26af-7fc9-4048-8a15-3da0c79574df None admin] Validating token access rules against request {{(pid=101892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:43:32.007272 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0edd8be9-5d74-425b-9756-f02ebc821094 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:43:32.007969 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0edd8be9-5d74-425b-9756-f02ebc821094 None admin] REQUEST_METHOD: `GET` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:43:32.008251 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0edd8be9-5d74-425b-9756-f02ebc821094 None admin] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:43:32.008524 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0edd8be9-5d74-425b-9756-f02ebc821094 None admin] PATH_INFO: `/v3/users` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:43:32.009358 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0edd8be9-5d74-425b-9756-f02ebc821094 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=101892) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:43:32.009667 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0edd8be9-5d74-425b-9756-f02ebc821094 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:43:32.011092 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0edd8be9-5d74-425b-9756-f02ebc821094 None admin] RBAC: Authorization granted {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:43:32.029396 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 393/800] 10.222.0.84 () {56 vars in 1135 bytes} [Wed May 25 14:43:31 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:43:32.034639 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0edd8be9-5d74-425b-9756-f02ebc821094 None admin] Authenticating user token {{(pid=101892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:43:32.041636 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2744f39-34b5-4bbe-88e7-55c7684266c3 None admin] Validating token access rules against request {{(pid=101893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:43:32.085835 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6af8299-c235-4b29-8971-32e0fad61843 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:43:32.086442 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6af8299-c235-4b29-8971-32e0fad61843 None admin] REQUEST_METHOD: `GET` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:43:32.086729 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6af8299-c235-4b29-8971-32e0fad61843 None admin] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:43:32.087104 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6af8299-c235-4b29-8971-32e0fad61843 None admin] PATH_INFO: `/v3/services` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:43:32.087869 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6af8299-c235-4b29-8971-32e0fad61843 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=101893) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:43:32.088183 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6af8299-c235-4b29-8971-32e0fad61843 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:43:32.089706 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6af8299-c235-4b29-8971-32e0fad61843 None admin] RBAC: Authorization granted {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:43:32.100785 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 408/801] 10.222.0.84 () {56 vars in 1124 bytes} [Wed May 25 14:43:31 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:43:32.101953 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6af8299-c235-4b29-8971-32e0fad61843 None admin] Authenticating user token {{(pid=101893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:43:32.104799 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG dbcounter [-] [101892] Writing DB stats keystone:SELECT=100 {{(pid=101892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:43:32.149749 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0edd8be9-5d74-425b-9756-f02ebc821094 None admin] Validating token access rules against request {{(pid=101892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:43:32.176368 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG dbcounter [-] [101893] Writing DB stats keystone:SELECT=100 {{(pid=101893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:43:32.189730 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c61d2b4f-0f81-4b3f-974a-f31f670c09a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:43:32.190523 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61d2b4f-0f81-4b3f-974a-f31f670c09a6 None admin] REQUEST_METHOD: `GET` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:43:32.190903 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61d2b4f-0f81-4b3f-974a-f31f670c09a6 None admin] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:43:32.191235 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61d2b4f-0f81-4b3f-974a-f31f670c09a6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:43:32.222928 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6af8299-c235-4b29-8971-32e0fad61843 None admin] Validating token access rules against request {{(pid=101893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:43:32.261992 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4f65ad2-b939-4553-8d52-bdb3b7284019 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:43:32.262892 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f65ad2-b939-4553-8d52-bdb3b7284019 None admin] REQUEST_METHOD: `GET` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:43:32.263122 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f65ad2-b939-4553-8d52-bdb3b7284019 None admin] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:43:32.263399 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f65ad2-b939-4553-8d52-bdb3b7284019 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:43:32.266664 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c61d2b4f-0f81-4b3f-974a-f31f670c09a6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:43:32.268146 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c61d2b4f-0f81-4b3f-974a-f31f670c09a6 None admin] RBAC: Authorization granted {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:43:32.274011 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4f65ad2-b939-4553-8d52-bdb3b7284019 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:43:32.275576 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4f65ad2-b939-4553-8d52-bdb3b7284019 None admin] RBAC: Authorization granted {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:43:32.294282 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application [None req-a4f65ad2-b939-4553-8d52-bdb3b7284019 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 25 14:43:32.294282 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:43:32.294282 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 14:43:32.294282 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 14:43:32.294282 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 14:43:32.294282 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 14:43:32.294282 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 14:43:32.294282 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 14:43:32.294282 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 14:43:32.294282 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 14:43:32.294282 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 14:43:32.294282 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 14:43:32.294282 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 25 14:43:32.294282 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 25 14:43:32.294282 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 25 14:43:32.295418 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 25 14:43:32.295418 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 14:43:32.295418 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 14:43:32.295418 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 14:43:32.295418 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 14:43:32.295418 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 14:43:32.295418 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return self.get_or_create( May 25 14:43:32.295418 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 14:43:32.295418 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application with Lock( May 25 14:43:32.295418 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 14:43:32.295418 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return self._enter() May 25 14:43:32.295418 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 14:43:32.295418 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 14:43:32.295418 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 14:43:32.295418 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return self.creator() May 25 14:43:32.295418 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 14:43:32.295418 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application created_value = creator( May 25 14:43:32.296438 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 25 14:43:32.296438 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 25 14:43:32.296438 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 25 14:43:32.296438 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application May 25 14:43:32.296438 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 409/802] 10.222.0.84 () {56 vars in 1108 bytes} [Wed May 25 14:43:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 14:43:32.296736 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4f65ad2-b939-4553-8d52-bdb3b7284019 None admin] Authenticating user token {{(pid=101893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:43:32.330999 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG dbcounter [-] [101892] Writing DB stats keystone:SELECT=100 {{(pid=101892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:43:32.372711 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 394/803] 10.222.0.84 () {58 vars in 1282 bytes} [Wed May 25 14:43:32 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 343 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 25 14:43:32.374036 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5d38d8-7e22-4150-a1f0-68fa3b001f29 None None] REQUEST_METHOD: `GET` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:43:32.374328 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5d38d8-7e22-4150-a1f0-68fa3b001f29 None None] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:43:32.374612 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5d38d8-7e22-4150-a1f0-68fa3b001f29 None None] PATH_INFO: `/` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:43:32.375926 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 395/804] 10.222.0.84 () {54 vars in 926 bytes} [Wed May 25 14:43:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 14:43:32.376998 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b061c7-a077-4f97-9b31-c2742abb5cce None None] REQUEST_METHOD: `GET` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:43:32.377301 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b061c7-a077-4f97-9b31-c2742abb5cce None None] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:43:32.377669 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b061c7-a077-4f97-9b31-c2742abb5cce None None] PATH_INFO: `/` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:43:32.378758 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 396/805] 10.222.0.84 () {54 vars in 926 bytes} [Wed May 25 14:43:32 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 14:43:32.379447 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58b061c7-a077-4f97-9b31-c2742abb5cce None None] Authenticating user token {{(pid=101892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:43:32.402587 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4f65ad2-b939-4553-8d52-bdb3b7284019 None admin] Validating token access rules against request {{(pid=101893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:43:32.419349 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG dbcounter [-] [101893] Writing DB stats keystone:SELECT=100 {{(pid=101893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:43:32.436491 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-651d38f0-c543-4e4e-94af-503518a31bfa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:43:32.437145 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651d38f0-c543-4e4e-94af-503518a31bfa None admin] REQUEST_METHOD: `POST` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:43:32.437461 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651d38f0-c543-4e4e-94af-503518a31bfa None admin] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:43:32.437736 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651d38f0-c543-4e4e-94af-503518a31bfa None admin] PATH_INFO: `/v3/endpoints` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:43:32.438460 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-651d38f0-c543-4e4e-94af-503518a31bfa None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:43:32.439860 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-651d38f0-c543-4e4e-94af-503518a31bfa None admin] RBAC: Authorization granted {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:43:32.479992 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58b061c7-a077-4f97-9b31-c2742abb5cce None None] Validating token access rules against request {{(pid=101892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:43:32.513787 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3672e56-9a51-4bfb-bca2-2b560ba799a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:43:32.514440 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3672e56-9a51-4bfb-bca2-2b560ba799a3 None admin] REQUEST_METHOD: `GET` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:43:32.514725 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3672e56-9a51-4bfb-bca2-2b560ba799a3 None admin] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:43:32.515004 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3672e56-9a51-4bfb-bca2-2b560ba799a3 None admin] PATH_INFO: `/v3/domains` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:43:32.515753 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3672e56-9a51-4bfb-bca2-2b560ba799a3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=101892) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:43:32.516072 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3672e56-9a51-4bfb-bca2-2b560ba799a3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:43:32.517434 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3672e56-9a51-4bfb-bca2-2b560ba799a3 None admin] RBAC: Authorization granted {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:43:32.528935 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 397/806] 10.222.0.84 () {56 vars in 1109 bytes} [Wed May 25 14:43:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:43:32.529740 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3672e56-9a51-4bfb-bca2-2b560ba799a3 None admin] Authenticating user token {{(pid=101892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:43:32.538408 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 410/807] 10.222.0.84 () {60 vars in 1144 bytes} [Wed May 25 14:43:32 2022] POST /identity/v3/endpoints => generated 346 bytes in 242 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 14:43:32.539777 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16493a64-9494-49fd-a584-94770f84870e None None] REQUEST_METHOD: `POST` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:43:32.544063 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16493a64-9494-49fd-a584-94770f84870e None None] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:43:32.544063 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16493a64-9494-49fd-a584-94770f84870e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:43:32.555895 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG dbcounter [-] [101892] Writing DB stats keystone:SELECT=100 {{(pid=101892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:43:32.569636 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.auth.core [None req-16493a64-9494-49fd-a584-94770f84870e None None] MFA Rules not processed for user `05d87e87798e429aa1c10b24391f915e`. Rule list: `[]` (Enabled: `True`). {{(pid=101893) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:43:32.570938 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.fernet_utils [None req-16493a64-9494-49fd-a584-94770f84870e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=101893) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:43:32.648509 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3672e56-9a51-4bfb-bca2-2b560ba799a3 None admin] Validating token access rules against request {{(pid=101892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:43:32.663616 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 411/808] 10.222.0.84 () {58 vars in 1023 bytes} [Wed May 25 14:43:32 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 25 14:43:32.663616 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774a074c-7e1d-41ed-8274-67a4b7d18773 None None] REQUEST_METHOD: `POST` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:43:32.663616 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774a074c-7e1d-41ed-8274-67a4b7d18773 None None] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:43:32.663616 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774a074c-7e1d-41ed-8274-67a4b7d18773 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:43:32.685541 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7120c4ef-2395-4cdf-83dc-236c5025e34d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:43:32.686348 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7120c4ef-2395-4cdf-83dc-236c5025e34d None admin] REQUEST_METHOD: `GET` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:43:32.686630 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7120c4ef-2395-4cdf-83dc-236c5025e34d None admin] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:43:32.686903 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7120c4ef-2395-4cdf-83dc-236c5025e34d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:43:32.689519 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.auth.core [None req-774a074c-7e1d-41ed-8274-67a4b7d18773 None None] MFA Rules not processed for user `05d87e87798e429aa1c10b24391f915e`. Rule list: `[]` (Enabled: `True`). {{(pid=101893) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:43:32.691233 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.fernet_utils [None req-774a074c-7e1d-41ed-8274-67a4b7d18773 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=101893) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:43:32.699508 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7120c4ef-2395-4cdf-83dc-236c5025e34d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:43:32.701020 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7120c4ef-2395-4cdf-83dc-236c5025e34d None admin] RBAC: Authorization granted {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:43:32.720874 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application [None req-7120c4ef-2395-4cdf-83dc-236c5025e34d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 25 14:43:32.720874 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:43:32.720874 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 14:43:32.720874 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 14:43:32.720874 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 14:43:32.720874 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 14:43:32.720874 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 14:43:32.720874 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 14:43:32.720874 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 14:43:32.720874 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 14:43:32.720874 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 14:43:32.720874 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 14:43:32.720874 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 25 14:43:32.720874 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 25 14:43:32.720874 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 25 14:43:32.721858 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 25 14:43:32.721858 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 14:43:32.721858 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 14:43:32.721858 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 14:43:32.721858 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 14:43:32.721858 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 14:43:32.721858 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application return self.get_or_create( May 25 14:43:32.721858 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 14:43:32.721858 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application with Lock( May 25 14:43:32.721858 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 14:43:32.721858 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application return self._enter() May 25 14:43:32.721858 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 14:43:32.721858 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 14:43:32.721858 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 14:43:32.721858 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application return self.creator() May 25 14:43:32.721858 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 14:43:32.721858 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application created_value = creator( May 25 14:43:32.722765 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 25 14:43:32.722765 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 25 14:43:32.722765 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 25 14:43:32.722765 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application May 25 14:43:32.722765 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 398/809] 10.222.0.84 () {56 vars in 1108 bytes} [Wed May 25 14:43:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 14:43:32.723045 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7120c4ef-2395-4cdf-83dc-236c5025e34d None admin] Authenticating user token {{(pid=101892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:43:32.779147 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 412/810] 10.222.0.84 () {58 vars in 1023 bytes} [Wed May 25 14:43:32 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 25 14:43:32.780120 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-774a074c-7e1d-41ed-8274-67a4b7d18773 None None] Authenticating user token {{(pid=101893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:43:32.816094 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG dbcounter [-] [101892] Writing DB stats keystone:SELECT=100 {{(pid=101892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:43:32.819358 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG dbcounter [-] [101893] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=101893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:43:32.848344 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7120c4ef-2395-4cdf-83dc-236c5025e34d None admin] Validating token access rules against request {{(pid=101892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:43:32.884372 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87cb6e85-0329-495e-bff1-1f11530a96b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:43:32.885175 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87cb6e85-0329-495e-bff1-1f11530a96b7 None admin] REQUEST_METHOD: `GET` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:43:32.885460 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87cb6e85-0329-495e-bff1-1f11530a96b7 None admin] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:43:32.885738 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87cb6e85-0329-495e-bff1-1f11530a96b7 None admin] PATH_INFO: `/v3/projects/service` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:43:32.889488 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-774a074c-7e1d-41ed-8274-67a4b7d18773 None None] Validating token access rules against request {{(pid=101893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:43:32.892749 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87cb6e85-0329-495e-bff1-1f11530a96b7 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:43:32.894256 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87cb6e85-0329-495e-bff1-1f11530a96b7 None admin] RBAC: Authorization granted {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:43:32.909500 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application [None req-87cb6e85-0329-495e-bff1-1f11530a96b7 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 25 14:43:32.909500 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:43:32.909500 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 14:43:32.909500 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 14:43:32.909500 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 14:43:32.909500 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 14:43:32.909500 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 14:43:32.909500 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 14:43:32.909500 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 14:43:32.909500 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 14:43:32.909500 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 14:43:32.909500 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 14:43:32.909500 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 25 14:43:32.909500 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application return self._get_project(project_id) May 25 14:43:32.909500 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 25 14:43:32.910618 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 25 14:43:32.910618 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 14:43:32.910618 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 14:43:32.910618 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 14:43:32.910618 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 14:43:32.910618 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 14:43:32.910618 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application return self.get_or_create( May 25 14:43:32.910618 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 14:43:32.910618 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application with Lock( May 25 14:43:32.910618 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 14:43:32.910618 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application return self._enter() May 25 14:43:32.910618 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 14:43:32.910618 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 14:43:32.910618 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 14:43:32.910618 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application return self.creator() May 25 14:43:32.910618 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 14:43:32.910618 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application created_value = creator( May 25 14:43:32.916421 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 25 14:43:32.916421 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 25 14:43:32.916421 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 25 14:43:32.916421 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 25 14:43:32.916421 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 25 14:43:32.916421 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 25 14:43:32.916421 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 25 14:43:32.916421 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application May 25 14:43:32.916421 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 399/811] 10.222.0.84 () {56 vars in 1111 bytes} [Wed May 25 14:43:32 2022] GET /identity/v3/projects/service => generated 88 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 14:43:32.916421 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87cb6e85-0329-495e-bff1-1f11530a96b7 None admin] Authenticating user token {{(pid=101892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:43:32.933422 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4743eb8-52b4-40f4-83b0-94c6b27dfb67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:43:32.934369 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4743eb8-52b4-40f4-83b0-94c6b27dfb67 None admin] REQUEST_METHOD: `GET` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:43:32.934657 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4743eb8-52b4-40f4-83b0-94c6b27dfb67 None admin] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:43:32.934938 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4743eb8-52b4-40f4-83b0-94c6b27dfb67 None admin] PATH_INFO: `/v3/roles/service` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:43:32.947262 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4743eb8-52b4-40f4-83b0-94c6b27dfb67 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 14:43:32.955506 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application [None req-a4743eb8-52b4-40f4-83b0-94c6b27dfb67 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 25 14:43:32.955506 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:43:32.955506 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 14:43:32.955506 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 14:43:32.955506 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 14:43:32.955506 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 14:43:32.955506 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 14:43:32.955506 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 14:43:32.955506 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 14:43:32.955506 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 14:43:32.955506 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 14:43:32.955506 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 14:43:32.955506 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 14:43:32.955506 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 14:43:32.955506 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 14:43:32.955506 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 14:43:32.956516 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 14:43:32.956516 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 14:43:32.956516 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 14:43:32.956516 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 14:43:32.956516 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 14:43:32.956516 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 14:43:32.956516 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 14:43:32.956516 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 14:43:32.956516 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 14:43:32.956516 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return self.get_or_create( May 25 14:43:32.956516 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 14:43:32.956516 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application with Lock( May 25 14:43:32.956516 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 14:43:32.956516 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return self._enter() May 25 14:43:32.956516 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 14:43:32.956516 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 14:43:32.957368 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 14:43:32.957368 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return self.creator() May 25 14:43:32.957368 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 14:43:32.957368 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application created_value = creator( May 25 14:43:32.957368 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 14:43:32.957368 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 14:43:32.957368 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 14:43:32.957368 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 14:43:32.957368 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 14:43:32.957368 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 14:43:32.957368 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 25 14:43:32.957368 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application May 25 14:43:32.957368 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 413/812] 10.222.0.84 () {56 vars in 1102 bytes} [Wed May 25 14:43:32 2022] GET /identity/v3/roles/service => generated 85 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 14:43:32.958118 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4743eb8-52b4-40f4-83b0-94c6b27dfb67 None admin] Authenticating user token {{(pid=101893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:43:33.020135 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87cb6e85-0329-495e-bff1-1f11530a96b7 None admin] Validating token access rules against request {{(pid=101892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:43:33.050268 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG dbcounter [-] [101892] Writing DB stats keystone:SELECT=100 {{(pid=101892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:43:33.056248 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG dbcounter [-] [101893] Writing DB stats keystone:SELECT=100 {{(pid=101893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:43:33.057248 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c3eb073-cc0b-4a65-bc9f-52c839fbf693 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:43:33.057918 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3eb073-cc0b-4a65-bc9f-52c839fbf693 None admin] REQUEST_METHOD: `GET` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:43:33.058210 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3eb073-cc0b-4a65-bc9f-52c839fbf693 None admin] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:43:33.058494 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3eb073-cc0b-4a65-bc9f-52c839fbf693 None admin] PATH_INFO: `/v3/domains` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:43:33.059218 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c3eb073-cc0b-4a65-bc9f-52c839fbf693 None admin] RBAC: Adding query filter params (name=Default) {{(pid=101892) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:43:33.059522 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c3eb073-cc0b-4a65-bc9f-52c839fbf693 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:43:33.060923 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c3eb073-cc0b-4a65-bc9f-52c839fbf693 None admin] RBAC: Authorization granted {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:43:33.066225 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4743eb8-52b4-40f4-83b0-94c6b27dfb67 None admin] Validating token access rules against request {{(pid=101893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:43:33.077198 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 400/813] 10.222.0.84 () {56 vars in 1109 bytes} [Wed May 25 14:43:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:43:33.077198 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c3eb073-cc0b-4a65-bc9f-52c839fbf693 None admin] Authenticating user token {{(pid=101892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:43:33.107165 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b1459bf-5618-4dc2-bc29-bd2e3b36aa8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:43:33.108160 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1459bf-5618-4dc2-bc29-bd2e3b36aa8d None admin] REQUEST_METHOD: `GET` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:43:33.108459 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1459bf-5618-4dc2-bc29-bd2e3b36aa8d None admin] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:43:33.109492 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1459bf-5618-4dc2-bc29-bd2e3b36aa8d None admin] PATH_INFO: `/v3/services/network` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:43:33.110161 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b1459bf-5618-4dc2-bc29-bd2e3b36aa8d None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:43:33.111547 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b1459bf-5618-4dc2-bc29-bd2e3b36aa8d None admin] RBAC: Authorization granted {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:43:33.127392 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application [None req-5b1459bf-5618-4dc2-bc29-bd2e3b36aa8d None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. May 25 14:43:33.127392 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:43:33.127392 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 25 14:43:33.127392 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 25 14:43:33.127392 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 25 14:43:33.127392 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 25 14:43:33.127392 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 25 14:43:33.127392 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 25 14:43:33.127392 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. May 25 14:43:33.127392 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application May 25 14:43:33.127392 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 25 14:43:33.127392 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application May 25 14:43:33.127392 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:43:33.127392 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 14:43:33.127392 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 14:43:33.127392 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 14:43:33.127392 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 14:43:33.128597 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 14:43:33.128597 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 14:43:33.128597 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 14:43:33.128597 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 14:43:33.128597 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 14:43:33.128597 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 14:43:33.128597 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 25 14:43:33.128597 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return self._get_service(service_id) May 25 14:43:33.128597 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 25 14:43:33.128597 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 25 14:43:33.128597 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 14:43:33.128597 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 14:43:33.128597 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 14:43:33.128597 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 14:43:33.128597 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 14:43:33.128597 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return self.get_or_create( May 25 14:43:33.129971 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 14:43:33.129971 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application with Lock( May 25 14:43:33.129971 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 14:43:33.129971 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return self._enter() May 25 14:43:33.129971 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 14:43:33.129971 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 14:43:33.129971 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 14:43:33.129971 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return self.creator() May 25 14:43:33.129971 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 14:43:33.129971 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application created_value = creator( May 25 14:43:33.129971 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 25 14:43:33.129971 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 25 14:43:33.129971 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. May 25 14:43:33.129971 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application May 25 14:43:33.129971 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 414/814] 10.222.0.84 () {56 vars in 1111 bytes} [Wed May 25 14:43:32 2022] GET /identity/v3/services/network => generated 88 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 14:43:33.131533 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b1459bf-5618-4dc2-bc29-bd2e3b36aa8d None admin] Authenticating user token {{(pid=101893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:43:33.181215 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c3eb073-cc0b-4a65-bc9f-52c839fbf693 None admin] Validating token access rules against request {{(pid=101892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:43:33.217290 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe53c29-f65e-4c04-9ae3-c3f5582187db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:43:33.217948 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe53c29-f65e-4c04-9ae3-c3f5582187db None admin] REQUEST_METHOD: `GET` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:43:33.218229 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe53c29-f65e-4c04-9ae3-c3f5582187db None admin] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:43:33.218495 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe53c29-f65e-4c04-9ae3-c3f5582187db None admin] PATH_INFO: `/v3/projects` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:43:33.219279 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fe53c29-f65e-4c04-9ae3-c3f5582187db None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=101892) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:43:33.219600 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fe53c29-f65e-4c04-9ae3-c3f5582187db None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:43:33.221018 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fe53c29-f65e-4c04-9ae3-c3f5582187db None admin] RBAC: Authorization granted {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:43:33.234664 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 401/815] 10.222.0.84 () {56 vars in 1148 bytes} [Wed May 25 14:43:33 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:43:33.235489 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe53c29-f65e-4c04-9ae3-c3f5582187db None admin] Authenticating user token {{(pid=101892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:43:33.238223 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b1459bf-5618-4dc2-bc29-bd2e3b36aa8d None admin] Validating token access rules against request {{(pid=101893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:43:33.276993 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-717dfd8e-fe8d-448c-81a7-7f00ea62583f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:43:33.278020 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717dfd8e-fe8d-448c-81a7-7f00ea62583f None admin] REQUEST_METHOD: `GET` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:43:33.278501 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717dfd8e-fe8d-448c-81a7-7f00ea62583f None admin] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:43:33.278952 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717dfd8e-fe8d-448c-81a7-7f00ea62583f None admin] PATH_INFO: `/v3/roles` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:43:33.279827 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-717dfd8e-fe8d-448c-81a7-7f00ea62583f None admin] RBAC: Adding query filter params (name=service) {{(pid=101893) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:43:33.280144 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-717dfd8e-fe8d-448c-81a7-7f00ea62583f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:43:33.281528 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-717dfd8e-fe8d-448c-81a7-7f00ea62583f None admin] RBAC: Authorization granted {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:43:33.289997 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG dbcounter [-] [101892] Writing DB stats keystone:SELECT=100 {{(pid=101892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:43:33.295528 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 415/816] 10.222.0.84 () {56 vars in 1103 bytes} [Wed May 25 14:43:33 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:43:33.295528 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-717dfd8e-fe8d-448c-81a7-7f00ea62583f None admin] Authenticating user token {{(pid=101893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:43:33.318378 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG dbcounter [-] [101893] Writing DB stats keystone:SELECT=100 {{(pid=101893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:43:33.341137 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe53c29-f65e-4c04-9ae3-c3f5582187db None admin] Validating token access rules against request {{(pid=101892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:43:33.378322 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-848ea48a-5a06-4ef4-af90-291a45309463 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:43:33.379054 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848ea48a-5a06-4ef4-af90-291a45309463 None admin] REQUEST_METHOD: `GET` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:43:33.379335 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848ea48a-5a06-4ef4-af90-291a45309463 None admin] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:43:33.379631 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848ea48a-5a06-4ef4-af90-291a45309463 None admin] PATH_INFO: `/v3/projects/service` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:43:33.386533 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-848ea48a-5a06-4ef4-af90-291a45309463 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:43:33.387990 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-848ea48a-5a06-4ef4-af90-291a45309463 None admin] RBAC: Authorization granted {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:43:33.402601 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application [None req-848ea48a-5a06-4ef4-af90-291a45309463 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 25 14:43:33.402601 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:43:33.402601 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 14:43:33.402601 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 14:43:33.402601 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 14:43:33.402601 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 14:43:33.402601 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 14:43:33.402601 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 14:43:33.402601 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 14:43:33.402601 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 14:43:33.402601 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 14:43:33.402601 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 14:43:33.402601 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 25 14:43:33.402601 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application return self._get_project(project_id) May 25 14:43:33.402601 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 25 14:43:33.403529 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 25 14:43:33.403529 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 14:43:33.403529 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 14:43:33.403529 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 14:43:33.403529 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 14:43:33.403529 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 14:43:33.403529 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application return self.get_or_create( May 25 14:43:33.403529 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 14:43:33.403529 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application with Lock( May 25 14:43:33.403529 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 14:43:33.403529 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application return self._enter() May 25 14:43:33.403529 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 14:43:33.403529 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 14:43:33.403529 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 14:43:33.403529 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application return self.creator() May 25 14:43:33.403529 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 14:43:33.403529 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application created_value = creator( May 25 14:43:33.404487 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 25 14:43:33.404487 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 25 14:43:33.404487 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 25 14:43:33.404487 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 25 14:43:33.404487 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 25 14:43:33.404487 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 25 14:43:33.404487 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 25 14:43:33.404487 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application May 25 14:43:33.404487 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 402/817] 10.222.0.84 () {56 vars in 1111 bytes} [Wed May 25 14:43:33 2022] GET /identity/v3/projects/service => generated 88 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 14:43:33.405005 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-848ea48a-5a06-4ef4-af90-291a45309463 None admin] Authenticating user token {{(pid=101892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:43:33.418942 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-717dfd8e-fe8d-448c-81a7-7f00ea62583f None admin] Validating token access rules against request {{(pid=101893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:43:33.455109 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-389bbbaf-2cbf-44b4-b39e-3cd0e8789ef4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:43:33.455785 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389bbbaf-2cbf-44b4-b39e-3cd0e8789ef4 None admin] REQUEST_METHOD: `GET` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:43:33.456155 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389bbbaf-2cbf-44b4-b39e-3cd0e8789ef4 None admin] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:43:33.456438 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389bbbaf-2cbf-44b4-b39e-3cd0e8789ef4 None admin] PATH_INFO: `/v3/services` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:43:33.457145 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-389bbbaf-2cbf-44b4-b39e-3cd0e8789ef4 None admin] RBAC: Adding query filter params (name=network) {{(pid=101893) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:43:33.457580 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-389bbbaf-2cbf-44b4-b39e-3cd0e8789ef4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:43:33.459063 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-389bbbaf-2cbf-44b4-b39e-3cd0e8789ef4 None admin] RBAC: Authorization granted {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:43:33.464292 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 416/818] 10.222.0.84 () {56 vars in 1112 bytes} [Wed May 25 14:43:33 2022] GET /identity/v3/services?name=network => generated 124 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:43:33.465026 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-389bbbaf-2cbf-44b4-b39e-3cd0e8789ef4 None admin] Authenticating user token {{(pid=101893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:43:33.512933 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-848ea48a-5a06-4ef4-af90-291a45309463 None admin] Validating token access rules against request {{(pid=101892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:43:33.522961 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG dbcounter [-] [101892] Writing DB stats keystone:SELECT=100 {{(pid=101892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:43:33.547435 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8b15a2b-6d34-49e3-af20-b7a2a46079e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:43:33.550734 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b15a2b-6d34-49e3-af20-b7a2a46079e6 None admin] REQUEST_METHOD: `PUT` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:43:33.550734 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b15a2b-6d34-49e3-af20-b7a2a46079e6 None admin] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:43:33.550734 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b15a2b-6d34-49e3-af20-b7a2a46079e6 None admin] PATH_INFO: `/v3/projects/a000829c658c4a7cab67f7b6353ba3fa/users/e196f0897b98455c9e164271d7d0070a/roles/a3b78e7d547d4d2d998b4c99a4396bba` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:43:33.551024 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8b15a2b-6d34-49e3-af20-b7a2a46079e6 None admin] RBAC: Authorizing `identity:create_grant(project_id=a000829c658c4a7cab67f7b6353ba3fa, user_id=e196f0897b98455c9e164271d7d0070a, role_id=a3b78e7d547d4d2d998b4c99a4396bba)` {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:43:33.553091 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8b15a2b-6d34-49e3-af20-b7a2a46079e6 None admin] RBAC: Authorization granted {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:43:33.561197 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG dbcounter [-] [101893] Writing DB stats keystone:SELECT=100 {{(pid=101893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:43:33.579769 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-389bbbaf-2cbf-44b4-b39e-3cd0e8789ef4 None admin] Validating token access rules against request {{(pid=101893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:43:33.613499 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b77c4a-1857-4a1e-9e16-53549f651767 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:43:33.614336 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b77c4a-1857-4a1e-9e16-53549f651767 None admin] REQUEST_METHOD: `GET` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:43:33.614627 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b77c4a-1857-4a1e-9e16-53549f651767 None admin] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:43:33.614903 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b77c4a-1857-4a1e-9e16-53549f651767 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:43:33.619462 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 403/819] 10.222.0.84 () {58 vars in 1439 bytes} [Wed May 25 14:43:33 2022] PUT /identity/v3/projects/a000829c658c4a7cab67f7b6353ba3fa/users/e196f0897b98455c9e164271d7d0070a/roles/a3b78e7d547d4d2d998b4c99a4396bba => generated 0 bytes in 215 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 14:43:33.620462 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8b15a2b-6d34-49e3-af20-b7a2a46079e6 None admin] Authenticating user token {{(pid=101892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:43:33.626103 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69b77c4a-1857-4a1e-9e16-53549f651767 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:43:33.627625 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69b77c4a-1857-4a1e-9e16-53549f651767 None admin] RBAC: Authorization granted {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:43:33.647509 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application [None req-69b77c4a-1857-4a1e-9e16-53549f651767 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 25 14:43:33.647509 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:43:33.647509 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 14:43:33.647509 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 14:43:33.647509 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 14:43:33.647509 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 14:43:33.647509 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 14:43:33.647509 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 14:43:33.647509 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 14:43:33.647509 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 14:43:33.647509 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 14:43:33.647509 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 14:43:33.647509 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 25 14:43:33.647509 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 25 14:43:33.647509 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 25 14:43:33.648832 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 25 14:43:33.648832 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 14:43:33.648832 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 14:43:33.648832 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 14:43:33.648832 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 14:43:33.648832 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 14:43:33.648832 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return self.get_or_create( May 25 14:43:33.648832 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 14:43:33.648832 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application with Lock( May 25 14:43:33.648832 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 14:43:33.648832 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return self._enter() May 25 14:43:33.648832 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 14:43:33.648832 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 14:43:33.648832 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 14:43:33.648832 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return self.creator() May 25 14:43:33.648832 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 14:43:33.648832 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application created_value = creator( May 25 14:43:33.649985 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 25 14:43:33.649985 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 25 14:43:33.649985 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 25 14:43:33.649985 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application May 25 14:43:33.657084 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 417/820] 10.222.0.84 () {56 vars in 1108 bytes} [Wed May 25 14:43:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 14:43:33.657084 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b77c4a-1857-4a1e-9e16-53549f651767 None admin] Authenticating user token {{(pid=101893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:43:33.763411 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8b15a2b-6d34-49e3-af20-b7a2a46079e6 None admin] Validating token access rules against request {{(pid=101892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:43:33.782105 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b77c4a-1857-4a1e-9e16-53549f651767 None admin] Validating token access rules against request {{(pid=101893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:43:33.803258 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0942bf4c-2cd5-4ed1-aebe-3e3045f1de07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:43:33.804290 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0942bf4c-2cd5-4ed1-aebe-3e3045f1de07 None admin] REQUEST_METHOD: `GET` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:43:33.804686 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0942bf4c-2cd5-4ed1-aebe-3e3045f1de07 None admin] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:43:33.805059 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0942bf4c-2cd5-4ed1-aebe-3e3045f1de07 None admin] PATH_INFO: `/v3/projects` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:43:33.806052 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0942bf4c-2cd5-4ed1-aebe-3e3045f1de07 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=101892) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:43:33.806463 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0942bf4c-2cd5-4ed1-aebe-3e3045f1de07 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:43:33.808306 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0942bf4c-2cd5-4ed1-aebe-3e3045f1de07 None admin] RBAC: Authorization granted {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:43:33.814214 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG dbcounter [-] [101893] Writing DB stats keystone:SELECT=100 {{(pid=101893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:43:33.820622 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d302bb4-bf19-4cf6-a5e3-2f18035a961c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:43:33.821305 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d302bb4-bf19-4cf6-a5e3-2f18035a961c None admin] REQUEST_METHOD: `GET` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:43:33.821605 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d302bb4-bf19-4cf6-a5e3-2f18035a961c None admin] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:43:33.821875 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d302bb4-bf19-4cf6-a5e3-2f18035a961c None admin] PATH_INFO: `/v3/services` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:43:33.822602 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d302bb4-bf19-4cf6-a5e3-2f18035a961c None admin] RBAC: Adding query filter params (type=network) {{(pid=101893) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:43:33.822911 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d302bb4-bf19-4cf6-a5e3-2f18035a961c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:43:33.824339 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d302bb4-bf19-4cf6-a5e3-2f18035a961c None admin] RBAC: Authorization granted {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:43:33.824446 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 404/821] 10.222.0.84 () {56 vars in 1148 bytes} [Wed May 25 14:43:33 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:43:33.825213 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0942bf4c-2cd5-4ed1-aebe-3e3045f1de07 None admin] Authenticating user token {{(pid=101892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:43:33.830068 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 418/822] 10.222.0.84 () {56 vars in 1112 bytes} [Wed May 25 14:43:33 2022] GET /identity/v3/services?type=network => generated 350 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:43:33.831822 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d302bb4-bf19-4cf6-a5e3-2f18035a961c None admin] Authenticating user token {{(pid=101893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:43:33.864584 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG dbcounter [-] [101892] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=101892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:43:33.950663 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d302bb4-bf19-4cf6-a5e3-2f18035a961c None admin] Validating token access rules against request {{(pid=101893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:43:33.951905 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0942bf4c-2cd5-4ed1-aebe-3e3045f1de07 None admin] Validating token access rules against request {{(pid=101892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:43:33.984943 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10aea5c1-cc3a-40b9-8bb5-11799517f979 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:43:33.985720 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10aea5c1-cc3a-40b9-8bb5-11799517f979 None admin] REQUEST_METHOD: `GET` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:43:33.986043 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10aea5c1-cc3a-40b9-8bb5-11799517f979 None admin] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:43:33.986386 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10aea5c1-cc3a-40b9-8bb5-11799517f979 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:43:33.987271 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10aea5c1-cc3a-40b9-8bb5-11799517f979 None admin] RBAC: Adding query filter params (role.id=a3b78e7d547d4d2d998b4c99a4396bba, scope.project.id=a000829c658c4a7cab67f7b6353ba3fa, user.id=2aeb182e6a5b43cfb0cc347ec847c848) {{(pid=101893) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:43:33.987686 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10aea5c1-cc3a-40b9-8bb5-11799517f979 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:43:33.989207 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10aea5c1-cc3a-40b9-8bb5-11799517f979 None admin] RBAC: Authorization granted {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:43:33.996879 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a003fd86-0b47-4273-a6c1-1b2185f5301c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:43:33.997839 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a003fd86-0b47-4273-a6c1-1b2185f5301c None admin] REQUEST_METHOD: `GET` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:43:33.998288 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a003fd86-0b47-4273-a6c1-1b2185f5301c None admin] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:43:33.998736 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a003fd86-0b47-4273-a6c1-1b2185f5301c None admin] PATH_INFO: `/v3/domains` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:43:33.999722 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a003fd86-0b47-4273-a6c1-1b2185f5301c None admin] RBAC: Adding query filter params (name=Default) {{(pid=101892) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:43:34.000219 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a003fd86-0b47-4273-a6c1-1b2185f5301c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:43:34.001818 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a003fd86-0b47-4273-a6c1-1b2185f5301c None admin] RBAC: Authorization granted {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:43:34.003908 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 419/823] 10.222.0.84 () {56 vars in 1374 bytes} [Wed May 25 14:43:33 2022] GET /identity/v3/role_assignments?user.id=2aeb182e6a5b43cfb0cc347ec847c848&scope.project.id=a000829c658c4a7cab67f7b6353ba3fa&role.id=a3b78e7d547d4d2d998b4c99a4396bba => generated 608 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 14:43:34.005388 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10aea5c1-cc3a-40b9-8bb5-11799517f979 None admin] Authenticating user token {{(pid=101893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:43:34.018083 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 405/824] 10.222.0.84 () {56 vars in 1109 bytes} [Wed May 25 14:43:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:43:34.023881 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a003fd86-0b47-4273-a6c1-1b2185f5301c None admin] Authenticating user token {{(pid=101892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:43:34.099091 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG dbcounter [-] [101893] Writing DB stats keystone:SELECT=100 {{(pid=101893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:43:34.147174 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10aea5c1-cc3a-40b9-8bb5-11799517f979 None admin] Validating token access rules against request {{(pid=101893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:43:34.185859 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c9978f4-3381-4ff7-b441-4d56a17447c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:43:34.186930 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9978f4-3381-4ff7-b441-4d56a17447c9 None admin] REQUEST_METHOD: `POST` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:43:34.187397 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9978f4-3381-4ff7-b441-4d56a17447c9 None admin] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:43:34.187910 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9978f4-3381-4ff7-b441-4d56a17447c9 None admin] PATH_INFO: `/v3/endpoints` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:43:34.189016 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c9978f4-3381-4ff7-b441-4d56a17447c9 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:43:34.190604 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c9978f4-3381-4ff7-b441-4d56a17447c9 None admin] RBAC: Authorization granted {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:43:34.243344 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG dbcounter [-] [101892] Writing DB stats keystone:SELECT=100 {{(pid=101892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:43:34.257206 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a003fd86-0b47-4273-a6c1-1b2185f5301c None admin] Validating token access rules against request {{(pid=101892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:43:34.295945 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 420/825] 10.222.0.84 () {60 vars in 1144 bytes} [Wed May 25 14:43:34 2022] POST /identity/v3/endpoints => generated 327 bytes in 287 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 14:43:34.318301 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0132b3eb-ea0a-4fb8-b174-fce508e2930b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:43:34.319324 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0132b3eb-ea0a-4fb8-b174-fce508e2930b None admin] REQUEST_METHOD: `GET` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:43:34.319768 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0132b3eb-ea0a-4fb8-b174-fce508e2930b None admin] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:43:34.320103 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0132b3eb-ea0a-4fb8-b174-fce508e2930b None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:43:34.329529 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0132b3eb-ea0a-4fb8-b174-fce508e2930b None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:43:34.331001 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0132b3eb-ea0a-4fb8-b174-fce508e2930b None admin] RBAC: Authorization granted {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:43:34.348541 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application [None req-0132b3eb-ea0a-4fb8-b174-fce508e2930b None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. May 25 14:43:34.348541 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:43:34.348541 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 14:43:34.348541 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 14:43:34.348541 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 14:43:34.348541 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 14:43:34.348541 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 14:43:34.348541 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 14:43:34.348541 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 14:43:34.348541 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 14:43:34.348541 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 14:43:34.348541 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 14:43:34.348541 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 25 14:43:34.348541 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application return self._get_user(user_id) May 25 14:43:34.348541 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 25 14:43:34.348541 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 25 14:43:34.350212 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 14:43:34.350212 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 14:43:34.350212 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 25 14:43:34.350212 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 25 14:43:34.350212 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 25 14:43:34.350212 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 25 14:43:34.350212 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 14:43:34.350212 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 14:43:34.350212 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 14:43:34.350212 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application return self.get_or_create( May 25 14:43:34.350212 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 14:43:34.350212 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application with Lock( May 25 14:43:34.350212 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 14:43:34.350212 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application return self._enter() May 25 14:43:34.350212 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 14:43:34.350212 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 14:43:34.350212 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 14:43:34.350212 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application return self.creator() May 25 14:43:34.351161 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 14:43:34.351161 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application created_value = creator( May 25 14:43:34.351161 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 25 14:43:34.351161 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 25 14:43:34.351161 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 25 14:43:34.351161 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 25 14:43:34.351161 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 25 14:43:34.351161 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 25 14:43:34.351161 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. May 25 14:43:34.351161 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application May 25 14:43:34.351161 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 406/826] 10.222.0.84 () {56 vars in 1117 bytes} [Wed May 25 14:43:34 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 327 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 14:43:34.355736 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c9978f4-3381-4ff7-b441-4d56a17447c9 None admin] Authenticating user token {{(pid=101893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:43:34.478335 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c9978f4-3381-4ff7-b441-4d56a17447c9 None admin] Validating token access rules against request {{(pid=101893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:43:34.498649 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG dbcounter [-] [101893] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=101893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:43:34.518712 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25cdcc10-2523-410d-b0ef-e2e64eda325a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:43:34.519387 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25cdcc10-2523-410d-b0ef-e2e64eda325a None admin] REQUEST_METHOD: `GET` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:43:34.519699 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25cdcc10-2523-410d-b0ef-e2e64eda325a None admin] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:43:34.523988 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25cdcc10-2523-410d-b0ef-e2e64eda325a None admin] PATH_INFO: `/v3/users` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:43:34.523988 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25cdcc10-2523-410d-b0ef-e2e64eda325a None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=101893) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:43:34.523988 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25cdcc10-2523-410d-b0ef-e2e64eda325a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:43:34.523988 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25cdcc10-2523-410d-b0ef-e2e64eda325a None admin] RBAC: Authorization granted {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:43:34.542479 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 421/827] 10.222.0.84 () {56 vars in 1149 bytes} [Wed May 25 14:43:34 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:43:34.547634 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0132b3eb-ea0a-4fb8-b174-fce508e2930b None admin] Authenticating user token {{(pid=101892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:43:34.656810 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0132b3eb-ea0a-4fb8-b174-fce508e2930b None admin] Validating token access rules against request {{(pid=101892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:43:34.692873 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ddb753-2953-421f-bcc3-6db84241d0fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:43:34.693676 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ddb753-2953-421f-bcc3-6db84241d0fd None admin] REQUEST_METHOD: `GET` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:43:34.694117 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ddb753-2953-421f-bcc3-6db84241d0fd None admin] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:43:34.694393 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ddb753-2953-421f-bcc3-6db84241d0fd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:43:34.706012 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46ddb753-2953-421f-bcc3-6db84241d0fd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:43:34.707541 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46ddb753-2953-421f-bcc3-6db84241d0fd None admin] RBAC: Authorization granted {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:43:34.715934 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG dbcounter [-] [101892] Writing DB stats keystone:SELECT=100 {{(pid=101892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:43:34.728332 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application [None req-46ddb753-2953-421f-bcc3-6db84241d0fd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 25 14:43:34.728332 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:43:34.728332 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 14:43:34.728332 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 14:43:34.728332 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 14:43:34.728332 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 14:43:34.728332 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 14:43:34.728332 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 14:43:34.728332 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 14:43:34.728332 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 14:43:34.728332 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 14:43:34.728332 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 14:43:34.728332 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 25 14:43:34.728332 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 25 14:43:34.728332 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 25 14:43:34.729305 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 25 14:43:34.729305 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 14:43:34.729305 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 14:43:34.729305 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 14:43:34.729305 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 14:43:34.729305 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 14:43:34.729305 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application return self.get_or_create( May 25 14:43:34.729305 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 14:43:34.729305 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application with Lock( May 25 14:43:34.729305 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 14:43:34.729305 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application return self._enter() May 25 14:43:34.729305 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 14:43:34.729305 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 14:43:34.729305 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 14:43:34.729305 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application return self.creator() May 25 14:43:34.729305 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 14:43:34.729305 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application created_value = creator( May 25 14:43:34.730462 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 25 14:43:34.730462 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 25 14:43:34.730462 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 25 14:43:34.730462 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application May 25 14:43:34.730462 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 407/828] 10.222.0.84 () {56 vars in 1108 bytes} [Wed May 25 14:43:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 25 14:43:34.735382 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25cdcc10-2523-410d-b0ef-e2e64eda325a None admin] Authenticating user token {{(pid=101893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:43:34.860895 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25cdcc10-2523-410d-b0ef-e2e64eda325a None admin] Validating token access rules against request {{(pid=101893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:43:34.898989 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-180cecbf-205b-4a0e-a8ea-f1bc2aabb57c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:43:34.899754 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180cecbf-205b-4a0e-a8ea-f1bc2aabb57c None admin] REQUEST_METHOD: `GET` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:43:34.900041 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180cecbf-205b-4a0e-a8ea-f1bc2aabb57c None admin] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:43:34.900319 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180cecbf-205b-4a0e-a8ea-f1bc2aabb57c None admin] PATH_INFO: `/v3/domains` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:43:34.901051 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-180cecbf-205b-4a0e-a8ea-f1bc2aabb57c None admin] RBAC: Adding query filter params (name=Default) {{(pid=101893) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:43:34.901427 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-180cecbf-205b-4a0e-a8ea-f1bc2aabb57c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:43:34.902874 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-180cecbf-205b-4a0e-a8ea-f1bc2aabb57c None admin] RBAC: Authorization granted {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:43:34.915382 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 422/829] 10.222.0.84 () {56 vars in 1109 bytes} [Wed May 25 14:43:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:43:34.920801 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ddb753-2953-421f-bcc3-6db84241d0fd None admin] Authenticating user token {{(pid=101892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:43:34.954762 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a53e09-7e2b-4c6f-9045-cbb3e0066f50 None None] REQUEST_METHOD: `GET` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:43:34.955099 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a53e09-7e2b-4c6f-9045-cbb3e0066f50 None None] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:43:34.955628 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a53e09-7e2b-4c6f-9045-cbb3e0066f50 None None] PATH_INFO: `/` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:43:34.959298 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 423/830] 10.222.0.84 () {54 vars in 926 bytes} [Wed May 25 14:43:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 14:43:34.964812 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713311d4-eb98-4372-8424-e9667e007229 None None] REQUEST_METHOD: `POST` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:43:34.965102 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713311d4-eb98-4372-8424-e9667e007229 None None] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:43:34.965385 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713311d4-eb98-4372-8424-e9667e007229 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:43:34.983504 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.auth.core [None req-713311d4-eb98-4372-8424-e9667e007229 None None] MFA Rules not processed for user `05d87e87798e429aa1c10b24391f915e`. Rule list: `[]` (Enabled: `True`). {{(pid=101893) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:43:34.985021 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.fernet_utils [None req-713311d4-eb98-4372-8424-e9667e007229 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=101893) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:43:35.015687 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG dbcounter [-] [101893] Writing DB stats keystone:SELECT=100 {{(pid=101893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:43:35.028014 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ddb753-2953-421f-bcc3-6db84241d0fd None admin] Validating token access rules against request {{(pid=101892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:43:35.062544 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22ea532c-d691-4e18-b2d1-b973f1d77b49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:43:35.063717 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ea532c-d691-4e18-b2d1-b973f1d77b49 None admin] REQUEST_METHOD: `GET` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:43:35.064200 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ea532c-d691-4e18-b2d1-b973f1d77b49 None admin] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:43:35.064669 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ea532c-d691-4e18-b2d1-b973f1d77b49 None admin] PATH_INFO: `/v3/projects/service` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:43:35.066840 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 424/831] 10.222.0.84 () {58 vars in 1023 bytes} [Wed May 25 14:43:34 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 25 14:43:35.072649 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22ea532c-d691-4e18-b2d1-b973f1d77b49 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:43:35.074319 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22ea532c-d691-4e18-b2d1-b973f1d77b49 None admin] RBAC: Authorization granted {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:43:35.085266 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-713311d4-eb98-4372-8424-e9667e007229 None None] Authenticating user token {{(pid=101893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:43:35.089198 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application [None req-22ea532c-d691-4e18-b2d1-b973f1d77b49 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 25 14:43:35.089198 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:43:35.089198 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 14:43:35.089198 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 14:43:35.089198 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 14:43:35.089198 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 14:43:35.089198 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 14:43:35.089198 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 14:43:35.089198 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 14:43:35.089198 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 14:43:35.089198 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 14:43:35.089198 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 14:43:35.089198 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 25 14:43:35.089198 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application return self._get_project(project_id) May 25 14:43:35.089198 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 25 14:43:35.090079 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 25 14:43:35.090079 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 14:43:35.090079 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 14:43:35.090079 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 14:43:35.090079 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 14:43:35.090079 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 14:43:35.090079 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application return self.get_or_create( May 25 14:43:35.090079 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 14:43:35.090079 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application with Lock( May 25 14:43:35.090079 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 14:43:35.090079 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application return self._enter() May 25 14:43:35.090079 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 14:43:35.090079 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 14:43:35.090079 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 14:43:35.090079 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application return self.creator() May 25 14:43:35.090079 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 14:43:35.090079 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application created_value = creator( May 25 14:43:35.090975 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 25 14:43:35.090975 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 25 14:43:35.090975 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 25 14:43:35.090975 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 25 14:43:35.090975 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 25 14:43:35.090975 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 25 14:43:35.090975 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 25 14:43:35.090975 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application May 25 14:43:35.093462 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 408/832] 10.222.0.84 () {56 vars in 1111 bytes} [Wed May 25 14:43:34 2022] GET /identity/v3/projects/service => generated 88 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 14:43:35.099221 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22ea532c-d691-4e18-b2d1-b973f1d77b49 None admin] Authenticating user token {{(pid=101892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:43:35.186490 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG dbcounter [-] [101892] Writing DB stats keystone:SELECT=100 {{(pid=101892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:43:35.204234 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-713311d4-eb98-4372-8424-e9667e007229 None None] Validating token access rules against request {{(pid=101893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:43:35.223612 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22ea532c-d691-4e18-b2d1-b973f1d77b49 None admin] Validating token access rules against request {{(pid=101892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:43:35.245304 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aed7938-229a-4c0d-91cd-9eea91825a10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:43:35.246116 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aed7938-229a-4c0d-91cd-9eea91825a10 None admin] REQUEST_METHOD: `GET` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:43:35.246646 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aed7938-229a-4c0d-91cd-9eea91825a10 None admin] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:43:35.247024 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aed7938-229a-4c0d-91cd-9eea91825a10 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:43:35.247721 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aed7938-229a-4c0d-91cd-9eea91825a10 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:43:35.249199 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aed7938-229a-4c0d-91cd-9eea91825a10 None admin] RBAC: Authorization granted {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:43:35.263247 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application [None req-4aed7938-229a-4c0d-91cd-9eea91825a10 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. May 25 14:43:35.263247 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:43:35.263247 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 25 14:43:35.263247 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 25 14:43:35.263247 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 25 14:43:35.263247 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 25 14:43:35.263247 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 25 14:43:35.263247 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 25 14:43:35.263247 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. May 25 14:43:35.263247 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application May 25 14:43:35.263247 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 25 14:43:35.263247 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application May 25 14:43:35.263247 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:43:35.263247 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 14:43:35.263247 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 14:43:35.263247 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 14:43:35.263247 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 14:43:35.264327 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 14:43:35.264327 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 14:43:35.264327 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 14:43:35.264327 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 14:43:35.264327 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 14:43:35.264327 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 14:43:35.264327 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 25 14:43:35.264327 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return self._get_service(service_id) May 25 14:43:35.264327 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 25 14:43:35.264327 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 25 14:43:35.264327 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 14:43:35.264327 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 14:43:35.264327 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 14:43:35.264327 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 14:43:35.264327 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 14:43:35.264327 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return self.get_or_create( May 25 14:43:35.265212 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 14:43:35.265212 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application with Lock( May 25 14:43:35.265212 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 14:43:35.265212 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return self._enter() May 25 14:43:35.265212 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 14:43:35.265212 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 14:43:35.265212 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 14:43:35.265212 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return self.creator() May 25 14:43:35.265212 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 14:43:35.265212 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application created_value = creator( May 25 14:43:35.265212 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 25 14:43:35.265212 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 25 14:43:35.265212 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. May 25 14:43:35.265212 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application May 25 14:43:35.265966 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d54c32-2ba3-413b-a2fa-a504a4c86956 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:43:35.265966 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d54c32-2ba3-413b-a2fa-a504a4c86956 None admin] REQUEST_METHOD: `GET` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:43:35.265966 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d54c32-2ba3-413b-a2fa-a504a4c86956 None admin] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:43:35.265966 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d54c32-2ba3-413b-a2fa-a504a4c86956 None admin] PATH_INFO: `/v3/projects` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:43:35.266240 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 425/833] 10.222.0.84 () {56 vars in 1114 bytes} [Wed May 25 14:43:35 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 25 14:43:35.266311 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0d54c32-2ba3-413b-a2fa-a504a4c86956 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=101892) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:43:35.266311 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0d54c32-2ba3-413b-a2fa-a504a4c86956 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:43:35.267491 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0d54c32-2ba3-413b-a2fa-a504a4c86956 None admin] RBAC: Authorization granted {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:43:35.272728 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aed7938-229a-4c0d-91cd-9eea91825a10 None admin] Authenticating user token {{(pid=101893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:43:35.283595 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 409/834] 10.222.0.84 () {56 vars in 1148 bytes} [Wed May 25 14:43:35 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:43:35.288501 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d54c32-2ba3-413b-a2fa-a504a4c86956 None admin] Authenticating user token {{(pid=101892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:43:35.314125 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG dbcounter [-] [101893] Writing DB stats keystone:SELECT=100 {{(pid=101893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:43:35.400781 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d54c32-2ba3-413b-a2fa-a504a4c86956 None admin] Validating token access rules against request {{(pid=101892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:43:35.412761 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aed7938-229a-4c0d-91cd-9eea91825a10 None admin] Validating token access rules against request {{(pid=101893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:43:35.419991 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG dbcounter [-] [101892] Writing DB stats keystone:SELECT=100 {{(pid=101892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:43:35.444856 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb5e7f6c-53b8-4ae5-a842-275e4636ec62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:43:35.446827 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5e7f6c-53b8-4ae5-a842-275e4636ec62 None admin] REQUEST_METHOD: `PUT` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:43:35.447599 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5e7f6c-53b8-4ae5-a842-275e4636ec62 None admin] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:43:35.448105 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5e7f6c-53b8-4ae5-a842-275e4636ec62 None admin] PATH_INFO: `/v3/projects/a000829c658c4a7cab67f7b6353ba3fa/users/049a7ab3f95f460e908f79cc321176fd/roles/fdcb2eda27b84f44a392b7e8b59cc425` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:43:35.452518 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-843cf699-27f5-4c19-b8e9-5558cde75789 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:43:35.452680 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843cf699-27f5-4c19-b8e9-5558cde75789 None admin] REQUEST_METHOD: `GET` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:43:35.452912 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843cf699-27f5-4c19-b8e9-5558cde75789 None admin] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:43:35.453213 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843cf699-27f5-4c19-b8e9-5558cde75789 None admin] PATH_INFO: `/v3/services` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:43:35.454040 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-843cf699-27f5-4c19-b8e9-5558cde75789 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=101893) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:43:35.454359 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-843cf699-27f5-4c19-b8e9-5558cde75789 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:43:35.455786 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-843cf699-27f5-4c19-b8e9-5558cde75789 None admin] RBAC: Authorization granted {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:43:35.465704 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 426/835] 10.222.0.84 () {56 vars in 1114 bytes} [Wed May 25 14:43:35 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:43:35.466704 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-843cf699-27f5-4c19-b8e9-5558cde75789 None admin] Authenticating user token {{(pid=101893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:43:35.467277 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb5e7f6c-53b8-4ae5-a842-275e4636ec62 None admin] RBAC: Authorizing `identity:create_grant(project_id=a000829c658c4a7cab67f7b6353ba3fa, user_id=049a7ab3f95f460e908f79cc321176fd, role_id=fdcb2eda27b84f44a392b7e8b59cc425)` {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:43:35.468947 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb5e7f6c-53b8-4ae5-a842-275e4636ec62 None admin] RBAC: Authorization granted {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:43:35.523451 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 410/836] 10.222.0.84 () {58 vars in 1439 bytes} [Wed May 25 14:43:35 2022] PUT /identity/v3/projects/a000829c658c4a7cab67f7b6353ba3fa/users/049a7ab3f95f460e908f79cc321176fd/roles/fdcb2eda27b84f44a392b7e8b59cc425 => generated 0 bytes in 235 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 14:43:35.575843 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG dbcounter [-] [101893] Writing DB stats keystone:SELECT=100 {{(pid=101893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:43:35.586523 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-843cf699-27f5-4c19-b8e9-5558cde75789 None admin] Validating token access rules against request {{(pid=101893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:43:35.628736 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a514059-efd2-4113-86f9-7230efe85d0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:43:35.629418 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a514059-efd2-4113-86f9-7230efe85d0e None admin] REQUEST_METHOD: `GET` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:43:35.629698 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a514059-efd2-4113-86f9-7230efe85d0e None admin] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:43:35.630014 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a514059-efd2-4113-86f9-7230efe85d0e None admin] PATH_INFO: `/v3/services` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:43:35.630730 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a514059-efd2-4113-86f9-7230efe85d0e None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=101893) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:43:35.631033 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a514059-efd2-4113-86f9-7230efe85d0e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:43:35.632459 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a514059-efd2-4113-86f9-7230efe85d0e None admin] RBAC: Authorization granted {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:43:35.638385 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 427/837] 10.222.0.84 () {56 vars in 1114 bytes} [Wed May 25 14:43:35 2022] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:43:35.930795 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf814f63-a6b1-446a-a969-cd856ce4c38d None None] REQUEST_METHOD: `GET` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:43:35.931173 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf814f63-a6b1-446a-a969-cd856ce4c38d None None] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:43:35.931376 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf814f63-a6b1-446a-a969-cd856ce4c38d None None] PATH_INFO: `/` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:43:35.933013 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 411/838] 10.222.0.84 () {54 vars in 926 bytes} [Wed May 25 14:43:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 14:43:35.938672 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a81a0b0-387d-4b6c-b7da-4001d7f13402 None None] REQUEST_METHOD: `POST` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:43:35.938957 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a81a0b0-387d-4b6c-b7da-4001d7f13402 None None] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:43:35.939236 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a81a0b0-387d-4b6c-b7da-4001d7f13402 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:43:35.956450 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.auth.core [None req-2a81a0b0-387d-4b6c-b7da-4001d7f13402 None None] MFA Rules not processed for user `05d87e87798e429aa1c10b24391f915e`. Rule list: `[]` (Enabled: `True`). {{(pid=101893) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:43:35.957640 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.fernet_utils [None req-2a81a0b0-387d-4b6c-b7da-4001d7f13402 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=101893) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:43:36.031879 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 428/839] 10.222.0.84 () {58 vars in 1023 bytes} [Wed May 25 14:43:35 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 25 14:43:36.053417 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf814f63-a6b1-446a-a969-cd856ce4c38d None None] Authenticating user token {{(pid=101892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:43:36.160264 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf814f63-a6b1-446a-a969-cd856ce4c38d None None] Validating token access rules against request {{(pid=101892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:43:36.197015 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-055f4729-860b-48d1-bbde-12737f4d4bc6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:43:36.197760 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-055f4729-860b-48d1-bbde-12737f4d4bc6 None admin] REQUEST_METHOD: `GET` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:43:36.198016 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-055f4729-860b-48d1-bbde-12737f4d4bc6 None admin] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:43:36.198291 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-055f4729-860b-48d1-bbde-12737f4d4bc6 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:43:36.209343 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-055f4729-860b-48d1-bbde-12737f4d4bc6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 14:43:36.218879 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application [None req-055f4729-860b-48d1-bbde-12737f4d4bc6 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 25 14:43:36.218879 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:43:36.218879 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 14:43:36.218879 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 14:43:36.218879 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 14:43:36.218879 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 14:43:36.218879 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 14:43:36.218879 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 14:43:36.218879 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 14:43:36.218879 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 14:43:36.218879 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 14:43:36.218879 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 14:43:36.218879 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 14:43:36.218879 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 14:43:36.218879 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 14:43:36.218879 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 14:43:36.220089 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 14:43:36.220089 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 14:43:36.220089 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 14:43:36.220089 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 14:43:36.220089 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 14:43:36.220089 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 14:43:36.220089 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 14:43:36.220089 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 14:43:36.220089 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 14:43:36.220089 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application return self.get_or_create( May 25 14:43:36.220089 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 14:43:36.220089 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application with Lock( May 25 14:43:36.220089 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 14:43:36.220089 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application return self._enter() May 25 14:43:36.220089 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 14:43:36.220089 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 14:43:36.221754 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 14:43:36.221754 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application return self.creator() May 25 14:43:36.221754 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 14:43:36.221754 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application created_value = creator( May 25 14:43:36.221754 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 14:43:36.221754 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 14:43:36.221754 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 14:43:36.221754 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 14:43:36.221754 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 14:43:36.221754 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 14:43:36.221754 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 25 14:43:36.221754 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application May 25 14:43:36.227952 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 412/840] 10.222.0.84 () {56 vars in 1096 bytes} [Wed May 25 14:43:36 2022] GET /identity/v3/roles/admin => generated 83 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 14:43:36.231362 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a81a0b0-387d-4b6c-b7da-4001d7f13402 None None] Authenticating user token {{(pid=101893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:43:36.322793 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG dbcounter [-] [101893] Writing DB stats keystone:SELECT=100 {{(pid=101893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:43:36.338453 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a81a0b0-387d-4b6c-b7da-4001d7f13402 None None] Validating token access rules against request {{(pid=101893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:43:36.373930 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-974e9fce-8866-46e8-9cde-ec134cf3b2a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:43:36.374598 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974e9fce-8866-46e8-9cde-ec134cf3b2a6 None admin] REQUEST_METHOD: `GET` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:43:36.374880 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974e9fce-8866-46e8-9cde-ec134cf3b2a6 None admin] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:43:36.375156 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974e9fce-8866-46e8-9cde-ec134cf3b2a6 None admin] PATH_INFO: `/v3/roles` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:43:36.375932 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-974e9fce-8866-46e8-9cde-ec134cf3b2a6 None admin] RBAC: Adding query filter params (name=admin) {{(pid=101893) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:43:36.376237 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-974e9fce-8866-46e8-9cde-ec134cf3b2a6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:43:36.377598 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-974e9fce-8866-46e8-9cde-ec134cf3b2a6 None admin] RBAC: Authorization granted {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:43:36.390469 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 429/841] 10.222.0.84 () {56 vars in 1099 bytes} [Wed May 25 14:43:36 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:43:36.391872 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-055f4729-860b-48d1-bbde-12737f4d4bc6 None admin] Authenticating user token {{(pid=101892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:43:36.423505 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG dbcounter [-] [101892] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=101892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:43:36.498176 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-055f4729-860b-48d1-bbde-12737f4d4bc6 None admin] Validating token access rules against request {{(pid=101892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:43:36.536845 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88e5334d-e47b-48d8-bb8e-af96e435120c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:43:36.538253 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e5334d-e47b-48d8-bb8e-af96e435120c None admin] REQUEST_METHOD: `GET` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:43:36.538604 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e5334d-e47b-48d8-bb8e-af96e435120c None admin] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:43:36.538947 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e5334d-e47b-48d8-bb8e-af96e435120c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:43:36.549905 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88e5334d-e47b-48d8-bb8e-af96e435120c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:43:36.551436 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88e5334d-e47b-48d8-bb8e-af96e435120c None admin] RBAC: Authorization granted {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:43:36.569980 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application [None req-88e5334d-e47b-48d8-bb8e-af96e435120c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 25 14:43:36.569980 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:43:36.569980 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 14:43:36.569980 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 14:43:36.569980 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 14:43:36.569980 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 14:43:36.569980 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 14:43:36.569980 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 14:43:36.569980 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 14:43:36.569980 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 14:43:36.569980 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 14:43:36.569980 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 14:43:36.569980 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 25 14:43:36.569980 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 25 14:43:36.569980 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 25 14:43:36.572124 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 25 14:43:36.572124 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 14:43:36.572124 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 14:43:36.572124 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 14:43:36.572124 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 14:43:36.572124 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 14:43:36.572124 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application return self.get_or_create( May 25 14:43:36.572124 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 14:43:36.572124 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application with Lock( May 25 14:43:36.572124 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 14:43:36.572124 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application return self._enter() May 25 14:43:36.572124 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 14:43:36.572124 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 14:43:36.572124 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 14:43:36.572124 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application return self.creator() May 25 14:43:36.572124 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 14:43:36.572124 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application created_value = creator( May 25 14:43:36.574322 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 25 14:43:36.574322 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 25 14:43:36.574322 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 25 14:43:36.574322 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application May 25 14:43:36.578689 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 413/842] 10.222.0.84 () {56 vars in 1108 bytes} [Wed May 25 14:43:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 14:43:36.578871 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-974e9fce-8866-46e8-9cde-ec134cf3b2a6 None admin] Authenticating user token {{(pid=101893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:43:36.680187 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-974e9fce-8866-46e8-9cde-ec134cf3b2a6 None admin] Validating token access rules against request {{(pid=101893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:43:36.701797 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d3da1b-6b1a-46dc-831d-2018a5435267 None None] REQUEST_METHOD: `GET` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:43:36.702103 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d3da1b-6b1a-46dc-831d-2018a5435267 None None] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:43:36.702345 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d3da1b-6b1a-46dc-831d-2018a5435267 None None] PATH_INFO: `/` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:43:36.703854 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 414/843] 10.222.0.84 () {54 vars in 926 bytes} [Wed May 25 14:43:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 25 14:43:36.710530 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8033d65a-b85a-4766-82c6-2476a123b863 None None] REQUEST_METHOD: `POST` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:43:36.710530 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8033d65a-b85a-4766-82c6-2476a123b863 None None] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:43:36.710530 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8033d65a-b85a-4766-82c6-2476a123b863 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:43:36.714906 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63b37d14-a6a6-4399-a0ab-850e54cb58e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:43:36.716369 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b37d14-a6a6-4399-a0ab-850e54cb58e2 None admin] REQUEST_METHOD: `GET` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:43:36.716683 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b37d14-a6a6-4399-a0ab-850e54cb58e2 None admin] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:43:36.716966 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b37d14-a6a6-4399-a0ab-850e54cb58e2 None admin] PATH_INFO: `/v3/domains` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:43:36.717704 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63b37d14-a6a6-4399-a0ab-850e54cb58e2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=101893) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:43:36.718011 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63b37d14-a6a6-4399-a0ab-850e54cb58e2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:43:36.719426 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63b37d14-a6a6-4399-a0ab-850e54cb58e2 None admin] RBAC: Authorization granted {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:43:36.729344 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.auth.core [None req-8033d65a-b85a-4766-82c6-2476a123b863 None None] MFA Rules not processed for user `05d87e87798e429aa1c10b24391f915e`. Rule list: `[]` (Enabled: `True`). {{(pid=101892) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:43:36.731208 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.fernet_utils [None req-8033d65a-b85a-4766-82c6-2476a123b863 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=101892) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:43:36.735651 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 430/844] 10.222.0.84 () {56 vars in 1109 bytes} [Wed May 25 14:43:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:43:36.744574 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63b37d14-a6a6-4399-a0ab-850e54cb58e2 None admin] Authenticating user token {{(pid=101893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:43:36.759150 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG dbcounter [-] [101893] Writing DB stats keystone:SELECT=100 {{(pid=101893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:43:36.830974 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 415/845] 10.222.0.84 () {58 vars in 1023 bytes} [Wed May 25 14:43:36 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 25 14:43:36.847034 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8033d65a-b85a-4766-82c6-2476a123b863 None None] Authenticating user token {{(pid=101892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:43:36.861891 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG dbcounter [-] [101892] Writing DB stats keystone:SELECT=100 {{(pid=101892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:43:36.878354 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63b37d14-a6a6-4399-a0ab-850e54cb58e2 None admin] Validating token access rules against request {{(pid=101893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:43:36.925323 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f603eecb-cadb-4aae-a746-6ef9c881c4bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:43:36.926270 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f603eecb-cadb-4aae-a746-6ef9c881c4bd None admin] REQUEST_METHOD: `GET` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:43:36.927203 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f603eecb-cadb-4aae-a746-6ef9c881c4bd None admin] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:43:36.927489 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f603eecb-cadb-4aae-a746-6ef9c881c4bd None admin] PATH_INFO: `/v3/users/swift` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:43:36.936558 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f603eecb-cadb-4aae-a746-6ef9c881c4bd None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:43:36.938671 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f603eecb-cadb-4aae-a746-6ef9c881c4bd None admin] RBAC: Authorization granted {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:43:36.959477 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application [None req-f603eecb-cadb-4aae-a746-6ef9c881c4bd None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. May 25 14:43:36.959477 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:43:36.959477 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 14:43:36.959477 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 14:43:36.959477 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 14:43:36.959477 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 14:43:36.959477 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 14:43:36.959477 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 14:43:36.959477 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 14:43:36.959477 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 14:43:36.959477 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 14:43:36.959477 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 14:43:36.959477 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 25 14:43:36.959477 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return self._get_user(user_id) May 25 14:43:36.959477 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 25 14:43:36.959477 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 25 14:43:36.960720 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 14:43:36.960720 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 14:43:36.960720 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 25 14:43:36.960720 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 25 14:43:36.960720 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 25 14:43:36.960720 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 25 14:43:36.960720 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 14:43:36.960720 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 14:43:36.960720 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 14:43:36.960720 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return self.get_or_create( May 25 14:43:36.960720 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 14:43:36.960720 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application with Lock( May 25 14:43:36.960720 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 14:43:36.960720 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return self._enter() May 25 14:43:36.960720 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 14:43:36.960720 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 14:43:36.960720 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 14:43:36.960720 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return self.creator() May 25 14:43:36.961954 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 14:43:36.961954 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application created_value = creator( May 25 14:43:36.961954 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 25 14:43:36.961954 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 25 14:43:36.961954 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 25 14:43:36.961954 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 25 14:43:36.961954 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 25 14:43:36.961954 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 25 14:43:36.961954 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. May 25 14:43:36.961954 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application May 25 14:43:36.964088 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8033d65a-b85a-4766-82c6-2476a123b863 None None] Validating token access rules against request {{(pid=101892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:43:36.967631 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 431/846] 10.222.0.84 () {56 vars in 1096 bytes} [Wed May 25 14:43:36 2022] GET /identity/v3/users/swift => generated 83 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 14:43:36.968967 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f603eecb-cadb-4aae-a746-6ef9c881c4bd None admin] Authenticating user token {{(pid=101893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:43:37.014259 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f7d5b1-e8d1-4c5b-a3e2-8fb0f6915ecb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:43:37.016078 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f7d5b1-e8d1-4c5b-a3e2-8fb0f6915ecb None admin] REQUEST_METHOD: `GET` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:43:37.016566 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f7d5b1-e8d1-4c5b-a3e2-8fb0f6915ecb None admin] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:43:37.017066 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f7d5b1-e8d1-4c5b-a3e2-8fb0f6915ecb None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:43:37.018096 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83f7d5b1-e8d1-4c5b-a3e2-8fb0f6915ecb None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:43:37.020424 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83f7d5b1-e8d1-4c5b-a3e2-8fb0f6915ecb None admin] RBAC: Authorization granted {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:43:37.037946 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application [None req-83f7d5b1-e8d1-4c5b-a3e2-8fb0f6915ecb None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 25 14:43:37.037946 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:43:37.037946 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 25 14:43:37.037946 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 25 14:43:37.037946 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 25 14:43:37.037946 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 25 14:43:37.037946 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 25 14:43:37.037946 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 25 14:43:37.037946 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 25 14:43:37.037946 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application May 25 14:43:37.037946 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 25 14:43:37.037946 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application May 25 14:43:37.037946 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:43:37.037946 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 14:43:37.037946 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 14:43:37.037946 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 14:43:37.038900 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 14:43:37.038900 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 14:43:37.038900 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 14:43:37.038900 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 14:43:37.038900 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 14:43:37.038900 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 14:43:37.038900 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 14:43:37.038900 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 25 14:43:37.038900 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application return self._get_service(service_id) May 25 14:43:37.038900 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 25 14:43:37.038900 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 25 14:43:37.038900 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 14:43:37.038900 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 14:43:37.038900 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 14:43:37.038900 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 14:43:37.038900 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 14:43:37.039783 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application return self.get_or_create( May 25 14:43:37.039783 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 14:43:37.039783 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application with Lock( May 25 14:43:37.039783 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 14:43:37.039783 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application return self._enter() May 25 14:43:37.039783 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 14:43:37.039783 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 14:43:37.039783 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 14:43:37.039783 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application return self.creator() May 25 14:43:37.039783 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 14:43:37.039783 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application created_value = creator( May 25 14:43:37.039783 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 25 14:43:37.039783 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 25 14:43:37.039783 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 25 14:43:37.039783 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application May 25 14:43:37.041602 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 416/847] 10.222.0.84 () {56 vars in 1132 bytes} [Wed May 25 14:43:36 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 25 14:43:37.042318 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG dbcounter [-] [101893] Writing DB stats keystone:SELECT=100 {{(pid=101893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:43:37.048444 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f7d5b1-e8d1-4c5b-a3e2-8fb0f6915ecb None admin] Authenticating user token {{(pid=101892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:43:37.080415 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f603eecb-cadb-4aae-a746-6ef9c881c4bd None admin] Validating token access rules against request {{(pid=101893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:43:37.120286 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95ae4f0c-7a25-48aa-ad44-3563bfb46135 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:43:37.120957 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ae4f0c-7a25-48aa-ad44-3563bfb46135 None admin] REQUEST_METHOD: `GET` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:43:37.121241 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ae4f0c-7a25-48aa-ad44-3563bfb46135 None admin] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:43:37.121765 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ae4f0c-7a25-48aa-ad44-3563bfb46135 None admin] PATH_INFO: `/v3/users` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:43:37.122658 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95ae4f0c-7a25-48aa-ad44-3563bfb46135 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=101893) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:43:37.122964 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95ae4f0c-7a25-48aa-ad44-3563bfb46135 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:43:37.124488 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95ae4f0c-7a25-48aa-ad44-3563bfb46135 None admin] RBAC: Authorization granted {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:43:37.147380 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG dbcounter [-] [101892] Writing DB stats keystone:SELECT=100 {{(pid=101892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:43:37.152913 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 432/848] 10.222.0.84 () {56 vars in 1135 bytes} [Wed May 25 14:43:36 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:43:37.155767 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95ae4f0c-7a25-48aa-ad44-3563bfb46135 None admin] Authenticating user token {{(pid=101893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:43:37.177655 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f7d5b1-e8d1-4c5b-a3e2-8fb0f6915ecb None admin] Validating token access rules against request {{(pid=101892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:43:37.216765 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c398bb8-331c-470c-823c-b17b1ee86c01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:43:37.217471 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c398bb8-331c-470c-823c-b17b1ee86c01 None admin] REQUEST_METHOD: `GET` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:43:37.217718 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c398bb8-331c-470c-823c-b17b1ee86c01 None admin] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:43:37.217992 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c398bb8-331c-470c-823c-b17b1ee86c01 None admin] PATH_INFO: `/v3/services` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:43:37.218718 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c398bb8-331c-470c-823c-b17b1ee86c01 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=101892) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:43:37.219024 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c398bb8-331c-470c-823c-b17b1ee86c01 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:43:37.220548 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c398bb8-331c-470c-823c-b17b1ee86c01 None admin] RBAC: Authorization granted {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:43:37.232696 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 417/849] 10.222.0.84 () {56 vars in 1126 bytes} [Wed May 25 14:43:37 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:43:37.233997 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c398bb8-331c-470c-823c-b17b1ee86c01 None admin] Authenticating user token {{(pid=101892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:43:37.284706 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95ae4f0c-7a25-48aa-ad44-3563bfb46135 None admin] Validating token access rules against request {{(pid=101893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:43:37.314894 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG dbcounter [-] [101893] Writing DB stats keystone:SELECT=100 {{(pid=101893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:43:37.324725 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-578a6ee4-c15c-4a7c-abc3-06594bb313a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:43:37.325480 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578a6ee4-c15c-4a7c-abc3-06594bb313a3 None admin] REQUEST_METHOD: `GET` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:43:37.325821 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578a6ee4-c15c-4a7c-abc3-06594bb313a3 None admin] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:43:37.329383 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578a6ee4-c15c-4a7c-abc3-06594bb313a3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:43:37.367525 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c398bb8-331c-470c-823c-b17b1ee86c01 None admin] Validating token access rules against request {{(pid=101892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:43:37.402874 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-578a6ee4-c15c-4a7c-abc3-06594bb313a3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:43:37.404633 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-578a6ee4-c15c-4a7c-abc3-06594bb313a3 None admin] RBAC: Authorization granted {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:43:37.412048 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5df45e4-3fe8-49a2-8b14-b9f8f02c43d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:43:37.413217 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5df45e4-3fe8-49a2-8b14-b9f8f02c43d1 None admin] REQUEST_METHOD: `GET` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:43:37.413704 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5df45e4-3fe8-49a2-8b14-b9f8f02c43d1 None admin] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:43:37.414187 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5df45e4-3fe8-49a2-8b14-b9f8f02c43d1 None admin] PATH_INFO: `/v3/services` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:43:37.415103 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5df45e4-3fe8-49a2-8b14-b9f8f02c43d1 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=101892) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:43:37.415718 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5df45e4-3fe8-49a2-8b14-b9f8f02c43d1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:43:37.417300 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5df45e4-3fe8-49a2-8b14-b9f8f02c43d1 None admin] RBAC: Authorization granted {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:43:37.427995 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 418/850] 10.222.0.84 () {56 vars in 1126 bytes} [Wed May 25 14:43:37 2022] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:43:37.526114 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 433/851] 10.222.0.84 () {58 vars in 1282 bytes} [Wed May 25 14:43:37 2022] GET /identity/v3/auth/tokens => generated 1151 bytes in 367 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 25 14:43:37.527620 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5df45e4-3fe8-49a2-8b14-b9f8f02c43d1 None admin] Authenticating user token {{(pid=101892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:43:37.531047 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG dbcounter [-] [101892] Writing DB stats keystone:SELECT=100 {{(pid=101892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:43:37.661480 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5df45e4-3fe8-49a2-8b14-b9f8f02c43d1 None admin] Validating token access rules against request {{(pid=101892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:43:37.700383 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c4e1523-b525-40cb-80d5-49fbfac0bc20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:43:37.701550 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c4e1523-b525-40cb-80d5-49fbfac0bc20 None admin] REQUEST_METHOD: `GET` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:43:37.702046 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c4e1523-b525-40cb-80d5-49fbfac0bc20 None admin] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:43:37.702513 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c4e1523-b525-40cb-80d5-49fbfac0bc20 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:43:37.714601 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c4e1523-b525-40cb-80d5-49fbfac0bc20 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:43:37.716409 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c4e1523-b525-40cb-80d5-49fbfac0bc20 None admin] RBAC: Authorization granted {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:43:37.735028 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application [None req-2c4e1523-b525-40cb-80d5-49fbfac0bc20 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 25 14:43:37.735028 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:43:37.735028 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 14:43:37.735028 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 14:43:37.735028 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 14:43:37.735028 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 14:43:37.735028 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 14:43:37.735028 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 14:43:37.735028 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 14:43:37.735028 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 14:43:37.735028 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 14:43:37.735028 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 14:43:37.735028 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 25 14:43:37.735028 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 25 14:43:37.735028 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 25 14:43:37.736125 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 25 14:43:37.736125 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 14:43:37.736125 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 14:43:37.736125 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 14:43:37.736125 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 14:43:37.736125 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 14:43:37.736125 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application return self.get_or_create( May 25 14:43:37.736125 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 14:43:37.736125 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application with Lock( May 25 14:43:37.736125 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 14:43:37.736125 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application return self._enter() May 25 14:43:37.736125 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 14:43:37.736125 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 14:43:37.736125 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 14:43:37.736125 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application return self.creator() May 25 14:43:37.736125 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 14:43:37.736125 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application created_value = creator( May 25 14:43:37.737039 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 25 14:43:37.737039 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 25 14:43:37.737039 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 25 14:43:37.737039 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application May 25 14:43:37.739584 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 419/852] 10.222.0.84 () {56 vars in 1108 bytes} [Wed May 25 14:43:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 14:43:37.751635 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-578a6ee4-c15c-4a7c-abc3-06594bb313a3 None admin] Authenticating user token {{(pid=101893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:43:37.776060 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG dbcounter [-] [101893] Writing DB stats keystone:SELECT=100 {{(pid=101893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:43:37.845382 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11892601-078c-4903-b00b-bd7ed9c41a6a None None] REQUEST_METHOD: `GET` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:43:37.845998 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11892601-078c-4903-b00b-bd7ed9c41a6a None None] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:43:37.846476 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11892601-078c-4903-b00b-bd7ed9c41a6a None None] PATH_INFO: `/` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:43:37.848421 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 420/853] 10.222.0.84 () {54 vars in 926 bytes} [Wed May 25 14:43:37 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 25 14:43:37.852075 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-578a6ee4-c15c-4a7c-abc3-06594bb313a3 None admin] Validating token access rules against request {{(pid=101893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:43:37.853139 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f776e5-1b53-4270-81f2-470a856d2d15 None None] REQUEST_METHOD: `POST` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:43:37.853430 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f776e5-1b53-4270-81f2-470a856d2d15 None None] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:43:37.853709 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f776e5-1b53-4270-81f2-470a856d2d15 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:43:37.871609 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.auth.core [None req-79f776e5-1b53-4270-81f2-470a856d2d15 None None] MFA Rules not processed for user `05d87e87798e429aa1c10b24391f915e`. Rule list: `[]` (Enabled: `True`). {{(pid=101892) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:43:37.872781 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.fernet_utils [None req-79f776e5-1b53-4270-81f2-470a856d2d15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=101892) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:43:37.887832 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9bc7018-61e4-44f1-adf6-19ddbcbe0bb1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:43:37.888504 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9bc7018-61e4-44f1-adf6-19ddbcbe0bb1 None admin] REQUEST_METHOD: `GET` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:43:37.888786 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9bc7018-61e4-44f1-adf6-19ddbcbe0bb1 None admin] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:43:37.889061 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9bc7018-61e4-44f1-adf6-19ddbcbe0bb1 None admin] PATH_INFO: `/v3/domains` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:43:37.889780 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9bc7018-61e4-44f1-adf6-19ddbcbe0bb1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=101893) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:43:37.890085 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9bc7018-61e4-44f1-adf6-19ddbcbe0bb1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:43:37.891449 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9bc7018-61e4-44f1-adf6-19ddbcbe0bb1 None admin] RBAC: Authorization granted {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:43:37.908377 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 434/854] 10.222.0.84 () {56 vars in 1109 bytes} [Wed May 25 14:43:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:43:37.909876 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9bc7018-61e4-44f1-adf6-19ddbcbe0bb1 None admin] Authenticating user token {{(pid=101893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:43:37.931961 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG dbcounter [-] [101892] Writing DB stats keystone:SELECT=100 {{(pid=101892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:43:37.950067 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 421/855] 10.222.0.84 () {58 vars in 1023 bytes} [Wed May 25 14:43:37 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 25 14:43:37.956843 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec1576d-9e02-4ee7-9d28-09e7434191e1 None None] REQUEST_METHOD: `GET` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:43:37.957134 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec1576d-9e02-4ee7-9d28-09e7434191e1 None None] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:43:37.957419 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec1576d-9e02-4ee7-9d28-09e7434191e1 None None] PATH_INFO: `/` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:43:37.958773 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 422/856] 10.222.0.84 () {54 vars in 926 bytes} [Wed May 25 14:43:37 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 14:43:37.964857 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d822c65-c68c-4244-b06e-dd428b4cbe98 None None] REQUEST_METHOD: `POST` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:43:37.965246 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d822c65-c68c-4244-b06e-dd428b4cbe98 None None] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:43:37.965659 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d822c65-c68c-4244-b06e-dd428b4cbe98 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:43:37.982787 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.auth.core [None req-6d822c65-c68c-4244-b06e-dd428b4cbe98 None None] MFA Rules not processed for user `05d87e87798e429aa1c10b24391f915e`. Rule list: `[]` (Enabled: `True`). {{(pid=101892) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:43:37.984085 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.fernet_utils [None req-6d822c65-c68c-4244-b06e-dd428b4cbe98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=101892) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:43:38.011613 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG dbcounter [-] [101893] Writing DB stats keystone:SELECT=100 {{(pid=101893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:43:38.030502 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9bc7018-61e4-44f1-adf6-19ddbcbe0bb1 None admin] Validating token access rules against request {{(pid=101893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:43:38.056222 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 423/857] 10.222.0.84 () {58 vars in 1023 bytes} [Wed May 25 14:43:37 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 25 14:43:38.057065 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d822c65-c68c-4244-b06e-dd428b4cbe98 None None] Authenticating user token {{(pid=101892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:43:38.072224 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25936e96-244f-41e9-b944-ef996dc47fab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:43:38.073607 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25936e96-244f-41e9-b944-ef996dc47fab None admin] REQUEST_METHOD: `GET` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:43:38.074090 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25936e96-244f-41e9-b944-ef996dc47fab None admin] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:43:38.074797 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25936e96-244f-41e9-b944-ef996dc47fab None admin] PATH_INFO: `/v3/projects/service` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:43:38.084034 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25936e96-244f-41e9-b944-ef996dc47fab None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:43:38.086840 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25936e96-244f-41e9-b944-ef996dc47fab None admin] RBAC: Authorization granted {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:43:38.102812 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application [None req-25936e96-244f-41e9-b944-ef996dc47fab None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 25 14:43:38.102812 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:43:38.102812 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 14:43:38.102812 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 14:43:38.102812 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 14:43:38.102812 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 14:43:38.102812 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 14:43:38.102812 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 14:43:38.102812 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 14:43:38.102812 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 14:43:38.102812 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 14:43:38.102812 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 14:43:38.102812 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 25 14:43:38.102812 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return self._get_project(project_id) May 25 14:43:38.102812 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 25 14:43:38.103901 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 25 14:43:38.103901 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 14:43:38.103901 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 14:43:38.103901 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 14:43:38.103901 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 14:43:38.103901 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 14:43:38.103901 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return self.get_or_create( May 25 14:43:38.103901 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 14:43:38.103901 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application with Lock( May 25 14:43:38.103901 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 14:43:38.103901 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return self._enter() May 25 14:43:38.103901 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 14:43:38.103901 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 14:43:38.103901 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 14:43:38.103901 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return self.creator() May 25 14:43:38.103901 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 14:43:38.103901 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application created_value = creator( May 25 14:43:38.104983 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 25 14:43:38.104983 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 25 14:43:38.104983 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 25 14:43:38.104983 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 25 14:43:38.104983 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 25 14:43:38.104983 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 25 14:43:38.104983 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 25 14:43:38.104983 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application May 25 14:43:38.106904 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 435/858] 10.222.0.84 () {56 vars in 1111 bytes} [Wed May 25 14:43:37 2022] GET /identity/v3/projects/service => generated 88 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 14:43:38.107814 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25936e96-244f-41e9-b944-ef996dc47fab None admin] Authenticating user token {{(pid=101893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:43:38.165787 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d822c65-c68c-4244-b06e-dd428b4cbe98 None None] Validating token access rules against request {{(pid=101892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:43:38.181566 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG dbcounter [-] [101892] Writing DB stats keystone:SELECT=100 {{(pid=101892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:43:38.202774 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a743ad78-1c93-4058-9c7d-ba066effe7e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:43:38.203718 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a743ad78-1c93-4058-9c7d-ba066effe7e0 None admin] REQUEST_METHOD: `GET` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:43:38.204005 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a743ad78-1c93-4058-9c7d-ba066effe7e0 None admin] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:43:38.204281 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a743ad78-1c93-4058-9c7d-ba066effe7e0 None admin] PATH_INFO: `/v3/roles/service` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:43:38.214923 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25936e96-244f-41e9-b944-ef996dc47fab None admin] Validating token access rules against request {{(pid=101893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:43:38.215660 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a743ad78-1c93-4058-9c7d-ba066effe7e0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 14:43:38.225038 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application [None req-a743ad78-1c93-4058-9c7d-ba066effe7e0 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 25 14:43:38.225038 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:43:38.225038 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 14:43:38.225038 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 14:43:38.225038 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 14:43:38.225038 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 14:43:38.225038 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 14:43:38.225038 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 14:43:38.225038 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 14:43:38.225038 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 14:43:38.225038 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 14:43:38.225038 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 14:43:38.225038 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 14:43:38.225038 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 14:43:38.225038 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 14:43:38.225038 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 14:43:38.226443 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 14:43:38.226443 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 14:43:38.226443 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 14:43:38.226443 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 14:43:38.226443 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 14:43:38.226443 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 14:43:38.226443 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 14:43:38.226443 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 14:43:38.226443 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 14:43:38.226443 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application return self.get_or_create( May 25 14:43:38.226443 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 14:43:38.226443 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application with Lock( May 25 14:43:38.226443 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 14:43:38.226443 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application return self._enter() May 25 14:43:38.226443 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 14:43:38.226443 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 14:43:38.228311 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 14:43:38.228311 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application return self.creator() May 25 14:43:38.228311 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 14:43:38.228311 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application created_value = creator( May 25 14:43:38.228311 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 14:43:38.228311 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 14:43:38.228311 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 14:43:38.228311 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 14:43:38.228311 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 14:43:38.228311 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 14:43:38.228311 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 25 14:43:38.228311 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application May 25 14:43:38.228311 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 424/859] 10.222.0.84 () {56 vars in 1102 bytes} [Wed May 25 14:43:38 2022] GET /identity/v3/roles/service => generated 85 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 14:43:38.228311 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a743ad78-1c93-4058-9c7d-ba066effe7e0 None admin] Authenticating user token {{(pid=101892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:43:38.264309 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21d6fb68-02fd-4cfc-a088-778e9b2288f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:43:38.266087 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d6fb68-02fd-4cfc-a088-778e9b2288f8 None admin] REQUEST_METHOD: `POST` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:43:38.266521 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d6fb68-02fd-4cfc-a088-778e9b2288f8 None admin] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:43:38.267091 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d6fb68-02fd-4cfc-a088-778e9b2288f8 None admin] PATH_INFO: `/v3/services` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:43:38.268332 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21d6fb68-02fd-4cfc-a088-778e9b2288f8 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:43:38.270793 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21d6fb68-02fd-4cfc-a088-778e9b2288f8 None admin] RBAC: Authorization granted {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:43:38.341568 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 436/860] 10.222.0.84 () {60 vars in 1141 bytes} [Wed May 25 14:43:38 2022] POST /identity/v3/services => generated 251 bytes in 232 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 14:43:38.341568 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21d6fb68-02fd-4cfc-a088-778e9b2288f8 None admin] Authenticating user token {{(pid=101893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:43:38.342103 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a743ad78-1c93-4058-9c7d-ba066effe7e0 None admin] Validating token access rules against request {{(pid=101892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:43:38.353984 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG dbcounter [-] [101893] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=101893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:43:38.393892 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fe5ad05-0c03-41b5-b488-bad9064570bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:43:38.394581 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe5ad05-0c03-41b5-b488-bad9064570bb None admin] REQUEST_METHOD: `GET` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:43:38.394864 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe5ad05-0c03-41b5-b488-bad9064570bb None admin] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:43:38.395816 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe5ad05-0c03-41b5-b488-bad9064570bb None admin] PATH_INFO: `/v3/projects` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:43:38.396848 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fe5ad05-0c03-41b5-b488-bad9064570bb None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=101892) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:43:38.398028 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fe5ad05-0c03-41b5-b488-bad9064570bb None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:43:38.398749 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fe5ad05-0c03-41b5-b488-bad9064570bb None admin] RBAC: Authorization granted {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:43:38.418352 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 425/861] 10.222.0.84 () {56 vars in 1148 bytes} [Wed May 25 14:43:38 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:43:38.419547 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fe5ad05-0c03-41b5-b488-bad9064570bb None admin] Authenticating user token {{(pid=101892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:43:38.461044 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG dbcounter [-] [101892] Writing DB stats keystone:SELECT=100 {{(pid=101892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:43:38.482524 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21d6fb68-02fd-4cfc-a088-778e9b2288f8 None admin] Validating token access rules against request {{(pid=101893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:43:38.523255 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99878630-c3f0-4b27-ab4f-48b09922ba0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:43:38.524155 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99878630-c3f0-4b27-ab4f-48b09922ba0d None admin] REQUEST_METHOD: `GET` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:43:38.524810 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99878630-c3f0-4b27-ab4f-48b09922ba0d None admin] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:43:38.525196 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99878630-c3f0-4b27-ab4f-48b09922ba0d None admin] PATH_INFO: `/v3/roles` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:43:38.526834 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99878630-c3f0-4b27-ab4f-48b09922ba0d None admin] RBAC: Adding query filter params (name=service) {{(pid=101893) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:43:38.527343 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99878630-c3f0-4b27-ab4f-48b09922ba0d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:43:38.528934 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99878630-c3f0-4b27-ab4f-48b09922ba0d None admin] RBAC: Authorization granted {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:43:38.539847 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 437/862] 10.222.0.84 () {56 vars in 1103 bytes} [Wed May 25 14:43:38 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:43:38.544873 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99878630-c3f0-4b27-ab4f-48b09922ba0d None admin] Authenticating user token {{(pid=101893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:43:38.566333 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fe5ad05-0c03-41b5-b488-bad9064570bb None admin] Validating token access rules against request {{(pid=101892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:43:38.612461 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4abdc35-e208-4259-8201-4ca40a06a01c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:43:38.613677 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4abdc35-e208-4259-8201-4ca40a06a01c None admin] REQUEST_METHOD: `GET` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:43:38.615075 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4abdc35-e208-4259-8201-4ca40a06a01c None admin] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:43:38.616079 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4abdc35-e208-4259-8201-4ca40a06a01c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:43:38.617170 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4abdc35-e208-4259-8201-4ca40a06a01c None admin] RBAC: Adding query filter params (role.id=a3b78e7d547d4d2d998b4c99a4396bba, scope.project.id=a000829c658c4a7cab67f7b6353ba3fa, user.id=e196f0897b98455c9e164271d7d0070a) {{(pid=101892) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:43:38.617685 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4abdc35-e208-4259-8201-4ca40a06a01c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:43:38.620179 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4abdc35-e208-4259-8201-4ca40a06a01c None admin] RBAC: Authorization granted {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:43:38.630989 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 426/863] 10.222.0.84 () {56 vars in 1374 bytes} [Wed May 25 14:43:38 2022] GET /identity/v3/role_assignments?user.id=e196f0897b98455c9e164271d7d0070a&scope.project.id=a000829c658c4a7cab67f7b6353ba3fa&role.id=a3b78e7d547d4d2d998b4c99a4396bba => generated 608 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 14:43:38.637046 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG dbcounter [-] [101893] Writing DB stats keystone:SELECT=100 {{(pid=101893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:43:38.682403 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99878630-c3f0-4b27-ab4f-48b09922ba0d None admin] Validating token access rules against request {{(pid=101893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:43:38.720885 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef84d406-3470-448a-958d-e22c3785ad6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:43:38.721779 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef84d406-3470-448a-958d-e22c3785ad6e None admin] REQUEST_METHOD: `GET` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:43:38.722064 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef84d406-3470-448a-958d-e22c3785ad6e None admin] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:43:38.722397 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef84d406-3470-448a-958d-e22c3785ad6e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:43:38.735537 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef84d406-3470-448a-958d-e22c3785ad6e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:43:38.737055 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef84d406-3470-448a-958d-e22c3785ad6e None admin] RBAC: Authorization granted {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:43:38.757172 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application [None req-ef84d406-3470-448a-958d-e22c3785ad6e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 25 14:43:38.757172 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:43:38.757172 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 14:43:38.757172 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 14:43:38.757172 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 14:43:38.757172 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 14:43:38.757172 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 14:43:38.757172 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 14:43:38.757172 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 14:43:38.757172 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 14:43:38.757172 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 14:43:38.757172 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 14:43:38.757172 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 25 14:43:38.757172 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 25 14:43:38.757172 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 25 14:43:38.758555 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 25 14:43:38.758555 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 14:43:38.758555 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 14:43:38.758555 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 14:43:38.758555 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 14:43:38.758555 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 14:43:38.758555 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return self.get_or_create( May 25 14:43:38.758555 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 14:43:38.758555 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application with Lock( May 25 14:43:38.758555 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 14:43:38.758555 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return self._enter() May 25 14:43:38.758555 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 14:43:38.758555 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 14:43:38.758555 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 14:43:38.758555 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return self.creator() May 25 14:43:38.758555 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 14:43:38.758555 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application created_value = creator( May 25 14:43:38.759521 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 25 14:43:38.759521 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 25 14:43:38.759521 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 25 14:43:38.759521 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application May 25 14:43:38.759521 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 438/864] 10.222.0.84 () {56 vars in 1108 bytes} [Wed May 25 14:43:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 14:43:38.764117 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4abdc35-e208-4259-8201-4ca40a06a01c None admin] Authenticating user token {{(pid=101892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:43:38.869674 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG dbcounter [-] [101892] Writing DB stats keystone:SELECT=100 {{(pid=101892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:43:38.877199 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4abdc35-e208-4259-8201-4ca40a06a01c None admin] Validating token access rules against request {{(pid=101892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:43:38.915129 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9365087-49ea-4773-a461-5bca36619f53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:43:38.915827 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9365087-49ea-4773-a461-5bca36619f53 None admin] REQUEST_METHOD: `GET` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:43:38.916116 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9365087-49ea-4773-a461-5bca36619f53 None admin] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:43:38.916395 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9365087-49ea-4773-a461-5bca36619f53 None admin] PATH_INFO: `/v3/domains` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:43:38.917121 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9365087-49ea-4773-a461-5bca36619f53 None admin] RBAC: Adding query filter params (name=Default) {{(pid=101892) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:43:38.917431 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9365087-49ea-4773-a461-5bca36619f53 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:43:38.918795 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9365087-49ea-4773-a461-5bca36619f53 None admin] RBAC: Authorization granted {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:43:38.931664 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 427/865] 10.222.0.84 () {56 vars in 1109 bytes} [Wed May 25 14:43:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:43:38.936715 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef84d406-3470-448a-958d-e22c3785ad6e None admin] Authenticating user token {{(pid=101893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:43:39.047325 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef84d406-3470-448a-958d-e22c3785ad6e None admin] Validating token access rules against request {{(pid=101893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:43:39.068049 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG dbcounter [-] [101893] Writing DB stats keystone:SELECT=100 {{(pid=101893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:43:39.089159 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6352980e-a956-46f3-9e62-237ad58320fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:43:39.089982 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6352980e-a956-46f3-9e62-237ad58320fe None admin] REQUEST_METHOD: `GET` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:43:39.090267 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6352980e-a956-46f3-9e62-237ad58320fe None admin] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:43:39.090543 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6352980e-a956-46f3-9e62-237ad58320fe None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:43:39.099377 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6352980e-a956-46f3-9e62-237ad58320fe None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:43:39.101002 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6352980e-a956-46f3-9e62-237ad58320fe None admin] RBAC: Authorization granted {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:43:39.116069 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application [None req-6352980e-a956-46f3-9e62-237ad58320fe None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. May 25 14:43:39.116069 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:43:39.116069 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 14:43:39.116069 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 14:43:39.116069 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 14:43:39.116069 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 14:43:39.116069 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 14:43:39.116069 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 14:43:39.116069 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 14:43:39.116069 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 14:43:39.116069 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 14:43:39.116069 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 14:43:39.116069 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 25 14:43:39.116069 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return self._get_user(user_id) May 25 14:43:39.116069 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 25 14:43:39.116069 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 25 14:43:39.117076 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 14:43:39.117076 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 14:43:39.117076 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 25 14:43:39.117076 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 25 14:43:39.117076 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 25 14:43:39.117076 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 25 14:43:39.117076 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 14:43:39.117076 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 14:43:39.117076 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 14:43:39.117076 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return self.get_or_create( May 25 14:43:39.117076 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 14:43:39.117076 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application with Lock( May 25 14:43:39.117076 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 14:43:39.117076 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return self._enter() May 25 14:43:39.117076 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 14:43:39.117076 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 14:43:39.117076 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 14:43:39.117076 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return self.creator() May 25 14:43:39.118042 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 14:43:39.118042 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application created_value = creator( May 25 14:43:39.118042 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 25 14:43:39.118042 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 25 14:43:39.118042 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 25 14:43:39.118042 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 25 14:43:39.118042 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 25 14:43:39.118042 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 25 14:43:39.118042 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. May 25 14:43:39.118042 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application May 25 14:43:39.118042 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 439/866] 10.222.0.84 () {56 vars in 1117 bytes} [Wed May 25 14:43:38 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 14:43:39.123480 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9365087-49ea-4773-a461-5bca36619f53 None admin] Authenticating user token {{(pid=101892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:43:39.230093 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9365087-49ea-4773-a461-5bca36619f53 None admin] Validating token access rules against request {{(pid=101892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:43:39.267152 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-985bf3bc-1e4c-4473-8d9d-0844132873ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:43:39.268425 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985bf3bc-1e4c-4473-8d9d-0844132873ab None admin] REQUEST_METHOD: `GET` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:43:39.268926 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985bf3bc-1e4c-4473-8d9d-0844132873ab None admin] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:43:39.269415 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985bf3bc-1e4c-4473-8d9d-0844132873ab None admin] PATH_INFO: `/v3/users` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:43:39.271210 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-985bf3bc-1e4c-4473-8d9d-0844132873ab None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=101892) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:43:39.271757 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-985bf3bc-1e4c-4473-8d9d-0844132873ab None admin] RBAC: Authorizing `identity:list_users()` {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:43:39.273387 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-985bf3bc-1e4c-4473-8d9d-0844132873ab None admin] RBAC: Authorization granted {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:43:39.292325 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 428/867] 10.222.0.84 () {56 vars in 1149 bytes} [Wed May 25 14:43:39 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:43:39.300140 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6352980e-a956-46f3-9e62-237ad58320fe None admin] Authenticating user token {{(pid=101893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:43:39.402567 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6352980e-a956-46f3-9e62-237ad58320fe None admin] Validating token access rules against request {{(pid=101893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:43:39.436429 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69175581-a2ed-43a0-af25-8d5bb2d3e960 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:43:39.437088 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69175581-a2ed-43a0-af25-8d5bb2d3e960 None admin] REQUEST_METHOD: `GET` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:43:39.437372 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69175581-a2ed-43a0-af25-8d5bb2d3e960 None admin] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:43:39.437648 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69175581-a2ed-43a0-af25-8d5bb2d3e960 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:43:39.487955 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG dbcounter [-] [101893] Writing DB stats keystone:SELECT=100 {{(pid=101893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:43:39.507968 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69175581-a2ed-43a0-af25-8d5bb2d3e960 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:43:39.514981 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69175581-a2ed-43a0-af25-8d5bb2d3e960 None admin] RBAC: Authorization granted {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:43:39.623801 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 440/868] 10.222.0.84 () {58 vars in 1282 bytes} [Wed May 25 14:43:39 2022] GET /identity/v3/auth/tokens => generated 1252 bytes in 323 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 25 14:43:39.625525 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-985bf3bc-1e4c-4473-8d9d-0844132873ab None admin] Authenticating user token {{(pid=101892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:43:39.641644 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG dbcounter [-] [101892] Writing DB stats keystone:SELECT=100 {{(pid=101892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:43:39.729830 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b82cee1-faaa-4ac2-a1e7-3ea8a4160c09 None None] REQUEST_METHOD: `GET` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:43:39.730025 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b82cee1-faaa-4ac2-a1e7-3ea8a4160c09 None None] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:43:39.730246 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b82cee1-faaa-4ac2-a1e7-3ea8a4160c09 None None] PATH_INFO: `/` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:43:39.731899 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 441/869] 10.222.0.84 () {54 vars in 926 bytes} [Wed May 25 14:43:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 25 14:43:39.739582 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-679a62b1-55a4-4692-9ce5-f773cce086e2 None None] REQUEST_METHOD: `POST` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:43:39.739582 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-679a62b1-55a4-4692-9ce5-f773cce086e2 None None] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:43:39.739582 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-679a62b1-55a4-4692-9ce5-f773cce086e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:43:39.739877 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-985bf3bc-1e4c-4473-8d9d-0844132873ab None admin] Validating token access rules against request {{(pid=101892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:43:39.759854 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.auth.core [None req-679a62b1-55a4-4692-9ce5-f773cce086e2 None None] MFA Rules not processed for user `05d87e87798e429aa1c10b24391f915e`. Rule list: `[]` (Enabled: `True`). {{(pid=101893) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:43:39.761707 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.fernet_utils [None req-679a62b1-55a4-4692-9ce5-f773cce086e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=101893) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:43:39.775472 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7419b989-9b69-4391-b47b-6526e90f1c80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:43:39.776409 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7419b989-9b69-4391-b47b-6526e90f1c80 None admin] REQUEST_METHOD: `GET` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:43:39.776701 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7419b989-9b69-4391-b47b-6526e90f1c80 None admin] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:43:39.776987 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7419b989-9b69-4391-b47b-6526e90f1c80 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:43:39.788312 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7419b989-9b69-4391-b47b-6526e90f1c80 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:43:39.789760 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7419b989-9b69-4391-b47b-6526e90f1c80 None admin] RBAC: Authorization granted {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:43:39.809198 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application [None req-7419b989-9b69-4391-b47b-6526e90f1c80 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 25 14:43:39.809198 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:43:39.809198 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 14:43:39.809198 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 14:43:39.809198 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 14:43:39.809198 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 14:43:39.809198 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 14:43:39.809198 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 14:43:39.809198 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 14:43:39.809198 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 14:43:39.809198 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 14:43:39.809198 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 14:43:39.809198 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 25 14:43:39.809198 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 25 14:43:39.809198 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 25 14:43:39.810199 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 25 14:43:39.810199 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 14:43:39.810199 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 14:43:39.810199 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 14:43:39.810199 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 14:43:39.810199 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 14:43:39.810199 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application return self.get_or_create( May 25 14:43:39.810199 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 14:43:39.810199 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application with Lock( May 25 14:43:39.810199 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 14:43:39.810199 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application return self._enter() May 25 14:43:39.810199 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 14:43:39.810199 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 14:43:39.810199 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 14:43:39.810199 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application return self.creator() May 25 14:43:39.810199 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 14:43:39.810199 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application created_value = creator( May 25 14:43:39.811138 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 25 14:43:39.811138 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 25 14:43:39.811138 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 25 14:43:39.811138 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application May 25 14:43:39.811138 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 429/870] 10.222.0.84 () {56 vars in 1108 bytes} [Wed May 25 14:43:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 14:43:39.816614 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7419b989-9b69-4391-b47b-6526e90f1c80 None admin] Authenticating user token {{(pid=101892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:43:39.855691 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 442/871] 10.222.0.84 () {58 vars in 1023 bytes} [Wed May 25 14:43:39 2022] POST /identity/v3/auth/tokens => generated 1252 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 25 14:43:39.872515 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-679a62b1-55a4-4692-9ce5-f773cce086e2 None None] Authenticating user token {{(pid=101893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:43:39.884516 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG dbcounter [-] [101893] Writing DB stats keystone:SELECT=100 {{(pid=101893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:43:39.892913 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG dbcounter [-] [101892] Writing DB stats keystone:SELECT=100 {{(pid=101892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:43:39.933136 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7419b989-9b69-4391-b47b-6526e90f1c80 None admin] Validating token access rules against request {{(pid=101892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:43:39.972481 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce8b4403-85e7-42a4-838c-e8d4d1cfde6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:43:39.973148 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8b4403-85e7-42a4-838c-e8d4d1cfde6e None admin] REQUEST_METHOD: `GET` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:43:39.973564 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8b4403-85e7-42a4-838c-e8d4d1cfde6e None admin] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:43:39.973848 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8b4403-85e7-42a4-838c-e8d4d1cfde6e None admin] PATH_INFO: `/v3/domains` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:43:39.974574 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce8b4403-85e7-42a4-838c-e8d4d1cfde6e None admin] RBAC: Adding query filter params (name=Default) {{(pid=101892) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:43:39.974923 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce8b4403-85e7-42a4-838c-e8d4d1cfde6e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:43:39.976403 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce8b4403-85e7-42a4-838c-e8d4d1cfde6e None admin] RBAC: Authorization granted {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:43:39.990625 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 430/872] 10.222.0.84 () {56 vars in 1109 bytes} [Wed May 25 14:43:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 14:43:39.996494 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce8b4403-85e7-42a4-838c-e8d4d1cfde6e None admin] Authenticating user token {{(pid=101892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:43:40.007538 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-679a62b1-55a4-4692-9ce5-f773cce086e2 None None] Validating token access rules against request {{(pid=101893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:43:40.043415 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29d69700-1c59-409d-a71e-19007708351d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:43:40.044155 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d69700-1c59-409d-a71e-19007708351d None admin] REQUEST_METHOD: `POST` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:43:40.044440 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d69700-1c59-409d-a71e-19007708351d None admin] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:43:40.044712 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d69700-1c59-409d-a71e-19007708351d None admin] PATH_INFO: `/v3/services` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:43:40.045451 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29d69700-1c59-409d-a71e-19007708351d None admin] RBAC: Authorizing `identity:create_service()` {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:43:40.046833 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29d69700-1c59-409d-a71e-19007708351d None admin] RBAC: Authorization granted {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:43:40.113697 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce8b4403-85e7-42a4-838c-e8d4d1cfde6e None admin] Validating token access rules against request {{(pid=101892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:43:40.124612 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 443/873] 10.222.0.84 () {60 vars in 1141 bytes} [Wed May 25 14:43:39 2022] POST /identity/v3/services => generated 269 bytes in 252 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 14:43:40.151814 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG dbcounter [-] [101892] Writing DB stats keystone:SELECT=100 {{(pid=101892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:43:40.171514 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55065eb6-8d08-497e-88c0-a9f83ec5dc5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:43:40.172415 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55065eb6-8d08-497e-88c0-a9f83ec5dc5a None admin] REQUEST_METHOD: `GET` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:43:40.172703 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55065eb6-8d08-497e-88c0-a9f83ec5dc5a None admin] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:43:40.172981 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55065eb6-8d08-497e-88c0-a9f83ec5dc5a None admin] PATH_INFO: `/v3/projects/service` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:43:40.180942 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55065eb6-8d08-497e-88c0-a9f83ec5dc5a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:43:40.182742 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55065eb6-8d08-497e-88c0-a9f83ec5dc5a None admin] RBAC: Authorization granted {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:43:40.200132 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application [None req-55065eb6-8d08-497e-88c0-a9f83ec5dc5a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 25 14:43:40.200132 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:43:40.200132 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 14:43:40.200132 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 14:43:40.200132 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 14:43:40.200132 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 14:43:40.200132 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 14:43:40.200132 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 14:43:40.200132 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 14:43:40.200132 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 14:43:40.200132 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 14:43:40.200132 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 14:43:40.200132 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 25 14:43:40.200132 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application return self._get_project(project_id) May 25 14:43:40.200132 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 25 14:43:40.202277 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 25 14:43:40.202277 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 14:43:40.202277 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 14:43:40.202277 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 14:43:40.202277 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 14:43:40.202277 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 14:43:40.202277 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application return self.get_or_create( May 25 14:43:40.202277 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 14:43:40.202277 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application with Lock( May 25 14:43:40.202277 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 14:43:40.202277 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application return self._enter() May 25 14:43:40.202277 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 14:43:40.202277 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 14:43:40.202277 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 14:43:40.202277 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application return self.creator() May 25 14:43:40.202277 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 14:43:40.202277 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application created_value = creator( May 25 14:43:40.203469 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 25 14:43:40.203469 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 25 14:43:40.203469 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 25 14:43:40.203469 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 25 14:43:40.203469 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 25 14:43:40.203469 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 25 14:43:40.203469 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 25 14:43:40.203469 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application May 25 14:43:40.203469 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 431/874] 10.222.0.84 () {56 vars in 1111 bytes} [Wed May 25 14:43:39 2022] GET /identity/v3/projects/service => generated 88 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 25 14:43:40.207452 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29d69700-1c59-409d-a71e-19007708351d None admin] Authenticating user token {{(pid=101893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:43:40.294523 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG dbcounter [-] [101893] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=101893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:43:40.329476 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29d69700-1c59-409d-a71e-19007708351d None admin] Validating token access rules against request {{(pid=101893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:43:40.366099 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f401fae-9418-4b06-b0bf-d66d46ef1d17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:43:40.366777 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f401fae-9418-4b06-b0bf-d66d46ef1d17 None admin] REQUEST_METHOD: `GET` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:43:40.367062 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f401fae-9418-4b06-b0bf-d66d46ef1d17 None admin] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:43:40.367343 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f401fae-9418-4b06-b0bf-d66d46ef1d17 None admin] PATH_INFO: `/v3/projects` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:43:40.368170 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f401fae-9418-4b06-b0bf-d66d46ef1d17 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=101893) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:43:40.368487 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f401fae-9418-4b06-b0bf-d66d46ef1d17 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:43:40.369934 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f401fae-9418-4b06-b0bf-d66d46ef1d17 None admin] RBAC: Authorization granted {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:43:40.384214 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 444/875] 10.222.0.84 () {56 vars in 1148 bytes} [Wed May 25 14:43:40 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:43:40.390228 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55065eb6-8d08-497e-88c0-a9f83ec5dc5a None admin] Authenticating user token {{(pid=101892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:43:40.496755 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55065eb6-8d08-497e-88c0-a9f83ec5dc5a None admin] Validating token access rules against request {{(pid=101892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:43:40.533810 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-516a23c0-5ddc-4a17-8614-3565e5b6ec5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:43:40.534472 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516a23c0-5ddc-4a17-8614-3565e5b6ec5b None admin] REQUEST_METHOD: `GET` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:43:40.534755 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516a23c0-5ddc-4a17-8614-3565e5b6ec5b None admin] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:43:40.535032 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516a23c0-5ddc-4a17-8614-3565e5b6ec5b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:43:40.535996 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-516a23c0-5ddc-4a17-8614-3565e5b6ec5b None admin] RBAC: Adding query filter params (role.id=fdcb2eda27b84f44a392b7e8b59cc425, scope.project.id=a000829c658c4a7cab67f7b6353ba3fa, user.id=049a7ab3f95f460e908f79cc321176fd) {{(pid=101892) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:43:40.536314 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-516a23c0-5ddc-4a17-8614-3565e5b6ec5b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:43:40.537807 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-516a23c0-5ddc-4a17-8614-3565e5b6ec5b None admin] RBAC: Authorization granted {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:43:40.544925 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 432/876] 10.222.0.84 () {56 vars in 1374 bytes} [Wed May 25 14:43:40 2022] GET /identity/v3/role_assignments?user.id=049a7ab3f95f460e908f79cc321176fd&scope.project.id=a000829c658c4a7cab67f7b6353ba3fa&role.id=fdcb2eda27b84f44a392b7e8b59cc425 => generated 608 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:43:40.764544 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3fb936a-d0df-4660-9bed-35b3b1530b80 None None] REQUEST_METHOD: `GET` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:43:40.765439 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3fb936a-d0df-4660-9bed-35b3b1530b80 None None] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:43:40.765729 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3fb936a-d0df-4660-9bed-35b3b1530b80 None None] PATH_INFO: `/` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:43:40.767377 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 445/877] 10.222.0.84 () {54 vars in 926 bytes} [Wed May 25 14:43:40 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 14:43:40.772960 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c86883a-3cd5-4976-9568-791cac6ddf97 None None] REQUEST_METHOD: `POST` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:43:40.773491 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c86883a-3cd5-4976-9568-791cac6ddf97 None None] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:43:40.773654 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c86883a-3cd5-4976-9568-791cac6ddf97 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:43:40.791198 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.auth.core [None req-9c86883a-3cd5-4976-9568-791cac6ddf97 None None] MFA Rules not processed for user `05d87e87798e429aa1c10b24391f915e`. Rule list: `[]` (Enabled: `True`). {{(pid=101892) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:43:40.792404 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.fernet_utils [None req-9c86883a-3cd5-4976-9568-791cac6ddf97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=101892) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:43:40.836495 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG dbcounter [-] [101892] Writing DB stats keystone:SELECT=100 {{(pid=101892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:43:40.866643 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 433/878] 10.222.0.84 () {58 vars in 1023 bytes} [Wed May 25 14:43:40 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 25 14:43:40.889565 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3fb936a-d0df-4660-9bed-35b3b1530b80 None None] Authenticating user token {{(pid=101893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:43:41.000208 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3fb936a-d0df-4660-9bed-35b3b1530b80 None None] Validating token access rules against request {{(pid=101893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:43:41.030886 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG dbcounter [-] [101893] Writing DB stats keystone:SELECT=100 {{(pid=101893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:43:41.036675 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d077c9ee-a44e-45fc-9c61-3f3d621c6683 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:43:41.037482 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d077c9ee-a44e-45fc-9c61-3f3d621c6683 None admin] REQUEST_METHOD: `GET` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:43:41.037765 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d077c9ee-a44e-45fc-9c61-3f3d621c6683 None admin] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:43:41.038042 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d077c9ee-a44e-45fc-9c61-3f3d621c6683 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:43:41.038765 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d077c9ee-a44e-45fc-9c61-3f3d621c6683 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:43:41.040171 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d077c9ee-a44e-45fc-9c61-3f3d621c6683 None admin] RBAC: Authorization granted {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:43:41.054239 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92132d3-0b66-4695-82b4-f7ac3ade8896 None None] REQUEST_METHOD: `GET` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:43:41.054535 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92132d3-0b66-4695-82b4-f7ac3ade8896 None None] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:43:41.054798 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92132d3-0b66-4695-82b4-f7ac3ade8896 None None] PATH_INFO: `/` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:43:41.057324 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application [None req-d077c9ee-a44e-45fc-9c61-3f3d621c6683 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. May 25 14:43:41.057324 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:43:41.057324 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 25 14:43:41.057324 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 25 14:43:41.057324 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 25 14:43:41.057324 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 25 14:43:41.057324 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 25 14:43:41.057324 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 25 14:43:41.057324 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. May 25 14:43:41.057324 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application May 25 14:43:41.057324 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 25 14:43:41.057324 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application May 25 14:43:41.057324 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:43:41.057324 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 14:43:41.057324 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 14:43:41.057324 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 14:43:41.057324 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 14:43:41.058418 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 14:43:41.058418 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 14:43:41.058418 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 14:43:41.058418 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 14:43:41.058418 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 14:43:41.058418 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 14:43:41.058418 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 25 14:43:41.058418 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return self._get_service(service_id) May 25 14:43:41.058418 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 25 14:43:41.058418 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 25 14:43:41.058418 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 14:43:41.058418 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 14:43:41.058418 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 14:43:41.058418 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 14:43:41.058418 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 14:43:41.058418 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return self.get_or_create( May 25 14:43:41.059338 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 14:43:41.059338 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application with Lock( May 25 14:43:41.059338 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 14:43:41.059338 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return self._enter() May 25 14:43:41.059338 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 14:43:41.059338 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 14:43:41.059338 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 14:43:41.059338 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return self.creator() May 25 14:43:41.059338 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 14:43:41.059338 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application created_value = creator( May 25 14:43:41.059338 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 25 14:43:41.059338 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 25 14:43:41.059338 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. May 25 14:43:41.059338 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application May 25 14:43:41.060184 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 434/879] 10.222.0.84 () {54 vars in 926 bytes} [Wed May 25 14:43:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 25 14:43:41.060262 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 446/880] 10.222.0.84 () {56 vars in 1114 bytes} [Wed May 25 14:43:40 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 14:43:41.063136 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d92132d3-0b66-4695-82b4-f7ac3ade8896 None None] Authenticating user token {{(pid=101892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:43:41.066440 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e60ce9c-ef32-40fc-bc3e-d55df30ecbcc None None] REQUEST_METHOD: `POST` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:43:41.066726 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e60ce9c-ef32-40fc-bc3e-d55df30ecbcc None None] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:43:41.067553 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e60ce9c-ef32-40fc-bc3e-d55df30ecbcc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:43:41.087900 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.auth.core [None req-2e60ce9c-ef32-40fc-bc3e-d55df30ecbcc None None] MFA Rules not processed for user `05d87e87798e429aa1c10b24391f915e`. Rule list: `[]` (Enabled: `True`). {{(pid=101893) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:43:41.089016 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.fernet_utils [None req-2e60ce9c-ef32-40fc-bc3e-d55df30ecbcc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=101893) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:43:41.173038 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 447/881] 10.222.0.84 () {58 vars in 1023 bytes} [Wed May 25 14:43:41 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 25 14:43:41.196954 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d92132d3-0b66-4695-82b4-f7ac3ade8896 None None] Validating token access rules against request {{(pid=101892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:43:41.198495 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e60ce9c-ef32-40fc-bc3e-d55df30ecbcc None None] Authenticating user token {{(pid=101893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:43:41.237006 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74c714c3-7d92-4102-9c1e-953a349251a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:43:41.237942 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c714c3-7d92-4102-9c1e-953a349251a4 None admin] REQUEST_METHOD: `GET` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:43:41.238397 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c714c3-7d92-4102-9c1e-953a349251a4 None admin] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:43:41.239348 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c714c3-7d92-4102-9c1e-953a349251a4 None admin] PATH_INFO: `/v3/services` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:43:41.240438 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74c714c3-7d92-4102-9c1e-953a349251a4 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=101892) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:43:41.247454 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74c714c3-7d92-4102-9c1e-953a349251a4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:43:41.247454 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74c714c3-7d92-4102-9c1e-953a349251a4 None admin] RBAC: Authorization granted {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:43:41.248642 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 435/882] 10.222.0.84 () {56 vars in 1114 bytes} [Wed May 25 14:43:41 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:43:41.254990 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74c714c3-7d92-4102-9c1e-953a349251a4 None admin] Authenticating user token {{(pid=101892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:43:41.298858 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG dbcounter [-] [101892] Writing DB stats keystone:SELECT=100 {{(pid=101892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:43:41.304061 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e60ce9c-ef32-40fc-bc3e-d55df30ecbcc None None] Validating token access rules against request {{(pid=101893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:43:41.330701 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG dbcounter [-] [101893] Writing DB stats keystone:SELECT=100 {{(pid=101893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:43:41.342070 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-729976d4-b77c-48ed-88b5-718a8619263b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:43:41.342823 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729976d4-b77c-48ed-88b5-718a8619263b None admin] REQUEST_METHOD: `GET` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:43:41.343108 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729976d4-b77c-48ed-88b5-718a8619263b None admin] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:43:41.343384 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729976d4-b77c-48ed-88b5-718a8619263b None admin] PATH_INFO: `/v3/services/object-store` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:43:41.344093 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-729976d4-b77c-48ed-88b5-718a8619263b None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:43:41.345523 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-729976d4-b77c-48ed-88b5-718a8619263b None admin] RBAC: Authorization granted {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:43:41.358569 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application [None req-729976d4-b77c-48ed-88b5-718a8619263b None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. May 25 14:43:41.358569 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:43:41.358569 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 25 14:43:41.358569 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 25 14:43:41.358569 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 25 14:43:41.358569 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 25 14:43:41.358569 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 25 14:43:41.358569 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 25 14:43:41.358569 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 25 14:43:41.358569 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application May 25 14:43:41.358569 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 25 14:43:41.358569 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application May 25 14:43:41.358569 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:43:41.358569 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 14:43:41.358569 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 14:43:41.358569 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 14:43:41.358569 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 14:43:41.359897 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 14:43:41.359897 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 14:43:41.359897 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 14:43:41.359897 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 14:43:41.359897 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 14:43:41.359897 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 14:43:41.359897 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 25 14:43:41.359897 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return self._get_service(service_id) May 25 14:43:41.359897 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 25 14:43:41.359897 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 25 14:43:41.359897 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 14:43:41.359897 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 14:43:41.359897 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 14:43:41.359897 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 14:43:41.359897 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 14:43:41.359897 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return self.get_or_create( May 25 14:43:41.360923 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 14:43:41.360923 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application with Lock( May 25 14:43:41.360923 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 14:43:41.360923 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return self._enter() May 25 14:43:41.360923 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 14:43:41.360923 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 14:43:41.360923 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 14:43:41.360923 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return self.creator() May 25 14:43:41.360923 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 14:43:41.360923 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application created_value = creator( May 25 14:43:41.360923 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 25 14:43:41.360923 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 25 14:43:41.360923 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 25 14:43:41.360923 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application May 25 14:43:41.364830 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 448/883] 10.222.0.84 () {56 vars in 1126 bytes} [Wed May 25 14:43:41 2022] GET /identity/v3/services/object-store => generated 93 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 25 14:43:41.365914 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-729976d4-b77c-48ed-88b5-718a8619263b None admin] Authenticating user token {{(pid=101893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:43:41.373932 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74c714c3-7d92-4102-9c1e-953a349251a4 None admin] Validating token access rules against request {{(pid=101892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:43:41.412966 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5646bea8-1b48-492e-bf65-6750677f968e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:43:41.413933 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5646bea8-1b48-492e-bf65-6750677f968e None admin] REQUEST_METHOD: `GET` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:43:41.414365 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5646bea8-1b48-492e-bf65-6750677f968e None admin] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:43:41.414826 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5646bea8-1b48-492e-bf65-6750677f968e None admin] PATH_INFO: `/v3/services` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:43:41.415810 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5646bea8-1b48-492e-bf65-6750677f968e None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=101892) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:43:41.416269 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5646bea8-1b48-492e-bf65-6750677f968e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:43:41.417875 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5646bea8-1b48-492e-bf65-6750677f968e None admin] RBAC: Authorization granted {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:43:41.427704 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 436/884] 10.222.0.84 () {56 vars in 1114 bytes} [Wed May 25 14:43:41 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 14:43:41.429865 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5646bea8-1b48-492e-bf65-6750677f968e None admin] Authenticating user token {{(pid=101892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:43:41.473013 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-729976d4-b77c-48ed-88b5-718a8619263b None admin] Validating token access rules against request {{(pid=101893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:43:41.508347 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e1ba8f-d710-4faa-a8b0-9fb95c94e4b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:43:41.509019 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e1ba8f-d710-4faa-a8b0-9fb95c94e4b7 None admin] REQUEST_METHOD: `GET` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:43:41.509306 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e1ba8f-d710-4faa-a8b0-9fb95c94e4b7 None admin] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:43:41.509584 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e1ba8f-d710-4faa-a8b0-9fb95c94e4b7 None admin] PATH_INFO: `/v3/services` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:43:41.510291 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17e1ba8f-d710-4faa-a8b0-9fb95c94e4b7 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=101893) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:43:41.510600 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17e1ba8f-d710-4faa-a8b0-9fb95c94e4b7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:43:41.512065 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17e1ba8f-d710-4faa-a8b0-9fb95c94e4b7 None admin] RBAC: Authorization granted {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:43:41.522182 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 449/885] 10.222.0.84 () {56 vars in 1122 bytes} [Wed May 25 14:43:41 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:43:41.523126 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e1ba8f-d710-4faa-a8b0-9fb95c94e4b7 None admin] Authenticating user token {{(pid=101893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:43:41.541204 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5646bea8-1b48-492e-bf65-6750677f968e None admin] Validating token access rules against request {{(pid=101892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:43:41.542967 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG dbcounter [-] [101892] Writing DB stats keystone:SELECT=100 {{(pid=101892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:43:41.581100 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d010467-4ccc-409c-9d4c-2f4684fbc257 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:43:41.582072 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d010467-4ccc-409c-9d4c-2f4684fbc257 None admin] REQUEST_METHOD: `GET` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:43:41.583145 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d010467-4ccc-409c-9d4c-2f4684fbc257 None admin] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:43:41.583761 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG dbcounter [-] [101893] Writing DB stats keystone:SELECT=100 {{(pid=101893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:43:41.584791 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d010467-4ccc-409c-9d4c-2f4684fbc257 None admin] PATH_INFO: `/v3/endpoints` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:43:41.585860 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d010467-4ccc-409c-9d4c-2f4684fbc257 None admin] RBAC: Adding query filter params (interface=public, service_id=3117f705a21143a2beb2d83033933128, region_id=RegionOne) {{(pid=101892) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:43:41.586383 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d010467-4ccc-409c-9d4c-2f4684fbc257 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:43:41.588005 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d010467-4ccc-409c-9d4c-2f4684fbc257 None admin] RBAC: Authorization granted {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:43:41.598278 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 437/886] 10.222.0.84 () {56 vars in 1251 bytes} [Wed May 25 14:43:41 2022] GET /identity/v3/endpoints?service_id=3117f705a21143a2beb2d83033933128&interface=public®ion_id=RegionOne => generated 194 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 14:43:41.599878 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d010467-4ccc-409c-9d4c-2f4684fbc257 None admin] Authenticating user token {{(pid=101892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:43:41.643413 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e1ba8f-d710-4faa-a8b0-9fb95c94e4b7 None admin] Validating token access rules against request {{(pid=101893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:43:41.693311 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c795f24-58be-4602-a724-df6a827193e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:43:41.694364 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c795f24-58be-4602-a724-df6a827193e2 None admin] REQUEST_METHOD: `GET` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:43:41.695395 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c795f24-58be-4602-a724-df6a827193e2 None admin] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:43:41.695940 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c795f24-58be-4602-a724-df6a827193e2 None admin] PATH_INFO: `/v3/services` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:43:41.697145 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c795f24-58be-4602-a724-df6a827193e2 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=101893) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:43:41.697916 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c795f24-58be-4602-a724-df6a827193e2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:43:41.700274 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c795f24-58be-4602-a724-df6a827193e2 None admin] RBAC: Authorization granted {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:43:41.707363 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 450/887] 10.222.0.84 () {56 vars in 1122 bytes} [Wed May 25 14:43:41 2022] GET /identity/v3/services?type=object-store => generated 129 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:43:41.715690 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d010467-4ccc-409c-9d4c-2f4684fbc257 None admin] Validating token access rules against request {{(pid=101892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:43:41.759237 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d838d326-1995-4e5f-9c1f-de6d6cef2e32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:43:41.759941 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d838d326-1995-4e5f-9c1f-de6d6cef2e32 None admin] REQUEST_METHOD: `GET` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:43:41.760226 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d838d326-1995-4e5f-9c1f-de6d6cef2e32 None admin] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:43:41.760504 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d838d326-1995-4e5f-9c1f-de6d6cef2e32 None admin] PATH_INFO: `/v3/services` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:43:41.761194 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d838d326-1995-4e5f-9c1f-de6d6cef2e32 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:43:41.762658 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d838d326-1995-4e5f-9c1f-de6d6cef2e32 None admin] RBAC: Authorization granted {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:43:41.769845 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 438/888] 10.222.0.84 () {56 vars in 1087 bytes} [Wed May 25 14:43:41 2022] GET /identity/v3/services => generated 1268 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 14:43:42.458315 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fefa30a-2727-40d8-866e-d880350ff0f4 None None] REQUEST_METHOD: `GET` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:43:42.459197 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fefa30a-2727-40d8-866e-d880350ff0f4 None None] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:43:42.459658 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fefa30a-2727-40d8-866e-d880350ff0f4 None None] PATH_INFO: `/` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:43:42.461424 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 451/889] 10.222.0.84 () {54 vars in 926 bytes} [Wed May 25 14:43:42 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 14:43:42.467130 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9b1fc1-415d-4eab-91e0-75f5a429879b None None] REQUEST_METHOD: `POST` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:43:42.468034 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9b1fc1-415d-4eab-91e0-75f5a429879b None None] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:43:42.468554 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9b1fc1-415d-4eab-91e0-75f5a429879b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:43:42.488301 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.auth.core [None req-1a9b1fc1-415d-4eab-91e0-75f5a429879b None None] MFA Rules not processed for user `05d87e87798e429aa1c10b24391f915e`. Rule list: `[]` (Enabled: `True`). {{(pid=101892) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:43:42.490410 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.fernet_utils [None req-1a9b1fc1-415d-4eab-91e0-75f5a429879b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=101892) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:43:42.518114 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG dbcounter [-] [101892] Writing DB stats keystone:SELECT=100 {{(pid=101892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:43:42.565525 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 439/890] 10.222.0.84 () {58 vars in 1023 bytes} [Wed May 25 14:43:42 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 25 14:43:42.588868 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fefa30a-2727-40d8-866e-d880350ff0f4 None None] Authenticating user token {{(pid=101893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:43:42.699803 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fefa30a-2727-40d8-866e-d880350ff0f4 None None] Validating token access rules against request {{(pid=101893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:43:42.716479 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG dbcounter [-] [101893] Writing DB stats keystone:SELECT=100 {{(pid=101893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:43:42.737484 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b53d19ff-b1f1-40da-ac93-ff07adbdb53f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:43:42.738341 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53d19ff-b1f1-40da-ac93-ff07adbdb53f None admin] REQUEST_METHOD: `GET` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:43:42.738624 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53d19ff-b1f1-40da-ac93-ff07adbdb53f None admin] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:43:42.739432 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53d19ff-b1f1-40da-ac93-ff07adbdb53f None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:43:42.740136 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b53d19ff-b1f1-40da-ac93-ff07adbdb53f None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:43:42.741634 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b53d19ff-b1f1-40da-ac93-ff07adbdb53f None admin] RBAC: Authorization granted {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:43:42.756250 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application [None req-b53d19ff-b1f1-40da-ac93-ff07adbdb53f None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 25 14:43:42.756250 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:43:42.756250 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 25 14:43:42.756250 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 25 14:43:42.756250 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 25 14:43:42.756250 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 25 14:43:42.756250 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 25 14:43:42.756250 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 25 14:43:42.756250 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 25 14:43:42.756250 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application May 25 14:43:42.756250 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 25 14:43:42.756250 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application May 25 14:43:42.756250 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:43:42.756250 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 14:43:42.756250 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 14:43:42.756250 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 14:43:42.757309 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 14:43:42.757309 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 14:43:42.757309 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 14:43:42.757309 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 14:43:42.757309 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 14:43:42.757309 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 14:43:42.757309 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 14:43:42.757309 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 25 14:43:42.757309 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return self._get_service(service_id) May 25 14:43:42.757309 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 25 14:43:42.757309 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 25 14:43:42.757309 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 14:43:42.757309 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 14:43:42.757309 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 14:43:42.757309 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 14:43:42.757309 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 14:43:42.758414 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return self.get_or_create( May 25 14:43:42.758414 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 14:43:42.758414 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application with Lock( May 25 14:43:42.758414 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 14:43:42.758414 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return self._enter() May 25 14:43:42.758414 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 14:43:42.758414 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 14:43:42.758414 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 14:43:42.758414 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return self.creator() May 25 14:43:42.758414 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 14:43:42.758414 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application created_value = creator( May 25 14:43:42.758414 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 25 14:43:42.758414 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 25 14:43:42.758414 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 25 14:43:42.758414 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application May 25 14:43:42.758414 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 452/891] 10.222.0.84 () {56 vars in 1132 bytes} [Wed May 25 14:43:42 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 14:43:42.766303 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a9b1fc1-415d-4eab-91e0-75f5a429879b None None] Authenticating user token {{(pid=101892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:43:42.872550 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a9b1fc1-415d-4eab-91e0-75f5a429879b None None] Validating token access rules against request {{(pid=101892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:43:42.909465 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16807a8f-e22b-43f4-8ce5-4f9d96209776 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:43:42.910154 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16807a8f-e22b-43f4-8ce5-4f9d96209776 None admin] REQUEST_METHOD: `GET` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:43:42.910440 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16807a8f-e22b-43f4-8ce5-4f9d96209776 None admin] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:43:42.910762 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16807a8f-e22b-43f4-8ce5-4f9d96209776 None admin] PATH_INFO: `/v3/services` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:43:42.911493 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16807a8f-e22b-43f4-8ce5-4f9d96209776 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=101892) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:43:42.911830 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16807a8f-e22b-43f4-8ce5-4f9d96209776 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:43:42.913233 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16807a8f-e22b-43f4-8ce5-4f9d96209776 None admin] RBAC: Authorization granted {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:43:42.919006 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 440/892] 10.222.0.84 () {56 vars in 1126 bytes} [Wed May 25 14:43:42 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:43:42.925065 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b53d19ff-b1f1-40da-ac93-ff07adbdb53f None admin] Authenticating user token {{(pid=101893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:43:42.927547 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031aeea1-ce9e-43f0-8653-3fb8b176da53 None None] REQUEST_METHOD: `GET` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:43:42.927863 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031aeea1-ce9e-43f0-8653-3fb8b176da53 None None] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:43:42.928141 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031aeea1-ce9e-43f0-8653-3fb8b176da53 None None] PATH_INFO: `/` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:43:42.929605 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 441/893] 10.222.0.84 () {54 vars in 926 bytes} [Wed May 25 14:43:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 14:43:42.934536 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b269415d-3e82-4983-b54d-49b3848fc928 None None] REQUEST_METHOD: `POST` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:43:42.934821 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b269415d-3e82-4983-b54d-49b3848fc928 None None] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:43:42.935100 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b269415d-3e82-4983-b54d-49b3848fc928 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:43:42.955862 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.auth.core [None req-b269415d-3e82-4983-b54d-49b3848fc928 None None] MFA Rules not processed for user `05d87e87798e429aa1c10b24391f915e`. Rule list: `[]` (Enabled: `True`). {{(pid=101892) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:43:42.957440 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.fernet_utils [None req-b269415d-3e82-4983-b54d-49b3848fc928 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=101892) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:43:42.979758 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG dbcounter [-] [101892] Writing DB stats keystone:SELECT=100 {{(pid=101892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:43:43.043644 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 442/894] 10.222.0.84 () {58 vars in 1023 bytes} [Wed May 25 14:43:42 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 25 14:43:43.059335 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b53d19ff-b1f1-40da-ac93-ff07adbdb53f None admin] Validating token access rules against request {{(pid=101893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:43:43.059514 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b269415d-3e82-4983-b54d-49b3848fc928 None None] Authenticating user token {{(pid=101892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:43:43.110390 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-476cffe5-10be-4568-9851-881e49603467 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:43:43.111066 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476cffe5-10be-4568-9851-881e49603467 None admin] REQUEST_METHOD: `GET` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:43:43.111609 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476cffe5-10be-4568-9851-881e49603467 None admin] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:43:43.111943 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476cffe5-10be-4568-9851-881e49603467 None admin] PATH_INFO: `/v3/services` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:43:43.113149 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-476cffe5-10be-4568-9851-881e49603467 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=101893) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:43:43.113466 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-476cffe5-10be-4568-9851-881e49603467 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:43:43.115409 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-476cffe5-10be-4568-9851-881e49603467 None admin] RBAC: Authorization granted {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:43:43.122466 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 453/895] 10.222.0.84 () {56 vars in 1126 bytes} [Wed May 25 14:43:42 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:43:43.128452 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-476cffe5-10be-4568-9851-881e49603467 None admin] Authenticating user token {{(pid=101893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:43:43.172296 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b269415d-3e82-4983-b54d-49b3848fc928 None None] Validating token access rules against request {{(pid=101892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:43:43.192463 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG dbcounter [-] [101893] Writing DB stats keystone:SELECT=100 {{(pid=101893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:43:43.215893 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47387f67-17f4-4fd9-be2a-752de15a9c2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:43:43.218285 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47387f67-17f4-4fd9-be2a-752de15a9c2b None admin] REQUEST_METHOD: `GET` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:43:43.218285 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47387f67-17f4-4fd9-be2a-752de15a9c2b None admin] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:43:43.218714 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47387f67-17f4-4fd9-be2a-752de15a9c2b None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:43:43.233214 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47387f67-17f4-4fd9-be2a-752de15a9c2b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 14:43:43.246367 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application [None req-47387f67-17f4-4fd9-be2a-752de15a9c2b None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 25 14:43:43.246367 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:43:43.246367 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 14:43:43.246367 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 14:43:43.246367 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 14:43:43.246367 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 14:43:43.246367 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 14:43:43.246367 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 14:43:43.246367 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 14:43:43.246367 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 14:43:43.246367 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 14:43:43.246367 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 14:43:43.246367 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 14:43:43.246367 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 14:43:43.246367 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 14:43:43.246367 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 14:43:43.251039 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 14:43:43.251039 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 14:43:43.251039 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 14:43:43.251039 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 14:43:43.251039 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 14:43:43.251039 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 14:43:43.251039 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 14:43:43.251039 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 14:43:43.251039 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 14:43:43.251039 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application return self.get_or_create( May 25 14:43:43.251039 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 14:43:43.251039 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application with Lock( May 25 14:43:43.251039 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 14:43:43.251039 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application return self._enter() May 25 14:43:43.251039 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 14:43:43.251039 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 14:43:43.251948 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 14:43:43.251948 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application return self.creator() May 25 14:43:43.251948 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 14:43:43.251948 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application created_value = creator( May 25 14:43:43.251948 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 14:43:43.251948 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 14:43:43.251948 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 14:43:43.251948 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 14:43:43.251948 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 14:43:43.251948 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 14:43:43.251948 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 25 14:43:43.251948 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application May 25 14:43:43.251948 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 443/896] 10.222.0.84 () {56 vars in 1120 bytes} [Wed May 25 14:43:43 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 14:43:43.254973 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47387f67-17f4-4fd9-be2a-752de15a9c2b None admin] Authenticating user token {{(pid=101892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:43:43.256112 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-476cffe5-10be-4568-9851-881e49603467 None admin] Validating token access rules against request {{(pid=101893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:43:43.276849 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG dbcounter [-] [101892] Writing DB stats keystone:SELECT=100 {{(pid=101892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:43:43.292961 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf7ad35c-79ca-4260-9df5-b0dd13cd7ce9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:43:43.293660 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7ad35c-79ca-4260-9df5-b0dd13cd7ce9 None admin] REQUEST_METHOD: `GET` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:43:43.294025 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7ad35c-79ca-4260-9df5-b0dd13cd7ce9 None admin] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:43:43.294256 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7ad35c-79ca-4260-9df5-b0dd13cd7ce9 None admin] PATH_INFO: `/v3/endpoints` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:43:43.295041 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf7ad35c-79ca-4260-9df5-b0dd13cd7ce9 None admin] RBAC: Adding query filter params (interface=public, service_id=0b3e7fd80b264967a8a1529b8b158a63, region_id=RegionOne) {{(pid=101893) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:43:43.295542 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf7ad35c-79ca-4260-9df5-b0dd13cd7ce9 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:43:43.296979 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf7ad35c-79ca-4260-9df5-b0dd13cd7ce9 None admin] RBAC: Authorization granted {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:43:43.303575 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 454/897] 10.222.0.84 () {56 vars in 1251 bytes} [Wed May 25 14:43:43 2022] GET /identity/v3/endpoints?service_id=0b3e7fd80b264967a8a1529b8b158a63&interface=public®ion_id=RegionOne => generated 194 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:43:43.313080 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf7ad35c-79ca-4260-9df5-b0dd13cd7ce9 None admin] Authenticating user token {{(pid=101893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:43:43.381002 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47387f67-17f4-4fd9-be2a-752de15a9c2b None admin] Validating token access rules against request {{(pid=101892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:43:43.425181 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-622b0cc6-47e5-4cea-a8e5-da6b8fc814e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:43:43.426845 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-622b0cc6-47e5-4cea-a8e5-da6b8fc814e2 None admin] REQUEST_METHOD: `GET` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:43:43.427295 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-622b0cc6-47e5-4cea-a8e5-da6b8fc814e2 None admin] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:43:43.428049 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-622b0cc6-47e5-4cea-a8e5-da6b8fc814e2 None admin] PATH_INFO: `/v3/roles` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:43:43.429258 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-622b0cc6-47e5-4cea-a8e5-da6b8fc814e2 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=101892) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:43:43.429724 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-622b0cc6-47e5-4cea-a8e5-da6b8fc814e2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:43:43.432062 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-622b0cc6-47e5-4cea-a8e5-da6b8fc814e2 None admin] RBAC: Authorization granted {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:43:43.433985 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf7ad35c-79ca-4260-9df5-b0dd13cd7ce9 None admin] Validating token access rules against request {{(pid=101893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:43:43.443259 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 444/898] 10.222.0.84 () {56 vars in 1115 bytes} [Wed May 25 14:43:43 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:43:43.449247 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG dbcounter [-] [101893] Writing DB stats keystone:SELECT=100 {{(pid=101893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:43:43.450312 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-622b0cc6-47e5-4cea-a8e5-da6b8fc814e2 None admin] Authenticating user token {{(pid=101892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:43:43.482236 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02cd387e-5a3b-4b0a-84be-02ba93141855 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:43:43.482981 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02cd387e-5a3b-4b0a-84be-02ba93141855 None admin] REQUEST_METHOD: `GET` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:43:43.483175 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02cd387e-5a3b-4b0a-84be-02ba93141855 None admin] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:43:43.483493 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02cd387e-5a3b-4b0a-84be-02ba93141855 None admin] PATH_INFO: `/v3/services` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:43:43.484158 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02cd387e-5a3b-4b0a-84be-02ba93141855 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:43:43.485588 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02cd387e-5a3b-4b0a-84be-02ba93141855 None admin] RBAC: Authorization granted {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:43:43.499583 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 455/899] 10.222.0.84 () {56 vars in 1087 bytes} [Wed May 25 14:43:43 2022] GET /identity/v3/services => generated 1268 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 14:43:43.571429 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG dbcounter [-] [101892] Writing DB stats keystone:SELECT=100 {{(pid=101892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:43:43.595444 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-622b0cc6-47e5-4cea-a8e5-da6b8fc814e2 None admin] Validating token access rules against request {{(pid=101892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:43:43.638671 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c718f003-728d-446e-a8ec-214585c94c08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:43:43.639941 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c718f003-728d-446e-a8ec-214585c94c08 None admin] REQUEST_METHOD: `GET` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:43:43.640437 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c718f003-728d-446e-a8ec-214585c94c08 None admin] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:43:43.640985 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c718f003-728d-446e-a8ec-214585c94c08 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:43:43.653534 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c718f003-728d-446e-a8ec-214585c94c08 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:43:43.655366 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c718f003-728d-446e-a8ec-214585c94c08 None admin] RBAC: Authorization granted {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:43:43.674525 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application [None req-c718f003-728d-446e-a8ec-214585c94c08 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 25 14:43:43.674525 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:43:43.674525 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 14:43:43.674525 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 14:43:43.674525 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 14:43:43.674525 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 14:43:43.674525 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 14:43:43.674525 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 14:43:43.674525 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 14:43:43.674525 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 14:43:43.674525 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 14:43:43.674525 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 14:43:43.674525 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 25 14:43:43.674525 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 25 14:43:43.674525 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 25 14:43:43.675665 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 25 14:43:43.675665 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 14:43:43.675665 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 14:43:43.675665 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 14:43:43.675665 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 14:43:43.675665 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 14:43:43.675665 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application return self.get_or_create( May 25 14:43:43.675665 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 14:43:43.675665 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application with Lock( May 25 14:43:43.675665 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 14:43:43.675665 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application return self._enter() May 25 14:43:43.675665 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 14:43:43.675665 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 14:43:43.675665 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 14:43:43.675665 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application return self.creator() May 25 14:43:43.675665 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 14:43:43.675665 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application created_value = creator( May 25 14:43:43.677185 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 25 14:43:43.677185 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 25 14:43:43.677185 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 25 14:43:43.677185 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application May 25 14:43:43.680246 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 445/900] 10.222.0.84 () {56 vars in 1108 bytes} [Wed May 25 14:43:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 14:43:43.685556 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02cd387e-5a3b-4b0a-84be-02ba93141855 None admin] Authenticating user token {{(pid=101893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:43:43.797729 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02cd387e-5a3b-4b0a-84be-02ba93141855 None admin] Validating token access rules against request {{(pid=101893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:43:43.833688 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce70c8dd-84d9-47a8-bfb1-feb652ff15ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:43:43.834783 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce70c8dd-84d9-47a8-bfb1-feb652ff15ca None admin] REQUEST_METHOD: `GET` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:43:43.835305 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce70c8dd-84d9-47a8-bfb1-feb652ff15ca None admin] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:43:43.835810 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce70c8dd-84d9-47a8-bfb1-feb652ff15ca None admin] PATH_INFO: `/v3/domains` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:43:43.836848 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce70c8dd-84d9-47a8-bfb1-feb652ff15ca None admin] RBAC: Adding query filter params (name=Default) {{(pid=101893) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:43:43.837380 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce70c8dd-84d9-47a8-bfb1-feb652ff15ca None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:43:43.839051 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce70c8dd-84d9-47a8-bfb1-feb652ff15ca None admin] RBAC: Authorization granted {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:43:43.854340 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 456/901] 10.222.0.84 () {56 vars in 1109 bytes} [Wed May 25 14:43:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:43:43.859835 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c718f003-728d-446e-a8ec-214585c94c08 None admin] Authenticating user token {{(pid=101892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:43:43.970186 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c718f003-728d-446e-a8ec-214585c94c08 None admin] Validating token access rules against request {{(pid=101892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:43:43.998889 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG dbcounter [-] [101892] Writing DB stats keystone:SELECT=100 {{(pid=101892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:43:44.007611 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-659eb1e2-5b37-4424-8aa5-fd35abe28f00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:43:44.008775 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659eb1e2-5b37-4424-8aa5-fd35abe28f00 None admin] REQUEST_METHOD: `GET` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:43:44.009268 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659eb1e2-5b37-4424-8aa5-fd35abe28f00 None admin] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:43:44.009797 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659eb1e2-5b37-4424-8aa5-fd35abe28f00 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:43:44.017832 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-659eb1e2-5b37-4424-8aa5-fd35abe28f00 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:43:44.019712 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-659eb1e2-5b37-4424-8aa5-fd35abe28f00 None admin] RBAC: Authorization granted {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:43:44.035836 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application [None req-659eb1e2-5b37-4424-8aa5-fd35abe28f00 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. May 25 14:43:44.035836 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:43:44.035836 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 14:43:44.035836 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 14:43:44.035836 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 14:43:44.035836 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 14:43:44.035836 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 14:43:44.035836 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 14:43:44.035836 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 14:43:44.035836 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 14:43:44.035836 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 14:43:44.035836 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 14:43:44.035836 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 25 14:43:44.035836 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application return self._get_user(user_id) May 25 14:43:44.035836 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 25 14:43:44.035836 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 25 14:43:44.036869 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 14:43:44.036869 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 14:43:44.036869 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 25 14:43:44.036869 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 25 14:43:44.036869 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 25 14:43:44.036869 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 25 14:43:44.036869 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 14:43:44.036869 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 14:43:44.036869 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 14:43:44.036869 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application return self.get_or_create( May 25 14:43:44.036869 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 14:43:44.036869 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application with Lock( May 25 14:43:44.036869 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 14:43:44.036869 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application return self._enter() May 25 14:43:44.036869 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 14:43:44.036869 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 14:43:44.036869 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 14:43:44.036869 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application return self.creator() May 25 14:43:44.037838 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 14:43:44.037838 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application created_value = creator( May 25 14:43:44.037838 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 25 14:43:44.037838 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 25 14:43:44.037838 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 25 14:43:44.037838 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 25 14:43:44.037838 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 25 14:43:44.037838 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 25 14:43:44.037838 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. May 25 14:43:44.037838 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application May 25 14:43:44.040592 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 446/902] 10.222.0.84 () {56 vars in 1117 bytes} [Wed May 25 14:43:43 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 14:43:44.044579 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce1e4ef-67a0-4bd2-9cb7-b49f20a0184c None None] REQUEST_METHOD: `GET` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:43:44.044579 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce1e4ef-67a0-4bd2-9cb7-b49f20a0184c None None] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:43:44.044579 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce1e4ef-67a0-4bd2-9cb7-b49f20a0184c None None] PATH_INFO: `/` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:43:44.044579 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 457/903] 10.222.0.84 () {54 vars in 926 bytes} [Wed May 25 14:43:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 14:43:44.046233 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-659eb1e2-5b37-4424-8aa5-fd35abe28f00 None admin] Authenticating user token {{(pid=101892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:43:44.048824 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598c3473-6e2f-4046-b41e-06bd3db49398 None None] REQUEST_METHOD: `POST` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:43:44.049042 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598c3473-6e2f-4046-b41e-06bd3db49398 None None] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:43:44.049323 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598c3473-6e2f-4046-b41e-06bd3db49398 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:43:44.066649 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.auth.core [None req-598c3473-6e2f-4046-b41e-06bd3db49398 None None] MFA Rules not processed for user `05d87e87798e429aa1c10b24391f915e`. Rule list: `[]` (Enabled: `True`). {{(pid=101893) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:43:44.068440 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.fernet_utils [None req-598c3473-6e2f-4046-b41e-06bd3db49398 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=101893) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:43:44.093987 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG dbcounter [-] [101893] Writing DB stats keystone:SELECT=100 {{(pid=101893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:43:44.138591 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 458/904] 10.222.0.84 () {58 vars in 1023 bytes} [Wed May 25 14:43:44 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 25 14:43:44.140103 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20300192-801e-48e1-bfb7-42da7a908b52 None None] REQUEST_METHOD: `GET` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:43:44.140462 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20300192-801e-48e1-bfb7-42da7a908b52 None None] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:43:44.140812 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20300192-801e-48e1-bfb7-42da7a908b52 None None] PATH_INFO: `/` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:43:44.143609 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 459/905] 10.222.0.84 () {54 vars in 926 bytes} [Wed May 25 14:43:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 14:43:44.147693 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d04a9aa-2091-4116-8909-8471ba214163 None None] REQUEST_METHOD: `POST` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:43:44.148136 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d04a9aa-2091-4116-8909-8471ba214163 None None] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:43:44.148577 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d04a9aa-2091-4116-8909-8471ba214163 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:43:44.166795 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.auth.core [None req-8d04a9aa-2091-4116-8909-8471ba214163 None None] MFA Rules not processed for user `05d87e87798e429aa1c10b24391f915e`. Rule list: `[]` (Enabled: `True`). {{(pid=101893) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:43:44.168029 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.fernet_utils [None req-8d04a9aa-2091-4116-8909-8471ba214163 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=101893) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:43:44.169434 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-659eb1e2-5b37-4424-8aa5-fd35abe28f00 None admin] Validating token access rules against request {{(pid=101892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:43:44.206441 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5119edab-78df-4a4c-b150-b8842914659b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:43:44.207110 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5119edab-78df-4a4c-b150-b8842914659b None admin] REQUEST_METHOD: `GET` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:43:44.207418 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5119edab-78df-4a4c-b150-b8842914659b None admin] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:43:44.207741 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5119edab-78df-4a4c-b150-b8842914659b None admin] PATH_INFO: `/v3/users` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:43:44.208572 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5119edab-78df-4a4c-b150-b8842914659b None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=101892) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:43:44.209012 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5119edab-78df-4a4c-b150-b8842914659b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:43:44.210444 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5119edab-78df-4a4c-b150-b8842914659b None admin] RBAC: Authorization granted {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:43:44.228638 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 447/906] 10.222.0.84 () {56 vars in 1149 bytes} [Wed May 25 14:43:44 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:43:44.229416 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5119edab-78df-4a4c-b150-b8842914659b None admin] Authenticating user token {{(pid=101892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:43:44.248082 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 460/907] 10.222.0.84 () {58 vars in 1023 bytes} [Wed May 25 14:43:44 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 25 14:43:44.249298 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d04a9aa-2091-4116-8909-8471ba214163 None None] Authenticating user token {{(pid=101893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:43:44.287643 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG dbcounter [-] [101892] Writing DB stats keystone:SELECT=100 {{(pid=101892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:43:44.351805 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5119edab-78df-4a4c-b150-b8842914659b None admin] Validating token access rules against request {{(pid=101892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:43:44.354484 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG dbcounter [-] [101893] Writing DB stats keystone:SELECT=100 {{(pid=101893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:43:44.364913 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d04a9aa-2091-4116-8909-8471ba214163 None None] Validating token access rules against request {{(pid=101893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:43:44.389220 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5dfe4a7-6fb7-4513-b4df-4516ae338299 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:43:44.390255 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5dfe4a7-6fb7-4513-b4df-4516ae338299 None admin] REQUEST_METHOD: `POST` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:43:44.390551 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5dfe4a7-6fb7-4513-b4df-4516ae338299 None admin] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:43:44.390829 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5dfe4a7-6fb7-4513-b4df-4516ae338299 None admin] PATH_INFO: `/v3/services` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:43:44.391550 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5dfe4a7-6fb7-4513-b4df-4516ae338299 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:43:44.392934 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5dfe4a7-6fb7-4513-b4df-4516ae338299 None admin] RBAC: Authorization granted {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:43:44.402329 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-575f6942-4705-42ef-80d0-9e9bf3bfa61d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:43:44.402979 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575f6942-4705-42ef-80d0-9e9bf3bfa61d None admin] REQUEST_METHOD: `GET` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:43:44.403260 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575f6942-4705-42ef-80d0-9e9bf3bfa61d None admin] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:43:44.403530 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575f6942-4705-42ef-80d0-9e9bf3bfa61d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:43:44.448961 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 448/908] 10.222.0.84 () {60 vars in 1141 bytes} [Wed May 25 14:43:44 2022] POST /identity/v3/services => generated 241 bytes in 220 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 14:43:44.450240 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5dfe4a7-6fb7-4513-b4df-4516ae338299 None admin] Authenticating user token {{(pid=101892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:43:44.486035 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-575f6942-4705-42ef-80d0-9e9bf3bfa61d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:43:44.487667 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-575f6942-4705-42ef-80d0-9e9bf3bfa61d None admin] RBAC: Authorization granted {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:43:44.577103 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5dfe4a7-6fb7-4513-b4df-4516ae338299 None admin] Validating token access rules against request {{(pid=101892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:43:44.579590 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG dbcounter [-] [101892] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=101892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:43:44.613959 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG dbcounter [-] [101893] Writing DB stats keystone:SELECT=100 {{(pid=101893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:43:44.617471 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab6465c2-d87e-4538-b2e4-5ddad0493d5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:43:44.618571 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6465c2-d87e-4538-b2e4-5ddad0493d5e None admin] REQUEST_METHOD: `GET` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:43:44.619153 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6465c2-d87e-4538-b2e4-5ddad0493d5e None admin] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:43:44.619889 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6465c2-d87e-4538-b2e4-5ddad0493d5e None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:43:44.620873 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab6465c2-d87e-4538-b2e4-5ddad0493d5e None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:43:44.622728 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab6465c2-d87e-4538-b2e4-5ddad0493d5e None admin] RBAC: Authorization granted {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:43:44.630386 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 461/909] 10.222.0.84 () {58 vars in 1282 bytes} [Wed May 25 14:43:44 2022] GET /identity/v3/auth/tokens => generated 1362 bytes in 381 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 25 14:43:44.631382 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-575f6942-4705-42ef-80d0-9e9bf3bfa61d None admin] Authenticating user token {{(pid=101893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:43:44.637385 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application [None req-ab6465c2-d87e-4538-b2e4-5ddad0493d5e None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. May 25 14:43:44.637385 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:43:44.637385 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 25 14:43:44.637385 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 25 14:43:44.637385 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 25 14:43:44.637385 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 25 14:43:44.637385 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 25 14:43:44.637385 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 25 14:43:44.637385 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. May 25 14:43:44.637385 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application May 25 14:43:44.637385 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 25 14:43:44.637385 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application May 25 14:43:44.637385 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:43:44.637385 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 14:43:44.637385 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 14:43:44.637385 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 14:43:44.637385 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 14:43:44.638436 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 14:43:44.638436 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 14:43:44.638436 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 14:43:44.638436 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 14:43:44.638436 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 14:43:44.638436 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 14:43:44.638436 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 25 14:43:44.638436 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application return self._get_service(service_id) May 25 14:43:44.638436 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 25 14:43:44.638436 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 25 14:43:44.638436 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 14:43:44.638436 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 14:43:44.638436 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 14:43:44.638436 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 14:43:44.638436 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 14:43:44.638436 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application return self.get_or_create( May 25 14:43:44.639303 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 14:43:44.639303 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application with Lock( May 25 14:43:44.639303 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 14:43:44.639303 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application return self._enter() May 25 14:43:44.639303 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 14:43:44.639303 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 14:43:44.639303 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 14:43:44.639303 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application return self.creator() May 25 14:43:44.639303 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 14:43:44.639303 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application created_value = creator( May 25 14:43:44.639303 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 25 14:43:44.639303 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 25 14:43:44.639303 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. May 25 14:43:44.639303 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application May 25 14:43:44.642431 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 449/910] 10.222.0.84 () {56 vars in 1114 bytes} [Wed May 25 14:43:44 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 14:43:44.648578 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab6465c2-d87e-4538-b2e4-5ddad0493d5e None admin] Authenticating user token {{(pid=101892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:43:44.768575 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-575f6942-4705-42ef-80d0-9e9bf3bfa61d None admin] Validating token access rules against request {{(pid=101893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:43:44.769026 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab6465c2-d87e-4538-b2e4-5ddad0493d5e None admin] Validating token access rules against request {{(pid=101892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:43:44.807201 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f25c4dd-d62d-4afd-8722-22ea0c361bf2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:43:44.808136 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f25c4dd-d62d-4afd-8722-22ea0c361bf2 None admin] REQUEST_METHOD: `GET` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:43:44.808423 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f25c4dd-d62d-4afd-8722-22ea0c361bf2 None admin] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:43:44.808531 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47754913-416d-44ff-8f4f-4a6961bd59ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:43:44.808736 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f25c4dd-d62d-4afd-8722-22ea0c361bf2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:43:44.809286 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47754913-416d-44ff-8f4f-4a6961bd59ed None admin] REQUEST_METHOD: `GET` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:43:44.809677 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47754913-416d-44ff-8f4f-4a6961bd59ed None admin] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:43:44.809963 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47754913-416d-44ff-8f4f-4a6961bd59ed None admin] PATH_INFO: `/v3/services` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:43:44.810795 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47754913-416d-44ff-8f4f-4a6961bd59ed None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=101892) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:43:44.811105 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47754913-416d-44ff-8f4f-4a6961bd59ed None admin] RBAC: Authorizing `identity:list_services()` {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:43:44.812626 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47754913-416d-44ff-8f4f-4a6961bd59ed None admin] RBAC: Authorization granted {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:43:44.818787 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 450/911] 10.222.0.84 () {56 vars in 1114 bytes} [Wed May 25 14:43:44 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:43:44.820205 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f25c4dd-d62d-4afd-8722-22ea0c361bf2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:43:44.821679 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f25c4dd-d62d-4afd-8722-22ea0c361bf2 None admin] RBAC: Authorization granted {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:43:44.824421 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47754913-416d-44ff-8f4f-4a6961bd59ed None admin] Authenticating user token {{(pid=101892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:43:44.842075 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application [None req-8f25c4dd-d62d-4afd-8722-22ea0c361bf2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 25 14:43:44.842075 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:43:44.842075 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 14:43:44.842075 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 14:43:44.842075 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 14:43:44.842075 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 14:43:44.842075 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 14:43:44.842075 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 14:43:44.842075 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 14:43:44.842075 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 14:43:44.842075 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 14:43:44.842075 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 14:43:44.842075 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 25 14:43:44.842075 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 25 14:43:44.842075 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 25 14:43:44.843128 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 25 14:43:44.843128 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 14:43:44.843128 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 14:43:44.843128 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 14:43:44.843128 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 14:43:44.843128 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 14:43:44.843128 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return self.get_or_create( May 25 14:43:44.843128 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 14:43:44.843128 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application with Lock( May 25 14:43:44.843128 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 14:43:44.843128 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return self._enter() May 25 14:43:44.843128 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 14:43:44.843128 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 14:43:44.843128 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 14:43:44.843128 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return self.creator() May 25 14:43:44.843128 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 14:43:44.843128 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application created_value = creator( May 25 14:43:44.844372 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 25 14:43:44.844372 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 25 14:43:44.844372 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 25 14:43:44.844372 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application May 25 14:43:44.844372 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 462/912] 10.222.0.84 () {56 vars in 1108 bytes} [Wed May 25 14:43:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 14:43:44.849317 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f25c4dd-d62d-4afd-8722-22ea0c361bf2 None admin] Authenticating user token {{(pid=101893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:43:44.869368 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG dbcounter [-] [101892] Writing DB stats keystone:SELECT=100 {{(pid=101892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:43:44.904820 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG dbcounter [-] [101893] Writing DB stats keystone:SELECT=100 {{(pid=101893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:43:44.952968 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47754913-416d-44ff-8f4f-4a6961bd59ed None admin] Validating token access rules against request {{(pid=101892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:43:44.964830 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f25c4dd-d62d-4afd-8722-22ea0c361bf2 None admin] Validating token access rules against request {{(pid=101893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:43:44.991292 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f149e141-522e-4385-b450-2a0af379213f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:43:44.992219 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f149e141-522e-4385-b450-2a0af379213f None admin] REQUEST_METHOD: `GET` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:43:44.992346 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f149e141-522e-4385-b450-2a0af379213f None admin] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:43:44.992621 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f149e141-522e-4385-b450-2a0af379213f None admin] PATH_INFO: `/v3/services` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:43:44.993324 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f149e141-522e-4385-b450-2a0af379213f None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=101892) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:43:44.993720 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f149e141-522e-4385-b450-2a0af379213f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:43:44.995117 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f149e141-522e-4385-b450-2a0af379213f None admin] RBAC: Authorization granted {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:43:45.006236 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 451/913] 10.222.0.84 () {56 vars in 1114 bytes} [Wed May 25 14:43:44 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 14:43:45.007194 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f149e141-522e-4385-b450-2a0af379213f None admin] Authenticating user token {{(pid=101892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:43:45.009405 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e76a2e-6067-4dff-b41f-cde33a6fe7c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:43:45.010341 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e76a2e-6067-4dff-b41f-cde33a6fe7c2 None admin] REQUEST_METHOD: `GET` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:43:45.010874 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e76a2e-6067-4dff-b41f-cde33a6fe7c2 None admin] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:43:45.011299 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e76a2e-6067-4dff-b41f-cde33a6fe7c2 None admin] PATH_INFO: `/v3/domains` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:43:45.012203 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21e76a2e-6067-4dff-b41f-cde33a6fe7c2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=101893) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:43:45.012682 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21e76a2e-6067-4dff-b41f-cde33a6fe7c2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:43:45.014200 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21e76a2e-6067-4dff-b41f-cde33a6fe7c2 None admin] RBAC: Authorization granted {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:43:45.027355 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 463/914] 10.222.0.84 () {56 vars in 1109 bytes} [Wed May 25 14:43:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 14:43:45.035217 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e76a2e-6067-4dff-b41f-cde33a6fe7c2 None admin] Authenticating user token {{(pid=101893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:43:45.126810 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG dbcounter [-] [101892] Writing DB stats keystone:SELECT=100 {{(pid=101892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:43:45.137213 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f149e141-522e-4385-b450-2a0af379213f None admin] Validating token access rules against request {{(pid=101892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:43:45.166801 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e76a2e-6067-4dff-b41f-cde33a6fe7c2 None admin] Validating token access rules against request {{(pid=101893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:43:45.169329 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG dbcounter [-] [101893] Writing DB stats keystone:SELECT=100 {{(pid=101893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:43:45.179740 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d709f635-0a28-42d8-b9a3-8958cefc541e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:43:45.180719 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d709f635-0a28-42d8-b9a3-8958cefc541e None admin] REQUEST_METHOD: `POST` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:43:45.181229 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d709f635-0a28-42d8-b9a3-8958cefc541e None admin] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:43:45.181705 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d709f635-0a28-42d8-b9a3-8958cefc541e None admin] PATH_INFO: `/v3/endpoints` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:43:45.182610 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d709f635-0a28-42d8-b9a3-8958cefc541e None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:43:45.184286 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d709f635-0a28-42d8-b9a3-8958cefc541e None admin] RBAC: Authorization granted {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:43:45.203504 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82ea6e3b-85d8-46cf-88af-69c65b55b6f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:43:45.205257 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ea6e3b-85d8-46cf-88af-69c65b55b6f7 None admin] REQUEST_METHOD: `GET` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:43:45.205563 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ea6e3b-85d8-46cf-88af-69c65b55b6f7 None admin] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:43:45.205847 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ea6e3b-85d8-46cf-88af-69c65b55b6f7 None admin] PATH_INFO: `/v3/projects/service` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:43:45.213555 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82ea6e3b-85d8-46cf-88af-69c65b55b6f7 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:43:45.215090 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82ea6e3b-85d8-46cf-88af-69c65b55b6f7 None admin] RBAC: Authorization granted {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:43:45.230417 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application [None req-82ea6e3b-85d8-46cf-88af-69c65b55b6f7 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 25 14:43:45.230417 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:43:45.230417 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 14:43:45.230417 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 14:43:45.230417 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 14:43:45.230417 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 14:43:45.230417 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 14:43:45.230417 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 14:43:45.230417 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 14:43:45.230417 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 14:43:45.230417 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 14:43:45.230417 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 14:43:45.230417 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 25 14:43:45.230417 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return self._get_project(project_id) May 25 14:43:45.230417 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 25 14:43:45.231363 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 25 14:43:45.231363 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 14:43:45.231363 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 14:43:45.231363 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 14:43:45.231363 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 14:43:45.231363 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 14:43:45.231363 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return self.get_or_create( May 25 14:43:45.231363 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 14:43:45.231363 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application with Lock( May 25 14:43:45.231363 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 14:43:45.231363 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return self._enter() May 25 14:43:45.231363 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 14:43:45.231363 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 14:43:45.231363 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 14:43:45.231363 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return self.creator() May 25 14:43:45.231363 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 14:43:45.231363 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application created_value = creator( May 25 14:43:45.237625 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 25 14:43:45.237625 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 25 14:43:45.237625 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 25 14:43:45.237625 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 25 14:43:45.237625 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 25 14:43:45.237625 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 25 14:43:45.237625 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 25 14:43:45.237625 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application May 25 14:43:45.237625 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 464/915] 10.222.0.84 () {56 vars in 1111 bytes} [Wed May 25 14:43:45 2022] GET /identity/v3/projects/service => generated 88 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 25 14:43:45.237625 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82ea6e3b-85d8-46cf-88af-69c65b55b6f7 None admin] Authenticating user token {{(pid=101893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:43:45.281262 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 452/916] 10.222.0.84 () {60 vars in 1144 bytes} [Wed May 25 14:43:45 2022] POST /identity/v3/endpoints => generated 346 bytes in 274 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 14:43:45.357827 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82ea6e3b-85d8-46cf-88af-69c65b55b6f7 None admin] Validating token access rules against request {{(pid=101893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:43:45.404809 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eabacb5-28d5-4da6-b930-c6d4fd31678b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:43:45.405407 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eabacb5-28d5-4da6-b930-c6d4fd31678b None admin] REQUEST_METHOD: `GET` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:43:45.405689 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eabacb5-28d5-4da6-b930-c6d4fd31678b None admin] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:43:45.405965 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eabacb5-28d5-4da6-b930-c6d4fd31678b None admin] PATH_INFO: `/v3/projects` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:43:45.406764 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eabacb5-28d5-4da6-b930-c6d4fd31678b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=101893) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:43:45.407078 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eabacb5-28d5-4da6-b930-c6d4fd31678b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:43:45.408606 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eabacb5-28d5-4da6-b930-c6d4fd31678b None admin] RBAC: Authorization granted {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:43:45.422094 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 465/917] 10.222.0.84 () {56 vars in 1148 bytes} [Wed May 25 14:43:45 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:43:45.428435 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d709f635-0a28-42d8-b9a3-8958cefc541e None admin] Authenticating user token {{(pid=101892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:43:45.539086 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d709f635-0a28-42d8-b9a3-8958cefc541e None admin] Validating token access rules against request {{(pid=101892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:43:45.578050 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a331592-a651-4838-a57b-058f319fd98e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:43:45.579587 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a331592-a651-4838-a57b-058f319fd98e None admin] REQUEST_METHOD: `GET` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:43:45.580086 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a331592-a651-4838-a57b-058f319fd98e None admin] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:43:45.580689 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a331592-a651-4838-a57b-058f319fd98e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:43:45.581710 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a331592-a651-4838-a57b-058f319fd98e None admin] RBAC: Adding query filter params (role.id=e36bc54201ab4defa2b100771ec121a4, scope.project.id=a000829c658c4a7cab67f7b6353ba3fa, user.id=049a7ab3f95f460e908f79cc321176fd) {{(pid=101892) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:43:45.582256 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a331592-a651-4838-a57b-058f319fd98e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:43:45.583921 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a331592-a651-4838-a57b-058f319fd98e None admin] RBAC: Authorization granted {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:43:45.590686 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 453/918] 10.222.0.84 () {56 vars in 1374 bytes} [Wed May 25 14:43:45 2022] GET /identity/v3/role_assignments?user.id=049a7ab3f95f460e908f79cc321176fd&scope.project.id=a000829c658c4a7cab67f7b6353ba3fa&role.id=e36bc54201ab4defa2b100771ec121a4 => generated 259 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:43:45.865292 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0b3706-e827-408c-82c6-c55ffa4e3592 None None] REQUEST_METHOD: `GET` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:43:45.865803 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0b3706-e827-408c-82c6-c55ffa4e3592 None None] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:43:45.865908 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0b3706-e827-408c-82c6-c55ffa4e3592 None None] PATH_INFO: `/` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:43:45.867423 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 466/919] 10.222.0.84 () {54 vars in 926 bytes} [Wed May 25 14:43:45 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 14:43:45.873159 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c1fdc9-1685-4f44-b3c2-d5ce8218682c None None] REQUEST_METHOD: `POST` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:43:45.873456 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c1fdc9-1685-4f44-b3c2-d5ce8218682c None None] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:43:45.873737 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c1fdc9-1685-4f44-b3c2-d5ce8218682c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:43:45.891312 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.auth.core [None req-a6c1fdc9-1685-4f44-b3c2-d5ce8218682c None None] MFA Rules not processed for user `05d87e87798e429aa1c10b24391f915e`. Rule list: `[]` (Enabled: `True`). {{(pid=101892) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:43:45.892538 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.fernet_utils [None req-a6c1fdc9-1685-4f44-b3c2-d5ce8218682c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=101892) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:43:45.902891 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG dbcounter [-] [101892] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=101892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:43:45.964468 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 454/920] 10.222.0.84 () {58 vars in 1023 bytes} [Wed May 25 14:43:45 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 25 14:43:45.987936 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa0b3706-e827-408c-82c6-c55ffa4e3592 None None] Authenticating user token {{(pid=101893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:43:46.014015 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG dbcounter [-] [101893] Writing DB stats keystone:SELECT=100 {{(pid=101893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:43:46.101304 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa0b3706-e827-408c-82c6-c55ffa4e3592 None None] Validating token access rules against request {{(pid=101893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:43:46.137678 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc011ab-05ce-4616-97bf-b9f9787506f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:43:46.138869 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc011ab-05ce-4616-97bf-b9f9787506f9 None admin] REQUEST_METHOD: `GET` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:43:46.139350 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc011ab-05ce-4616-97bf-b9f9787506f9 None admin] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:43:46.139870 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc011ab-05ce-4616-97bf-b9f9787506f9 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:43:46.140728 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdc011ab-05ce-4616-97bf-b9f9787506f9 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:43:46.142341 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdc011ab-05ce-4616-97bf-b9f9787506f9 None admin] RBAC: Authorization granted {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:43:46.155498 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application [None req-bdc011ab-05ce-4616-97bf-b9f9787506f9 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 25 14:43:46.155498 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:43:46.155498 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 25 14:43:46.155498 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 25 14:43:46.155498 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 25 14:43:46.155498 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 25 14:43:46.155498 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 25 14:43:46.155498 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 25 14:43:46.155498 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 25 14:43:46.155498 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application May 25 14:43:46.155498 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 25 14:43:46.155498 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application May 25 14:43:46.155498 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:43:46.155498 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 14:43:46.155498 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 14:43:46.155498 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 14:43:46.156541 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 14:43:46.156541 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 14:43:46.156541 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 14:43:46.156541 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 14:43:46.156541 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 14:43:46.156541 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 14:43:46.156541 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 14:43:46.156541 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 25 14:43:46.156541 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return self._get_service(service_id) May 25 14:43:46.156541 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 25 14:43:46.156541 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 25 14:43:46.156541 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 14:43:46.156541 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 14:43:46.156541 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 14:43:46.156541 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 14:43:46.156541 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 14:43:46.157381 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return self.get_or_create( May 25 14:43:46.157381 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 14:43:46.157381 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application with Lock( May 25 14:43:46.157381 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 14:43:46.157381 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return self._enter() May 25 14:43:46.157381 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 14:43:46.157381 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 14:43:46.157381 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 14:43:46.157381 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return self.creator() May 25 14:43:46.157381 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 14:43:46.157381 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application created_value = creator( May 25 14:43:46.157381 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 25 14:43:46.157381 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 25 14:43:46.157381 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 25 14:43:46.157381 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application May 25 14:43:46.160879 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 467/921] 10.222.0.84 () {56 vars in 1132 bytes} [Wed May 25 14:43:45 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 14:43:46.167611 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6c1fdc9-1685-4f44-b3c2-d5ce8218682c None None] Authenticating user token {{(pid=101892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:43:46.272132 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6c1fdc9-1685-4f44-b3c2-d5ce8218682c None None] Validating token access rules against request {{(pid=101892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:43:46.309230 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2afdf11-0446-4b39-9d3e-19da78c029c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:43:46.309895 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2afdf11-0446-4b39-9d3e-19da78c029c1 None admin] REQUEST_METHOD: `GET` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:43:46.310179 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2afdf11-0446-4b39-9d3e-19da78c029c1 None admin] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:43:46.310458 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2afdf11-0446-4b39-9d3e-19da78c029c1 None admin] PATH_INFO: `/v3/services` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:43:46.311169 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2afdf11-0446-4b39-9d3e-19da78c029c1 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=101892) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:43:46.311480 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2afdf11-0446-4b39-9d3e-19da78c029c1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:43:46.313389 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2afdf11-0446-4b39-9d3e-19da78c029c1 None admin] RBAC: Authorization granted {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:43:46.318453 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 455/922] 10.222.0.84 () {56 vars in 1126 bytes} [Wed May 25 14:43:46 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:43:46.327973 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc011ab-05ce-4616-97bf-b9f9787506f9 None admin] Authenticating user token {{(pid=101893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:43:46.417181 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG dbcounter [-] [101893] Writing DB stats keystone:SELECT=100 {{(pid=101893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:43:46.432933 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc011ab-05ce-4616-97bf-b9f9787506f9 None admin] Validating token access rules against request {{(pid=101893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:43:46.471120 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a552c69-863d-47fb-9a6e-3288eb9f3724 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:43:46.471834 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a552c69-863d-47fb-9a6e-3288eb9f3724 None admin] REQUEST_METHOD: `GET` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:43:46.472172 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a552c69-863d-47fb-9a6e-3288eb9f3724 None admin] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:43:46.472451 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a552c69-863d-47fb-9a6e-3288eb9f3724 None admin] PATH_INFO: `/v3/services` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:43:46.473850 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a552c69-863d-47fb-9a6e-3288eb9f3724 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=101893) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:43:46.474186 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a552c69-863d-47fb-9a6e-3288eb9f3724 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:43:46.475590 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a552c69-863d-47fb-9a6e-3288eb9f3724 None admin] RBAC: Authorization granted {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:43:46.480983 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 468/923] 10.222.0.84 () {56 vars in 1126 bytes} [Wed May 25 14:43:46 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:43:46.486508 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2afdf11-0446-4b39-9d3e-19da78c029c1 None admin] Authenticating user token {{(pid=101892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:43:46.498466 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG dbcounter [-] [101892] Writing DB stats keystone:SELECT=100 {{(pid=101892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:43:46.594089 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2afdf11-0446-4b39-9d3e-19da78c029c1 None admin] Validating token access rules against request {{(pid=101892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:43:46.630751 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4fdfd01-effb-40cd-80e5-6f81be21de03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:43:46.631416 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4fdfd01-effb-40cd-80e5-6f81be21de03 None admin] REQUEST_METHOD: `POST` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:43:46.631735 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4fdfd01-effb-40cd-80e5-6f81be21de03 None admin] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:43:46.632012 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4fdfd01-effb-40cd-80e5-6f81be21de03 None admin] PATH_INFO: `/v3/endpoints` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:43:46.632768 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4fdfd01-effb-40cd-80e5-6f81be21de03 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:43:46.634144 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4fdfd01-effb-40cd-80e5-6f81be21de03 None admin] RBAC: Authorization granted {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:43:46.716609 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 456/924] 10.222.0.84 () {60 vars in 1144 bytes} [Wed May 25 14:43:46 2022] POST /identity/v3/endpoints => generated 347 bytes in 230 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 14:43:46.839868 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78afa7fe-9ec7-44f6-a074-36f842baa5ed None None] REQUEST_METHOD: `GET` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:43:46.840236 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78afa7fe-9ec7-44f6-a074-36f842baa5ed None None] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:43:46.840438 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78afa7fe-9ec7-44f6-a074-36f842baa5ed None None] PATH_INFO: `/` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:43:46.842105 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 469/925] 10.222.0.84 () {54 vars in 926 bytes} [Wed May 25 14:43:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 14:43:46.847964 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77aa3103-d7b0-475b-ae7b-10e0aa7d5bb3 None None] REQUEST_METHOD: `POST` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:43:46.848258 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77aa3103-d7b0-475b-ae7b-10e0aa7d5bb3 None None] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:43:46.848540 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77aa3103-d7b0-475b-ae7b-10e0aa7d5bb3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:43:46.867111 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.auth.core [None req-77aa3103-d7b0-475b-ae7b-10e0aa7d5bb3 None None] MFA Rules not processed for user `05d87e87798e429aa1c10b24391f915e`. Rule list: `[]` (Enabled: `True`). {{(pid=101892) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:43:46.868482 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.fernet_utils [None req-77aa3103-d7b0-475b-ae7b-10e0aa7d5bb3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=101892) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:43:46.933308 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG dbcounter [-] [101892] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=101892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:43:46.947898 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 457/926] 10.222.0.84 () {58 vars in 1023 bytes} [Wed May 25 14:43:46 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 25 14:43:46.970704 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78afa7fe-9ec7-44f6-a074-36f842baa5ed None None] Authenticating user token {{(pid=101893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:43:47.076741 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78afa7fe-9ec7-44f6-a074-36f842baa5ed None None] Validating token access rules against request {{(pid=101893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:43:47.111296 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b19e8e82-ffb8-40f1-ac01-b332820ead27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:43:47.112157 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19e8e82-ffb8-40f1-ac01-b332820ead27 None admin] REQUEST_METHOD: `GET` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:43:47.112440 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19e8e82-ffb8-40f1-ac01-b332820ead27 None admin] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:43:47.112711 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19e8e82-ffb8-40f1-ac01-b332820ead27 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:43:47.113359 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b19e8e82-ffb8-40f1-ac01-b332820ead27 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:43:47.114831 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b19e8e82-ffb8-40f1-ac01-b332820ead27 None admin] RBAC: Authorization granted {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:43:47.131950 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application [None req-b19e8e82-ffb8-40f1-ac01-b332820ead27 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. May 25 14:43:47.131950 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:43:47.131950 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 25 14:43:47.131950 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 25 14:43:47.131950 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 25 14:43:47.131950 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 25 14:43:47.131950 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 25 14:43:47.131950 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 25 14:43:47.131950 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 25 14:43:47.131950 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application May 25 14:43:47.131950 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 25 14:43:47.131950 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application May 25 14:43:47.131950 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:43:47.131950 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 14:43:47.131950 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 14:43:47.131950 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 14:43:47.131950 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 14:43:47.132985 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 14:43:47.132985 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 14:43:47.132985 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 14:43:47.132985 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 14:43:47.132985 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 14:43:47.132985 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 14:43:47.132985 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 25 14:43:47.132985 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return self._get_service(service_id) May 25 14:43:47.132985 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 25 14:43:47.132985 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 25 14:43:47.132985 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 14:43:47.132985 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 14:43:47.132985 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 14:43:47.132985 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 14:43:47.132985 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 14:43:47.132985 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return self.get_or_create( May 25 14:43:47.133860 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 14:43:47.133860 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application with Lock( May 25 14:43:47.133860 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 14:43:47.133860 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return self._enter() May 25 14:43:47.133860 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 14:43:47.133860 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 14:43:47.133860 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 14:43:47.133860 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return self.creator() May 25 14:43:47.133860 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 14:43:47.133860 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application created_value = creator( May 25 14:43:47.133860 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 25 14:43:47.133860 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 25 14:43:47.133860 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 25 14:43:47.133860 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application May 25 14:43:47.133860 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 470/927] 10.222.0.84 () {56 vars in 1126 bytes} [Wed May 25 14:43:46 2022] GET /identity/v3/services/object-store => generated 93 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 14:43:47.139706 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77aa3103-d7b0-475b-ae7b-10e0aa7d5bb3 None None] Authenticating user token {{(pid=101892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:43:47.243279 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77aa3103-d7b0-475b-ae7b-10e0aa7d5bb3 None None] Validating token access rules against request {{(pid=101892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:43:47.280142 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3221f530-1c91-47c4-8908-7215e1a822a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:43:47.280806 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3221f530-1c91-47c4-8908-7215e1a822a2 None admin] REQUEST_METHOD: `GET` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:43:47.281087 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3221f530-1c91-47c4-8908-7215e1a822a2 None admin] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:43:47.281360 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3221f530-1c91-47c4-8908-7215e1a822a2 None admin] PATH_INFO: `/v3/services` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:43:47.282063 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3221f530-1c91-47c4-8908-7215e1a822a2 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=101892) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:43:47.282367 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3221f530-1c91-47c4-8908-7215e1a822a2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:43:47.283896 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3221f530-1c91-47c4-8908-7215e1a822a2 None admin] RBAC: Authorization granted {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:43:47.289891 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 458/928] 10.222.0.84 () {56 vars in 1122 bytes} [Wed May 25 14:43:47 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:43:47.295912 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b19e8e82-ffb8-40f1-ac01-b332820ead27 None admin] Authenticating user token {{(pid=101893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:43:47.315970 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG dbcounter [-] [101893] Writing DB stats keystone:SELECT=100 {{(pid=101893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:43:47.407780 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b19e8e82-ffb8-40f1-ac01-b332820ead27 None admin] Validating token access rules against request {{(pid=101893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:43:47.443605 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c127725c-b056-4635-b1c1-041965c09d8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:43:47.444628 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c127725c-b056-4635-b1c1-041965c09d8f None admin] REQUEST_METHOD: `GET` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:43:47.445108 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c127725c-b056-4635-b1c1-041965c09d8f None admin] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:43:47.445576 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c127725c-b056-4635-b1c1-041965c09d8f None admin] PATH_INFO: `/v3/services` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:43:47.446498 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c127725c-b056-4635-b1c1-041965c09d8f None admin] RBAC: Adding query filter params (type=object-store) {{(pid=101893) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:43:47.447018 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c127725c-b056-4635-b1c1-041965c09d8f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:43:47.448709 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c127725c-b056-4635-b1c1-041965c09d8f None admin] RBAC: Authorization granted {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:43:47.454388 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 471/929] 10.222.0.84 () {56 vars in 1122 bytes} [Wed May 25 14:43:47 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:43:47.460637 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3221f530-1c91-47c4-8908-7215e1a822a2 None admin] Authenticating user token {{(pid=101892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:43:47.518423 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG dbcounter [-] [101892] Writing DB stats keystone:SELECT=100 {{(pid=101892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:43:47.573267 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3221f530-1c91-47c4-8908-7215e1a822a2 None admin] Validating token access rules against request {{(pid=101892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:43:47.613854 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43c8999c-1657-449f-aa70-1031a3aef7cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:43:47.614610 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c8999c-1657-449f-aa70-1031a3aef7cf None admin] REQUEST_METHOD: `GET` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:43:47.614788 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c8999c-1657-449f-aa70-1031a3aef7cf None admin] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:43:47.615071 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c8999c-1657-449f-aa70-1031a3aef7cf None admin] PATH_INFO: `/v3/endpoints` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:43:47.615896 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43c8999c-1657-449f-aa70-1031a3aef7cf None admin] RBAC: Adding query filter params (interface=public, service_id=cd77571404234703bed444853c026478, region_id=RegionOne) {{(pid=101892) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:43:47.616213 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43c8999c-1657-449f-aa70-1031a3aef7cf None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:43:47.617593 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43c8999c-1657-449f-aa70-1031a3aef7cf None admin] RBAC: Authorization granted {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:43:47.624285 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 459/930] 10.222.0.84 () {56 vars in 1251 bytes} [Wed May 25 14:43:47 2022] GET /identity/v3/endpoints?service_id=cd77571404234703bed444853c026478&interface=public®ion_id=RegionOne => generated 194 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:43:47.629971 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c127725c-b056-4635-b1c1-041965c09d8f None admin] Authenticating user token {{(pid=101893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:43:47.708149 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG dbcounter [-] [101893] Writing DB stats keystone:SELECT=100 {{(pid=101893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:43:47.731040 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c127725c-b056-4635-b1c1-041965c09d8f None admin] Validating token access rules against request {{(pid=101893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:43:47.761469 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ad5771-d4fb-4e4b-85be-0ccfc4b396c1 None None] REQUEST_METHOD: `GET` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:43:47.761759 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ad5771-d4fb-4e4b-85be-0ccfc4b396c1 None None] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:43:47.762042 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ad5771-d4fb-4e4b-85be-0ccfc4b396c1 None None] PATH_INFO: `/` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:43:47.763626 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 460/931] 10.222.0.84 () {54 vars in 926 bytes} [Wed May 25 14:43:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 25 14:43:47.769453 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b886dfe-55d3-4e44-9de4-1156193d9f90 None None] REQUEST_METHOD: `POST` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:43:47.769695 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b886dfe-55d3-4e44-9de4-1156193d9f90 None None] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:43:47.770472 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b886dfe-55d3-4e44-9de4-1156193d9f90 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:43:47.771779 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eeb4f62-bd79-4864-85e1-643c9484b251 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:43:47.772658 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eeb4f62-bd79-4864-85e1-643c9484b251 None admin] REQUEST_METHOD: `GET` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:43:47.773089 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eeb4f62-bd79-4864-85e1-643c9484b251 None admin] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:43:47.773516 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eeb4f62-bd79-4864-85e1-643c9484b251 None admin] PATH_INFO: `/v3/services` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:43:47.774355 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eeb4f62-bd79-4864-85e1-643c9484b251 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:43:47.775949 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eeb4f62-bd79-4864-85e1-643c9484b251 None admin] RBAC: Authorization granted {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:43:47.783061 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 472/932] 10.222.0.84 () {56 vars in 1087 bytes} [Wed May 25 14:43:47 2022] GET /identity/v3/services => generated 1497 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 14:43:47.789725 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.auth.core [None req-7b886dfe-55d3-4e44-9de4-1156193d9f90 None None] MFA Rules not processed for user `05d87e87798e429aa1c10b24391f915e`. Rule list: `[]` (Enabled: `True`). {{(pid=101892) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:43:47.791117 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.fernet_utils [None req-7b886dfe-55d3-4e44-9de4-1156193d9f90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=101892) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:43:47.879711 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 461/933] 10.222.0.84 () {58 vars in 1023 bytes} [Wed May 25 14:43:47 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 25 14:43:47.897014 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eeb4f62-bd79-4864-85e1-643c9484b251 None admin] Authenticating user token {{(pid=101893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:43:47.968951 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ac746d-e019-40e8-9b1b-c3ed48bc47b8 None None] REQUEST_METHOD: `GET` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:43:47.969249 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ac746d-e019-40e8-9b1b-c3ed48bc47b8 None None] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:43:47.969614 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ac746d-e019-40e8-9b1b-c3ed48bc47b8 None None] PATH_INFO: `/` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:43:47.971289 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 462/934] 10.222.0.84 () {54 vars in 926 bytes} [Wed May 25 14:43:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 14:43:47.977180 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762004af-2f84-4cbb-a229-125f86c43773 None None] REQUEST_METHOD: `POST` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:43:47.977471 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762004af-2f84-4cbb-a229-125f86c43773 None None] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:43:47.977756 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762004af-2f84-4cbb-a229-125f86c43773 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:43:47.994517 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.auth.core [None req-762004af-2f84-4cbb-a229-125f86c43773 None None] MFA Rules not processed for user `05d87e87798e429aa1c10b24391f915e`. Rule list: `[]` (Enabled: `True`). {{(pid=101892) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:43:47.996004 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.fernet_utils [None req-762004af-2f84-4cbb-a229-125f86c43773 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=101892) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:43:48.010665 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eeb4f62-bd79-4864-85e1-643c9484b251 None admin] Validating token access rules against request {{(pid=101893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:43:48.048280 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3159706c-1c68-4996-b2fb-9621411193c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:43:48.048868 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3159706c-1c68-4996-b2fb-9621411193c6 None admin] REQUEST_METHOD: `POST` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:43:48.049149 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3159706c-1c68-4996-b2fb-9621411193c6 None admin] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:43:48.049424 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3159706c-1c68-4996-b2fb-9621411193c6 None admin] PATH_INFO: `/v3/projects` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:43:48.050131 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3159706c-1c68-4996-b2fb-9621411193c6 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:43:48.051790 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3159706c-1c68-4996-b2fb-9621411193c6 None admin] RBAC: Authorization granted {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:43:48.053270 dv-cinder-803823-9-smb devstack@keystone.service[101893]: WARNING keystone.server.flask.common [None req-3159706c-1c68-4996-b2fb-9621411193c6 None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. May 25 14:43:48.054492 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG dbcounter [-] [101892] Writing DB stats keystone:SELECT=100 {{(pid=101892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:43:48.065283 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG dbcounter [-] [101893] Writing DB stats keystone:SELECT=100 {{(pid=101893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:43:48.083146 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 463/935] 10.222.0.84 () {58 vars in 1023 bytes} [Wed May 25 14:43:47 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 25 14:43:48.106173 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-762004af-2f84-4cbb-a229-125f86c43773 None None] Authenticating user token {{(pid=101892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:43:48.120439 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.sql.core [None req-3159706c-1c68-4996-b2fb-9621411193c6 None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") May 25 14:43:48.120439 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] May 25 14:43:48.120439 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [parameters: {'id': '50c90c06765a45539c18aec1cba15735', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] May 25 14:43:48.120439 dv-cinder-803823-9-smb devstack@keystone.service[101893]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=101893) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} May 25 14:43:48.128119 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application [None req-3159706c-1c68-4996-b2fb-9621411193c6 None admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 50c90c06765a45539c18aec1cba15735.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 50c90c06765a45539c18aec1cba15735. May 25 14:43:48.128119 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:43:48.128119 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context May 25 14:43:48.128119 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application self.dialect.do_execute( May 25 14:43:48.128119 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute May 25 14:43:48.128119 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) May 25 14:43:48.128119 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute May 25 14:43:48.128119 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application result = self._query(query) May 25 14:43:48.128119 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query May 25 14:43:48.128119 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application conn.query(q) May 25 14:43:48.128119 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query May 25 14:43:48.128119 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) May 25 14:43:48.128119 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result May 25 14:43:48.129984 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application result.read() May 25 14:43:48.129984 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read May 25 14:43:48.129984 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() May 25 14:43:48.129984 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet May 25 14:43:48.129984 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application packet.raise_for_error() May 25 14:43:48.129984 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error May 25 14:43:48.129984 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) May 25 14:43:48.129984 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception May 25 14:43:48.129984 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application raise errorclass(errno, errval) May 25 14:43:48.129984 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") May 25 14:43:48.129984 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application May 25 14:43:48.129984 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: May 25 14:43:48.129984 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application May 25 14:43:48.129984 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:43:48.129984 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper May 25 14:43:48.129984 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return method(*args, **kwargs) May 25 14:43:48.129984 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project May 25 14:43:48.129984 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return project_ref.to_dict() May 25 14:43:48.131262 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ May 25 14:43:48.131262 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application next(self.gen) May 25 14:43:48.131262 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope May 25 14:43:48.131262 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application yield resource May 25 14:43:48.131262 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ May 25 14:43:48.131262 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application next(self.gen) May 25 14:43:48.131262 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session May 25 14:43:48.131262 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application self.session.rollback() May 25 14:43:48.131262 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ May 25 14:43:48.131262 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application self.force_reraise() May 25 14:43:48.131262 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise May 25 14:43:48.131262 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application raise self.value May 25 14:43:48.131262 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session May 25 14:43:48.131262 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) May 25 14:43:48.131262 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction May 25 14:43:48.131262 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application session.commit() May 25 14:43:48.131262 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1435, in commit May 25 14:43:48.132197 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) May 25 14:43:48.132197 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit May 25 14:43:48.132197 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application self._prepare_impl() May 25 14:43:48.132197 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl May 25 14:43:48.132197 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application self.session.flush() May 25 14:43:48.132197 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3367, in flush May 25 14:43:48.132197 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application self._flush(objects) May 25 14:43:48.132197 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3507, in _flush May 25 14:43:48.132197 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) May 25 14:43:48.132197 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ May 25 14:43:48.132197 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application compat.raise_( May 25 14:43:48.132197 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ May 25 14:43:48.132197 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application raise exception May 25 14:43:48.132197 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3467, in _flush May 25 14:43:48.132197 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application flush_context.execute() May 25 14:43:48.132197 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute May 25 14:43:48.132197 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application rec.execute(self) May 25 14:43:48.133621 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute May 25 14:43:48.133621 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( May 25 14:43:48.133621 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj May 25 14:43:48.133621 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application _emit_insert_statements( May 25 14:43:48.133621 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements May 25 14:43:48.133621 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application c = connection._execute_20( May 25 14:43:48.133621 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 May 25 14:43:48.133621 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) May 25 14:43:48.133621 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 325, in _execute_on_connection May 25 14:43:48.133621 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return connection._execute_clauseelement( May 25 14:43:48.133621 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement May 25 14:43:48.133621 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application ret = self._execute_context( May 25 14:43:48.133621 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context May 25 14:43:48.133621 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application self._handle_dbapi_exception( May 25 14:43:48.133621 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception May 25 14:43:48.135819 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) May 25 14:43:48.135819 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ May 25 14:43:48.135819 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application raise exception May 25 14:43:48.135819 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context May 25 14:43:48.135819 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application self.dialect.do_execute( May 25 14:43:48.135819 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute May 25 14:43:48.135819 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) May 25 14:43:48.135819 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute May 25 14:43:48.135819 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application result = self._query(query) May 25 14:43:48.135819 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query May 25 14:43:48.135819 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application conn.query(q) May 25 14:43:48.135819 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query May 25 14:43:48.135819 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) May 25 14:43:48.135819 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result May 25 14:43:48.135819 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application result.read() May 25 14:43:48.135819 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read May 25 14:43:48.135819 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() May 25 14:43:48.138114 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet May 25 14:43:48.138114 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application packet.raise_for_error() May 25 14:43:48.138114 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error May 25 14:43:48.138114 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) May 25 14:43:48.138114 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception May 25 14:43:48.138114 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application raise errorclass(errno, errval) May 25 14:43:48.138114 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") May 25 14:43:48.138114 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] May 25 14:43:48.138114 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application [parameters: {'id': '50c90c06765a45539c18aec1cba15735', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] May 25 14:43:48.138114 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) May 25 14:43:48.138114 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application May 25 14:43:48.138114 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 25 14:43:48.138114 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application May 25 14:43:48.138114 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:43:48.138114 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project May 25 14:43:48.141204 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) May 25 14:43:48.141204 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper May 25 14:43:48.141204 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, May 25 14:43:48.141204 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name service at domain ID default. May 25 14:43:48.141204 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application May 25 14:43:48.141204 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 25 14:43:48.141204 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application May 25 14:43:48.141204 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:43:48.141204 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 14:43:48.141204 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 14:43:48.141204 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 14:43:48.141204 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 14:43:48.141204 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 14:43:48.141204 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 14:43:48.141204 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 14:43:48.141204 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 14:43:48.141204 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 14:43:48.143468 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 14:43:48.143468 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 176, in post May 25 14:43:48.143468 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_project( May 25 14:43:48.143468 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 14:43:48.143468 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 14:43:48.143468 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project May 25 14:43:48.143468 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application raise exception.Conflict( May 25 14:43:48.143468 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 50c90c06765a45539c18aec1cba15735. May 25 14:43:48.143468 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application May 25 14:43:48.143468 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 473/936] 10.222.0.84 () {60 vars in 1140 bytes} [Wed May 25 14:43:47 2022] POST /identity/v3/projects => generated 262 bytes in 233 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) May 25 14:43:48.143468 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3159706c-1c68-4996-b2fb-9621411193c6 None admin] Authenticating user token {{(pid=101893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:43:48.247270 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-762004af-2f84-4cbb-a229-125f86c43773 None None] Validating token access rules against request {{(pid=101892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:43:48.274202 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3159706c-1c68-4996-b2fb-9621411193c6 None admin] Validating token access rules against request {{(pid=101893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:43:48.289990 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f49d61c-2e37-44f1-b6a3-a0507fb01b91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:43:48.291507 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f49d61c-2e37-44f1-b6a3-a0507fb01b91 None admin] REQUEST_METHOD: `GET` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:43:48.291837 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f49d61c-2e37-44f1-b6a3-a0507fb01b91 None admin] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:43:48.292116 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f49d61c-2e37-44f1-b6a3-a0507fb01b91 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:43:48.307277 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f49d61c-2e37-44f1-b6a3-a0507fb01b91 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 14:43:48.313449 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-031bf503-f803-4de2-9adf-c2435a253ca2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:43:48.314338 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031bf503-f803-4de2-9adf-c2435a253ca2 None admin] REQUEST_METHOD: `GET` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:43:48.314690 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031bf503-f803-4de2-9adf-c2435a253ca2 None admin] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:43:48.315031 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031bf503-f803-4de2-9adf-c2435a253ca2 None admin] PATH_INFO: `/v3/projects/service` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:43:48.316495 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application [None req-1f49d61c-2e37-44f1-b6a3-a0507fb01b91 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 25 14:43:48.316495 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:43:48.316495 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 14:43:48.316495 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 14:43:48.316495 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 14:43:48.316495 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 14:43:48.316495 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 14:43:48.316495 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 14:43:48.316495 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 14:43:48.316495 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 14:43:48.316495 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 14:43:48.316495 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 14:43:48.316495 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 14:43:48.316495 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 14:43:48.316495 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 14:43:48.316495 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 14:43:48.318109 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 14:43:48.318109 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 14:43:48.318109 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 14:43:48.318109 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 14:43:48.318109 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 14:43:48.318109 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 14:43:48.318109 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 14:43:48.318109 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 14:43:48.318109 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 14:43:48.318109 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application return self.get_or_create( May 25 14:43:48.318109 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 14:43:48.318109 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application with Lock( May 25 14:43:48.318109 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 14:43:48.318109 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application return self._enter() May 25 14:43:48.318109 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 14:43:48.318109 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 14:43:48.320024 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 14:43:48.320024 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application return self.creator() May 25 14:43:48.320024 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 14:43:48.320024 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application created_value = creator( May 25 14:43:48.320024 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 14:43:48.320024 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 14:43:48.320024 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 14:43:48.320024 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 14:43:48.320024 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 14:43:48.320024 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 14:43:48.320024 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 25 14:43:48.320024 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application May 25 14:43:48.320024 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 464/937] 10.222.0.84 () {56 vars in 1120 bytes} [Wed May 25 14:43:48 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 25 14:43:48.327656 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f49d61c-2e37-44f1-b6a3-a0507fb01b91 None admin] Authenticating user token {{(pid=101892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:43:48.327826 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-031bf503-f803-4de2-9adf-c2435a253ca2 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:43:48.329401 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-031bf503-f803-4de2-9adf-c2435a253ca2 None admin] RBAC: Authorization granted {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:43:48.348500 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application [None req-031bf503-f803-4de2-9adf-c2435a253ca2 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 25 14:43:48.348500 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:43:48.348500 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 14:43:48.348500 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 14:43:48.348500 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 14:43:48.348500 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 14:43:48.348500 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 14:43:48.348500 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 14:43:48.348500 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 14:43:48.348500 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 14:43:48.348500 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 14:43:48.348500 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 14:43:48.348500 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 25 14:43:48.348500 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return self._get_project(project_id) May 25 14:43:48.348500 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 25 14:43:48.350578 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 25 14:43:48.350578 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 14:43:48.350578 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 14:43:48.350578 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 14:43:48.350578 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 14:43:48.350578 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 14:43:48.350578 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return self.get_or_create( May 25 14:43:48.350578 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 14:43:48.350578 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application with Lock( May 25 14:43:48.350578 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 14:43:48.350578 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return self._enter() May 25 14:43:48.350578 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 14:43:48.350578 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 14:43:48.350578 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 14:43:48.350578 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return self.creator() May 25 14:43:48.350578 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 14:43:48.350578 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application created_value = creator( May 25 14:43:48.357471 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 25 14:43:48.357471 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 25 14:43:48.357471 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 25 14:43:48.357471 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 25 14:43:48.357471 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 25 14:43:48.357471 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 25 14:43:48.357471 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 25 14:43:48.357471 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application May 25 14:43:48.357471 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 474/938] 10.222.0.84 () {56 vars in 1111 bytes} [Wed May 25 14:43:48 2022] GET /identity/v3/projects/service => generated 88 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 25 14:43:48.363014 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-031bf503-f803-4de2-9adf-c2435a253ca2 None admin] Authenticating user token {{(pid=101893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:43:48.392712 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG dbcounter [-] [101892] Writing DB stats keystone:SELECT=100 {{(pid=101892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:43:48.443652 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG dbcounter [-] [101893] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=101893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:43:48.460713 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f49d61c-2e37-44f1-b6a3-a0507fb01b91 None admin] Validating token access rules against request {{(pid=101892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:43:48.492678 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-031bf503-f803-4de2-9adf-c2435a253ca2 None admin] Validating token access rules against request {{(pid=101893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:43:48.506490 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c66209c-0d13-42b1-bc25-d62974a048a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:43:48.507665 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c66209c-0d13-42b1-bc25-d62974a048a6 None admin] REQUEST_METHOD: `GET` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:43:48.508532 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c66209c-0d13-42b1-bc25-d62974a048a6 None admin] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:43:48.509013 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c66209c-0d13-42b1-bc25-d62974a048a6 None admin] PATH_INFO: `/v3/roles` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:43:48.510228 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c66209c-0d13-42b1-bc25-d62974a048a6 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=101892) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:43:48.510748 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c66209c-0d13-42b1-bc25-d62974a048a6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:43:48.512805 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c66209c-0d13-42b1-bc25-d62974a048a6 None admin] RBAC: Authorization granted {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:43:48.529300 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 465/939] 10.222.0.84 () {56 vars in 1115 bytes} [Wed May 25 14:43:48 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 14:43:48.530800 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c66209c-0d13-42b1-bc25-d62974a048a6 None admin] Authenticating user token {{(pid=101892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:43:48.536544 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ddb20f4-5113-4e59-8c69-5bf14bbd9228 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:43:48.537378 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ddb20f4-5113-4e59-8c69-5bf14bbd9228 None admin] REQUEST_METHOD: `GET` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:43:48.537654 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ddb20f4-5113-4e59-8c69-5bf14bbd9228 None admin] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:43:48.537922 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ddb20f4-5113-4e59-8c69-5bf14bbd9228 None admin] PATH_INFO: `/v3/projects` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:43:48.538674 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ddb20f4-5113-4e59-8c69-5bf14bbd9228 None admin] RBAC: Adding query filter params (name=service) {{(pid=101893) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:43:48.539003 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ddb20f4-5113-4e59-8c69-5bf14bbd9228 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:43:48.545655 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ddb20f4-5113-4e59-8c69-5bf14bbd9228 None admin] RBAC: Authorization granted {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:43:48.583937 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 475/940] 10.222.0.84 () {56 vars in 1112 bytes} [Wed May 25 14:43:48 2022] GET /identity/v3/projects?name=service => generated 411 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 14:43:48.659853 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG dbcounter [-] [101892] Writing DB stats keystone:SELECT=100 {{(pid=101892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:43:48.664223 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c66209c-0d13-42b1-bc25-d62974a048a6 None admin] Validating token access rules against request {{(pid=101892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:43:48.702031 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4437b97f-69a6-4ea4-90d5-0a38978de1bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:43:48.703245 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4437b97f-69a6-4ea4-90d5-0a38978de1bd None admin] REQUEST_METHOD: `GET` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:43:48.703823 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4437b97f-69a6-4ea4-90d5-0a38978de1bd None admin] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:43:48.704286 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4437b97f-69a6-4ea4-90d5-0a38978de1bd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:43:48.716641 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4437b97f-69a6-4ea4-90d5-0a38978de1bd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:43:48.718441 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4437b97f-69a6-4ea4-90d5-0a38978de1bd None admin] RBAC: Authorization granted {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:43:48.737168 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application [None req-4437b97f-69a6-4ea4-90d5-0a38978de1bd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 25 14:43:48.737168 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:43:48.737168 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 14:43:48.737168 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 14:43:48.737168 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 14:43:48.737168 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 14:43:48.737168 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 14:43:48.737168 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 14:43:48.737168 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 14:43:48.737168 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 14:43:48.737168 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 14:43:48.737168 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 14:43:48.737168 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 25 14:43:48.737168 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 25 14:43:48.737168 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 25 14:43:48.738164 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 25 14:43:48.738164 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 14:43:48.738164 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 14:43:48.738164 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 14:43:48.738164 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 14:43:48.738164 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 14:43:48.738164 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application return self.get_or_create( May 25 14:43:48.738164 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 14:43:48.738164 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application with Lock( May 25 14:43:48.738164 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 14:43:48.738164 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application return self._enter() May 25 14:43:48.738164 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 14:43:48.738164 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 14:43:48.738164 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 14:43:48.738164 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application return self.creator() May 25 14:43:48.738164 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 14:43:48.738164 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application created_value = creator( May 25 14:43:48.739673 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 25 14:43:48.739673 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 25 14:43:48.739673 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 25 14:43:48.739673 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application May 25 14:43:48.742052 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 466/941] 10.222.0.84 () {56 vars in 1108 bytes} [Wed May 25 14:43:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 14:43:48.748703 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ddb20f4-5113-4e59-8c69-5bf14bbd9228 None admin] Authenticating user token {{(pid=101893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:43:48.859741 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ddb20f4-5113-4e59-8c69-5bf14bbd9228 None admin] Validating token access rules against request {{(pid=101893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:43:48.881505 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG dbcounter [-] [101893] Writing DB stats keystone:SELECT=100 {{(pid=101893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:43:48.900242 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f54f52-37f3-4f37-83ee-23eda312e112 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:43:48.900909 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f54f52-37f3-4f37-83ee-23eda312e112 None admin] REQUEST_METHOD: `GET` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:43:48.901191 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f54f52-37f3-4f37-83ee-23eda312e112 None admin] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:43:48.901464 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f54f52-37f3-4f37-83ee-23eda312e112 None admin] PATH_INFO: `/v3/domains` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:43:48.902211 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16f54f52-37f3-4f37-83ee-23eda312e112 None admin] RBAC: Adding query filter params (name=Default) {{(pid=101893) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:43:48.902517 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16f54f52-37f3-4f37-83ee-23eda312e112 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:43:48.903916 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16f54f52-37f3-4f37-83ee-23eda312e112 None admin] RBAC: Authorization granted {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:43:48.917066 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 476/942] 10.222.0.84 () {56 vars in 1109 bytes} [Wed May 25 14:43:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:43:48.922950 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4437b97f-69a6-4ea4-90d5-0a38978de1bd None admin] Authenticating user token {{(pid=101892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:43:49.026305 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0736e070-686f-402b-9ed0-f867ff182151 None None] REQUEST_METHOD: `GET` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:43:49.026849 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0736e070-686f-402b-9ed0-f867ff182151 None None] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:43:49.026849 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0736e070-686f-402b-9ed0-f867ff182151 None None] PATH_INFO: `/` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:43:49.028498 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 477/943] 10.222.0.84 () {54 vars in 926 bytes} [Wed May 25 14:43:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 14:43:49.032472 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4437b97f-69a6-4ea4-90d5-0a38978de1bd None admin] Validating token access rules against request {{(pid=101892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:43:49.037408 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c119af-4410-4dec-810f-c4f4c752e08b None None] REQUEST_METHOD: `POST` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:43:49.037804 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c119af-4410-4dec-810f-c4f4c752e08b None None] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:43:49.038181 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c119af-4410-4dec-810f-c4f4c752e08b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:43:49.057369 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.auth.core [None req-37c119af-4410-4dec-810f-c4f4c752e08b None None] MFA Rules not processed for user `05d87e87798e429aa1c10b24391f915e`. Rule list: `[]` (Enabled: `True`). {{(pid=101893) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:43:49.058785 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.fernet_utils [None req-37c119af-4410-4dec-810f-c4f4c752e08b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=101893) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:43:49.069293 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63ed7d3c-feb5-420c-8da6-d37f295c56ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:43:49.070451 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ed7d3c-feb5-420c-8da6-d37f295c56ee None admin] REQUEST_METHOD: `GET` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:43:49.070884 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ed7d3c-feb5-420c-8da6-d37f295c56ee None admin] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:43:49.071308 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ed7d3c-feb5-420c-8da6-d37f295c56ee None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:43:49.080094 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63ed7d3c-feb5-420c-8da6-d37f295c56ee None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:43:49.081761 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63ed7d3c-feb5-420c-8da6-d37f295c56ee None admin] RBAC: Authorization granted {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:43:49.098476 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application [None req-63ed7d3c-feb5-420c-8da6-d37f295c56ee None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. May 25 14:43:49.098476 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:43:49.098476 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 14:43:49.098476 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 14:43:49.098476 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 14:43:49.098476 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 14:43:49.098476 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 14:43:49.098476 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 14:43:49.098476 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 14:43:49.098476 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 14:43:49.098476 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 14:43:49.098476 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 14:43:49.098476 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 25 14:43:49.098476 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application return self._get_user(user_id) May 25 14:43:49.098476 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 25 14:43:49.098476 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 25 14:43:49.099698 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 14:43:49.099698 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 14:43:49.099698 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 25 14:43:49.099698 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 25 14:43:49.099698 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 25 14:43:49.099698 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 25 14:43:49.099698 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 14:43:49.099698 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 14:43:49.099698 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 14:43:49.099698 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application return self.get_or_create( May 25 14:43:49.099698 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 14:43:49.099698 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application with Lock( May 25 14:43:49.099698 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 14:43:49.099698 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application return self._enter() May 25 14:43:49.099698 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 14:43:49.099698 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 14:43:49.099698 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 14:43:49.099698 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application return self.creator() May 25 14:43:49.100886 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 14:43:49.100886 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application created_value = creator( May 25 14:43:49.100886 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 25 14:43:49.100886 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 25 14:43:49.100886 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 25 14:43:49.100886 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 25 14:43:49.100886 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 25 14:43:49.100886 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 25 14:43:49.100886 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. May 25 14:43:49.100886 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application May 25 14:43:49.103182 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 467/944] 10.222.0.84 () {56 vars in 1117 bytes} [Wed May 25 14:43:48 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 14:43:49.109051 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63ed7d3c-feb5-420c-8da6-d37f295c56ee None admin] Authenticating user token {{(pid=101892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:43:49.126651 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG dbcounter [-] [101892] Writing DB stats keystone:SELECT=100 {{(pid=101892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:43:49.133425 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 478/945] 10.222.0.84 () {58 vars in 1023 bytes} [Wed May 25 14:43:49 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 25 14:43:49.159171 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37c119af-4410-4dec-810f-c4f4c752e08b None None] Authenticating user token {{(pid=101893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:43:49.219212 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63ed7d3c-feb5-420c-8da6-d37f295c56ee None admin] Validating token access rules against request {{(pid=101892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:43:49.256970 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c72e5f0-c8d0-4e01-82d7-8f6ea650349c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:43:49.257886 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c72e5f0-c8d0-4e01-82d7-8f6ea650349c None admin] REQUEST_METHOD: `GET` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:43:49.258317 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c72e5f0-c8d0-4e01-82d7-8f6ea650349c None admin] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:43:49.258831 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c72e5f0-c8d0-4e01-82d7-8f6ea650349c None admin] PATH_INFO: `/v3/users` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:43:49.259950 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c72e5f0-c8d0-4e01-82d7-8f6ea650349c None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=101892) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:43:49.260407 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c72e5f0-c8d0-4e01-82d7-8f6ea650349c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:43:49.262150 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c72e5f0-c8d0-4e01-82d7-8f6ea650349c None admin] RBAC: Authorization granted {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:43:49.265671 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37c119af-4410-4dec-810f-c4f4c752e08b None None] Validating token access rules against request {{(pid=101893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:43:49.273740 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG dbcounter [-] [101893] Writing DB stats keystone:SELECT=100 {{(pid=101893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:43:49.282070 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 468/946] 10.222.0.84 () {56 vars in 1149 bytes} [Wed May 25 14:43:49 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 14:43:49.287774 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c72e5f0-c8d0-4e01-82d7-8f6ea650349c None admin] Authenticating user token {{(pid=101892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:43:49.314255 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9fdd26f-3998-4472-a3b8-3d935b632097 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:43:49.315062 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9fdd26f-3998-4472-a3b8-3d935b632097 None admin] REQUEST_METHOD: `GET` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:43:49.315343 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9fdd26f-3998-4472-a3b8-3d935b632097 None admin] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:43:49.315678 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9fdd26f-3998-4472-a3b8-3d935b632097 None admin] PATH_INFO: `/v3/services/compute` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:43:49.316404 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9fdd26f-3998-4472-a3b8-3d935b632097 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:43:49.318223 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9fdd26f-3998-4472-a3b8-3d935b632097 None admin] RBAC: Authorization granted {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:43:49.334103 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application [None req-f9fdd26f-3998-4472-a3b8-3d935b632097 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. May 25 14:43:49.334103 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:43:49.334103 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 25 14:43:49.334103 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 25 14:43:49.334103 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 25 14:43:49.334103 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 25 14:43:49.334103 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 25 14:43:49.334103 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 25 14:43:49.334103 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. May 25 14:43:49.334103 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application May 25 14:43:49.334103 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 25 14:43:49.334103 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application May 25 14:43:49.334103 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:43:49.334103 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 14:43:49.334103 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 14:43:49.334103 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 14:43:49.334103 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 14:43:49.335121 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 14:43:49.335121 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 14:43:49.335121 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 14:43:49.335121 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 14:43:49.335121 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 14:43:49.335121 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 14:43:49.335121 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 25 14:43:49.335121 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return self._get_service(service_id) May 25 14:43:49.335121 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 25 14:43:49.335121 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 25 14:43:49.335121 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 14:43:49.335121 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 14:43:49.335121 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 14:43:49.335121 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 14:43:49.335121 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 14:43:49.335121 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return self.get_or_create( May 25 14:43:49.336034 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 14:43:49.336034 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application with Lock( May 25 14:43:49.336034 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 14:43:49.336034 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return self._enter() May 25 14:43:49.336034 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 14:43:49.336034 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 14:43:49.336034 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 14:43:49.336034 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return self.creator() May 25 14:43:49.336034 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 14:43:49.336034 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application created_value = creator( May 25 14:43:49.336034 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 25 14:43:49.336034 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 25 14:43:49.336034 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. May 25 14:43:49.336034 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application May 25 14:43:49.340312 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 479/947] 10.222.0.84 () {56 vars in 1111 bytes} [Wed May 25 14:43:49 2022] GET /identity/v3/services/compute => generated 88 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 25 14:43:49.341756 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9fdd26f-3998-4472-a3b8-3d935b632097 None admin] Authenticating user token {{(pid=101893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:43:49.378922 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG dbcounter [-] [101892] Writing DB stats keystone:SELECT=100 {{(pid=101892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:43:49.417634 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c72e5f0-c8d0-4e01-82d7-8f6ea650349c None admin] Validating token access rules against request {{(pid=101892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:43:49.458812 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b27470c-2784-4fa1-9121-ec21091daf04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:43:49.459771 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b27470c-2784-4fa1-9121-ec21091daf04 None admin] REQUEST_METHOD: `GET` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:43:49.460210 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b27470c-2784-4fa1-9121-ec21091daf04 None admin] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:43:49.460556 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b27470c-2784-4fa1-9121-ec21091daf04 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:43:49.467245 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9fdd26f-3998-4472-a3b8-3d935b632097 None admin] Validating token access rules against request {{(pid=101893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:43:49.471708 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b27470c-2784-4fa1-9121-ec21091daf04 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:43:49.473842 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b27470c-2784-4fa1-9121-ec21091daf04 None admin] RBAC: Authorization granted {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:43:49.493022 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application [None req-9b27470c-2784-4fa1-9121-ec21091daf04 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 25 14:43:49.493022 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:43:49.493022 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 14:43:49.493022 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 14:43:49.493022 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 14:43:49.493022 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 14:43:49.493022 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 14:43:49.493022 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 14:43:49.493022 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 14:43:49.493022 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 14:43:49.493022 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 14:43:49.493022 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 14:43:49.493022 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 25 14:43:49.493022 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 25 14:43:49.493022 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 25 14:43:49.493987 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 25 14:43:49.493987 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 14:43:49.493987 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 14:43:49.493987 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 14:43:49.493987 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 14:43:49.493987 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 14:43:49.493987 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application return self.get_or_create( May 25 14:43:49.493987 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 14:43:49.493987 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application with Lock( May 25 14:43:49.493987 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 14:43:49.493987 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application return self._enter() May 25 14:43:49.493987 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 14:43:49.493987 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 14:43:49.493987 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 14:43:49.493987 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application return self.creator() May 25 14:43:49.493987 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 14:43:49.493987 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application created_value = creator( May 25 14:43:49.494898 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 25 14:43:49.494898 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 25 14:43:49.494898 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 25 14:43:49.494898 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application May 25 14:43:49.499521 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 469/948] 10.222.0.84 () {56 vars in 1108 bytes} [Wed May 25 14:43:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 14:43:49.500525 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b27470c-2784-4fa1-9121-ec21091daf04 None admin] Authenticating user token {{(pid=101892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:43:49.506548 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-403ce35e-9085-4d0a-961a-40f67b2b78f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:43:49.507480 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403ce35e-9085-4d0a-961a-40f67b2b78f1 None admin] REQUEST_METHOD: `GET` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:43:49.507961 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403ce35e-9085-4d0a-961a-40f67b2b78f1 None admin] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:43:49.508418 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403ce35e-9085-4d0a-961a-40f67b2b78f1 None admin] PATH_INFO: `/v3/services` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:43:49.509297 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-403ce35e-9085-4d0a-961a-40f67b2b78f1 None admin] RBAC: Adding query filter params (name=compute) {{(pid=101893) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:43:49.509780 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-403ce35e-9085-4d0a-961a-40f67b2b78f1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:43:49.511456 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-403ce35e-9085-4d0a-961a-40f67b2b78f1 None admin] RBAC: Authorization granted {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:43:49.517344 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 480/949] 10.222.0.84 () {56 vars in 1112 bytes} [Wed May 25 14:43:49 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 14:43:49.523246 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-403ce35e-9085-4d0a-961a-40f67b2b78f1 None admin] Authenticating user token {{(pid=101893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:43:49.568858 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG dbcounter [-] [101893] Writing DB stats keystone:SELECT=100 {{(pid=101893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:43:49.634119 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b27470c-2784-4fa1-9121-ec21091daf04 None admin] Validating token access rules against request {{(pid=101892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:43:49.659303 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG dbcounter [-] [101892] Writing DB stats keystone:SELECT=100 {{(pid=101892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:43:49.662718 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-403ce35e-9085-4d0a-961a-40f67b2b78f1 None admin] Validating token access rules against request {{(pid=101893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:43:49.672241 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aac13d0-9441-43b3-9fbf-a5fbcc08821f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:43:49.672901 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aac13d0-9441-43b3-9fbf-a5fbcc08821f None admin] REQUEST_METHOD: `GET` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:43:49.673181 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aac13d0-9441-43b3-9fbf-a5fbcc08821f None admin] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:43:49.675820 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aac13d0-9441-43b3-9fbf-a5fbcc08821f None admin] PATH_INFO: `/v3/domains` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:43:49.675820 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aac13d0-9441-43b3-9fbf-a5fbcc08821f None admin] RBAC: Adding query filter params (name=Default) {{(pid=101892) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:43:49.675820 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aac13d0-9441-43b3-9fbf-a5fbcc08821f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:43:49.676151 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aac13d0-9441-43b3-9fbf-a5fbcc08821f None admin] RBAC: Authorization granted {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:43:49.692188 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 470/950] 10.222.0.84 () {56 vars in 1109 bytes} [Wed May 25 14:43:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:43:49.694641 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aac13d0-9441-43b3-9fbf-a5fbcc08821f None admin] Authenticating user token {{(pid=101892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:43:49.711383 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a356329-d819-411f-8622-0841a6777b92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:43:49.712602 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a356329-d819-411f-8622-0841a6777b92 None admin] REQUEST_METHOD: `GET` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:43:49.713565 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a356329-d819-411f-8622-0841a6777b92 None admin] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:43:49.714293 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a356329-d819-411f-8622-0841a6777b92 None admin] PATH_INFO: `/v3/services` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:43:49.715449 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a356329-d819-411f-8622-0841a6777b92 None admin] RBAC: Adding query filter params (type=compute) {{(pid=101893) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:43:49.715965 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a356329-d819-411f-8622-0841a6777b92 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:43:49.717933 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a356329-d819-411f-8622-0841a6777b92 None admin] RBAC: Authorization granted {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:43:49.731819 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 481/951] 10.222.0.84 () {56 vars in 1112 bytes} [Wed May 25 14:43:49 2022] GET /identity/v3/services?type=compute => generated 124 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 14:43:49.813139 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aac13d0-9441-43b3-9fbf-a5fbcc08821f None admin] Validating token access rules against request {{(pid=101892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:43:49.852689 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac5de018-4009-4d71-95dc-ef20e612d4ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:43:49.853499 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5de018-4009-4d71-95dc-ef20e612d4ad None admin] REQUEST_METHOD: `GET` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:43:49.853779 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5de018-4009-4d71-95dc-ef20e612d4ad None admin] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:43:49.854054 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5de018-4009-4d71-95dc-ef20e612d4ad None admin] PATH_INFO: `/v3/projects/service` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:43:49.861558 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac5de018-4009-4d71-95dc-ef20e612d4ad None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:43:49.863025 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac5de018-4009-4d71-95dc-ef20e612d4ad None admin] RBAC: Authorization granted {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:43:49.879701 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application [None req-ac5de018-4009-4d71-95dc-ef20e612d4ad None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 25 14:43:49.879701 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:43:49.879701 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 14:43:49.879701 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 14:43:49.879701 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 14:43:49.879701 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 14:43:49.879701 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 14:43:49.879701 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 14:43:49.879701 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 14:43:49.879701 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 14:43:49.879701 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 14:43:49.879701 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 14:43:49.879701 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 25 14:43:49.879701 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application return self._get_project(project_id) May 25 14:43:49.879701 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 25 14:43:49.880744 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 25 14:43:49.880744 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 14:43:49.880744 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 14:43:49.880744 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 14:43:49.880744 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 14:43:49.880744 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 14:43:49.880744 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application return self.get_or_create( May 25 14:43:49.880744 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 14:43:49.880744 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application with Lock( May 25 14:43:49.880744 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 14:43:49.880744 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application return self._enter() May 25 14:43:49.880744 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 14:43:49.880744 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 14:43:49.880744 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 14:43:49.880744 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application return self.creator() May 25 14:43:49.880744 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 14:43:49.880744 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application created_value = creator( May 25 14:43:49.881785 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 25 14:43:49.881785 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 25 14:43:49.881785 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 25 14:43:49.881785 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 25 14:43:49.881785 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 25 14:43:49.881785 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 25 14:43:49.881785 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 25 14:43:49.881785 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application May 25 14:43:49.881785 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 471/952] 10.222.0.84 () {56 vars in 1111 bytes} [Wed May 25 14:43:49 2022] GET /identity/v3/projects/service => generated 88 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 25 14:43:49.887383 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a356329-d819-411f-8622-0841a6777b92 None admin] Authenticating user token {{(pid=101893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:43:49.998323 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG dbcounter [-] [101893] Writing DB stats keystone:SELECT=100 {{(pid=101893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:43:50.002669 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a356329-d819-411f-8622-0841a6777b92 None admin] Validating token access rules against request {{(pid=101893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:43:50.037715 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01dbdca8-a8d0-4793-a245-4dab352bf0e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:43:50.038373 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01dbdca8-a8d0-4793-a245-4dab352bf0e6 None admin] REQUEST_METHOD: `GET` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:43:50.038633 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01dbdca8-a8d0-4793-a245-4dab352bf0e6 None admin] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:43:50.039924 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01dbdca8-a8d0-4793-a245-4dab352bf0e6 None admin] PATH_INFO: `/v3/projects` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:43:50.040726 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01dbdca8-a8d0-4793-a245-4dab352bf0e6 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=101893) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:43:50.041096 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01dbdca8-a8d0-4793-a245-4dab352bf0e6 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:43:50.042549 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01dbdca8-a8d0-4793-a245-4dab352bf0e6 None admin] RBAC: Authorization granted {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:43:50.055539 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 482/953] 10.222.0.84 () {56 vars in 1148 bytes} [Wed May 25 14:43:49 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:43:50.061318 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac5de018-4009-4d71-95dc-ef20e612d4ad None admin] Authenticating user token {{(pid=101892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:43:50.094143 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32d5d79-75fc-4a91-8b28-697a206b5456 None None] REQUEST_METHOD: `GET` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:43:50.094461 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32d5d79-75fc-4a91-8b28-697a206b5456 None None] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:43:50.094711 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32d5d79-75fc-4a91-8b28-697a206b5456 None None] PATH_INFO: `/` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:43:50.096239 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 483/954] 10.222.0.84 () {54 vars in 926 bytes} [Wed May 25 14:43:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 25 14:43:50.101787 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab73255-a1cf-4e4e-bc2d-e4dce2efec04 None None] REQUEST_METHOD: `POST` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:43:50.102081 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab73255-a1cf-4e4e-bc2d-e4dce2efec04 None None] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:43:50.102366 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab73255-a1cf-4e4e-bc2d-e4dce2efec04 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:43:50.112462 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG dbcounter [-] [101892] Writing DB stats keystone:SELECT=100 {{(pid=101892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:43:50.121698 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.auth.core [None req-8ab73255-a1cf-4e4e-bc2d-e4dce2efec04 None None] MFA Rules not processed for user `05d87e87798e429aa1c10b24391f915e`. Rule list: `[]` (Enabled: `True`). {{(pid=101893) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:43:50.122901 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.fernet_utils [None req-8ab73255-a1cf-4e4e-bc2d-e4dce2efec04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=101893) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:43:50.173552 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac5de018-4009-4d71-95dc-ef20e612d4ad None admin] Validating token access rules against request {{(pid=101892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:43:50.196490 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 484/955] 10.222.0.84 () {58 vars in 1023 bytes} [Wed May 25 14:43:50 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 25 14:43:50.220223 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab73255-a1cf-4e4e-bc2d-e4dce2efec04 None None] Authenticating user token {{(pid=101893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:43:50.222665 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fb31275-4ae4-4b2a-8c0d-cdaed2d42232 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:43:50.223620 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb31275-4ae4-4b2a-8c0d-cdaed2d42232 None admin] REQUEST_METHOD: `PUT` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:43:50.223922 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb31275-4ae4-4b2a-8c0d-cdaed2d42232 None admin] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:43:50.224256 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb31275-4ae4-4b2a-8c0d-cdaed2d42232 None admin] PATH_INFO: `/v3/projects/a000829c658c4a7cab67f7b6353ba3fa/users/049a7ab3f95f460e908f79cc321176fd/roles/e36bc54201ab4defa2b100771ec121a4` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:43:50.226515 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fb31275-4ae4-4b2a-8c0d-cdaed2d42232 None admin] RBAC: Authorizing `identity:create_grant(project_id=a000829c658c4a7cab67f7b6353ba3fa, user_id=049a7ab3f95f460e908f79cc321176fd, role_id=e36bc54201ab4defa2b100771ec121a4)` {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:43:50.228077 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fb31275-4ae4-4b2a-8c0d-cdaed2d42232 None admin] RBAC: Authorization granted {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:43:50.303599 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 472/956] 10.222.0.84 () {58 vars in 1439 bytes} [Wed May 25 14:43:50 2022] PUT /identity/v3/projects/a000829c658c4a7cab67f7b6353ba3fa/users/049a7ab3f95f460e908f79cc321176fd/roles/e36bc54201ab4defa2b100771ec121a4 => generated 0 bytes in 238 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 14:43:50.320769 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG dbcounter [-] [101893] Writing DB stats keystone:SELECT=100 {{(pid=101893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:43:50.335865 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab73255-a1cf-4e4e-bc2d-e4dce2efec04 None None] Validating token access rules against request {{(pid=101893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:43:50.381292 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16db2b64-7643-46e3-b04e-08be81e53849 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:43:50.382188 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16db2b64-7643-46e3-b04e-08be81e53849 None admin] REQUEST_METHOD: `GET` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:43:50.382478 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16db2b64-7643-46e3-b04e-08be81e53849 None admin] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:43:50.382745 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16db2b64-7643-46e3-b04e-08be81e53849 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:43:50.383414 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16db2b64-7643-46e3-b04e-08be81e53849 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:43:50.385020 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16db2b64-7643-46e3-b04e-08be81e53849 None admin] RBAC: Authorization granted {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:43:50.398794 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application [None req-16db2b64-7643-46e3-b04e-08be81e53849 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. May 25 14:43:50.398794 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:43:50.398794 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 25 14:43:50.398794 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 25 14:43:50.398794 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 25 14:43:50.398794 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 25 14:43:50.398794 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 25 14:43:50.398794 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 25 14:43:50.398794 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 25 14:43:50.398794 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application May 25 14:43:50.398794 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 25 14:43:50.398794 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application May 25 14:43:50.398794 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:43:50.398794 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 14:43:50.398794 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 14:43:50.398794 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 14:43:50.398794 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 14:43:50.400018 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 14:43:50.400018 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 14:43:50.400018 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 14:43:50.400018 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 14:43:50.400018 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 14:43:50.400018 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 14:43:50.400018 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 25 14:43:50.400018 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return self._get_service(service_id) May 25 14:43:50.400018 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 25 14:43:50.400018 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 25 14:43:50.400018 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 14:43:50.400018 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 14:43:50.400018 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 14:43:50.400018 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 14:43:50.400018 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 14:43:50.400018 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return self.get_or_create( May 25 14:43:50.400876 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 14:43:50.400876 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application with Lock( May 25 14:43:50.400876 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 14:43:50.400876 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return self._enter() May 25 14:43:50.400876 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 14:43:50.400876 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 14:43:50.400876 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 14:43:50.400876 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return self.creator() May 25 14:43:50.400876 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 14:43:50.400876 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application created_value = creator( May 25 14:43:50.400876 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 25 14:43:50.400876 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 25 14:43:50.400876 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 25 14:43:50.400876 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application May 25 14:43:50.400876 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 485/957] 10.222.0.84 () {56 vars in 1126 bytes} [Wed May 25 14:43:50 2022] GET /identity/v3/services/object-store => generated 93 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 14:43:50.408662 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fb31275-4ae4-4b2a-8c0d-cdaed2d42232 None admin] Authenticating user token {{(pid=101892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:43:50.521101 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fb31275-4ae4-4b2a-8c0d-cdaed2d42232 None admin] Validating token access rules against request {{(pid=101892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:43:50.523147 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG dbcounter [-] [101892] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=101892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:43:50.568296 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9db1d0a9-bd96-44a6-b83c-af3bae2aad8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:43:50.568968 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db1d0a9-bd96-44a6-b83c-af3bae2aad8f None admin] REQUEST_METHOD: `GET` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:43:50.569247 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db1d0a9-bd96-44a6-b83c-af3bae2aad8f None admin] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:43:50.569538 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db1d0a9-bd96-44a6-b83c-af3bae2aad8f None admin] PATH_INFO: `/v3/services` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:43:50.570280 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9db1d0a9-bd96-44a6-b83c-af3bae2aad8f None admin] RBAC: Adding query filter params (name=object-store) {{(pid=101892) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:43:50.570587 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9db1d0a9-bd96-44a6-b83c-af3bae2aad8f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:43:50.572041 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9db1d0a9-bd96-44a6-b83c-af3bae2aad8f None admin] RBAC: Authorization granted {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:43:50.577579 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 473/958] 10.222.0.84 () {56 vars in 1122 bytes} [Wed May 25 14:43:50 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:43:50.583374 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16db2b64-7643-46e3-b04e-08be81e53849 None admin] Authenticating user token {{(pid=101893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:43:50.686359 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16db2b64-7643-46e3-b04e-08be81e53849 None admin] Validating token access rules against request {{(pid=101893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:43:50.721280 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a720c3-2cd6-4f34-bfaf-34ea37d444cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:43:50.721944 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a720c3-2cd6-4f34-bfaf-34ea37d444cf None admin] REQUEST_METHOD: `GET` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:43:50.722226 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a720c3-2cd6-4f34-bfaf-34ea37d444cf None admin] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:43:50.722501 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a720c3-2cd6-4f34-bfaf-34ea37d444cf None admin] PATH_INFO: `/v3/services` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:43:50.723762 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8a720c3-2cd6-4f34-bfaf-34ea37d444cf None admin] RBAC: Adding query filter params (type=object-store) {{(pid=101893) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:43:50.724072 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8a720c3-2cd6-4f34-bfaf-34ea37d444cf None admin] RBAC: Authorizing `identity:list_services()` {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:43:50.725633 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8a720c3-2cd6-4f34-bfaf-34ea37d444cf None admin] RBAC: Authorization granted {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:43:50.731164 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 486/959] 10.222.0.84 () {56 vars in 1122 bytes} [Wed May 25 14:43:50 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:43:50.736511 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9db1d0a9-bd96-44a6-b83c-af3bae2aad8f None admin] Authenticating user token {{(pid=101892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:43:50.843122 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9db1d0a9-bd96-44a6-b83c-af3bae2aad8f None admin] Validating token access rules against request {{(pid=101892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:43:50.877998 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e82b39c-dd63-4055-95cf-79d024b8c4ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:43:50.878651 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e82b39c-dd63-4055-95cf-79d024b8c4ed None admin] REQUEST_METHOD: `POST` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:43:50.878965 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e82b39c-dd63-4055-95cf-79d024b8c4ed None admin] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:43:50.879238 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e82b39c-dd63-4055-95cf-79d024b8c4ed None admin] PATH_INFO: `/v3/endpoints` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:43:50.880013 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e82b39c-dd63-4055-95cf-79d024b8c4ed None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:43:50.881371 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e82b39c-dd63-4055-95cf-79d024b8c4ed None admin] RBAC: Authorization granted {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:43:50.956678 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 474/960] 10.222.0.84 () {60 vars in 1144 bytes} [Wed May 25 14:43:50 2022] POST /identity/v3/endpoints => generated 349 bytes in 220 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 14:43:50.968922 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186dfd51-cbe8-48eb-84c3-2e2e2c102530 None None] REQUEST_METHOD: `GET` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:43:50.969261 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186dfd51-cbe8-48eb-84c3-2e2e2c102530 None None] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:43:50.969492 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186dfd51-cbe8-48eb-84c3-2e2e2c102530 None None] PATH_INFO: `/` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:43:50.971248 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 487/961] 10.222.0.84 () {54 vars in 926 bytes} [Wed May 25 14:43:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 14:43:50.977697 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14aa1c68-30f9-49a6-8a33-6fd6a3adcb5f None None] REQUEST_METHOD: `POST` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:43:50.978008 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14aa1c68-30f9-49a6-8a33-6fd6a3adcb5f None None] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:43:50.978273 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14aa1c68-30f9-49a6-8a33-6fd6a3adcb5f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:43:50.999626 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.auth.core [None req-14aa1c68-30f9-49a6-8a33-6fd6a3adcb5f None None] MFA Rules not processed for user `05d87e87798e429aa1c10b24391f915e`. Rule list: `[]` (Enabled: `True`). {{(pid=101892) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:43:51.001218 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.fernet_utils [None req-14aa1c68-30f9-49a6-8a33-6fd6a3adcb5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=101892) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:43:51.020688 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG dbcounter [-] [101892] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=101892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:43:51.084625 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 475/962] 10.222.0.84 () {58 vars in 1023 bytes} [Wed May 25 14:43:50 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 25 14:43:51.110878 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-186dfd51-cbe8-48eb-84c3-2e2e2c102530 None None] Authenticating user token {{(pid=101893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:43:51.131900 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG dbcounter [-] [101893] Writing DB stats keystone:SELECT=100 {{(pid=101893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:43:51.223025 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-186dfd51-cbe8-48eb-84c3-2e2e2c102530 None None] Validating token access rules against request {{(pid=101893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:43:51.258322 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-781e7ac5-fd20-44f4-97d7-7ab609735d20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:43:51.259052 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781e7ac5-fd20-44f4-97d7-7ab609735d20 None admin] REQUEST_METHOD: `POST` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:43:51.259334 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781e7ac5-fd20-44f4-97d7-7ab609735d20 None admin] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:43:51.259679 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781e7ac5-fd20-44f4-97d7-7ab609735d20 None admin] PATH_INFO: `/v3/users` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:43:51.260390 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-781e7ac5-fd20-44f4-97d7-7ab609735d20 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:43:51.261829 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-781e7ac5-fd20-44f4-97d7-7ab609735d20 None admin] RBAC: Authorization granted {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:43:51.303472 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.sql.core [None req-781e7ac5-fd20-44f4-97d7-7ab609735d20 None admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") May 25 14:43:51.303472 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] May 25 14:43:51.303472 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [parameters: {'user_id': 'ac5728c8d6034fc8b67ec930f18aa308', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] May 25 14:43:51.303472 dv-cinder-803823-9-smb devstack@keystone.service[101893]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=101893) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} May 25 14:43:51.311387 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application [None req-781e7ac5-fd20-44f4-97d7-7ab609735d20 None admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. May 25 14:43:51.311387 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:43:51.311387 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context May 25 14:43:51.311387 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application self.dialect.do_execute( May 25 14:43:51.311387 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute May 25 14:43:51.311387 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) May 25 14:43:51.311387 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute May 25 14:43:51.311387 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application result = self._query(query) May 25 14:43:51.311387 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query May 25 14:43:51.311387 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application conn.query(q) May 25 14:43:51.311387 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query May 25 14:43:51.311387 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) May 25 14:43:51.311387 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result May 25 14:43:51.311387 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application result.read() May 25 14:43:51.311387 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read May 25 14:43:51.312448 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() May 25 14:43:51.312448 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet May 25 14:43:51.312448 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application packet.raise_for_error() May 25 14:43:51.312448 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error May 25 14:43:51.312448 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) May 25 14:43:51.312448 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception May 25 14:43:51.312448 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application raise errorclass(errno, errval) May 25 14:43:51.312448 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") May 25 14:43:51.312448 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application May 25 14:43:51.312448 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: May 25 14:43:51.312448 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application May 25 14:43:51.312448 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:43:51.312448 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper May 25 14:43:51.312448 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return method(*args, **kwargs) May 25 14:43:51.312448 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 141, in create_user May 25 14:43:51.312448 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return base.filter_user(user_ref.to_dict()) May 25 14:43:51.312448 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ May 25 14:43:51.312448 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application next(self.gen) May 25 14:43:51.313852 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope May 25 14:43:51.313852 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application yield resource May 25 14:43:51.313852 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ May 25 14:43:51.313852 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application next(self.gen) May 25 14:43:51.313852 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session May 25 14:43:51.313852 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application self.session.rollback() May 25 14:43:51.313852 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ May 25 14:43:51.313852 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application self.force_reraise() May 25 14:43:51.313852 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise May 25 14:43:51.313852 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application raise self.value May 25 14:43:51.313852 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session May 25 14:43:51.313852 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) May 25 14:43:51.313852 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction May 25 14:43:51.313852 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application session.commit() May 25 14:43:51.313852 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1435, in commit May 25 14:43:51.313852 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) May 25 14:43:51.313852 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit May 25 14:43:51.314983 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application self._prepare_impl() May 25 14:43:51.314983 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl May 25 14:43:51.314983 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application self.session.flush() May 25 14:43:51.314983 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3367, in flush May 25 14:43:51.314983 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application self._flush(objects) May 25 14:43:51.314983 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3507, in _flush May 25 14:43:51.314983 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) May 25 14:43:51.314983 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ May 25 14:43:51.314983 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application compat.raise_( May 25 14:43:51.314983 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ May 25 14:43:51.314983 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application raise exception May 25 14:43:51.314983 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3467, in _flush May 25 14:43:51.314983 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application flush_context.execute() May 25 14:43:51.314983 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute May 25 14:43:51.314983 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application rec.execute(self) May 25 14:43:51.314983 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute May 25 14:43:51.314983 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( May 25 14:43:51.320967 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj May 25 14:43:51.320967 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application _emit_insert_statements( May 25 14:43:51.320967 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements May 25 14:43:51.320967 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application result = connection._execute_20( May 25 14:43:51.320967 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 May 25 14:43:51.320967 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) May 25 14:43:51.320967 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 325, in _execute_on_connection May 25 14:43:51.320967 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return connection._execute_clauseelement( May 25 14:43:51.320967 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement May 25 14:43:51.320967 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application ret = self._execute_context( May 25 14:43:51.320967 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context May 25 14:43:51.320967 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application self._handle_dbapi_exception( May 25 14:43:51.320967 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception May 25 14:43:51.320967 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) May 25 14:43:51.320967 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ May 25 14:43:51.320967 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application raise exception May 25 14:43:51.322910 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context May 25 14:43:51.322910 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application self.dialect.do_execute( May 25 14:43:51.322910 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute May 25 14:43:51.322910 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) May 25 14:43:51.322910 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute May 25 14:43:51.322910 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application result = self._query(query) May 25 14:43:51.322910 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query May 25 14:43:51.322910 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application conn.query(q) May 25 14:43:51.322910 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query May 25 14:43:51.322910 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) May 25 14:43:51.322910 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result May 25 14:43:51.322910 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application result.read() May 25 14:43:51.322910 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read May 25 14:43:51.322910 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() May 25 14:43:51.322910 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet May 25 14:43:51.322910 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application packet.raise_for_error() May 25 14:43:51.324888 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error May 25 14:43:51.324888 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) May 25 14:43:51.324888 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception May 25 14:43:51.324888 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application raise errorclass(errno, errval) May 25 14:43:51.324888 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") May 25 14:43:51.324888 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] May 25 14:43:51.324888 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application [parameters: {'user_id': 'ac5728c8d6034fc8b67ec930f18aa308', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] May 25 14:43:51.324888 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) May 25 14:43:51.324888 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application May 25 14:43:51.324888 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 25 14:43:51.324888 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application May 25 14:43:51.324888 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:43:51.324888 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 14:43:51.324888 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 14:43:51.324888 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 14:43:51.326938 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 14:43:51.326938 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 14:43:51.326938 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 14:43:51.326938 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 14:43:51.326938 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 14:43:51.326938 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 14:43:51.326938 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 14:43:51.326938 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 244, in post May 25 14:43:51.326938 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.create_user( May 25 14:43:51.326938 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 14:43:51.326938 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 14:43:51.326938 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 25 14:43:51.326938 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 25 14:43:51.326938 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 25 14:43:51.326938 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 25 14:43:51.326938 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1000, in create_user May 25 14:43:51.326938 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application ref = self._create_user_with_federated_objects(user, driver) May 25 14:43:51.330571 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 966, in _create_user_with_federated_objects May 25 14:43:51.330571 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application user = driver.create_user(user['id'], user) May 25 14:43:51.330571 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper May 25 14:43:51.330571 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, May 25 14:43:51.330571 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. May 25 14:43:51.330571 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application May 25 14:43:51.330571 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 488/963] 10.222.0.84 () {60 vars in 1131 bytes} [Wed May 25 14:43:51 2022] POST /identity/v3/users => generated 160 bytes in 203 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) May 25 14:43:51.331609 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14aa1c68-30f9-49a6-8a33-6fd6a3adcb5f None None] Authenticating user token {{(pid=101892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:43:51.423219 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14aa1c68-30f9-49a6-8a33-6fd6a3adcb5f None None] Validating token access rules against request {{(pid=101892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:43:51.458123 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-952983d8-9c7b-453c-baba-8e1ab8dcb60c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:43:51.458921 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952983d8-9c7b-453c-baba-8e1ab8dcb60c None admin] REQUEST_METHOD: `GET` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:43:51.459204 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952983d8-9c7b-453c-baba-8e1ab8dcb60c None admin] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:43:51.459480 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952983d8-9c7b-453c-baba-8e1ab8dcb60c None admin] PATH_INFO: `/v3/users/cinder` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:43:51.466802 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-952983d8-9c7b-453c-baba-8e1ab8dcb60c None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:43:51.468382 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-952983d8-9c7b-453c-baba-8e1ab8dcb60c None admin] RBAC: Authorization granted {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:43:51.482922 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application [None req-952983d8-9c7b-453c-baba-8e1ab8dcb60c None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. May 25 14:43:51.482922 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:43:51.482922 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 14:43:51.482922 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 14:43:51.482922 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 14:43:51.482922 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 14:43:51.482922 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 14:43:51.482922 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 14:43:51.482922 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 14:43:51.482922 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 14:43:51.482922 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 14:43:51.482922 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 14:43:51.482922 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 25 14:43:51.482922 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application return self._get_user(user_id) May 25 14:43:51.482922 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 25 14:43:51.482922 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 25 14:43:51.483968 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 14:43:51.483968 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 14:43:51.483968 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 25 14:43:51.483968 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 25 14:43:51.483968 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 25 14:43:51.483968 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 25 14:43:51.483968 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 14:43:51.483968 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 14:43:51.483968 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 14:43:51.483968 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application return self.get_or_create( May 25 14:43:51.483968 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 14:43:51.483968 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application with Lock( May 25 14:43:51.483968 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 14:43:51.483968 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application return self._enter() May 25 14:43:51.483968 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 14:43:51.483968 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 14:43:51.483968 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 14:43:51.483968 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application return self.creator() May 25 14:43:51.485548 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 14:43:51.485548 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application created_value = creator( May 25 14:43:51.485548 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 25 14:43:51.485548 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 25 14:43:51.485548 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 25 14:43:51.485548 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 25 14:43:51.485548 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 25 14:43:51.485548 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 25 14:43:51.485548 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. May 25 14:43:51.485548 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application May 25 14:43:51.485548 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 476/964] 10.222.0.84 () {56 vars in 1099 bytes} [Wed May 25 14:43:51 2022] GET /identity/v3/users/cinder => generated 84 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 25 14:43:51.490432 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-781e7ac5-fd20-44f4-97d7-7ab609735d20 None admin] Authenticating user token {{(pid=101893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:43:51.580120 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG dbcounter [-] [101893] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=101893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:43:51.598969 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-781e7ac5-fd20-44f4-97d7-7ab609735d20 None admin] Validating token access rules against request {{(pid=101893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:43:51.635024 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd75c92b-e0b9-4b6a-a5f4-6ca27f5dbff3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:43:51.635723 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd75c92b-e0b9-4b6a-a5f4-6ca27f5dbff3 None admin] REQUEST_METHOD: `GET` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:43:51.636012 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd75c92b-e0b9-4b6a-a5f4-6ca27f5dbff3 None admin] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:43:51.636292 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd75c92b-e0b9-4b6a-a5f4-6ca27f5dbff3 None admin] PATH_INFO: `/v3/users` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:43:51.637105 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd75c92b-e0b9-4b6a-a5f4-6ca27f5dbff3 None admin] RBAC: Adding query filter params (name=cinder) {{(pid=101893) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:43:51.637472 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd75c92b-e0b9-4b6a-a5f4-6ca27f5dbff3 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:43:51.639178 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd75c92b-e0b9-4b6a-a5f4-6ca27f5dbff3 None admin] RBAC: Authorization granted {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:43:51.684093 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 489/965] 10.222.0.84 () {56 vars in 1101 bytes} [Wed May 25 14:43:51 2022] GET /identity/v3/users?name=cinder => generated 354 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:43:52.161586 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e77aa75a-240d-489d-8564-b30388c615a0 None None] REQUEST_METHOD: `GET` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:43:52.162110 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e77aa75a-240d-489d-8564-b30388c615a0 None None] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:43:52.162190 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e77aa75a-240d-489d-8564-b30388c615a0 None None] PATH_INFO: `/` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:43:52.163692 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 477/966] 10.222.0.84 () {54 vars in 926 bytes} [Wed May 25 14:43:52 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 14:43:52.168885 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee6f2dc-0625-46ef-ad87-acf62786942a None None] REQUEST_METHOD: `POST` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:43:52.169314 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee6f2dc-0625-46ef-ad87-acf62786942a None None] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:43:52.169548 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee6f2dc-0625-46ef-ad87-acf62786942a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:43:52.188274 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.auth.core [None req-9ee6f2dc-0625-46ef-ad87-acf62786942a None None] MFA Rules not processed for user `05d87e87798e429aa1c10b24391f915e`. Rule list: `[]` (Enabled: `True`). {{(pid=101893) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:43:52.189843 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.fernet_utils [None req-9ee6f2dc-0625-46ef-ad87-acf62786942a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=101893) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:43:52.259339 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 490/967] 10.222.0.84 () {58 vars in 1023 bytes} [Wed May 25 14:43:52 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 25 14:43:52.281711 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e77aa75a-240d-489d-8564-b30388c615a0 None None] Authenticating user token {{(pid=101892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:43:52.293193 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG dbcounter [-] [101892] Writing DB stats keystone:SELECT=100 {{(pid=101892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:43:52.392393 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e77aa75a-240d-489d-8564-b30388c615a0 None None] Validating token access rules against request {{(pid=101892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:43:52.433559 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f55ddd09-f511-4c07-b4af-b9e11fc4ebcb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:43:52.434144 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55ddd09-f511-4c07-b4af-b9e11fc4ebcb None admin] REQUEST_METHOD: `POST` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:43:52.434425 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55ddd09-f511-4c07-b4af-b9e11fc4ebcb None admin] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:43:52.434698 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55ddd09-f511-4c07-b4af-b9e11fc4ebcb None admin] PATH_INFO: `/v3/services` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:43:52.435427 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f55ddd09-f511-4c07-b4af-b9e11fc4ebcb None admin] RBAC: Authorizing `identity:create_service()` {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:43:52.436819 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f55ddd09-f511-4c07-b4af-b9e11fc4ebcb None admin] RBAC: Authorization granted {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:43:52.533377 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 478/968] 10.222.0.84 () {60 vars in 1141 bytes} [Wed May 25 14:43:52 2022] POST /identity/v3/services => generated 242 bytes in 252 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 14:43:52.697132 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc92cb7-6e64-4d24-ba1d-029a5ec6b898 None None] REQUEST_METHOD: `GET` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:43:52.697433 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc92cb7-6e64-4d24-ba1d-029a5ec6b898 None None] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:43:52.697634 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc92cb7-6e64-4d24-ba1d-029a5ec6b898 None None] PATH_INFO: `/` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:43:52.699166 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 491/969] 10.222.0.84 () {54 vars in 926 bytes} [Wed May 25 14:43:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 14:43:52.704721 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33465c3-8217-4133-9e68-067330da4481 None None] REQUEST_METHOD: `POST` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:43:52.705014 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33465c3-8217-4133-9e68-067330da4481 None None] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:43:52.705292 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33465c3-8217-4133-9e68-067330da4481 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:43:52.723265 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.auth.core [None req-e33465c3-8217-4133-9e68-067330da4481 None None] MFA Rules not processed for user `05d87e87798e429aa1c10b24391f915e`. Rule list: `[]` (Enabled: `True`). {{(pid=101892) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:43:52.724467 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.fernet_utils [None req-e33465c3-8217-4133-9e68-067330da4481 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=101892) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:43:52.807369 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG dbcounter [-] [101892] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=101892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:43:52.819890 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 479/970] 10.222.0.84 () {58 vars in 1023 bytes} [Wed May 25 14:43:52 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 25 14:43:52.844307 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc92cb7-6e64-4d24-ba1d-029a5ec6b898 None None] Authenticating user token {{(pid=101893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:43:52.913650 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG dbcounter [-] [101893] Writing DB stats keystone:SELECT=100 {{(pid=101893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:43:52.949184 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc92cb7-6e64-4d24-ba1d-029a5ec6b898 None None] Validating token access rules against request {{(pid=101893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:43:52.983515 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbea09b7-b15b-49c8-9f93-d366c8853e5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:43:52.984355 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbea09b7-b15b-49c8-9f93-d366c8853e5a None admin] REQUEST_METHOD: `GET` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:43:52.984637 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbea09b7-b15b-49c8-9f93-d366c8853e5a None admin] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:43:52.984917 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbea09b7-b15b-49c8-9f93-d366c8853e5a None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:43:52.995859 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbea09b7-b15b-49c8-9f93-d366c8853e5a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 14:43:53.004048 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application [None req-cbea09b7-b15b-49c8-9f93-d366c8853e5a None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 25 14:43:53.004048 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:43:53.004048 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 14:43:53.004048 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 14:43:53.004048 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 14:43:53.004048 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 14:43:53.004048 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 14:43:53.004048 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 14:43:53.004048 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 14:43:53.004048 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 14:43:53.004048 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 14:43:53.004048 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 14:43:53.004048 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 14:43:53.004048 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 14:43:53.004048 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 14:43:53.004048 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 14:43:53.004978 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 14:43:53.004978 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 14:43:53.004978 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 14:43:53.004978 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 14:43:53.004978 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 14:43:53.004978 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 14:43:53.004978 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 14:43:53.004978 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 14:43:53.004978 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 14:43:53.004978 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return self.get_or_create( May 25 14:43:53.004978 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 14:43:53.004978 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application with Lock( May 25 14:43:53.004978 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 14:43:53.004978 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return self._enter() May 25 14:43:53.004978 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 14:43:53.004978 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 14:43:53.005995 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 14:43:53.005995 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return self.creator() May 25 14:43:53.005995 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 14:43:53.005995 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application created_value = creator( May 25 14:43:53.005995 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 14:43:53.005995 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 14:43:53.005995 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 14:43:53.005995 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 14:43:53.005995 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 14:43:53.005995 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 14:43:53.005995 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 25 14:43:53.005995 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application May 25 14:43:53.007654 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 492/971] 10.222.0.84 () {56 vars in 1120 bytes} [Wed May 25 14:43:52 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 14:43:53.011398 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e33465c3-8217-4133-9e68-067330da4481 None None] Authenticating user token {{(pid=101892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:43:53.113654 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e33465c3-8217-4133-9e68-067330da4481 None None] Validating token access rules against request {{(pid=101892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:43:53.152108 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee500d45-010c-416a-b708-f1bbaa9ef4dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:43:53.152971 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee500d45-010c-416a-b708-f1bbaa9ef4dc None admin] REQUEST_METHOD: `GET` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:43:53.153258 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee500d45-010c-416a-b708-f1bbaa9ef4dc None admin] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:43:53.153532 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee500d45-010c-416a-b708-f1bbaa9ef4dc None admin] PATH_INFO: `/v3/roles` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:43:53.154282 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee500d45-010c-416a-b708-f1bbaa9ef4dc None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=101892) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:43:53.154588 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee500d45-010c-416a-b708-f1bbaa9ef4dc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:43:53.155979 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee500d45-010c-416a-b708-f1bbaa9ef4dc None admin] RBAC: Authorization granted {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:43:53.169367 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 480/972] 10.222.0.84 () {56 vars in 1115 bytes} [Wed May 25 14:43:53 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:43:53.171131 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbea09b7-b15b-49c8-9f93-d366c8853e5a None admin] Authenticating user token {{(pid=101893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:43:53.272791 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbea09b7-b15b-49c8-9f93-d366c8853e5a None admin] Validating token access rules against request {{(pid=101893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:43:53.299120 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG dbcounter [-] [101893] Writing DB stats keystone:SELECT=100 {{(pid=101893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:43:53.308617 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-640c76e0-7b07-415f-9ba5-11b09601208b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:43:53.309422 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640c76e0-7b07-415f-9ba5-11b09601208b None admin] REQUEST_METHOD: `GET` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:43:53.309703 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640c76e0-7b07-415f-9ba5-11b09601208b None admin] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:43:53.309978 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640c76e0-7b07-415f-9ba5-11b09601208b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:43:53.315204 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c3a62c-4b22-4c32-b2f2-e607d70ac3c4 None None] REQUEST_METHOD: `GET` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:43:53.315499 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c3a62c-4b22-4c32-b2f2-e607d70ac3c4 None None] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:43:53.315816 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c3a62c-4b22-4c32-b2f2-e607d70ac3c4 None None] PATH_INFO: `/` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:43:53.317489 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 481/973] 10.222.0.84 () {54 vars in 926 bytes} [Wed May 25 14:43:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 14:43:53.320882 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-640c76e0-7b07-415f-9ba5-11b09601208b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:43:53.322340 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-640c76e0-7b07-415f-9ba5-11b09601208b None admin] RBAC: Authorization granted {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:43:53.322447 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b455700b-024c-49fe-8e76-64ef20dabefa None None] REQUEST_METHOD: `POST` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:43:53.322726 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b455700b-024c-49fe-8e76-64ef20dabefa None None] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:43:53.323006 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b455700b-024c-49fe-8e76-64ef20dabefa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:43:53.340670 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.auth.core [None req-b455700b-024c-49fe-8e76-64ef20dabefa None None] MFA Rules not processed for user `05d87e87798e429aa1c10b24391f915e`. Rule list: `[]` (Enabled: `True`). {{(pid=101892) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:43:53.340985 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application [None req-640c76e0-7b07-415f-9ba5-11b09601208b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 25 14:43:53.340985 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:43:53.340985 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 14:43:53.340985 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 14:43:53.340985 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 14:43:53.340985 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 14:43:53.340985 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 14:43:53.340985 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 14:43:53.340985 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 14:43:53.340985 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 14:43:53.340985 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 14:43:53.340985 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 14:43:53.340985 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 25 14:43:53.340985 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 25 14:43:53.340985 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 25 14:43:53.346895 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 25 14:43:53.346895 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 14:43:53.346895 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 14:43:53.346895 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 14:43:53.346895 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 14:43:53.346895 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 14:43:53.346895 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return self.get_or_create( May 25 14:43:53.346895 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 14:43:53.346895 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application with Lock( May 25 14:43:53.346895 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 14:43:53.346895 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return self._enter() May 25 14:43:53.346895 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 14:43:53.346895 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 14:43:53.346895 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 14:43:53.346895 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return self.creator() May 25 14:43:53.346895 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 14:43:53.346895 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application created_value = creator( May 25 14:43:53.348743 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 25 14:43:53.348743 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 25 14:43:53.348743 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 25 14:43:53.348743 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application May 25 14:43:53.348992 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.fernet_utils [None req-b455700b-024c-49fe-8e76-64ef20dabefa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=101892) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:43:53.349068 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 493/974] 10.222.0.84 () {56 vars in 1108 bytes} [Wed May 25 14:43:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 25 14:43:53.349068 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-640c76e0-7b07-415f-9ba5-11b09601208b None admin] Authenticating user token {{(pid=101893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:43:53.397072 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG dbcounter [-] [101892] Writing DB stats keystone:SELECT=100 {{(pid=101892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:43:53.416732 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 482/975] 10.222.0.84 () {58 vars in 1023 bytes} [Wed May 25 14:43:53 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 25 14:43:53.439101 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b455700b-024c-49fe-8e76-64ef20dabefa None None] Authenticating user token {{(pid=101892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:43:53.455059 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-640c76e0-7b07-415f-9ba5-11b09601208b None admin] Validating token access rules against request {{(pid=101893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:43:53.493594 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb1c484e-662f-4282-8726-4db763928820 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:43:53.494284 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb1c484e-662f-4282-8726-4db763928820 None admin] REQUEST_METHOD: `GET` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:43:53.494599 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb1c484e-662f-4282-8726-4db763928820 None admin] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:43:53.494879 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb1c484e-662f-4282-8726-4db763928820 None admin] PATH_INFO: `/v3/domains` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:43:53.495903 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb1c484e-662f-4282-8726-4db763928820 None admin] RBAC: Adding query filter params (name=Default) {{(pid=101893) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:43:53.496227 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb1c484e-662f-4282-8726-4db763928820 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:43:53.497646 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb1c484e-662f-4282-8726-4db763928820 None admin] RBAC: Authorization granted {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:43:53.510577 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 494/976] 10.222.0.84 () {56 vars in 1109 bytes} [Wed May 25 14:43:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 14:43:53.515888 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb1c484e-662f-4282-8726-4db763928820 None admin] Authenticating user token {{(pid=101893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:43:53.543611 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b455700b-024c-49fe-8e76-64ef20dabefa None None] Validating token access rules against request {{(pid=101892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:43:53.563999 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG dbcounter [-] [101893] Writing DB stats keystone:SELECT=100 {{(pid=101893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:43:53.581183 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f83c03c8-036e-4707-aa85-f9d6876c8aca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:43:53.583202 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83c03c8-036e-4707-aa85-f9d6876c8aca None admin] REQUEST_METHOD: `GET` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:43:53.583487 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83c03c8-036e-4707-aa85-f9d6876c8aca None admin] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:43:53.583809 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83c03c8-036e-4707-aa85-f9d6876c8aca None admin] PATH_INFO: `/v3/services/object-store` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:43:53.584633 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f83c03c8-036e-4707-aa85-f9d6876c8aca None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:43:53.586614 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f83c03c8-036e-4707-aa85-f9d6876c8aca None admin] RBAC: Authorization granted {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:43:53.602487 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application [None req-f83c03c8-036e-4707-aa85-f9d6876c8aca None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. May 25 14:43:53.602487 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:43:53.602487 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 25 14:43:53.602487 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 25 14:43:53.602487 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 25 14:43:53.602487 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 25 14:43:53.602487 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 25 14:43:53.602487 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 25 14:43:53.602487 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 25 14:43:53.602487 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application May 25 14:43:53.602487 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 25 14:43:53.602487 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application May 25 14:43:53.602487 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:43:53.602487 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 14:43:53.602487 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 14:43:53.602487 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 14:43:53.602487 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 14:43:53.603497 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 14:43:53.603497 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 14:43:53.603497 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 14:43:53.603497 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 14:43:53.603497 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 14:43:53.603497 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 14:43:53.603497 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 25 14:43:53.603497 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application return self._get_service(service_id) May 25 14:43:53.603497 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 25 14:43:53.603497 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 25 14:43:53.603497 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 14:43:53.603497 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 14:43:53.603497 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 14:43:53.603497 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 14:43:53.603497 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 14:43:53.603497 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application return self.get_or_create( May 25 14:43:53.604426 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 14:43:53.604426 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application with Lock( May 25 14:43:53.604426 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 14:43:53.604426 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application return self._enter() May 25 14:43:53.604426 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 14:43:53.604426 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 14:43:53.604426 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 14:43:53.604426 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application return self.creator() May 25 14:43:53.604426 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 14:43:53.604426 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application created_value = creator( May 25 14:43:53.604426 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 25 14:43:53.604426 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 25 14:43:53.604426 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 25 14:43:53.604426 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application May 25 14:43:53.605933 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 483/977] 10.222.0.84 () {56 vars in 1126 bytes} [Wed May 25 14:43:53 2022] GET /identity/v3/services/object-store => generated 93 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 14:43:53.610042 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f83c03c8-036e-4707-aa85-f9d6876c8aca None admin] Authenticating user token {{(pid=101892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:43:53.628519 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb1c484e-662f-4282-8726-4db763928820 None admin] Validating token access rules against request {{(pid=101893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:43:53.664946 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG dbcounter [-] [101892] Writing DB stats keystone:SELECT=100 {{(pid=101892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:43:53.666847 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-335169cf-ebd6-40f2-9ff5-f11092f21dbb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:43:53.667702 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335169cf-ebd6-40f2-9ff5-f11092f21dbb None admin] REQUEST_METHOD: `GET` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:43:53.667996 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335169cf-ebd6-40f2-9ff5-f11092f21dbb None admin] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:43:53.668269 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335169cf-ebd6-40f2-9ff5-f11092f21dbb None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:43:53.676038 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-335169cf-ebd6-40f2-9ff5-f11092f21dbb None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:43:53.677520 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-335169cf-ebd6-40f2-9ff5-f11092f21dbb None admin] RBAC: Authorization granted {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:43:53.693314 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application [None req-335169cf-ebd6-40f2-9ff5-f11092f21dbb None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. May 25 14:43:53.693314 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:43:53.693314 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 14:43:53.693314 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 14:43:53.693314 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 14:43:53.693314 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 14:43:53.693314 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 14:43:53.693314 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 14:43:53.693314 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 14:43:53.693314 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 14:43:53.693314 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 14:43:53.693314 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 14:43:53.693314 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 25 14:43:53.693314 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return self._get_user(user_id) May 25 14:43:53.693314 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 25 14:43:53.693314 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 25 14:43:53.694384 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 14:43:53.694384 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 14:43:53.694384 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 25 14:43:53.694384 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 25 14:43:53.694384 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 25 14:43:53.694384 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 25 14:43:53.694384 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 14:43:53.694384 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 14:43:53.694384 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 14:43:53.694384 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return self.get_or_create( May 25 14:43:53.694384 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 14:43:53.694384 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application with Lock( May 25 14:43:53.694384 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 14:43:53.694384 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return self._enter() May 25 14:43:53.694384 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 14:43:53.694384 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 14:43:53.694384 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 14:43:53.694384 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return self.creator() May 25 14:43:53.695371 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 14:43:53.695371 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application created_value = creator( May 25 14:43:53.695371 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 25 14:43:53.695371 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 25 14:43:53.695371 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 25 14:43:53.695371 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 25 14:43:53.695371 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 25 14:43:53.695371 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 25 14:43:53.695371 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. May 25 14:43:53.695371 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application May 25 14:43:53.695371 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 495/978] 10.222.0.84 () {56 vars in 1117 bytes} [Wed May 25 14:43:53 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 25 14:43:53.700324 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-335169cf-ebd6-40f2-9ff5-f11092f21dbb None admin] Authenticating user token {{(pid=101893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:43:53.721556 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f83c03c8-036e-4707-aa85-f9d6876c8aca None admin] Validating token access rules against request {{(pid=101892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:43:53.758978 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cdc8c05-3b51-449e-b705-639b9418f74f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:43:53.760122 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cdc8c05-3b51-449e-b705-639b9418f74f None admin] REQUEST_METHOD: `GET` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:43:53.760775 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cdc8c05-3b51-449e-b705-639b9418f74f None admin] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:43:53.761158 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cdc8c05-3b51-449e-b705-639b9418f74f None admin] PATH_INFO: `/v3/services` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:43:53.761878 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cdc8c05-3b51-449e-b705-639b9418f74f None admin] RBAC: Adding query filter params (name=object-store) {{(pid=101892) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:43:53.762194 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cdc8c05-3b51-449e-b705-639b9418f74f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:43:53.763703 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cdc8c05-3b51-449e-b705-639b9418f74f None admin] RBAC: Authorization granted {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:43:53.774606 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 484/979] 10.222.0.84 () {56 vars in 1122 bytes} [Wed May 25 14:43:53 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 14:43:53.775486 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cdc8c05-3b51-449e-b705-639b9418f74f None admin] Authenticating user token {{(pid=101892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:43:53.808165 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG dbcounter [-] [101893] Writing DB stats keystone:SELECT=100 {{(pid=101893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:43:53.813035 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-335169cf-ebd6-40f2-9ff5-f11092f21dbb None admin] Validating token access rules against request {{(pid=101893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:43:53.850817 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e61fbfa-5200-4053-9b01-303442de1f19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:43:53.851539 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e61fbfa-5200-4053-9b01-303442de1f19 None admin] REQUEST_METHOD: `GET` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:43:53.851850 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e61fbfa-5200-4053-9b01-303442de1f19 None admin] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:43:53.852125 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e61fbfa-5200-4053-9b01-303442de1f19 None admin] PATH_INFO: `/v3/users` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:43:53.853355 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e61fbfa-5200-4053-9b01-303442de1f19 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=101893) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:43:53.853667 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e61fbfa-5200-4053-9b01-303442de1f19 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:43:53.855450 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e61fbfa-5200-4053-9b01-303442de1f19 None admin] RBAC: Authorization granted {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:43:53.874541 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 496/980] 10.222.0.84 () {56 vars in 1149 bytes} [Wed May 25 14:43:53 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 14:43:53.877847 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cdc8c05-3b51-449e-b705-639b9418f74f None admin] Validating token access rules against request {{(pid=101892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:43:53.880502 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e61fbfa-5200-4053-9b01-303442de1f19 None admin] Authenticating user token {{(pid=101893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:43:53.893159 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG dbcounter [-] [101892] Writing DB stats keystone:SELECT=100 {{(pid=101892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:43:53.913627 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a196ae3-4e69-4c51-8778-6addae34898b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:43:53.914292 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a196ae3-4e69-4c51-8778-6addae34898b None admin] REQUEST_METHOD: `GET` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:43:53.914578 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a196ae3-4e69-4c51-8778-6addae34898b None admin] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:43:53.914855 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a196ae3-4e69-4c51-8778-6addae34898b None admin] PATH_INFO: `/v3/services` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:43:53.915573 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a196ae3-4e69-4c51-8778-6addae34898b None admin] RBAC: Adding query filter params (type=object-store) {{(pid=101892) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:43:53.915895 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a196ae3-4e69-4c51-8778-6addae34898b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:43:53.917261 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a196ae3-4e69-4c51-8778-6addae34898b None admin] RBAC: Authorization granted {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:43:53.922316 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 485/981] 10.222.0.84 () {56 vars in 1122 bytes} [Wed May 25 14:43:53 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:43:53.928680 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a196ae3-4e69-4c51-8778-6addae34898b None admin] Authenticating user token {{(pid=101892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:43:53.987878 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e61fbfa-5200-4053-9b01-303442de1f19 None admin] Validating token access rules against request {{(pid=101893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:43:54.022130 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72942908-f16c-4e5b-b97c-02561b7359f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:43:54.022774 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72942908-f16c-4e5b-b97c-02561b7359f0 None admin] REQUEST_METHOD: `GET` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:43:54.023061 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72942908-f16c-4e5b-b97c-02561b7359f0 None admin] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:43:54.023341 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72942908-f16c-4e5b-b97c-02561b7359f0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:43:54.034303 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a196ae3-4e69-4c51-8778-6addae34898b None admin] Validating token access rules against request {{(pid=101892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:43:54.047523 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG dbcounter [-] [101893] Writing DB stats keystone:SELECT=100 {{(pid=101893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:43:54.070890 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc7636d-39e6-43d7-90c0-c490655a5f0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:43:54.071799 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc7636d-39e6-43d7-90c0-c490655a5f0c None admin] REQUEST_METHOD: `GET` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:43:54.072234 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc7636d-39e6-43d7-90c0-c490655a5f0c None admin] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:43:54.072680 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc7636d-39e6-43d7-90c0-c490655a5f0c None admin] PATH_INFO: `/v3/endpoints` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:43:54.073710 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fc7636d-39e6-43d7-90c0-c490655a5f0c None admin] RBAC: Adding query filter params (interface=admin, service_id=cd77571404234703bed444853c026478, region_id=RegionOne) {{(pid=101892) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:43:54.074190 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fc7636d-39e6-43d7-90c0-c490655a5f0c None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:43:54.075758 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fc7636d-39e6-43d7-90c0-c490655a5f0c None admin] RBAC: Authorization granted {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:43:54.082573 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 486/982] 10.222.0.84 () {56 vars in 1249 bytes} [Wed May 25 14:43:53 2022] GET /identity/v3/endpoints?service_id=cd77571404234703bed444853c026478&interface=admin®ion_id=RegionOne => generated 193 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 14:43:54.088025 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc7636d-39e6-43d7-90c0-c490655a5f0c None admin] Authenticating user token {{(pid=101892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:43:54.094510 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72942908-f16c-4e5b-b97c-02561b7359f0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:43:54.096070 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72942908-f16c-4e5b-b97c-02561b7359f0 None admin] RBAC: Authorization granted {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:43:54.137910 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG dbcounter [-] [101892] Writing DB stats keystone:SELECT=100 {{(pid=101892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:43:54.196129 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc7636d-39e6-43d7-90c0-c490655a5f0c None admin] Validating token access rules against request {{(pid=101892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:43:54.209935 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 497/983] 10.222.0.84 () {58 vars in 1282 bytes} [Wed May 25 14:43:53 2022] GET /identity/v3/auth/tokens => generated 1560 bytes in 326 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) May 25 14:43:54.211123 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72942908-f16c-4e5b-b97c-02561b7359f0 None admin] Authenticating user token {{(pid=101893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:43:54.236622 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-175d3ef2-fcee-4aa6-a25b-2ebd55cacb09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:43:54.237345 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175d3ef2-fcee-4aa6-a25b-2ebd55cacb09 None admin] REQUEST_METHOD: `GET` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:43:54.237628 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175d3ef2-fcee-4aa6-a25b-2ebd55cacb09 None admin] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:43:54.237971 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175d3ef2-fcee-4aa6-a25b-2ebd55cacb09 None admin] PATH_INFO: `/v3/services` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:43:54.239171 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-175d3ef2-fcee-4aa6-a25b-2ebd55cacb09 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:43:54.240580 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-175d3ef2-fcee-4aa6-a25b-2ebd55cacb09 None admin] RBAC: Authorization granted {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:43:54.247135 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 487/984] 10.222.0.84 () {56 vars in 1087 bytes} [Wed May 25 14:43:54 2022] GET /identity/v3/services => generated 1727 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 25 14:43:54.276303 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG dbcounter [-] [101893] Writing DB stats keystone:SELECT=100 {{(pid=101893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:43:54.325389 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72942908-f16c-4e5b-b97c-02561b7359f0 None admin] Validating token access rules against request {{(pid=101893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:43:54.363970 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-462b1009-a36d-4c95-883e-796547550dc6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:43:54.364792 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462b1009-a36d-4c95-883e-796547550dc6 None admin] REQUEST_METHOD: `GET` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:43:54.365083 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462b1009-a36d-4c95-883e-796547550dc6 None admin] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:43:54.365364 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462b1009-a36d-4c95-883e-796547550dc6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:43:54.376849 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-462b1009-a36d-4c95-883e-796547550dc6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:43:54.378344 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-462b1009-a36d-4c95-883e-796547550dc6 None admin] RBAC: Authorization granted {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:43:54.400888 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application [None req-462b1009-a36d-4c95-883e-796547550dc6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 25 14:43:54.400888 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:43:54.400888 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 14:43:54.400888 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 14:43:54.400888 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 14:43:54.400888 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 14:43:54.400888 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 14:43:54.400888 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 14:43:54.400888 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 14:43:54.400888 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 14:43:54.400888 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 14:43:54.400888 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 14:43:54.400888 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 25 14:43:54.400888 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 25 14:43:54.400888 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 25 14:43:54.401895 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 25 14:43:54.401895 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 14:43:54.401895 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 14:43:54.401895 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 14:43:54.401895 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 14:43:54.401895 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 14:43:54.401895 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return self.get_or_create( May 25 14:43:54.401895 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 14:43:54.401895 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application with Lock( May 25 14:43:54.401895 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 14:43:54.401895 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return self._enter() May 25 14:43:54.401895 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 14:43:54.401895 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 14:43:54.401895 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 14:43:54.401895 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return self.creator() May 25 14:43:54.401895 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 14:43:54.401895 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application created_value = creator( May 25 14:43:54.402833 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 25 14:43:54.402833 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 25 14:43:54.402833 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 25 14:43:54.402833 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application May 25 14:43:54.407042 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 498/985] 10.222.0.84 () {56 vars in 1108 bytes} [Wed May 25 14:43:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 14:43:54.408432 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-175d3ef2-fcee-4aa6-a25b-2ebd55cacb09 None admin] Authenticating user token {{(pid=101892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:43:54.519441 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-175d3ef2-fcee-4aa6-a25b-2ebd55cacb09 None admin] Validating token access rules against request {{(pid=101892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:43:54.527051 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG dbcounter [-] [101892] Writing DB stats keystone:SELECT=100 {{(pid=101892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:43:54.559758 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e0eb2ae-dc8c-4d6f-843f-95b226fbf11e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:43:54.560436 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0eb2ae-dc8c-4d6f-843f-95b226fbf11e None admin] REQUEST_METHOD: `GET` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:43:54.561123 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0eb2ae-dc8c-4d6f-843f-95b226fbf11e None admin] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:43:54.561802 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0eb2ae-dc8c-4d6f-843f-95b226fbf11e None admin] PATH_INFO: `/v3/domains` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:43:54.563002 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e0eb2ae-dc8c-4d6f-843f-95b226fbf11e None admin] RBAC: Adding query filter params (name=Default) {{(pid=101892) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:43:54.563316 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e0eb2ae-dc8c-4d6f-843f-95b226fbf11e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:43:54.564730 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e0eb2ae-dc8c-4d6f-843f-95b226fbf11e None admin] RBAC: Authorization granted {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:43:54.577412 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 488/986] 10.222.0.84 () {56 vars in 1109 bytes} [Wed May 25 14:43:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:43:54.583187 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-462b1009-a36d-4c95-883e-796547550dc6 None admin] Authenticating user token {{(pid=101893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:43:54.689538 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-462b1009-a36d-4c95-883e-796547550dc6 None admin] Validating token access rules against request {{(pid=101893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:43:54.699061 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG dbcounter [-] [101893] Writing DB stats keystone:SELECT=100 {{(pid=101893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:43:54.724595 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b4e34a0-c8ff-44ac-b307-31b905c2d4db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:43:54.725395 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b4e34a0-c8ff-44ac-b307-31b905c2d4db None admin] REQUEST_METHOD: `GET` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:43:54.725680 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b4e34a0-c8ff-44ac-b307-31b905c2d4db None admin] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:43:54.725956 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b4e34a0-c8ff-44ac-b307-31b905c2d4db None admin] PATH_INFO: `/v3/projects/service` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:43:54.733168 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b4e34a0-c8ff-44ac-b307-31b905c2d4db None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:43:54.734624 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b4e34a0-c8ff-44ac-b307-31b905c2d4db None admin] RBAC: Authorization granted {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:43:54.748791 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application [None req-2b4e34a0-c8ff-44ac-b307-31b905c2d4db None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 25 14:43:54.748791 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:43:54.748791 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 14:43:54.748791 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 14:43:54.748791 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 14:43:54.748791 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 14:43:54.748791 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 14:43:54.748791 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 14:43:54.748791 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 14:43:54.748791 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 14:43:54.748791 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 14:43:54.748791 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 14:43:54.748791 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 25 14:43:54.748791 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return self._get_project(project_id) May 25 14:43:54.748791 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 25 14:43:54.749740 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 25 14:43:54.749740 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 14:43:54.749740 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 14:43:54.749740 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 14:43:54.749740 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 14:43:54.749740 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 14:43:54.749740 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return self.get_or_create( May 25 14:43:54.749740 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 14:43:54.749740 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application with Lock( May 25 14:43:54.749740 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 14:43:54.749740 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return self._enter() May 25 14:43:54.749740 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 14:43:54.749740 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 14:43:54.749740 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 14:43:54.749740 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return self.creator() May 25 14:43:54.749740 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 14:43:54.749740 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application created_value = creator( May 25 14:43:54.750676 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 25 14:43:54.750676 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 25 14:43:54.750676 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 25 14:43:54.750676 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 25 14:43:54.750676 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 25 14:43:54.750676 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 25 14:43:54.750676 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 25 14:43:54.750676 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application May 25 14:43:54.754798 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 499/987] 10.222.0.84 () {56 vars in 1111 bytes} [Wed May 25 14:43:54 2022] GET /identity/v3/projects/service => generated 88 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 14:43:54.755828 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e0eb2ae-dc8c-4d6f-843f-95b226fbf11e None admin] Authenticating user token {{(pid=101892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:43:54.793561 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a119d21-1a17-421f-a20b-b3081fe68bd9 None None] REQUEST_METHOD: `GET` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:43:54.793852 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a119d21-1a17-421f-a20b-b3081fe68bd9 None None] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:43:54.794133 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a119d21-1a17-421f-a20b-b3081fe68bd9 None None] PATH_INFO: `/` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:43:54.795596 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 500/988] 10.222.0.84 () {54 vars in 926 bytes} [Wed May 25 14:43:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 25 14:43:54.800538 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90b56bd-a14f-48aa-b60e-ac82042fa795 None None] REQUEST_METHOD: `POST` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:43:54.801018 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90b56bd-a14f-48aa-b60e-ac82042fa795 None None] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:43:54.801308 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90b56bd-a14f-48aa-b60e-ac82042fa795 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:43:54.817987 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.auth.core [None req-b90b56bd-a14f-48aa-b60e-ac82042fa795 None None] MFA Rules not processed for user `05d87e87798e429aa1c10b24391f915e`. Rule list: `[]` (Enabled: `True`). {{(pid=101893) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:43:54.819182 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.fernet_utils [None req-b90b56bd-a14f-48aa-b60e-ac82042fa795 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=101893) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:43:54.862580 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e0eb2ae-dc8c-4d6f-843f-95b226fbf11e None admin] Validating token access rules against request {{(pid=101892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:43:54.887491 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 501/989] 10.222.0.84 () {58 vars in 1023 bytes} [Wed May 25 14:43:54 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 25 14:43:54.896828 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26602e93-d200-42d8-84f9-e91348f5ce4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:43:54.897491 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26602e93-d200-42d8-84f9-e91348f5ce4a None admin] REQUEST_METHOD: `GET` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:43:54.897776 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26602e93-d200-42d8-84f9-e91348f5ce4a None admin] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:43:54.898055 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26602e93-d200-42d8-84f9-e91348f5ce4a None admin] PATH_INFO: `/v3/projects` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:43:54.898837 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26602e93-d200-42d8-84f9-e91348f5ce4a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=101892) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:43:54.899149 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26602e93-d200-42d8-84f9-e91348f5ce4a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:43:54.900610 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26602e93-d200-42d8-84f9-e91348f5ce4a None admin] RBAC: Authorization granted {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:43:54.911579 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b90b56bd-a14f-48aa-b60e-ac82042fa795 None None] Authenticating user token {{(pid=101893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:43:54.917401 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 489/990] 10.222.0.84 () {56 vars in 1148 bytes} [Wed May 25 14:43:54 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:43:54.919110 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26602e93-d200-42d8-84f9-e91348f5ce4a None admin] Authenticating user token {{(pid=101892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:43:54.949932 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG dbcounter [-] [101892] Writing DB stats keystone:SELECT=100 {{(pid=101892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:43:55.014860 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG dbcounter [-] [101893] Writing DB stats keystone:SELECT=100 {{(pid=101893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:43:55.019025 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b90b56bd-a14f-48aa-b60e-ac82042fa795 None None] Validating token access rules against request {{(pid=101893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:43:55.028266 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26602e93-d200-42d8-84f9-e91348f5ce4a None admin] Validating token access rules against request {{(pid=101892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:43:55.054354 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d9c44c9-a61e-43c2-865e-f2e12da7dc35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:43:55.055159 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9c44c9-a61e-43c2-865e-f2e12da7dc35 None admin] REQUEST_METHOD: `GET` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:43:55.055442 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9c44c9-a61e-43c2-865e-f2e12da7dc35 None admin] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:43:55.055758 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9c44c9-a61e-43c2-865e-f2e12da7dc35 None admin] PATH_INFO: `/v3/services/compute` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:43:55.056408 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d9c44c9-a61e-43c2-865e-f2e12da7dc35 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:43:55.057788 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d9c44c9-a61e-43c2-865e-f2e12da7dc35 None admin] RBAC: Authorization granted {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:43:55.064020 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-571500b9-9844-404b-ab8c-f378d6658557 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:43:55.064672 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-571500b9-9844-404b-ab8c-f378d6658557 None admin] REQUEST_METHOD: `GET` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:43:55.064955 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-571500b9-9844-404b-ab8c-f378d6658557 None admin] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:43:55.065233 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-571500b9-9844-404b-ab8c-f378d6658557 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:43:55.066605 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-571500b9-9844-404b-ab8c-f378d6658557 None admin] RBAC: Adding query filter params (role.id=e36bc54201ab4defa2b100771ec121a4, scope.project.id=a000829c658c4a7cab67f7b6353ba3fa, user.id=049a7ab3f95f460e908f79cc321176fd) {{(pid=101892) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:43:55.066921 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-571500b9-9844-404b-ab8c-f378d6658557 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:43:55.068351 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-571500b9-9844-404b-ab8c-f378d6658557 None admin] RBAC: Authorization granted {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:43:55.070375 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application [None req-4d9c44c9-a61e-43c2-865e-f2e12da7dc35 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. May 25 14:43:55.070375 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:43:55.070375 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 25 14:43:55.070375 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 25 14:43:55.070375 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 25 14:43:55.070375 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 25 14:43:55.070375 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 25 14:43:55.070375 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 25 14:43:55.070375 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. May 25 14:43:55.070375 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application May 25 14:43:55.070375 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 25 14:43:55.070375 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application May 25 14:43:55.070375 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:43:55.070375 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 14:43:55.070375 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 14:43:55.070375 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 14:43:55.070375 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 14:43:55.071419 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 14:43:55.071419 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 14:43:55.071419 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 14:43:55.071419 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 14:43:55.071419 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 14:43:55.071419 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 14:43:55.071419 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 25 14:43:55.071419 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return self._get_service(service_id) May 25 14:43:55.071419 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 25 14:43:55.071419 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 25 14:43:55.071419 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 14:43:55.071419 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 14:43:55.071419 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 14:43:55.071419 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 14:43:55.071419 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 14:43:55.071419 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return self.get_or_create( May 25 14:43:55.072318 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 14:43:55.072318 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application with Lock( May 25 14:43:55.072318 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 14:43:55.072318 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return self._enter() May 25 14:43:55.072318 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 14:43:55.072318 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 14:43:55.072318 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 14:43:55.072318 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return self.creator() May 25 14:43:55.072318 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 14:43:55.072318 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application created_value = creator( May 25 14:43:55.072318 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 25 14:43:55.072318 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 25 14:43:55.072318 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. May 25 14:43:55.072318 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application May 25 14:43:55.072318 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 502/991] 10.222.0.84 () {56 vars in 1111 bytes} [Wed May 25 14:43:54 2022] GET /identity/v3/services/compute => generated 88 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 25 14:43:55.077476 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 490/992] 10.222.0.84 () {56 vars in 1374 bytes} [Wed May 25 14:43:54 2022] GET /identity/v3/role_assignments?user.id=049a7ab3f95f460e908f79cc321176fd&scope.project.id=a000829c658c4a7cab67f7b6353ba3fa&role.id=e36bc54201ab4defa2b100771ec121a4 => generated 608 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 14:43:55.077614 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d9c44c9-a61e-43c2-865e-f2e12da7dc35 None admin] Authenticating user token {{(pid=101893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:43:55.186293 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d9c44c9-a61e-43c2-865e-f2e12da7dc35 None admin] Validating token access rules against request {{(pid=101893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:43:55.222931 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-964ad0a6-51b4-4294-b90c-6cf932f4e3a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:43:55.223779 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964ad0a6-51b4-4294-b90c-6cf932f4e3a8 None admin] REQUEST_METHOD: `GET` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:43:55.223960 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964ad0a6-51b4-4294-b90c-6cf932f4e3a8 None admin] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:43:55.224193 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964ad0a6-51b4-4294-b90c-6cf932f4e3a8 None admin] PATH_INFO: `/v3/services` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:43:55.224925 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-964ad0a6-51b4-4294-b90c-6cf932f4e3a8 None admin] RBAC: Adding query filter params (name=compute) {{(pid=101893) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:43:55.225241 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-964ad0a6-51b4-4294-b90c-6cf932f4e3a8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:43:55.226659 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-964ad0a6-51b4-4294-b90c-6cf932f4e3a8 None admin] RBAC: Authorization granted {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:43:55.232522 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 503/993] 10.222.0.84 () {56 vars in 1112 bytes} [Wed May 25 14:43:55 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 14:43:55.238141 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-571500b9-9844-404b-ab8c-f378d6658557 None admin] Authenticating user token {{(pid=101892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:43:55.338402 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG dbcounter [-] [101892] Writing DB stats keystone:SELECT=100 {{(pid=101892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:43:55.347711 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-571500b9-9844-404b-ab8c-f378d6658557 None admin] Validating token access rules against request {{(pid=101892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:43:55.385640 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f10ed64-73d7-4d89-a3d2-b62907407f0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:43:55.386315 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f10ed64-73d7-4d89-a3d2-b62907407f0e None admin] REQUEST_METHOD: `GET` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:43:55.386600 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f10ed64-73d7-4d89-a3d2-b62907407f0e None admin] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:43:55.386881 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f10ed64-73d7-4d89-a3d2-b62907407f0e None admin] PATH_INFO: `/v3/services` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:43:55.387607 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f10ed64-73d7-4d89-a3d2-b62907407f0e None admin] RBAC: Adding query filter params (type=compute) {{(pid=101892) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:43:55.387921 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f10ed64-73d7-4d89-a3d2-b62907407f0e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:43:55.389279 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f10ed64-73d7-4d89-a3d2-b62907407f0e None admin] RBAC: Authorization granted {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:43:55.398934 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 491/994] 10.222.0.84 () {56 vars in 1112 bytes} [Wed May 25 14:43:55 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:43:55.401930 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-964ad0a6-51b4-4294-b90c-6cf932f4e3a8 None admin] Authenticating user token {{(pid=101893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:43:55.438936 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG dbcounter [-] [101893] Writing DB stats keystone:SELECT=100 {{(pid=101893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:43:55.514818 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-964ad0a6-51b4-4294-b90c-6cf932f4e3a8 None admin] Validating token access rules against request {{(pid=101893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:43:55.551356 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b880d9a-d4ea-4a19-98f7-510762f1c53c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:43:55.551356 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b880d9a-d4ea-4a19-98f7-510762f1c53c None admin] REQUEST_METHOD: `GET` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:43:55.551356 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b880d9a-d4ea-4a19-98f7-510762f1c53c None admin] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:43:55.551356 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b880d9a-d4ea-4a19-98f7-510762f1c53c None admin] PATH_INFO: `/v3/endpoints` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:43:55.551961 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b880d9a-d4ea-4a19-98f7-510762f1c53c None admin] RBAC: Adding query filter params (interface=public, service_id=8f0afab2b2fb4df8b5a73db6462fc3e8, region_id=RegionOne) {{(pid=101893) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:43:55.551961 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b880d9a-d4ea-4a19-98f7-510762f1c53c None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:43:55.553457 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b880d9a-d4ea-4a19-98f7-510762f1c53c None admin] RBAC: Authorization granted {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:43:55.558542 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 504/995] 10.222.0.84 () {56 vars in 1251 bytes} [Wed May 25 14:43:55 2022] GET /identity/v3/endpoints?service_id=8f0afab2b2fb4df8b5a73db6462fc3e8&interface=public®ion_id=RegionOne => generated 194 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 14:43:55.565440 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f10ed64-73d7-4d89-a3d2-b62907407f0e None admin] Authenticating user token {{(pid=101892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:43:55.668472 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f10ed64-73d7-4d89-a3d2-b62907407f0e None admin] Validating token access rules against request {{(pid=101892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:43:55.708232 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aef1007-946e-4f8a-b6bc-9c22edf5a07d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:43:55.708814 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aef1007-946e-4f8a-b6bc-9c22edf5a07d None admin] REQUEST_METHOD: `GET` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:43:55.709096 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aef1007-946e-4f8a-b6bc-9c22edf5a07d None admin] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:43:55.709371 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aef1007-946e-4f8a-b6bc-9c22edf5a07d None admin] PATH_INFO: `/v3/services` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:43:55.710050 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aef1007-946e-4f8a-b6bc-9c22edf5a07d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:43:55.711410 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aef1007-946e-4f8a-b6bc-9c22edf5a07d None admin] RBAC: Authorization granted {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:43:55.723766 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 492/996] 10.222.0.84 () {56 vars in 1087 bytes} [Wed May 25 14:43:55 2022] GET /identity/v3/services => generated 1727 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 14:43:56.482854 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe4052f4-c79f-4d94-be17-d52e6fc4c83e None None] REQUEST_METHOD: `GET` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:43:56.483413 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe4052f4-c79f-4d94-be17-d52e6fc4c83e None None] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:43:56.483413 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe4052f4-c79f-4d94-be17-d52e6fc4c83e None None] PATH_INFO: `/` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:43:56.484791 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 505/997] 10.222.0.84 () {54 vars in 926 bytes} [Wed May 25 14:43:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 14:43:56.490247 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c7e5c2-99fc-4a7d-9597-1243bd63c6f5 None None] REQUEST_METHOD: `POST` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:43:56.490657 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c7e5c2-99fc-4a7d-9597-1243bd63c6f5 None None] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:43:56.490831 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c7e5c2-99fc-4a7d-9597-1243bd63c6f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:43:56.508108 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.auth.core [None req-22c7e5c2-99fc-4a7d-9597-1243bd63c6f5 None None] MFA Rules not processed for user `05d87e87798e429aa1c10b24391f915e`. Rule list: `[]` (Enabled: `True`). {{(pid=101892) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:43:56.509279 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.fernet_utils [None req-22c7e5c2-99fc-4a7d-9597-1243bd63c6f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=101892) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:43:56.522797 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG dbcounter [-] [101892] Writing DB stats keystone:SELECT=100 {{(pid=101892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:43:56.579617 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 493/998] 10.222.0.84 () {58 vars in 1023 bytes} [Wed May 25 14:43:56 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 25 14:43:56.601373 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe4052f4-c79f-4d94-be17-d52e6fc4c83e None None] Authenticating user token {{(pid=101893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:43:56.695246 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG dbcounter [-] [101893] Writing DB stats keystone:SELECT=100 {{(pid=101893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:43:56.706164 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe4052f4-c79f-4d94-be17-d52e6fc4c83e None None] Validating token access rules against request {{(pid=101893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:43:56.740926 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-462f9807-a3a9-4e76-8e38-d4c4ec034633 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:43:56.741648 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462f9807-a3a9-4e76-8e38-d4c4ec034633 None admin] REQUEST_METHOD: `GET` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:43:56.741930 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462f9807-a3a9-4e76-8e38-d4c4ec034633 None admin] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:43:56.742203 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462f9807-a3a9-4e76-8e38-d4c4ec034633 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:43:56.742838 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-462f9807-a3a9-4e76-8e38-d4c4ec034633 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:43:56.744230 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-462f9807-a3a9-4e76-8e38-d4c4ec034633 None admin] RBAC: Authorization granted {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:43:56.756997 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application [None req-462f9807-a3a9-4e76-8e38-d4c4ec034633 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. May 25 14:43:56.756997 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:43:56.756997 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 25 14:43:56.756997 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 25 14:43:56.756997 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 25 14:43:56.756997 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 25 14:43:56.756997 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 25 14:43:56.756997 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 25 14:43:56.756997 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 25 14:43:56.756997 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application May 25 14:43:56.756997 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 25 14:43:56.756997 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application May 25 14:43:56.756997 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:43:56.756997 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 14:43:56.756997 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 14:43:56.756997 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 14:43:56.756997 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 14:43:56.758008 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 14:43:56.758008 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 14:43:56.758008 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 14:43:56.758008 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 14:43:56.758008 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 14:43:56.758008 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 14:43:56.758008 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 25 14:43:56.758008 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return self._get_service(service_id) May 25 14:43:56.758008 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 25 14:43:56.758008 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 25 14:43:56.758008 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 14:43:56.758008 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 14:43:56.758008 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 14:43:56.758008 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 14:43:56.758008 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 14:43:56.758008 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return self.get_or_create( May 25 14:43:56.758874 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 14:43:56.758874 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application with Lock( May 25 14:43:56.758874 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 14:43:56.758874 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return self._enter() May 25 14:43:56.758874 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 14:43:56.758874 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 14:43:56.758874 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 14:43:56.758874 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return self.creator() May 25 14:43:56.758874 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 14:43:56.758874 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application created_value = creator( May 25 14:43:56.758874 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 25 14:43:56.758874 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 25 14:43:56.758874 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 25 14:43:56.758874 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application May 25 14:43:56.763196 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 506/999] 10.222.0.84 () {56 vars in 1126 bytes} [Wed May 25 14:43:56 2022] GET /identity/v3/services/object-store => generated 93 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 14:43:56.764391 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c7e5c2-99fc-4a7d-9597-1243bd63c6f5 None None] Authenticating user token {{(pid=101892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:43:56.870846 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c7e5c2-99fc-4a7d-9597-1243bd63c6f5 None None] Validating token access rules against request {{(pid=101892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:43:56.906152 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb0e1ab4-7f60-4a37-8580-bd0f7735aa9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:43:56.906822 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0e1ab4-7f60-4a37-8580-bd0f7735aa9b None admin] REQUEST_METHOD: `GET` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:43:56.907105 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0e1ab4-7f60-4a37-8580-bd0f7735aa9b None admin] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:43:56.907378 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0e1ab4-7f60-4a37-8580-bd0f7735aa9b None admin] PATH_INFO: `/v3/services` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:43:56.908109 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb0e1ab4-7f60-4a37-8580-bd0f7735aa9b None admin] RBAC: Adding query filter params (name=object-store) {{(pid=101892) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:43:56.908419 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb0e1ab4-7f60-4a37-8580-bd0f7735aa9b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:43:56.909837 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb0e1ab4-7f60-4a37-8580-bd0f7735aa9b None admin] RBAC: Authorization granted {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:43:56.920203 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 494/1000] 10.222.0.84 () {56 vars in 1122 bytes} [Wed May 25 14:43:56 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:43:56.921115 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-462f9807-a3a9-4e76-8e38-d4c4ec034633 None admin] Authenticating user token {{(pid=101893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:43:57.025002 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-462f9807-a3a9-4e76-8e38-d4c4ec034633 None admin] Validating token access rules against request {{(pid=101893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:43:57.058014 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3e1836e-000b-4d31-a0f5-83bb551078f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:43:57.058676 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e1836e-000b-4d31-a0f5-83bb551078f4 None admin] REQUEST_METHOD: `GET` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:43:57.058961 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e1836e-000b-4d31-a0f5-83bb551078f4 None admin] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:43:57.059238 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e1836e-000b-4d31-a0f5-83bb551078f4 None admin] PATH_INFO: `/v3/services` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:43:57.060032 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3e1836e-000b-4d31-a0f5-83bb551078f4 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=101893) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:43:57.060343 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3e1836e-000b-4d31-a0f5-83bb551078f4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:43:57.061761 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3e1836e-000b-4d31-a0f5-83bb551078f4 None admin] RBAC: Authorization granted {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:43:57.067371 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 507/1001] 10.222.0.84 () {56 vars in 1122 bytes} [Wed May 25 14:43:56 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 14:43:57.072996 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb0e1ab4-7f60-4a37-8580-bd0f7735aa9b None admin] Authenticating user token {{(pid=101892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:43:57.087934 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG dbcounter [-] [101892] Writing DB stats keystone:SELECT=100 {{(pid=101892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:43:57.175073 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb0e1ab4-7f60-4a37-8580-bd0f7735aa9b None admin] Validating token access rules against request {{(pid=101892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:43:57.212602 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9b397d9-d8c5-486f-9b94-ffaa4c3a5642 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:43:57.213263 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b397d9-d8c5-486f-9b94-ffaa4c3a5642 None admin] REQUEST_METHOD: `POST` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:43:57.213546 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b397d9-d8c5-486f-9b94-ffaa4c3a5642 None admin] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:43:57.213823 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b397d9-d8c5-486f-9b94-ffaa4c3a5642 None admin] PATH_INFO: `/v3/endpoints` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:43:57.214565 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9b397d9-d8c5-486f-9b94-ffaa4c3a5642 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:43:57.216035 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9b397d9-d8c5-486f-9b94-ffaa4c3a5642 None admin] RBAC: Authorization granted {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:43:57.286715 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 495/1002] 10.222.0.84 () {60 vars in 1144 bytes} [Wed May 25 14:43:57 2022] POST /identity/v3/endpoints => generated 325 bytes in 214 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 25 14:43:57.358712 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08cdf05f-cd66-4655-95c7-ee4c0f0d5f1a None None] REQUEST_METHOD: `GET` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:43:57.359052 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08cdf05f-cd66-4655-95c7-ee4c0f0d5f1a None None] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:43:57.359283 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08cdf05f-cd66-4655-95c7-ee4c0f0d5f1a None None] PATH_INFO: `/` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:43:57.360859 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 508/1003] 10.222.0.84 () {54 vars in 926 bytes} [Wed May 25 14:43:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 14:43:57.366978 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3469a5-7dc2-4bd8-982c-5c2c04f56c24 None None] REQUEST_METHOD: `POST` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:43:57.367268 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3469a5-7dc2-4bd8-982c-5c2c04f56c24 None None] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:43:57.367548 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3469a5-7dc2-4bd8-982c-5c2c04f56c24 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:43:57.385507 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.auth.core [None req-4c3469a5-7dc2-4bd8-982c-5c2c04f56c24 None None] MFA Rules not processed for user `05d87e87798e429aa1c10b24391f915e`. Rule list: `[]` (Enabled: `True`). {{(pid=101892) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:43:57.386734 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.fernet_utils [None req-4c3469a5-7dc2-4bd8-982c-5c2c04f56c24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=101892) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:43:57.463421 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG dbcounter [-] [101892] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=101892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:43:57.470485 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 496/1004] 10.222.0.84 () {58 vars in 1023 bytes} [Wed May 25 14:43:57 2022] POST /identity/v3/auth/tokens => generated 1707 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 25 14:43:57.493301 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08cdf05f-cd66-4655-95c7-ee4c0f0d5f1a None None] Authenticating user token {{(pid=101893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:43:57.519691 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG dbcounter [-] [101893] Writing DB stats keystone:SELECT=100 {{(pid=101893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:43:57.609419 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08cdf05f-cd66-4655-95c7-ee4c0f0d5f1a None None] Validating token access rules against request {{(pid=101893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:43:57.643750 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddf855e1-e182-4974-8738-ea0f35061ad4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:43:57.645319 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf855e1-e182-4974-8738-ea0f35061ad4 None admin] REQUEST_METHOD: `GET` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:43:57.645902 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf855e1-e182-4974-8738-ea0f35061ad4 None admin] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:43:57.646354 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf855e1-e182-4974-8738-ea0f35061ad4 None admin] PATH_INFO: `/v3/services/image` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:43:57.647198 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddf855e1-e182-4974-8738-ea0f35061ad4 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:43:57.648760 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddf855e1-e182-4974-8738-ea0f35061ad4 None admin] RBAC: Authorization granted {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:43:57.661067 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application [None req-ddf855e1-e182-4974-8738-ea0f35061ad4 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. May 25 14:43:57.661067 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:43:57.661067 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 25 14:43:57.661067 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 25 14:43:57.661067 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 25 14:43:57.661067 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 25 14:43:57.661067 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 25 14:43:57.661067 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 25 14:43:57.661067 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. May 25 14:43:57.661067 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application May 25 14:43:57.661067 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 25 14:43:57.661067 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application May 25 14:43:57.661067 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:43:57.661067 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 14:43:57.661067 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 14:43:57.661067 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 14:43:57.661067 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 14:43:57.662255 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 14:43:57.662255 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 14:43:57.662255 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 14:43:57.662255 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 14:43:57.662255 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 14:43:57.662255 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 14:43:57.662255 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 25 14:43:57.662255 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return self._get_service(service_id) May 25 14:43:57.662255 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 25 14:43:57.662255 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 25 14:43:57.662255 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 14:43:57.662255 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 14:43:57.662255 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 14:43:57.662255 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 14:43:57.662255 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 14:43:57.662255 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return self.get_or_create( May 25 14:43:57.663133 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 14:43:57.663133 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application with Lock( May 25 14:43:57.663133 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 14:43:57.663133 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return self._enter() May 25 14:43:57.663133 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 14:43:57.663133 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 14:43:57.663133 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 14:43:57.663133 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return self.creator() May 25 14:43:57.663133 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 14:43:57.663133 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application created_value = creator( May 25 14:43:57.663133 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 25 14:43:57.663133 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 25 14:43:57.663133 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. May 25 14:43:57.663133 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application May 25 14:43:57.665084 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 509/1005] 10.222.0.84 () {56 vars in 1105 bytes} [Wed May 25 14:43:57 2022] GET /identity/v3/services/image => generated 86 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 14:43:57.670853 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c3469a5-7dc2-4bd8-982c-5c2c04f56c24 None None] Authenticating user token {{(pid=101892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:43:57.779478 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c3469a5-7dc2-4bd8-982c-5c2c04f56c24 None None] Validating token access rules against request {{(pid=101892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:43:57.817987 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46bb4d33-54b8-4f02-9d2e-9c8168de3038 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:43:57.818583 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46bb4d33-54b8-4f02-9d2e-9c8168de3038 None admin] REQUEST_METHOD: `GET` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:43:57.818867 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46bb4d33-54b8-4f02-9d2e-9c8168de3038 None admin] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:43:57.819145 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46bb4d33-54b8-4f02-9d2e-9c8168de3038 None admin] PATH_INFO: `/v3/services` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:43:57.819885 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46bb4d33-54b8-4f02-9d2e-9c8168de3038 None admin] RBAC: Adding query filter params (name=image) {{(pid=101892) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:43:57.820194 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46bb4d33-54b8-4f02-9d2e-9c8168de3038 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:43:57.821561 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46bb4d33-54b8-4f02-9d2e-9c8168de3038 None admin] RBAC: Authorization granted {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:43:57.826805 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 497/1006] 10.222.0.84 () {56 vars in 1108 bytes} [Wed May 25 14:43:57 2022] GET /identity/v3/services?name=image => generated 122 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:43:57.832750 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddf855e1-e182-4974-8738-ea0f35061ad4 None admin] Authenticating user token {{(pid=101893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:43:57.918150 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG dbcounter [-] [101893] Writing DB stats keystone:SELECT=100 {{(pid=101893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:43:57.936045 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddf855e1-e182-4974-8738-ea0f35061ad4 None admin] Validating token access rules against request {{(pid=101893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:43:57.958570 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1540bf-b079-4dcd-87d7-8804677df82d None None] REQUEST_METHOD: `GET` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:43:57.958913 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1540bf-b079-4dcd-87d7-8804677df82d None None] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:43:57.959198 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1540bf-b079-4dcd-87d7-8804677df82d None None] PATH_INFO: `/` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:43:57.960571 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 498/1007] 10.222.0.84 () {54 vars in 926 bytes} [Wed May 25 14:43:57 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 25 14:43:57.965366 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05e78d7-85ef-457b-8a27-4e259998afec None None] REQUEST_METHOD: `POST` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:43:57.965654 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05e78d7-85ef-457b-8a27-4e259998afec None None] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:43:57.965934 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05e78d7-85ef-457b-8a27-4e259998afec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:43:57.972767 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ba4099-9385-4488-ad19-d0f40e89a174 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:43:57.973639 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ba4099-9385-4488-ad19-d0f40e89a174 None admin] REQUEST_METHOD: `GET` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:43:57.974076 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ba4099-9385-4488-ad19-d0f40e89a174 None admin] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:43:57.974524 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ba4099-9385-4488-ad19-d0f40e89a174 None admin] PATH_INFO: `/v3/services` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:43:57.975383 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6ba4099-9385-4488-ad19-d0f40e89a174 None admin] RBAC: Adding query filter params (type=image) {{(pid=101893) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:43:57.975882 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6ba4099-9385-4488-ad19-d0f40e89a174 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:43:57.977847 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6ba4099-9385-4488-ad19-d0f40e89a174 None admin] RBAC: Authorization granted {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:43:57.982214 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.auth.core [None req-b05e78d7-85ef-457b-8a27-4e259998afec None None] MFA Rules not processed for user `05d87e87798e429aa1c10b24391f915e`. Rule list: `[]` (Enabled: `True`). {{(pid=101892) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:43:57.983594 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.fernet_utils [None req-b05e78d7-85ef-457b-8a27-4e259998afec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=101892) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:43:57.987944 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 510/1008] 10.222.0.84 () {56 vars in 1108 bytes} [Wed May 25 14:43:57 2022] GET /identity/v3/services?type=image => generated 122 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:43:58.047030 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG dbcounter [-] [101892] Writing DB stats keystone:SELECT=100 {{(pid=101892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:43:58.059000 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 499/1009] 10.222.0.84 () {58 vars in 1023 bytes} [Wed May 25 14:43:57 2022] POST /identity/v3/auth/tokens => generated 1707 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 25 14:43:58.083047 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ba4099-9385-4488-ad19-d0f40e89a174 None admin] Authenticating user token {{(pid=101893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:43:58.192510 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ba4099-9385-4488-ad19-d0f40e89a174 None admin] Validating token access rules against request {{(pid=101893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:43:58.226666 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6369bae3-fa00-4d6f-9c91-274db8d2273a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:43:58.227462 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6369bae3-fa00-4d6f-9c91-274db8d2273a None admin] REQUEST_METHOD: `GET` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:43:58.227778 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6369bae3-fa00-4d6f-9c91-274db8d2273a None admin] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:43:58.228057 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6369bae3-fa00-4d6f-9c91-274db8d2273a None admin] PATH_INFO: `/v3/services/compute` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:43:58.228707 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6369bae3-fa00-4d6f-9c91-274db8d2273a None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:43:58.230076 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6369bae3-fa00-4d6f-9c91-274db8d2273a None admin] RBAC: Authorization granted {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:43:58.241812 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application [None req-6369bae3-fa00-4d6f-9c91-274db8d2273a None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. May 25 14:43:58.241812 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:43:58.241812 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 25 14:43:58.241812 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 25 14:43:58.241812 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 25 14:43:58.241812 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 25 14:43:58.241812 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 25 14:43:58.241812 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 25 14:43:58.241812 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. May 25 14:43:58.241812 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application May 25 14:43:58.241812 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 25 14:43:58.241812 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application May 25 14:43:58.241812 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:43:58.241812 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 14:43:58.241812 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 14:43:58.241812 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 14:43:58.241812 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 14:43:58.244758 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 14:43:58.244758 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 14:43:58.244758 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 14:43:58.244758 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 14:43:58.244758 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 14:43:58.244758 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 14:43:58.244758 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 25 14:43:58.244758 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return self._get_service(service_id) May 25 14:43:58.244758 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 25 14:43:58.244758 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 25 14:43:58.244758 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 14:43:58.244758 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 14:43:58.244758 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 14:43:58.244758 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 14:43:58.244758 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 14:43:58.244758 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return self.get_or_create( May 25 14:43:58.245879 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 14:43:58.245879 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application with Lock( May 25 14:43:58.245879 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 14:43:58.245879 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return self._enter() May 25 14:43:58.245879 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 14:43:58.245879 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 14:43:58.245879 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 14:43:58.245879 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return self.creator() May 25 14:43:58.245879 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 14:43:58.245879 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application created_value = creator( May 25 14:43:58.245879 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 25 14:43:58.245879 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 25 14:43:58.245879 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. May 25 14:43:58.245879 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application May 25 14:43:58.245879 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 511/1010] 10.222.0.84 () {56 vars in 1111 bytes} [Wed May 25 14:43:58 2022] GET /identity/v3/services/compute => generated 88 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 14:43:58.249250 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b05e78d7-85ef-457b-8a27-4e259998afec None None] Authenticating user token {{(pid=101892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:43:58.349937 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b05e78d7-85ef-457b-8a27-4e259998afec None None] Validating token access rules against request {{(pid=101892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:43:58.384814 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be2974ba-33aa-4045-871b-fdb0e3c48062 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:43:58.385476 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2974ba-33aa-4045-871b-fdb0e3c48062 None admin] REQUEST_METHOD: `GET` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:43:58.385754 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2974ba-33aa-4045-871b-fdb0e3c48062 None admin] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:43:58.386024 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2974ba-33aa-4045-871b-fdb0e3c48062 None admin] PATH_INFO: `/v3/services` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:43:58.386723 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be2974ba-33aa-4045-871b-fdb0e3c48062 None admin] RBAC: Adding query filter params (name=compute) {{(pid=101892) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:43:58.387022 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be2974ba-33aa-4045-871b-fdb0e3c48062 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:43:58.388400 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be2974ba-33aa-4045-871b-fdb0e3c48062 None admin] RBAC: Authorization granted {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:43:58.398056 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 500/1011] 10.222.0.84 () {56 vars in 1112 bytes} [Wed May 25 14:43:58 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 14:43:58.399152 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6369bae3-fa00-4d6f-9c91-274db8d2273a None admin] Authenticating user token {{(pid=101893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:43:58.413078 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG dbcounter [-] [101893] Writing DB stats keystone:SELECT=100 {{(pid=101893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:43:58.513394 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6369bae3-fa00-4d6f-9c91-274db8d2273a None admin] Validating token access rules against request {{(pid=101893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:43:58.546375 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7a2b0cb-c550-4103-be4b-2e3bd78ac98d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:43:58.547038 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a2b0cb-c550-4103-be4b-2e3bd78ac98d None admin] REQUEST_METHOD: `GET` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:43:58.547319 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a2b0cb-c550-4103-be4b-2e3bd78ac98d None admin] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:43:58.551391 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a2b0cb-c550-4103-be4b-2e3bd78ac98d None admin] PATH_INFO: `/v3/services` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:43:58.551391 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7a2b0cb-c550-4103-be4b-2e3bd78ac98d None admin] RBAC: Adding query filter params (type=compute) {{(pid=101893) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:43:58.551391 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7a2b0cb-c550-4103-be4b-2e3bd78ac98d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:43:58.551391 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7a2b0cb-c550-4103-be4b-2e3bd78ac98d None admin] RBAC: Authorization granted {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:43:58.559907 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 512/1012] 10.222.0.84 () {56 vars in 1112 bytes} [Wed May 25 14:43:58 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:43:58.565484 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be2974ba-33aa-4045-871b-fdb0e3c48062 None admin] Authenticating user token {{(pid=101892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:43:58.623357 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG dbcounter [-] [101892] Writing DB stats keystone:SELECT=100 {{(pid=101892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:43:58.665556 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be2974ba-33aa-4045-871b-fdb0e3c48062 None admin] Validating token access rules against request {{(pid=101892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:43:58.701004 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-850fdcb2-f21d-4d7d-b3c2-356516412fa2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:43:58.701640 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850fdcb2-f21d-4d7d-b3c2-356516412fa2 None admin] REQUEST_METHOD: `POST` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:43:58.701930 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850fdcb2-f21d-4d7d-b3c2-356516412fa2 None admin] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:43:58.702208 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850fdcb2-f21d-4d7d-b3c2-356516412fa2 None admin] PATH_INFO: `/v3/endpoints` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:43:58.702943 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-850fdcb2-f21d-4d7d-b3c2-356516412fa2 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:43:58.704341 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-850fdcb2-f21d-4d7d-b3c2-356516412fa2 None admin] RBAC: Authorization granted {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:43:58.795542 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 501/1013] 10.222.0.84 () {60 vars in 1144 bytes} [Wed May 25 14:43:58 2022] POST /identity/v3/endpoints => generated 334 bytes in 230 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 25 14:43:59.554735 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb9dec9-8a03-4182-9a23-d73cbfb213cb None None] REQUEST_METHOD: `GET` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:43:59.555251 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb9dec9-8a03-4182-9a23-d73cbfb213cb None None] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:43:59.555330 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb9dec9-8a03-4182-9a23-d73cbfb213cb None None] PATH_INFO: `/` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:43:59.556969 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 513/1014] 10.222.0.84 () {54 vars in 926 bytes} [Wed May 25 14:43:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 14:43:59.562555 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e52ad2-cf7e-4974-ad29-a379a56cd0f6 None None] REQUEST_METHOD: `POST` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:43:59.562849 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e52ad2-cf7e-4974-ad29-a379a56cd0f6 None None] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:43:59.563128 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e52ad2-cf7e-4974-ad29-a379a56cd0f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:43:59.580249 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.auth.core [None req-47e52ad2-cf7e-4974-ad29-a379a56cd0f6 None None] MFA Rules not processed for user `05d87e87798e429aa1c10b24391f915e`. Rule list: `[]` (Enabled: `True`). {{(pid=101892) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:43:59.582062 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.fernet_utils [None req-47e52ad2-cf7e-4974-ad29-a379a56cd0f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=101892) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:43:59.657416 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 502/1015] 10.222.0.84 () {58 vars in 1023 bytes} [Wed May 25 14:43:59 2022] POST /identity/v3/auth/tokens => generated 1863 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 25 14:43:59.680578 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eb9dec9-8a03-4182-9a23-d73cbfb213cb None None] Authenticating user token {{(pid=101893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:43:59.757171 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG dbcounter [-] [101893] Writing DB stats keystone:SELECT=100 {{(pid=101893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:43:59.782414 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eb9dec9-8a03-4182-9a23-d73cbfb213cb None None] Validating token access rules against request {{(pid=101893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:43:59.816689 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a6f8266-2278-45ea-8dac-319d1a81a1e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:43:59.817415 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6f8266-2278-45ea-8dac-319d1a81a1e0 None admin] REQUEST_METHOD: `GET` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:43:59.817700 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6f8266-2278-45ea-8dac-319d1a81a1e0 None admin] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:43:59.817972 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6f8266-2278-45ea-8dac-319d1a81a1e0 None admin] PATH_INFO: `/v3/domains/default` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:43:59.819149 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a6f8266-2278-45ea-8dac-319d1a81a1e0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:43:59.820619 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a6f8266-2278-45ea-8dac-319d1a81a1e0 None admin] RBAC: Authorization granted {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:43:59.822439 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 514/1016] 10.222.0.84 () {56 vars in 1108 bytes} [Wed May 25 14:43:59 2022] GET /identity/v3/domains/default => generated 199 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:43:59.827920 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47e52ad2-cf7e-4974-ad29-a379a56cd0f6 None None] Authenticating user token {{(pid=101892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:43:59.868402 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG dbcounter [-] [101892] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=101892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:43:59.929154 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47e52ad2-cf7e-4974-ad29-a379a56cd0f6 None None] Validating token access rules against request {{(pid=101892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:43:59.963368 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd9bafe1-9755-4ba7-921d-9c840c4977d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:43:59.964058 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9bafe1-9755-4ba7-921d-9c840c4977d0 None admin] REQUEST_METHOD: `POST` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:43:59.964346 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9bafe1-9755-4ba7-921d-9c840c4977d0 None admin] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:43:59.964625 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9bafe1-9755-4ba7-921d-9c840c4977d0 None admin] PATH_INFO: `/v3/projects` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:43:59.965345 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd9bafe1-9755-4ba7-921d-9c840c4977d0 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:43:59.966769 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd9bafe1-9755-4ba7-921d-9c840c4977d0 None admin] RBAC: Authorization granted {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:44:00.042645 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 503/1017] 10.222.0.84 () {60 vars in 1141 bytes} [Wed May 25 14:43:59 2022] POST /identity/v3/projects => generated 311 bytes in 215 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 14:44:00.213445 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-423027f4-1e58-4942-b7a2-2ccd720d61f3 None None] REQUEST_METHOD: `GET` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:44:00.213776 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-423027f4-1e58-4942-b7a2-2ccd720d61f3 None None] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:44:00.214005 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-423027f4-1e58-4942-b7a2-2ccd720d61f3 None None] PATH_INFO: `/` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:44:00.215545 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 515/1018] 10.222.0.84 () {54 vars in 926 bytes} [Wed May 25 14:44:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 14:44:00.220600 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f72326e-c526-43ea-8ad9-87fe5c1da812 None None] REQUEST_METHOD: `POST` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:44:00.220892 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f72326e-c526-43ea-8ad9-87fe5c1da812 None None] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:44:00.221170 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f72326e-c526-43ea-8ad9-87fe5c1da812 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:44:00.239905 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.auth.core [None req-0f72326e-c526-43ea-8ad9-87fe5c1da812 None None] MFA Rules not processed for user `05d87e87798e429aa1c10b24391f915e`. Rule list: `[]` (Enabled: `True`). {{(pid=101892) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:44:00.241085 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.fernet_utils [None req-0f72326e-c526-43ea-8ad9-87fe5c1da812 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=101892) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:44:00.311879 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 504/1019] 10.222.0.84 () {58 vars in 1023 bytes} [Wed May 25 14:44:00 2022] POST /identity/v3/auth/tokens => generated 1863 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 25 14:44:00.334122 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-423027f4-1e58-4942-b7a2-2ccd720d61f3 None None] Authenticating user token {{(pid=101893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:44:00.440747 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-423027f4-1e58-4942-b7a2-2ccd720d61f3 None None] Validating token access rules against request {{(pid=101893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:44:00.475363 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0801d256-0472-426d-b3bb-2ce5af9a22d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:44:00.475972 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0801d256-0472-426d-b3bb-2ce5af9a22d1 None admin] REQUEST_METHOD: `POST` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:44:00.476255 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0801d256-0472-426d-b3bb-2ce5af9a22d1 None admin] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:44:00.476529 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0801d256-0472-426d-b3bb-2ce5af9a22d1 None admin] PATH_INFO: `/v3/services` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:44:00.477262 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0801d256-0472-426d-b3bb-2ce5af9a22d1 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:44:00.478633 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0801d256-0472-426d-b3bb-2ce5af9a22d1 None admin] RBAC: Authorization granted {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:44:00.557169 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 516/1020] 10.222.0.84 () {60 vars in 1141 bytes} [Wed May 25 14:44:00 2022] POST /identity/v3/services => generated 242 bytes in 223 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 14:44:01.108621 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4ad25e-4d17-4b40-a60f-d4d7cb49ca27 None None] REQUEST_METHOD: `GET` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:44:01.109383 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4ad25e-4d17-4b40-a60f-d4d7cb49ca27 None None] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:44:01.109383 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4ad25e-4d17-4b40-a60f-d4d7cb49ca27 None None] PATH_INFO: `/` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:44:01.110843 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 505/1021] 10.222.0.84 () {54 vars in 926 bytes} [Wed May 25 14:44:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 14:44:01.119115 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188daf10-3a1b-4d08-bbbe-caba1569a118 None None] REQUEST_METHOD: `POST` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:44:01.119661 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188daf10-3a1b-4d08-bbbe-caba1569a118 None None] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:44:01.120384 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188daf10-3a1b-4d08-bbbe-caba1569a118 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:44:01.127086 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG dbcounter [-] [101893] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=101893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:44:01.147592 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.auth.core [None req-188daf10-3a1b-4d08-bbbe-caba1569a118 None None] MFA Rules not processed for user `05d87e87798e429aa1c10b24391f915e`. Rule list: `[]` (Enabled: `True`). {{(pid=101893) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:44:01.150007 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.fernet_utils [None req-188daf10-3a1b-4d08-bbbe-caba1569a118 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=101893) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:44:01.279265 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 517/1022] 10.222.0.84 () {58 vars in 1023 bytes} [Wed May 25 14:44:01 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 25 14:44:01.320373 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a4ad25e-4d17-4b40-a60f-d4d7cb49ca27 None None] Authenticating user token {{(pid=101892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:44:01.355603 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG dbcounter [-] [101892] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=101892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:44:01.437642 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a4ad25e-4d17-4b40-a60f-d4d7cb49ca27 None None] Validating token access rules against request {{(pid=101892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:44:01.473767 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db92bc3-7967-4210-a5c7-965abee6429e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:44:01.474588 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db92bc3-7967-4210-a5c7-965abee6429e None admin] REQUEST_METHOD: `GET` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:44:01.474870 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db92bc3-7967-4210-a5c7-965abee6429e None admin] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:44:01.475144 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db92bc3-7967-4210-a5c7-965abee6429e None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:44:01.486982 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4db92bc3-7967-4210-a5c7-965abee6429e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 14:44:01.496042 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application [None req-4db92bc3-7967-4210-a5c7-965abee6429e None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 25 14:44:01.496042 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:44:01.496042 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 14:44:01.496042 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 14:44:01.496042 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 14:44:01.496042 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 14:44:01.496042 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 14:44:01.496042 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 14:44:01.496042 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 14:44:01.496042 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 14:44:01.496042 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 14:44:01.496042 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 14:44:01.496042 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 14:44:01.496042 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 14:44:01.496042 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 14:44:01.496042 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 14:44:01.497061 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 14:44:01.497061 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 14:44:01.497061 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 14:44:01.497061 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 14:44:01.497061 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 14:44:01.497061 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 14:44:01.497061 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 14:44:01.497061 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 14:44:01.497061 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 14:44:01.497061 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application return self.get_or_create( May 25 14:44:01.497061 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 14:44:01.497061 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application with Lock( May 25 14:44:01.497061 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 14:44:01.497061 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application return self._enter() May 25 14:44:01.497061 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 14:44:01.497061 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 14:44:01.497942 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 14:44:01.497942 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application return self.creator() May 25 14:44:01.497942 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 14:44:01.497942 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application created_value = creator( May 25 14:44:01.497942 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 14:44:01.497942 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 14:44:01.497942 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 14:44:01.497942 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 14:44:01.497942 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 14:44:01.497942 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 14:44:01.497942 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 25 14:44:01.497942 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application May 25 14:44:01.499891 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 506/1023] 10.222.0.84 () {56 vars in 1120 bytes} [Wed May 25 14:44:01 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 14:44:01.503299 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-188daf10-3a1b-4d08-bbbe-caba1569a118 None None] Authenticating user token {{(pid=101893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:44:01.608516 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-188daf10-3a1b-4d08-bbbe-caba1569a118 None None] Validating token access rules against request {{(pid=101893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:44:01.634383 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG dbcounter [-] [101893] Writing DB stats keystone:SELECT=100 {{(pid=101893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:44:01.642827 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-042ad58e-7abf-41aa-a263-afa0d163ca07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:44:01.643510 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042ad58e-7abf-41aa-a263-afa0d163ca07 None admin] REQUEST_METHOD: `GET` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:44:01.644403 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042ad58e-7abf-41aa-a263-afa0d163ca07 None admin] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:44:01.644681 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042ad58e-7abf-41aa-a263-afa0d163ca07 None admin] PATH_INFO: `/v3/roles` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:44:01.645434 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-042ad58e-7abf-41aa-a263-afa0d163ca07 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=101893) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:44:01.651006 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-042ad58e-7abf-41aa-a263-afa0d163ca07 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:44:01.651006 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-042ad58e-7abf-41aa-a263-afa0d163ca07 None admin] RBAC: Authorization granted {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:44:01.660325 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 518/1024] 10.222.0.84 () {56 vars in 1115 bytes} [Wed May 25 14:44:01 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:44:01.661190 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db92bc3-7967-4210-a5c7-965abee6429e None admin] Authenticating user token {{(pid=101892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:44:01.745472 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG dbcounter [-] [101892] Writing DB stats keystone:SELECT=100 {{(pid=101892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:44:01.765609 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db92bc3-7967-4210-a5c7-965abee6429e None admin] Validating token access rules against request {{(pid=101892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:44:01.800760 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b79b9de1-9e1a-4c42-96f0-7ba33ed0cab9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:44:01.801553 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79b9de1-9e1a-4c42-96f0-7ba33ed0cab9 None admin] REQUEST_METHOD: `GET` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:44:01.801830 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79b9de1-9e1a-4c42-96f0-7ba33ed0cab9 None admin] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:44:01.802100 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79b9de1-9e1a-4c42-96f0-7ba33ed0cab9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:44:01.812937 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b79b9de1-9e1a-4c42-96f0-7ba33ed0cab9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:44:01.814382 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b79b9de1-9e1a-4c42-96f0-7ba33ed0cab9 None admin] RBAC: Authorization granted {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:44:01.832572 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application [None req-b79b9de1-9e1a-4c42-96f0-7ba33ed0cab9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 25 14:44:01.832572 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:44:01.832572 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 14:44:01.832572 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 14:44:01.832572 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 14:44:01.832572 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 14:44:01.832572 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 14:44:01.832572 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 14:44:01.832572 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 14:44:01.832572 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 14:44:01.832572 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 14:44:01.832572 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 14:44:01.832572 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 25 14:44:01.832572 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 25 14:44:01.832572 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 25 14:44:01.833516 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 25 14:44:01.833516 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 14:44:01.833516 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 14:44:01.833516 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 14:44:01.833516 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 14:44:01.833516 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 14:44:01.833516 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application return self.get_or_create( May 25 14:44:01.833516 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 14:44:01.833516 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application with Lock( May 25 14:44:01.833516 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 14:44:01.833516 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application return self._enter() May 25 14:44:01.833516 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 14:44:01.833516 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 14:44:01.833516 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 14:44:01.833516 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application return self.creator() May 25 14:44:01.833516 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 14:44:01.833516 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application created_value = creator( May 25 14:44:01.834526 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 25 14:44:01.834526 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 25 14:44:01.834526 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 25 14:44:01.834526 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application May 25 14:44:01.834526 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 507/1025] 10.222.0.84 () {56 vars in 1108 bytes} [Wed May 25 14:44:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 25 14:44:01.839583 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-042ad58e-7abf-41aa-a263-afa0d163ca07 None admin] Authenticating user token {{(pid=101893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:44:01.941396 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-042ad58e-7abf-41aa-a263-afa0d163ca07 None admin] Validating token access rules against request {{(pid=101893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:44:01.974924 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a300b4d-354a-4d2a-bb40-5f2084a61afe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:44:01.975626 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a300b4d-354a-4d2a-bb40-5f2084a61afe None admin] REQUEST_METHOD: `GET` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:44:01.975964 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a300b4d-354a-4d2a-bb40-5f2084a61afe None admin] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:44:01.976243 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a300b4d-354a-4d2a-bb40-5f2084a61afe None admin] PATH_INFO: `/v3/domains` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:44:01.976962 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a300b4d-354a-4d2a-bb40-5f2084a61afe None admin] RBAC: Adding query filter params (name=Default) {{(pid=101893) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:44:01.977270 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a300b4d-354a-4d2a-bb40-5f2084a61afe None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:44:01.978693 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a300b4d-354a-4d2a-bb40-5f2084a61afe None admin] RBAC: Authorization granted {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:44:01.990725 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 519/1026] 10.222.0.84 () {56 vars in 1109 bytes} [Wed May 25 14:44:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:44:01.996577 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b79b9de1-9e1a-4c42-96f0-7ba33ed0cab9 None admin] Authenticating user token {{(pid=101892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:44:02.097662 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b79b9de1-9e1a-4c42-96f0-7ba33ed0cab9 None admin] Validating token access rules against request {{(pid=101892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:44:02.127280 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG dbcounter [-] [101892] Writing DB stats keystone:SELECT=100 {{(pid=101892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:44:02.133414 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9284618-7d50-4bd7-8e52-1eb02d45046b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:44:02.134214 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9284618-7d50-4bd7-8e52-1eb02d45046b None admin] REQUEST_METHOD: `GET` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:44:02.134499 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9284618-7d50-4bd7-8e52-1eb02d45046b None admin] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:44:02.134778 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9284618-7d50-4bd7-8e52-1eb02d45046b None admin] PATH_INFO: `/v3/users/nova` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:44:02.142806 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9284618-7d50-4bd7-8e52-1eb02d45046b None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:44:02.144318 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9284618-7d50-4bd7-8e52-1eb02d45046b None admin] RBAC: Authorization granted {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:44:02.158160 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application [None req-b9284618-7d50-4bd7-8e52-1eb02d45046b None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 25 14:44:02.158160 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:44:02.158160 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 14:44:02.158160 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 14:44:02.158160 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 14:44:02.158160 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 14:44:02.158160 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 14:44:02.158160 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 14:44:02.158160 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 14:44:02.158160 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 14:44:02.158160 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 14:44:02.158160 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 14:44:02.158160 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 25 14:44:02.158160 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application return self._get_user(user_id) May 25 14:44:02.158160 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 25 14:44:02.158160 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 25 14:44:02.159137 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 14:44:02.159137 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 14:44:02.159137 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 25 14:44:02.159137 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 25 14:44:02.159137 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 25 14:44:02.159137 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 25 14:44:02.159137 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 14:44:02.159137 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 14:44:02.159137 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 14:44:02.159137 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application return self.get_or_create( May 25 14:44:02.159137 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 14:44:02.159137 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application with Lock( May 25 14:44:02.159137 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 14:44:02.159137 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application return self._enter() May 25 14:44:02.159137 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 14:44:02.159137 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 14:44:02.159137 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 14:44:02.159137 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application return self.creator() May 25 14:44:02.160493 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 14:44:02.160493 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application created_value = creator( May 25 14:44:02.160493 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 25 14:44:02.160493 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 25 14:44:02.160493 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 25 14:44:02.160493 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 25 14:44:02.160493 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 25 14:44:02.160493 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 25 14:44:02.160493 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 25 14:44:02.160493 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application May 25 14:44:02.163650 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 508/1027] 10.222.0.84 () {56 vars in 1093 bytes} [Wed May 25 14:44:01 2022] GET /identity/v3/users/nova => generated 82 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 14:44:02.165605 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a300b4d-354a-4d2a-bb40-5f2084a61afe None admin] Authenticating user token {{(pid=101893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:44:02.217551 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG dbcounter [-] [101893] Writing DB stats keystone:SELECT=100 {{(pid=101893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:44:02.275590 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a300b4d-354a-4d2a-bb40-5f2084a61afe None admin] Validating token access rules against request {{(pid=101893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:44:02.311859 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9352fd50-1546-452f-9966-113c02d1c9e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:44:02.312905 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9352fd50-1546-452f-9966-113c02d1c9e0 None admin] REQUEST_METHOD: `GET` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:44:02.313394 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9352fd50-1546-452f-9966-113c02d1c9e0 None admin] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:44:02.313869 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9352fd50-1546-452f-9966-113c02d1c9e0 None admin] PATH_INFO: `/v3/users` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:44:02.314912 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9352fd50-1546-452f-9966-113c02d1c9e0 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=101893) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:44:02.315471 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9352fd50-1546-452f-9966-113c02d1c9e0 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:44:02.317716 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9352fd50-1546-452f-9966-113c02d1c9e0 None admin] RBAC: Authorization granted {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:44:02.340602 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 520/1028] 10.222.0.84 () {56 vars in 1133 bytes} [Wed May 25 14:44:02 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:44:02.342221 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9284618-7d50-4bd7-8e52-1eb02d45046b None admin] Authenticating user token {{(pid=101892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:44:02.423191 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b1ed89-2a6b-4dbf-8414-634c0bdb2e30 None None] REQUEST_METHOD: `GET` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:44:02.423482 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b1ed89-2a6b-4dbf-8414-634c0bdb2e30 None None] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:44:02.423787 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b1ed89-2a6b-4dbf-8414-634c0bdb2e30 None None] PATH_INFO: `/` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:44:02.425685 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 521/1029] 10.222.0.84 () {54 vars in 926 bytes} [Wed May 25 14:44:02 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 25 14:44:02.430652 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31bc8aa7-af12-42f9-b5b2-638fc216dcc8 None None] REQUEST_METHOD: `POST` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:44:02.430933 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31bc8aa7-af12-42f9-b5b2-638fc216dcc8 None None] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:44:02.431205 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31bc8aa7-af12-42f9-b5b2-638fc216dcc8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:44:02.447992 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.auth.core [None req-31bc8aa7-af12-42f9-b5b2-638fc216dcc8 None None] MFA Rules not processed for user `05d87e87798e429aa1c10b24391f915e`. Rule list: `[]` (Enabled: `True`). {{(pid=101893) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:44:02.448928 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9284618-7d50-4bd7-8e52-1eb02d45046b None admin] Validating token access rules against request {{(pid=101892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:44:02.449182 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.fernet_utils [None req-31bc8aa7-af12-42f9-b5b2-638fc216dcc8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=101893) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:44:02.486067 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12f9832d-0bcb-4131-a153-665ade88db66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:44:02.487073 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f9832d-0bcb-4131-a153-665ade88db66 None admin] REQUEST_METHOD: `GET` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:44:02.488121 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f9832d-0bcb-4131-a153-665ade88db66 None admin] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:44:02.488573 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f9832d-0bcb-4131-a153-665ade88db66 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:44:02.517234 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 522/1030] 10.222.0.84 () {58 vars in 1023 bytes} [Wed May 25 14:44:02 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 25 14:44:02.547590 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31bc8aa7-af12-42f9-b5b2-638fc216dcc8 None None] Authenticating user token {{(pid=101893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:44:02.565856 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG dbcounter [-] [101892] Writing DB stats keystone:SELECT=100 {{(pid=101892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:44:02.576634 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12f9832d-0bcb-4131-a153-665ade88db66 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:44:02.578080 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12f9832d-0bcb-4131-a153-665ade88db66 None admin] RBAC: Authorization granted {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:44:02.591840 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG dbcounter [-] [101893] Writing DB stats keystone:SELECT=100 {{(pid=101893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:44:02.655874 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31bc8aa7-af12-42f9-b5b2-638fc216dcc8 None None] Validating token access rules against request {{(pid=101893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:44:02.690967 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 509/1031] 10.222.0.84 () {58 vars in 1282 bytes} [Wed May 25 14:44:02 2022] GET /identity/v3/auth/tokens => generated 1959 bytes in 349 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 25 14:44:02.696760 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12f9832d-0bcb-4131-a153-665ade88db66 None admin] Authenticating user token {{(pid=101892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:44:02.698223 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f815a60-2770-48bc-8262-c7d0c6a68ed9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:44:02.699214 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f815a60-2770-48bc-8262-c7d0c6a68ed9 None admin] REQUEST_METHOD: `GET` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:44:02.700396 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f815a60-2770-48bc-8262-c7d0c6a68ed9 None admin] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:44:02.700680 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f815a60-2770-48bc-8262-c7d0c6a68ed9 None admin] PATH_INFO: `/v3/domains/default` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:44:02.701883 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f815a60-2770-48bc-8262-c7d0c6a68ed9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:44:02.703328 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f815a60-2770-48bc-8262-c7d0c6a68ed9 None admin] RBAC: Authorization granted {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:44:02.707911 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 523/1032] 10.222.0.84 () {56 vars in 1108 bytes} [Wed May 25 14:44:02 2022] GET /identity/v3/domains/default => generated 199 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 14:44:02.710821 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f815a60-2770-48bc-8262-c7d0c6a68ed9 None admin] Authenticating user token {{(pid=101893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:44:02.797203 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG dbcounter [-] [101892] Writing DB stats keystone:SELECT=100 {{(pid=101892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:44:02.809155 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12f9832d-0bcb-4131-a153-665ade88db66 None admin] Validating token access rules against request {{(pid=101892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:44:02.817687 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f815a60-2770-48bc-8262-c7d0c6a68ed9 None admin] Validating token access rules against request {{(pid=101893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:44:02.825158 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG dbcounter [-] [101893] Writing DB stats keystone:SELECT=100 {{(pid=101893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:44:02.843441 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71a5df93-8f5d-43c8-92fd-94f2eed7f304 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:44:02.844283 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a5df93-8f5d-43c8-92fd-94f2eed7f304 None admin] REQUEST_METHOD: `GET` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:44:02.844573 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a5df93-8f5d-43c8-92fd-94f2eed7f304 None admin] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:44:02.844857 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a5df93-8f5d-43c8-92fd-94f2eed7f304 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:44:02.852162 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df0542e6-cd6f-4253-8f6d-176c65b1f6bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:44:02.852840 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0542e6-cd6f-4253-8f6d-176c65b1f6bd None admin] REQUEST_METHOD: `POST` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:44:02.853127 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0542e6-cd6f-4253-8f6d-176c65b1f6bd None admin] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:44:02.853406 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0542e6-cd6f-4253-8f6d-176c65b1f6bd None admin] PATH_INFO: `/v3/users` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:44:02.854121 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df0542e6-cd6f-4253-8f6d-176c65b1f6bd None admin] RBAC: Authorizing `identity:create_user()` {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:44:02.855597 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71a5df93-8f5d-43c8-92fd-94f2eed7f304 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:44:02.855700 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df0542e6-cd6f-4253-8f6d-176c65b1f6bd None admin] RBAC: Authorization granted {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:44:02.857029 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71a5df93-8f5d-43c8-92fd-94f2eed7f304 None admin] RBAC: Authorization granted {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:44:02.876841 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application [None req-71a5df93-8f5d-43c8-92fd-94f2eed7f304 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 25 14:44:02.876841 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:44:02.876841 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 14:44:02.876841 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 14:44:02.876841 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 14:44:02.876841 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 14:44:02.876841 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 14:44:02.876841 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 14:44:02.876841 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 14:44:02.876841 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 14:44:02.876841 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 14:44:02.876841 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 14:44:02.876841 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 25 14:44:02.876841 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 25 14:44:02.876841 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 25 14:44:02.878047 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 25 14:44:02.878047 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 14:44:02.878047 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 14:44:02.878047 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 14:44:02.878047 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 14:44:02.878047 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 14:44:02.878047 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application return self.get_or_create( May 25 14:44:02.878047 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 14:44:02.878047 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application with Lock( May 25 14:44:02.878047 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 14:44:02.878047 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application return self._enter() May 25 14:44:02.878047 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 14:44:02.878047 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 14:44:02.878047 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 14:44:02.878047 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application return self.creator() May 25 14:44:02.878047 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 14:44:02.878047 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application created_value = creator( May 25 14:44:02.879020 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 25 14:44:02.879020 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 25 14:44:02.879020 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 25 14:44:02.879020 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application May 25 14:44:02.879891 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 510/1033] 10.222.0.84 () {56 vars in 1108 bytes} [Wed May 25 14:44:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 25 14:44:02.881245 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75056215-492d-4271-9616-1ed689cbecd9 None None] REQUEST_METHOD: `GET` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:44:02.884000 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75056215-492d-4271-9616-1ed689cbecd9 None None] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:44:02.884000 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75056215-492d-4271-9616-1ed689cbecd9 None None] PATH_INFO: `/` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:44:02.884000 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 511/1034] 10.222.0.84 () {54 vars in 926 bytes} [Wed May 25 14:44:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 14:44:02.884000 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75056215-492d-4271-9616-1ed689cbecd9 None None] Authenticating user token {{(pid=101892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:44:02.954685 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 524/1035] 10.222.0.84 () {60 vars in 1132 bytes} [Wed May 25 14:44:02 2022] POST /identity/v3/users => generated 285 bytes in 244 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 25 14:44:02.956002 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b00118-b2da-4d53-b7b1-f7681b6da3b7 None None] REQUEST_METHOD: `POST` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:44:02.956318 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b00118-b2da-4d53-b7b1-f7681b6da3b7 None None] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:44:02.956593 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b00118-b2da-4d53-b7b1-f7681b6da3b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:44:02.975075 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.auth.core [None req-f6b00118-b2da-4d53-b7b1-f7681b6da3b7 None None] MFA Rules not processed for user `05d87e87798e429aa1c10b24391f915e`. Rule list: `[]` (Enabled: `True`). {{(pid=101893) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:44:02.976493 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.fernet_utils [None req-f6b00118-b2da-4d53-b7b1-f7681b6da3b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=101893) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:44:02.989297 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75056215-492d-4271-9616-1ed689cbecd9 None None] Validating token access rules against request {{(pid=101892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:44:03.027703 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da267744-e3d8-49e8-9e6f-af4bb5954c1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:44:03.028442 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da267744-e3d8-49e8-9e6f-af4bb5954c1c None admin] REQUEST_METHOD: `GET` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:44:03.028731 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da267744-e3d8-49e8-9e6f-af4bb5954c1c None admin] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:44:03.029009 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da267744-e3d8-49e8-9e6f-af4bb5954c1c None admin] PATH_INFO: `/v3/domains` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:44:03.029741 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da267744-e3d8-49e8-9e6f-af4bb5954c1c None admin] RBAC: Adding query filter params (name=Default) {{(pid=101892) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:44:03.030049 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da267744-e3d8-49e8-9e6f-af4bb5954c1c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:44:03.031440 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da267744-e3d8-49e8-9e6f-af4bb5954c1c None admin] RBAC: Authorization granted {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:44:03.044244 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 512/1036] 10.222.0.84 () {56 vars in 1109 bytes} [Wed May 25 14:44:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 14:44:03.050441 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da267744-e3d8-49e8-9e6f-af4bb5954c1c None admin] Authenticating user token {{(pid=101892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:44:03.055079 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG dbcounter [-] [101892] Writing DB stats keystone:SELECT=100 {{(pid=101892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:44:03.071666 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 525/1037] 10.222.0.84 () {58 vars in 1023 bytes} [Wed May 25 14:44:02 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 25 14:44:03.084920 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6b00118-b2da-4d53-b7b1-f7681b6da3b7 None None] Authenticating user token {{(pid=101893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:44:03.172235 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da267744-e3d8-49e8-9e6f-af4bb5954c1c None admin] Validating token access rules against request {{(pid=101892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:44:03.187379 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG dbcounter [-] [101893] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=101893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:44:03.199873 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6b00118-b2da-4d53-b7b1-f7681b6da3b7 None None] Validating token access rules against request {{(pid=101893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:44:03.213150 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e19ce35a-6c81-499d-8f26-a3ac246943da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:44:03.213952 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e19ce35a-6c81-499d-8f26-a3ac246943da None admin] REQUEST_METHOD: `GET` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:44:03.214232 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e19ce35a-6c81-499d-8f26-a3ac246943da None admin] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:44:03.214505 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e19ce35a-6c81-499d-8f26-a3ac246943da None admin] PATH_INFO: `/v3/projects/service` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:44:03.221635 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e19ce35a-6c81-499d-8f26-a3ac246943da None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:44:03.223118 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e19ce35a-6c81-499d-8f26-a3ac246943da None admin] RBAC: Authorization granted {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:44:03.238232 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application [None req-e19ce35a-6c81-499d-8f26-a3ac246943da None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 25 14:44:03.238232 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:44:03.238232 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 14:44:03.238232 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 14:44:03.238232 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 14:44:03.238232 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 14:44:03.238232 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 14:44:03.238232 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 14:44:03.238232 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 14:44:03.238232 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 14:44:03.238232 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 14:44:03.238232 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 14:44:03.238232 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 25 14:44:03.238232 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application return self._get_project(project_id) May 25 14:44:03.238232 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 25 14:44:03.239457 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 25 14:44:03.239457 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 14:44:03.239457 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 14:44:03.239457 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 14:44:03.239457 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 14:44:03.239457 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 14:44:03.239457 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application return self.get_or_create( May 25 14:44:03.239457 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 14:44:03.239457 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application with Lock( May 25 14:44:03.239457 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 14:44:03.239457 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application return self._enter() May 25 14:44:03.239457 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 14:44:03.239457 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 14:44:03.239457 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 14:44:03.239457 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application return self.creator() May 25 14:44:03.239457 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 14:44:03.239457 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application created_value = creator( May 25 14:44:03.240847 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 25 14:44:03.240847 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 25 14:44:03.240847 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 25 14:44:03.240847 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 25 14:44:03.240847 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 25 14:44:03.240847 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 25 14:44:03.240847 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 25 14:44:03.240847 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application May 25 14:44:03.241315 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff6c821-3571-4212-8b26-294e903562fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:44:03.241454 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 513/1038] 10.222.0.84 () {56 vars in 1111 bytes} [Wed May 25 14:44:03 2022] GET /identity/v3/projects/service => generated 88 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 25 14:44:03.241542 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff6c821-3571-4212-8b26-294e903562fb None admin] REQUEST_METHOD: `GET` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:44:03.241542 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff6c821-3571-4212-8b26-294e903562fb None admin] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:44:03.241542 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff6c821-3571-4212-8b26-294e903562fb None admin] PATH_INFO: `/v3/services/image` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:44:03.241747 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ff6c821-3571-4212-8b26-294e903562fb None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:44:03.243048 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ff6c821-3571-4212-8b26-294e903562fb None admin] RBAC: Authorization granted {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:44:03.245409 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e19ce35a-6c81-499d-8f26-a3ac246943da None admin] Authenticating user token {{(pid=101892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:44:03.256655 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application [None req-2ff6c821-3571-4212-8b26-294e903562fb None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. May 25 14:44:03.256655 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:44:03.256655 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 25 14:44:03.256655 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 25 14:44:03.256655 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 25 14:44:03.256655 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 25 14:44:03.256655 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 25 14:44:03.256655 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 25 14:44:03.256655 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. May 25 14:44:03.256655 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application May 25 14:44:03.256655 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 25 14:44:03.256655 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application May 25 14:44:03.256655 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:44:03.256655 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 14:44:03.256655 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 14:44:03.256655 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 14:44:03.256655 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 14:44:03.257871 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 14:44:03.257871 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 14:44:03.257871 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 14:44:03.257871 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 14:44:03.257871 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 14:44:03.257871 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 14:44:03.257871 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 25 14:44:03.257871 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return self._get_service(service_id) May 25 14:44:03.257871 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 25 14:44:03.257871 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 25 14:44:03.257871 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 14:44:03.257871 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 14:44:03.257871 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 14:44:03.257871 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 14:44:03.257871 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 14:44:03.257871 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return self.get_or_create( May 25 14:44:03.258994 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 14:44:03.258994 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application with Lock( May 25 14:44:03.258994 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 14:44:03.258994 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return self._enter() May 25 14:44:03.258994 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 14:44:03.258994 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 14:44:03.258994 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 14:44:03.258994 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return self.creator() May 25 14:44:03.258994 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 14:44:03.258994 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application created_value = creator( May 25 14:44:03.258994 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 25 14:44:03.258994 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 25 14:44:03.258994 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. May 25 14:44:03.258994 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application May 25 14:44:03.260753 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 526/1039] 10.222.0.84 () {56 vars in 1105 bytes} [Wed May 25 14:44:03 2022] GET /identity/v3/services/image => generated 86 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 25 14:44:03.263654 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff6c821-3571-4212-8b26-294e903562fb None admin] Authenticating user token {{(pid=101893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:44:03.316132 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG dbcounter [-] [101892] Writing DB stats keystone:SELECT=100 {{(pid=101892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:44:03.355767 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e19ce35a-6c81-499d-8f26-a3ac246943da None admin] Validating token access rules against request {{(pid=101892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:44:03.375398 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff6c821-3571-4212-8b26-294e903562fb None admin] Validating token access rules against request {{(pid=101893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:44:03.394370 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-184141a6-89b1-499f-8d22-b1754b9dd281 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:44:03.395074 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184141a6-89b1-499f-8d22-b1754b9dd281 None admin] REQUEST_METHOD: `GET` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:44:03.395459 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184141a6-89b1-499f-8d22-b1754b9dd281 None admin] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:44:03.395817 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184141a6-89b1-499f-8d22-b1754b9dd281 None admin] PATH_INFO: `/v3/projects` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:44:03.397109 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-184141a6-89b1-499f-8d22-b1754b9dd281 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=101892) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:44:03.397429 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-184141a6-89b1-499f-8d22-b1754b9dd281 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:44:03.399151 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-184141a6-89b1-499f-8d22-b1754b9dd281 None admin] RBAC: Authorization granted {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:44:03.412514 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c092a8-a241-41d9-953b-fc4b31fc8b9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:44:03.413176 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c092a8-a241-41d9-953b-fc4b31fc8b9a None admin] REQUEST_METHOD: `GET` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:44:03.413454 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c092a8-a241-41d9-953b-fc4b31fc8b9a None admin] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:44:03.413722 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c092a8-a241-41d9-953b-fc4b31fc8b9a None admin] PATH_INFO: `/v3/services` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:44:03.418783 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 514/1040] 10.222.0.84 () {56 vars in 1148 bytes} [Wed May 25 14:44:03 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 14:44:03.418868 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9c092a8-a241-41d9-953b-fc4b31fc8b9a None admin] RBAC: Adding query filter params (name=image) {{(pid=101893) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:44:03.418868 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9c092a8-a241-41d9-953b-fc4b31fc8b9a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:44:03.418868 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9c092a8-a241-41d9-953b-fc4b31fc8b9a None admin] RBAC: Authorization granted {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:44:03.419549 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-184141a6-89b1-499f-8d22-b1754b9dd281 None admin] Authenticating user token {{(pid=101892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:44:03.425806 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 527/1041] 10.222.0.84 () {56 vars in 1108 bytes} [Wed May 25 14:44:03 2022] GET /identity/v3/services?name=image => generated 122 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 14:44:03.426737 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c092a8-a241-41d9-953b-fc4b31fc8b9a None admin] Authenticating user token {{(pid=101893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:44:03.450945 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG dbcounter [-] [101893] Writing DB stats keystone:SELECT=100 {{(pid=101893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:44:03.531232 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-184141a6-89b1-499f-8d22-b1754b9dd281 None admin] Validating token access rules against request {{(pid=101892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:44:03.532080 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c092a8-a241-41d9-953b-fc4b31fc8b9a None admin] Validating token access rules against request {{(pid=101893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:44:03.559303 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG dbcounter [-] [101892] Writing DB stats keystone:SELECT=100 {{(pid=101892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:44:03.570275 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d952b8f9-c3a8-41ac-adea-3b081b7c5972 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:44:03.577831 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d952b8f9-c3a8-41ac-adea-3b081b7c5972 None admin] REQUEST_METHOD: `GET` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:44:03.577831 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d952b8f9-c3a8-41ac-adea-3b081b7c5972 None admin] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:44:03.577831 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d952b8f9-c3a8-41ac-adea-3b081b7c5972 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:44:03.578065 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-112398ad-d889-4170-a479-9dfd244fb32b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:44:03.578158 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d952b8f9-c3a8-41ac-adea-3b081b7c5972 None admin] RBAC: Adding query filter params (role.id=e36bc54201ab4defa2b100771ec121a4, scope.project.id=a000829c658c4a7cab67f7b6353ba3fa, user.id=2aeb182e6a5b43cfb0cc347ec847c848) {{(pid=101892) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:44:03.578250 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-112398ad-d889-4170-a479-9dfd244fb32b None admin] REQUEST_METHOD: `GET` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:44:03.578334 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d952b8f9-c3a8-41ac-adea-3b081b7c5972 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:44:03.578407 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-112398ad-d889-4170-a479-9dfd244fb32b None admin] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:44:03.578407 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-112398ad-d889-4170-a479-9dfd244fb32b None admin] PATH_INFO: `/v3/services` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:44:03.578407 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-112398ad-d889-4170-a479-9dfd244fb32b None admin] RBAC: Adding query filter params (type=image) {{(pid=101893) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:44:03.578407 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-112398ad-d889-4170-a479-9dfd244fb32b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:44:03.578668 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d952b8f9-c3a8-41ac-adea-3b081b7c5972 None admin] RBAC: Authorization granted {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:44:03.578740 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-112398ad-d889-4170-a479-9dfd244fb32b None admin] RBAC: Authorization granted {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:44:03.587755 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 528/1042] 10.222.0.84 () {56 vars in 1108 bytes} [Wed May 25 14:44:03 2022] GET /identity/v3/services?type=image => generated 350 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:44:03.587925 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 515/1043] 10.222.0.84 () {56 vars in 1374 bytes} [Wed May 25 14:44:03 2022] GET /identity/v3/role_assignments?user.id=2aeb182e6a5b43cfb0cc347ec847c848&scope.project.id=a000829c658c4a7cab67f7b6353ba3fa&role.id=e36bc54201ab4defa2b100771ec121a4 => generated 259 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:44:03.588025 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-112398ad-d889-4170-a479-9dfd244fb32b None admin] Authenticating user token {{(pid=101893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:44:03.679834 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG dbcounter [-] [101893] Writing DB stats keystone:SELECT=100 {{(pid=101893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:44:03.698622 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-112398ad-d889-4170-a479-9dfd244fb32b None admin] Validating token access rules against request {{(pid=101893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:44:03.735522 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3ef6b86-1466-4610-9ef1-849b36f4d8aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:44:03.736224 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ef6b86-1466-4610-9ef1-849b36f4d8aa None admin] REQUEST_METHOD: `GET` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:44:03.736509 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ef6b86-1466-4610-9ef1-849b36f4d8aa None admin] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:44:03.736787 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ef6b86-1466-4610-9ef1-849b36f4d8aa None admin] PATH_INFO: `/v3/endpoints` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:44:03.738470 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3ef6b86-1466-4610-9ef1-849b36f4d8aa None admin] RBAC: Adding query filter params (interface=public, service_id=04ae39a259694d8bbbfa84f3107ae7e4, region_id=RegionOne) {{(pid=101893) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:44:03.738792 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3ef6b86-1466-4610-9ef1-849b36f4d8aa None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:44:03.740245 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3ef6b86-1466-4610-9ef1-849b36f4d8aa None admin] RBAC: Authorization granted {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:44:03.750927 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 529/1044] 10.222.0.84 () {56 vars in 1251 bytes} [Wed May 25 14:44:03 2022] GET /identity/v3/endpoints?service_id=04ae39a259694d8bbbfa84f3107ae7e4&interface=public®ion_id=RegionOne => generated 194 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 14:44:03.752700 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d952b8f9-c3a8-41ac-adea-3b081b7c5972 None admin] Authenticating user token {{(pid=101892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:44:03.855187 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d952b8f9-c3a8-41ac-adea-3b081b7c5972 None admin] Validating token access rules against request {{(pid=101892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:44:03.891014 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-987a8f41-6332-4264-bfde-f6746f40e7bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:44:03.891702 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-987a8f41-6332-4264-bfde-f6746f40e7bd None admin] REQUEST_METHOD: `GET` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:44:03.891988 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-987a8f41-6332-4264-bfde-f6746f40e7bd None admin] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:44:03.892262 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-987a8f41-6332-4264-bfde-f6746f40e7bd None admin] PATH_INFO: `/v3/services` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:44:03.892931 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-987a8f41-6332-4264-bfde-f6746f40e7bd None admin] RBAC: Authorizing `identity:list_services()` {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:44:03.894317 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-987a8f41-6332-4264-bfde-f6746f40e7bd None admin] RBAC: Authorization granted {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:44:03.907598 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 516/1045] 10.222.0.84 () {56 vars in 1087 bytes} [Wed May 25 14:44:03 2022] GET /identity/v3/services => generated 1957 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 14:44:05.214709 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c8fc78-4ef7-4c1e-8f6f-85e839631def None None] REQUEST_METHOD: `GET` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:44:05.215229 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c8fc78-4ef7-4c1e-8f6f-85e839631def None None] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:44:05.215337 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c8fc78-4ef7-4c1e-8f6f-85e839631def None None] PATH_INFO: `/` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:44:05.216790 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 530/1046] 10.222.0.84 () {54 vars in 926 bytes} [Wed May 25 14:44:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 14:44:05.221794 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf64a66-d1e3-498c-a6fd-d82967841bcf None None] REQUEST_METHOD: `POST` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:44:05.222189 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf64a66-d1e3-498c-a6fd-d82967841bcf None None] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:44:05.222357 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf64a66-d1e3-498c-a6fd-d82967841bcf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:44:05.239750 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.auth.core [None req-cdf64a66-d1e3-498c-a6fd-d82967841bcf None None] MFA Rules not processed for user `05d87e87798e429aa1c10b24391f915e`. Rule list: `[]` (Enabled: `True`). {{(pid=101892) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:44:05.240915 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.fernet_utils [None req-cdf64a66-d1e3-498c-a6fd-d82967841bcf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=101892) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:44:05.289780 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG dbcounter [-] [101892] Writing DB stats keystone:SELECT=100 {{(pid=101892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:44:05.309388 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 517/1047] 10.222.0.84 () {58 vars in 1023 bytes} [Wed May 25 14:44:05 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 25 14:44:05.333592 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57c8fc78-4ef7-4c1e-8f6f-85e839631def None None] Authenticating user token {{(pid=101893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:44:05.437042 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57c8fc78-4ef7-4c1e-8f6f-85e839631def None None] Validating token access rules against request {{(pid=101893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:44:05.470433 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b10d093f-dcf9-4e8c-a088-f5a7d890cf78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:44:05.471150 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b10d093f-dcf9-4e8c-a088-f5a7d890cf78 None admin] REQUEST_METHOD: `GET` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:44:05.471422 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b10d093f-dcf9-4e8c-a088-f5a7d890cf78 None admin] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:44:05.472246 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b10d093f-dcf9-4e8c-a088-f5a7d890cf78 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:44:05.482765 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b10d093f-dcf9-4e8c-a088-f5a7d890cf78 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 14:44:05.491079 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application [None req-b10d093f-dcf9-4e8c-a088-f5a7d890cf78 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 25 14:44:05.491079 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:44:05.491079 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 14:44:05.491079 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 14:44:05.491079 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 14:44:05.491079 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 14:44:05.491079 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 14:44:05.491079 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 14:44:05.491079 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 14:44:05.491079 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 14:44:05.491079 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 14:44:05.491079 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 14:44:05.491079 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 14:44:05.491079 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 14:44:05.491079 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 14:44:05.491079 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 14:44:05.492057 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 14:44:05.492057 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 14:44:05.492057 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 14:44:05.492057 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 14:44:05.492057 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 14:44:05.492057 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 14:44:05.492057 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 14:44:05.492057 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 14:44:05.492057 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 14:44:05.492057 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return self.get_or_create( May 25 14:44:05.492057 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 14:44:05.492057 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application with Lock( May 25 14:44:05.492057 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 14:44:05.492057 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return self._enter() May 25 14:44:05.492057 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 14:44:05.492057 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 14:44:05.493206 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 14:44:05.493206 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return self.creator() May 25 14:44:05.493206 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 14:44:05.493206 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application created_value = creator( May 25 14:44:05.493206 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 14:44:05.493206 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 14:44:05.493206 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 14:44:05.493206 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 14:44:05.493206 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 14:44:05.493206 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 14:44:05.493206 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 25 14:44:05.493206 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application May 25 14:44:05.493206 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 531/1048] 10.222.0.84 () {56 vars in 1096 bytes} [Wed May 25 14:44:05 2022] GET /identity/v3/roles/admin => generated 83 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 14:44:05.498504 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdf64a66-d1e3-498c-a6fd-d82967841bcf None None] Authenticating user token {{(pid=101892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:44:05.608998 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdf64a66-d1e3-498c-a6fd-d82967841bcf None None] Validating token access rules against request {{(pid=101892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:44:05.646502 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c1156a5-e8fa-4359-93db-35303e84f165 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:44:05.647295 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1156a5-e8fa-4359-93db-35303e84f165 None admin] REQUEST_METHOD: `GET` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:44:05.647680 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1156a5-e8fa-4359-93db-35303e84f165 None admin] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:44:05.647965 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1156a5-e8fa-4359-93db-35303e84f165 None admin] PATH_INFO: `/v3/roles` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:44:05.648722 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c1156a5-e8fa-4359-93db-35303e84f165 None admin] RBAC: Adding query filter params (name=admin) {{(pid=101892) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:44:05.649035 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c1156a5-e8fa-4359-93db-35303e84f165 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:44:05.650403 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c1156a5-e8fa-4359-93db-35303e84f165 None admin] RBAC: Authorization granted {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:44:05.663617 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 518/1049] 10.222.0.84 () {56 vars in 1099 bytes} [Wed May 25 14:44:05 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:44:05.664808 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b10d093f-dcf9-4e8c-a088-f5a7d890cf78 None admin] Authenticating user token {{(pid=101893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:44:05.675598 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG dbcounter [-] [101893] Writing DB stats keystone:SELECT=100 {{(pid=101893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:44:05.765631 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b10d093f-dcf9-4e8c-a088-f5a7d890cf78 None admin] Validating token access rules against request {{(pid=101893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:44:05.792989 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07c40ba-80e8-4d7f-b811-4b6b18e02965 None None] REQUEST_METHOD: `GET` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:44:05.793296 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07c40ba-80e8-4d7f-b811-4b6b18e02965 None None] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:44:05.793560 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07c40ba-80e8-4d7f-b811-4b6b18e02965 None None] PATH_INFO: `/` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:44:05.794933 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 519/1050] 10.222.0.84 () {54 vars in 926 bytes} [Wed May 25 14:44:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 14:44:05.799621 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-404c51e5-188e-464a-9312-587004b8e24d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:44:05.800458 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fddc1550-5144-4a2a-8b60-067160b917f4 None None] REQUEST_METHOD: `POST` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:44:05.800752 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fddc1550-5144-4a2a-8b60-067160b917f4 None None] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:44:05.801005 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404c51e5-188e-464a-9312-587004b8e24d None admin] REQUEST_METHOD: `GET` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:44:05.801104 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fddc1550-5144-4a2a-8b60-067160b917f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:44:05.801287 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404c51e5-188e-464a-9312-587004b8e24d None admin] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:44:05.801561 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404c51e5-188e-464a-9312-587004b8e24d None admin] PATH_INFO: `/v3/users/faedece942af4c0182a75ee8d5b6be3c` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:44:05.816149 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-404c51e5-188e-464a-9312-587004b8e24d None admin] RBAC: Authorizing `identity:get_user(user_id=faedece942af4c0182a75ee8d5b6be3c)` {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:44:05.817616 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-404c51e5-188e-464a-9312-587004b8e24d None admin] RBAC: Authorization granted {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:44:05.817990 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.auth.core [None req-fddc1550-5144-4a2a-8b60-067160b917f4 None None] MFA Rules not processed for user `05d87e87798e429aa1c10b24391f915e`. Rule list: `[]` (Enabled: `True`). {{(pid=101892) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:44:05.819186 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.fernet_utils [None req-fddc1550-5144-4a2a-8b60-067160b917f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=101892) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:44:05.823837 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 532/1051] 10.222.0.84 () {56 vars in 1177 bytes} [Wed May 25 14:44:05 2022] GET /identity/v3/users/faedece942af4c0182a75ee8d5b6be3c => generated 285 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 14:44:05.824787 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-404c51e5-188e-464a-9312-587004b8e24d None admin] Authenticating user token {{(pid=101893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:44:05.863692 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG dbcounter [-] [101892] Writing DB stats keystone:SELECT=100 {{(pid=101892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:44:05.893634 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 520/1052] 10.222.0.84 () {58 vars in 1023 bytes} [Wed May 25 14:44:05 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 25 14:44:05.893852 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG dbcounter [-] [101893] Writing DB stats keystone:SELECT=100 {{(pid=101893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:44:05.916226 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fddc1550-5144-4a2a-8b60-067160b917f4 None None] Authenticating user token {{(pid=101892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:44:05.933587 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-404c51e5-188e-464a-9312-587004b8e24d None admin] Validating token access rules against request {{(pid=101893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:44:05.974231 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb572df2-09c2-4325-b6df-361ac96edca5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:44:05.974891 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb572df2-09c2-4325-b6df-361ac96edca5 None admin] REQUEST_METHOD: `GET` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:44:05.975438 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb572df2-09c2-4325-b6df-361ac96edca5 None admin] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:44:05.975438 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb572df2-09c2-4325-b6df-361ac96edca5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:44:06.028557 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fddc1550-5144-4a2a-8b60-067160b917f4 None None] Validating token access rules against request {{(pid=101892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:44:06.048562 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb572df2-09c2-4325-b6df-361ac96edca5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:44:06.050963 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb572df2-09c2-4325-b6df-361ac96edca5 None admin] RBAC: Authorization granted {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:44:06.067408 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa141483-602e-4a07-84f0-45a119743891 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:44:06.068459 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa141483-602e-4a07-84f0-45a119743891 None admin] REQUEST_METHOD: `GET` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:44:06.068936 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa141483-602e-4a07-84f0-45a119743891 None admin] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:44:06.069216 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa141483-602e-4a07-84f0-45a119743891 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:44:06.080837 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa141483-602e-4a07-84f0-45a119743891 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 14:44:06.089100 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application [None req-fa141483-602e-4a07-84f0-45a119743891 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 25 14:44:06.089100 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:44:06.089100 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 14:44:06.089100 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 14:44:06.089100 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 14:44:06.089100 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 14:44:06.089100 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 14:44:06.089100 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 14:44:06.089100 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 14:44:06.089100 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 14:44:06.089100 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 14:44:06.089100 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 14:44:06.089100 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 14:44:06.089100 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 14:44:06.089100 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 14:44:06.089100 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 14:44:06.090100 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 14:44:06.090100 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 14:44:06.090100 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 14:44:06.090100 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 14:44:06.090100 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 14:44:06.090100 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 14:44:06.090100 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 14:44:06.090100 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 14:44:06.090100 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 14:44:06.090100 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application return self.get_or_create( May 25 14:44:06.090100 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 14:44:06.090100 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application with Lock( May 25 14:44:06.090100 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 14:44:06.090100 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application return self._enter() May 25 14:44:06.090100 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 14:44:06.090100 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 14:44:06.092565 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 14:44:06.092565 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application return self.creator() May 25 14:44:06.092565 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 14:44:06.092565 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application created_value = creator( May 25 14:44:06.092565 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 14:44:06.092565 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 14:44:06.092565 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 14:44:06.092565 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 14:44:06.092565 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 14:44:06.092565 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 14:44:06.092565 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 25 14:44:06.092565 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application May 25 14:44:06.092565 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 521/1053] 10.222.0.84 () {56 vars in 1120 bytes} [Wed May 25 14:44:05 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 25 14:44:06.096818 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa141483-602e-4a07-84f0-45a119743891 None admin] Authenticating user token {{(pid=101892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:44:06.126358 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG dbcounter [-] [101893] Writing DB stats keystone:SELECT=100 {{(pid=101893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:44:06.132496 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG dbcounter [-] [101892] Writing DB stats keystone:SELECT=100 {{(pid=101892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:44:06.165992 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 533/1054] 10.222.0.84 () {58 vars in 1282 bytes} [Wed May 25 14:44:05 2022] GET /identity/v3/auth/tokens => generated 1959 bytes in 337 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 25 14:44:06.165992 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11181cc-97b3-4201-8d80-1ce266752c5e None None] REQUEST_METHOD: `GET` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:44:06.165992 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11181cc-97b3-4201-8d80-1ce266752c5e None None] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:44:06.165992 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11181cc-97b3-4201-8d80-1ce266752c5e None None] PATH_INFO: `/` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:44:06.165992 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 534/1055] 10.222.0.84 () {54 vars in 926 bytes} [Wed May 25 14:44:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 14:44:06.168400 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e11181cc-97b3-4201-8d80-1ce266752c5e None None] Authenticating user token {{(pid=101893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:44:06.197598 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa141483-602e-4a07-84f0-45a119743891 None admin] Validating token access rules against request {{(pid=101892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:44:06.234518 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a904691b-fe21-4926-bcbd-4315d097852d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:44:06.235186 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a904691b-fe21-4926-bcbd-4315d097852d None admin] REQUEST_METHOD: `GET` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:44:06.235450 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a904691b-fe21-4926-bcbd-4315d097852d None admin] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:44:06.235754 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a904691b-fe21-4926-bcbd-4315d097852d None admin] PATH_INFO: `/v3/roles` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:44:06.236497 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a904691b-fe21-4926-bcbd-4315d097852d None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=101892) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:44:06.236808 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a904691b-fe21-4926-bcbd-4315d097852d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:44:06.238871 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a904691b-fe21-4926-bcbd-4315d097852d None admin] RBAC: Authorization granted {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:44:06.247012 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 522/1056] 10.222.0.84 () {56 vars in 1115 bytes} [Wed May 25 14:44:06 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 14:44:06.248249 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb642377-e20e-4cc3-a2a7-9052249cc3fe None None] REQUEST_METHOD: `POST` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:44:06.250473 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb642377-e20e-4cc3-a2a7-9052249cc3fe None None] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:44:06.250473 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb642377-e20e-4cc3-a2a7-9052249cc3fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:44:06.265220 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.auth.core [None req-fb642377-e20e-4cc3-a2a7-9052249cc3fe None None] MFA Rules not processed for user `05d87e87798e429aa1c10b24391f915e`. Rule list: `[]` (Enabled: `True`). {{(pid=101892) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:44:06.266399 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.fernet_utils [None req-fb642377-e20e-4cc3-a2a7-9052249cc3fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=101892) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:44:06.275587 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e11181cc-97b3-4201-8d80-1ce266752c5e None None] Validating token access rules against request {{(pid=101893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:44:06.311216 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8516f31-0e8a-492b-951f-83ce9b18ded3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:44:06.313850 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8516f31-0e8a-492b-951f-83ce9b18ded3 None admin] REQUEST_METHOD: `GET` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:44:06.314139 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8516f31-0e8a-492b-951f-83ce9b18ded3 None admin] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:44:06.314414 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8516f31-0e8a-492b-951f-83ce9b18ded3 None admin] PATH_INFO: `/v3/projects/05fdc09bc44e44c0bc6223ba0727907c` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:44:06.315659 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8516f31-0e8a-492b-951f-83ce9b18ded3 None admin] RBAC: Authorizing `identity:get_project(project_id=05fdc09bc44e44c0bc6223ba0727907c)` {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:44:06.317104 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8516f31-0e8a-492b-951f-83ce9b18ded3 None admin] RBAC: Authorization granted {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:44:06.318802 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 535/1057] 10.222.0.84 () {56 vars in 1186 bytes} [Wed May 25 14:44:06 2022] GET /identity/v3/projects/05fdc09bc44e44c0bc6223ba0727907c => generated 311 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:44:06.319617 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8516f31-0e8a-492b-951f-83ce9b18ded3 None admin] Authenticating user token {{(pid=101893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:44:06.337408 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 523/1058] 10.222.0.84 () {58 vars in 1023 bytes} [Wed May 25 14:44:06 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 25 14:44:06.338249 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb642377-e20e-4cc3-a2a7-9052249cc3fe None None] Authenticating user token {{(pid=101892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:44:06.356001 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG dbcounter [-] [101893] Writing DB stats keystone:SELECT=100 {{(pid=101893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:44:06.380828 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG dbcounter [-] [101892] Writing DB stats keystone:SELECT=100 {{(pid=101892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:44:06.429496 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8516f31-0e8a-492b-951f-83ce9b18ded3 None admin] Validating token access rules against request {{(pid=101893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:44:06.452512 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb642377-e20e-4cc3-a2a7-9052249cc3fe None None] Validating token access rules against request {{(pid=101892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:44:06.462787 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d770199b-d31b-4449-ba4c-1851c115cb34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:44:06.463609 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d770199b-d31b-4449-ba4c-1851c115cb34 None admin] REQUEST_METHOD: `GET` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:44:06.463903 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d770199b-d31b-4449-ba4c-1851c115cb34 None admin] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:44:06.464183 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d770199b-d31b-4449-ba4c-1851c115cb34 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:44:06.475538 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d770199b-d31b-4449-ba4c-1851c115cb34 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:44:06.477029 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d770199b-d31b-4449-ba4c-1851c115cb34 None admin] RBAC: Authorization granted {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:44:06.487091 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf603879-b8b2-4b5b-9c44-0e10b693faab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:44:06.488317 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf603879-b8b2-4b5b-9c44-0e10b693faab None admin] REQUEST_METHOD: `GET` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:44:06.488607 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf603879-b8b2-4b5b-9c44-0e10b693faab None admin] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:44:06.488882 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf603879-b8b2-4b5b-9c44-0e10b693faab None admin] PATH_INFO: `/v3/role_assignments` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:44:06.489702 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf603879-b8b2-4b5b-9c44-0e10b693faab None admin] RBAC: Adding query filter params (role.id=a3b78e7d547d4d2d998b4c99a4396bba, scope.project.id=05fdc09bc44e44c0bc6223ba0727907c, user.id=faedece942af4c0182a75ee8d5b6be3c) {{(pid=101892) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:44:06.490016 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf603879-b8b2-4b5b-9c44-0e10b693faab None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:44:06.491423 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf603879-b8b2-4b5b-9c44-0e10b693faab None admin] RBAC: Authorization granted {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:44:06.495323 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application [None req-d770199b-d31b-4449-ba4c-1851c115cb34 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 25 14:44:06.495323 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:44:06.495323 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 14:44:06.495323 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 14:44:06.495323 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 14:44:06.495323 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 14:44:06.495323 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 14:44:06.495323 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 14:44:06.495323 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 14:44:06.495323 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 14:44:06.495323 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 14:44:06.495323 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 14:44:06.495323 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 25 14:44:06.495323 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 25 14:44:06.495323 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 25 14:44:06.496265 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 25 14:44:06.496265 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 14:44:06.496265 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 14:44:06.496265 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 14:44:06.496265 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 14:44:06.496265 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 14:44:06.496265 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return self.get_or_create( May 25 14:44:06.496265 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 14:44:06.496265 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application with Lock( May 25 14:44:06.496265 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 14:44:06.496265 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return self._enter() May 25 14:44:06.496265 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 14:44:06.496265 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 14:44:06.496265 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 14:44:06.496265 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return self.creator() May 25 14:44:06.496265 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 14:44:06.496265 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application created_value = creator( May 25 14:44:06.497345 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 25 14:44:06.497345 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 25 14:44:06.497345 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 25 14:44:06.497345 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application May 25 14:44:06.497345 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 536/1059] 10.222.0.84 () {56 vars in 1108 bytes} [Wed May 25 14:44:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 14:44:06.497628 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 524/1060] 10.222.0.84 () {56 vars in 1374 bytes} [Wed May 25 14:44:06 2022] GET /identity/v3/role_assignments?user.id=faedece942af4c0182a75ee8d5b6be3c&scope.project.id=05fdc09bc44e44c0bc6223ba0727907c&role.id=a3b78e7d547d4d2d998b4c99a4396bba => generated 259 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:44:06.497710 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d770199b-d31b-4449-ba4c-1851c115cb34 None admin] Authenticating user token {{(pid=101893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:44:06.502326 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf603879-b8b2-4b5b-9c44-0e10b693faab None admin] Authenticating user token {{(pid=101892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:44:06.599722 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG dbcounter [-] [101893] Writing DB stats keystone:SELECT=100 {{(pid=101893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:44:06.614329 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG dbcounter [-] [101892] Writing DB stats keystone:SELECT=100 {{(pid=101892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:44:06.617464 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d770199b-d31b-4449-ba4c-1851c115cb34 None admin] Validating token access rules against request {{(pid=101893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:44:06.624729 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf603879-b8b2-4b5b-9c44-0e10b693faab None admin] Validating token access rules against request {{(pid=101892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:44:06.657026 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b59cdc-ea3d-4d40-9b18-4c24fe22a933 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:44:06.657839 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b59cdc-ea3d-4d40-9b18-4c24fe22a933 None admin] REQUEST_METHOD: `GET` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:44:06.658122 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b59cdc-ea3d-4d40-9b18-4c24fe22a933 None admin] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:44:06.658402 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b59cdc-ea3d-4d40-9b18-4c24fe22a933 None admin] PATH_INFO: `/v3/services/image` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:44:06.659102 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50b59cdc-ea3d-4d40-9b18-4c24fe22a933 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:44:06.660619 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50b59cdc-ea3d-4d40-9b18-4c24fe22a933 None admin] RBAC: Authorization granted {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:44:06.663621 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b13df0-28d1-4e68-a671-4452f15a87c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:44:06.664373 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b13df0-28d1-4e68-a671-4452f15a87c1 None admin] REQUEST_METHOD: `GET` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:44:06.664663 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b13df0-28d1-4e68-a671-4452f15a87c1 None admin] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:44:06.664944 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b13df0-28d1-4e68-a671-4452f15a87c1 None admin] PATH_INFO: `/v3/domains` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:44:06.665689 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6b13df0-28d1-4e68-a671-4452f15a87c1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=101892) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:44:06.666002 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6b13df0-28d1-4e68-a671-4452f15a87c1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:44:06.667398 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6b13df0-28d1-4e68-a671-4452f15a87c1 None admin] RBAC: Authorization granted {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:44:06.673141 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application [None req-50b59cdc-ea3d-4d40-9b18-4c24fe22a933 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. May 25 14:44:06.673141 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:44:06.673141 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 25 14:44:06.673141 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 25 14:44:06.673141 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 25 14:44:06.673141 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 25 14:44:06.673141 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 25 14:44:06.673141 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 25 14:44:06.673141 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. May 25 14:44:06.673141 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application May 25 14:44:06.673141 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 25 14:44:06.673141 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application May 25 14:44:06.673141 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:44:06.673141 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 14:44:06.673141 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 14:44:06.673141 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 14:44:06.673141 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 14:44:06.674198 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 14:44:06.674198 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 14:44:06.674198 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 14:44:06.674198 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 14:44:06.674198 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 14:44:06.674198 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 14:44:06.674198 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 25 14:44:06.674198 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return self._get_service(service_id) May 25 14:44:06.674198 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 25 14:44:06.674198 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 25 14:44:06.674198 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 14:44:06.674198 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 14:44:06.674198 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 14:44:06.674198 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 14:44:06.674198 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 14:44:06.674198 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return self.get_or_create( May 25 14:44:06.675656 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 14:44:06.675656 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application with Lock( May 25 14:44:06.675656 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 14:44:06.675656 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return self._enter() May 25 14:44:06.675656 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 14:44:06.675656 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 14:44:06.675656 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 14:44:06.675656 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return self.creator() May 25 14:44:06.675656 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 14:44:06.675656 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application created_value = creator( May 25 14:44:06.675656 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 25 14:44:06.675656 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 25 14:44:06.675656 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. May 25 14:44:06.675656 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application May 25 14:44:06.675656 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 537/1061] 10.222.0.84 () {56 vars in 1105 bytes} [Wed May 25 14:44:06 2022] GET /identity/v3/services/image => generated 86 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 14:44:06.681186 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b59cdc-ea3d-4d40-9b18-4c24fe22a933 None admin] Authenticating user token {{(pid=101893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:44:06.687416 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 525/1062] 10.222.0.84 () {56 vars in 1109 bytes} [Wed May 25 14:44:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 14:44:06.688328 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b13df0-28d1-4e68-a671-4452f15a87c1 None admin] Authenticating user token {{(pid=101892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:44:06.794351 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b13df0-28d1-4e68-a671-4452f15a87c1 None admin] Validating token access rules against request {{(pid=101892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:44:06.797651 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b59cdc-ea3d-4d40-9b18-4c24fe22a933 None admin] Validating token access rules against request {{(pid=101893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:44:06.829620 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b21622eb-26eb-45df-bf5b-6e57360582c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:44:06.830414 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21622eb-26eb-45df-bf5b-6e57360582c4 None admin] REQUEST_METHOD: `GET` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:44:06.830699 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21622eb-26eb-45df-bf5b-6e57360582c4 None admin] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:44:06.831516 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21622eb-26eb-45df-bf5b-6e57360582c4 None admin] PATH_INFO: `/v3/users/nova` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:44:06.833280 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adafb8cc-fe1e-42be-9836-42f07ea40891 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:44:06.833949 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adafb8cc-fe1e-42be-9836-42f07ea40891 None admin] REQUEST_METHOD: `GET` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:44:06.834237 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adafb8cc-fe1e-42be-9836-42f07ea40891 None admin] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:44:06.834518 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adafb8cc-fe1e-42be-9836-42f07ea40891 None admin] PATH_INFO: `/v3/services` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:44:06.835230 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adafb8cc-fe1e-42be-9836-42f07ea40891 None admin] RBAC: Adding query filter params (name=image) {{(pid=101893) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:44:06.835543 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adafb8cc-fe1e-42be-9836-42f07ea40891 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:44:06.836946 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adafb8cc-fe1e-42be-9836-42f07ea40891 None admin] RBAC: Authorization granted {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:44:06.840152 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b21622eb-26eb-45df-bf5b-6e57360582c4 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:44:06.841582 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b21622eb-26eb-45df-bf5b-6e57360582c4 None admin] RBAC: Authorization granted {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:44:06.842263 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 538/1063] 10.222.0.84 () {56 vars in 1108 bytes} [Wed May 25 14:44:06 2022] GET /identity/v3/services?name=image => generated 122 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 14:44:06.848345 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adafb8cc-fe1e-42be-9836-42f07ea40891 None admin] Authenticating user token {{(pid=101893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:44:06.861366 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application [None req-b21622eb-26eb-45df-bf5b-6e57360582c4 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 25 14:44:06.861366 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:44:06.861366 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 14:44:06.861366 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 14:44:06.861366 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 14:44:06.861366 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 14:44:06.861366 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 14:44:06.861366 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 14:44:06.861366 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 14:44:06.861366 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 14:44:06.861366 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 14:44:06.861366 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 14:44:06.861366 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 25 14:44:06.861366 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application return self._get_user(user_id) May 25 14:44:06.861366 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 25 14:44:06.861366 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 25 14:44:06.862351 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 14:44:06.862351 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 14:44:06.862351 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 25 14:44:06.862351 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 25 14:44:06.862351 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 25 14:44:06.862351 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 25 14:44:06.862351 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 14:44:06.862351 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 14:44:06.862351 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 14:44:06.862351 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application return self.get_or_create( May 25 14:44:06.862351 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 14:44:06.862351 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application with Lock( May 25 14:44:06.862351 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 14:44:06.862351 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application return self._enter() May 25 14:44:06.862351 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 14:44:06.862351 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 14:44:06.862351 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 14:44:06.862351 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application return self.creator() May 25 14:44:06.863324 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 14:44:06.863324 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application created_value = creator( May 25 14:44:06.863324 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 25 14:44:06.863324 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 25 14:44:06.863324 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 25 14:44:06.863324 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 25 14:44:06.863324 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 25 14:44:06.863324 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 25 14:44:06.863324 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 25 14:44:06.863324 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application May 25 14:44:06.865281 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG dbcounter [-] [101893] Writing DB stats keystone:SELECT=100 {{(pid=101893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:44:06.867390 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 526/1064] 10.222.0.84 () {56 vars in 1093 bytes} [Wed May 25 14:44:06 2022] GET /identity/v3/users/nova => generated 82 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 25 14:44:06.868257 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b21622eb-26eb-45df-bf5b-6e57360582c4 None admin] Authenticating user token {{(pid=101892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:44:06.881827 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG dbcounter [-] [101892] Writing DB stats keystone:SELECT=100 {{(pid=101892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:44:06.958603 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adafb8cc-fe1e-42be-9836-42f07ea40891 None admin] Validating token access rules against request {{(pid=101893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:44:06.982048 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b21622eb-26eb-45df-bf5b-6e57360582c4 None admin] Validating token access rules against request {{(pid=101892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:44:07.000596 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c79bfbf-ba1d-4005-a64d-6aa7b5b1565c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:44:07.001275 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c79bfbf-ba1d-4005-a64d-6aa7b5b1565c None admin] REQUEST_METHOD: `GET` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:44:07.001560 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c79bfbf-ba1d-4005-a64d-6aa7b5b1565c None admin] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:44:07.001837 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c79bfbf-ba1d-4005-a64d-6aa7b5b1565c None admin] PATH_INFO: `/v3/services` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:44:07.002546 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c79bfbf-ba1d-4005-a64d-6aa7b5b1565c None admin] RBAC: Adding query filter params (type=image) {{(pid=101893) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:44:07.002887 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c79bfbf-ba1d-4005-a64d-6aa7b5b1565c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:44:07.004294 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c79bfbf-ba1d-4005-a64d-6aa7b5b1565c None admin] RBAC: Authorization granted {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:44:07.009256 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 539/1065] 10.222.0.84 () {56 vars in 1108 bytes} [Wed May 25 14:44:06 2022] GET /identity/v3/services?type=image => generated 350 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 14:44:07.014591 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c79bfbf-ba1d-4005-a64d-6aa7b5b1565c None admin] Authenticating user token {{(pid=101893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:44:07.021847 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a61678-ff29-4d1d-95a1-b0201f1efc89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:44:07.022527 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a61678-ff29-4d1d-95a1-b0201f1efc89 None admin] REQUEST_METHOD: `GET` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:44:07.022812 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a61678-ff29-4d1d-95a1-b0201f1efc89 None admin] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:44:07.023090 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a61678-ff29-4d1d-95a1-b0201f1efc89 None admin] PATH_INFO: `/v3/users` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:44:07.023971 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7a61678-ff29-4d1d-95a1-b0201f1efc89 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=101892) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:44:07.024285 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7a61678-ff29-4d1d-95a1-b0201f1efc89 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:44:07.025805 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7a61678-ff29-4d1d-95a1-b0201f1efc89 None admin] RBAC: Authorization granted {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:44:07.048182 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 527/1066] 10.222.0.84 () {56 vars in 1133 bytes} [Wed May 25 14:44:06 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:44:07.049781 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a61678-ff29-4d1d-95a1-b0201f1efc89 None admin] Authenticating user token {{(pid=101892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:44:07.097157 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG dbcounter [-] [101893] Writing DB stats keystone:SELECT=100 {{(pid=101893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:44:07.119324 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c79bfbf-ba1d-4005-a64d-6aa7b5b1565c None admin] Validating token access rules against request {{(pid=101893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:44:07.125164 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG dbcounter [-] [101892] Writing DB stats keystone:SELECT=100 {{(pid=101892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:44:07.153918 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f822b5-4c19-45a1-93d2-da578220de0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:44:07.154587 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f822b5-4c19-45a1-93d2-da578220de0d None admin] REQUEST_METHOD: `POST` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:44:07.154874 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f822b5-4c19-45a1-93d2-da578220de0d None admin] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:44:07.155153 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f822b5-4c19-45a1-93d2-da578220de0d None admin] PATH_INFO: `/v3/endpoints` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:44:07.156144 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1f822b5-4c19-45a1-93d2-da578220de0d None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:44:07.156958 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a61678-ff29-4d1d-95a1-b0201f1efc89 None admin] Validating token access rules against request {{(pid=101892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:44:07.157582 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1f822b5-4c19-45a1-93d2-da578220de0d None admin] RBAC: Authorization granted {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:44:07.191811 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ded75af-9a5d-416a-ac9d-dc68effc33c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:44:07.192596 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ded75af-9a5d-416a-ac9d-dc68effc33c6 None admin] REQUEST_METHOD: `GET` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:44:07.192879 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ded75af-9a5d-416a-ac9d-dc68effc33c6 None admin] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:44:07.193157 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ded75af-9a5d-416a-ac9d-dc68effc33c6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:44:07.203014 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ded75af-9a5d-416a-ac9d-dc68effc33c6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:44:07.204478 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ded75af-9a5d-416a-ac9d-dc68effc33c6 None admin] RBAC: Authorization granted {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:44:07.222212 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application [None req-1ded75af-9a5d-416a-ac9d-dc68effc33c6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 25 14:44:07.222212 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:44:07.222212 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 14:44:07.222212 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 14:44:07.222212 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 14:44:07.222212 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 14:44:07.222212 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 14:44:07.222212 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 14:44:07.222212 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 14:44:07.222212 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 14:44:07.222212 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 14:44:07.222212 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 14:44:07.222212 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 25 14:44:07.222212 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 25 14:44:07.222212 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 25 14:44:07.223309 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 25 14:44:07.223309 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 14:44:07.223309 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 14:44:07.223309 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 14:44:07.223309 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 14:44:07.223309 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 14:44:07.223309 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application return self.get_or_create( May 25 14:44:07.223309 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 14:44:07.223309 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application with Lock( May 25 14:44:07.223309 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 14:44:07.223309 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application return self._enter() May 25 14:44:07.223309 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 14:44:07.223309 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 14:44:07.223309 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 14:44:07.223309 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application return self.creator() May 25 14:44:07.223309 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 14:44:07.223309 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application created_value = creator( May 25 14:44:07.229250 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 25 14:44:07.229250 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 25 14:44:07.229250 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 25 14:44:07.229250 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application May 25 14:44:07.229250 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 528/1067] 10.222.0.84 () {56 vars in 1108 bytes} [Wed May 25 14:44:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 25 14:44:07.229761 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ded75af-9a5d-416a-ac9d-dc68effc33c6 None admin] Authenticating user token {{(pid=101892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:44:07.243635 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 540/1068] 10.222.0.84 () {60 vars in 1144 bytes} [Wed May 25 14:44:07 2022] POST /identity/v3/endpoints => generated 327 bytes in 221 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 25 14:44:07.341862 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ded75af-9a5d-416a-ac9d-dc68effc33c6 None admin] Validating token access rules against request {{(pid=101892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:44:07.364025 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG dbcounter [-] [101892] Writing DB stats keystone:SELECT=100 {{(pid=101892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:44:07.386113 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da14ed0d-6264-4676-9887-56ea885ca71b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:44:07.386695 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da14ed0d-6264-4676-9887-56ea885ca71b None admin] REQUEST_METHOD: `GET` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:44:07.386979 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da14ed0d-6264-4676-9887-56ea885ca71b None admin] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:44:07.387255 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da14ed0d-6264-4676-9887-56ea885ca71b None admin] PATH_INFO: `/v3/domains` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:44:07.388018 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da14ed0d-6264-4676-9887-56ea885ca71b None admin] RBAC: Adding query filter params (name=Default) {{(pid=101892) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:44:07.388391 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da14ed0d-6264-4676-9887-56ea885ca71b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:44:07.389805 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da14ed0d-6264-4676-9887-56ea885ca71b None admin] RBAC: Authorization granted {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:44:07.403635 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 529/1069] 10.222.0.84 () {56 vars in 1109 bytes} [Wed May 25 14:44:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 14:44:07.409776 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f822b5-4c19-45a1-93d2-da578220de0d None admin] Authenticating user token {{(pid=101893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:44:07.515311 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f822b5-4c19-45a1-93d2-da578220de0d None admin] Validating token access rules against request {{(pid=101893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:44:07.552941 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-040bfa42-56e5-4f2e-b5cf-0347cb2f440d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:44:07.554072 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040bfa42-56e5-4f2e-b5cf-0347cb2f440d None admin] REQUEST_METHOD: `GET` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:44:07.554582 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040bfa42-56e5-4f2e-b5cf-0347cb2f440d None admin] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:44:07.555036 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040bfa42-56e5-4f2e-b5cf-0347cb2f440d None admin] PATH_INFO: `/v3/projects/service` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:44:07.561847 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG dbcounter [-] [101893] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=101893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:44:07.563124 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-040bfa42-56e5-4f2e-b5cf-0347cb2f440d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:44:07.564873 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-040bfa42-56e5-4f2e-b5cf-0347cb2f440d None admin] RBAC: Authorization granted {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:44:07.579057 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application [None req-040bfa42-56e5-4f2e-b5cf-0347cb2f440d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 25 14:44:07.579057 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:44:07.579057 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 14:44:07.579057 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 14:44:07.579057 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 14:44:07.579057 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 14:44:07.579057 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 14:44:07.579057 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 14:44:07.579057 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 14:44:07.579057 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 14:44:07.579057 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 14:44:07.579057 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 14:44:07.579057 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 25 14:44:07.579057 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return self._get_project(project_id) May 25 14:44:07.579057 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 25 14:44:07.580055 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 25 14:44:07.580055 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 14:44:07.580055 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 14:44:07.580055 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 14:44:07.580055 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 14:44:07.580055 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 14:44:07.580055 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return self.get_or_create( May 25 14:44:07.580055 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 14:44:07.580055 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application with Lock( May 25 14:44:07.580055 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 14:44:07.580055 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return self._enter() May 25 14:44:07.580055 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 14:44:07.580055 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 14:44:07.580055 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 14:44:07.580055 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return self.creator() May 25 14:44:07.580055 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 14:44:07.580055 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application created_value = creator( May 25 14:44:07.581494 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 25 14:44:07.581494 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 25 14:44:07.581494 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 25 14:44:07.581494 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 25 14:44:07.581494 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 25 14:44:07.581494 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 25 14:44:07.581494 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 25 14:44:07.581494 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application May 25 14:44:07.581494 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 541/1070] 10.222.0.84 () {56 vars in 1111 bytes} [Wed May 25 14:44:07 2022] GET /identity/v3/projects/service => generated 88 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 14:44:07.586846 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da14ed0d-6264-4676-9887-56ea885ca71b None admin] Authenticating user token {{(pid=101892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:44:07.693533 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da14ed0d-6264-4676-9887-56ea885ca71b None admin] Validating token access rules against request {{(pid=101892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:44:07.726977 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c3f5b70-bf17-48bb-b041-0a06098d4b49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:44:07.727667 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3f5b70-bf17-48bb-b041-0a06098d4b49 None admin] REQUEST_METHOD: `GET` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:44:07.727953 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3f5b70-bf17-48bb-b041-0a06098d4b49 None admin] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:44:07.728229 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3f5b70-bf17-48bb-b041-0a06098d4b49 None admin] PATH_INFO: `/v3/projects` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:44:07.729007 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c3f5b70-bf17-48bb-b041-0a06098d4b49 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=101892) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:44:07.729317 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c3f5b70-bf17-48bb-b041-0a06098d4b49 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:44:07.730743 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c3f5b70-bf17-48bb-b041-0a06098d4b49 None admin] RBAC: Authorization granted {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:44:07.747901 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 530/1071] 10.222.0.84 () {56 vars in 1148 bytes} [Wed May 25 14:44:07 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:44:07.749478 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-040bfa42-56e5-4f2e-b5cf-0347cb2f440d None admin] Authenticating user token {{(pid=101893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:44:07.852189 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-040bfa42-56e5-4f2e-b5cf-0347cb2f440d None admin] Validating token access rules against request {{(pid=101893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:44:07.886869 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe6bf71f-06f8-438f-b6d7-e9636bd7d471 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:44:07.887774 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6bf71f-06f8-438f-b6d7-e9636bd7d471 None admin] REQUEST_METHOD: `PUT` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:44:07.888059 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6bf71f-06f8-438f-b6d7-e9636bd7d471 None admin] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:44:07.888335 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6bf71f-06f8-438f-b6d7-e9636bd7d471 None admin] PATH_INFO: `/v3/projects/a000829c658c4a7cab67f7b6353ba3fa/users/2aeb182e6a5b43cfb0cc347ec847c848/roles/e36bc54201ab4defa2b100771ec121a4` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:44:07.890509 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe6bf71f-06f8-438f-b6d7-e9636bd7d471 None admin] RBAC: Authorizing `identity:create_grant(project_id=a000829c658c4a7cab67f7b6353ba3fa, user_id=2aeb182e6a5b43cfb0cc347ec847c848, role_id=e36bc54201ab4defa2b100771ec121a4)` {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:44:07.891972 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe6bf71f-06f8-438f-b6d7-e9636bd7d471 None admin] RBAC: Authorization granted {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:44:07.963587 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 542/1072] 10.222.0.84 () {58 vars in 1439 bytes} [Wed May 25 14:44:07 2022] PUT /identity/v3/projects/a000829c658c4a7cab67f7b6353ba3fa/users/2aeb182e6a5b43cfb0cc347ec847c848/roles/e36bc54201ab4defa2b100771ec121a4 => generated 0 bytes in 214 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 14:44:08.729079 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f01196-968d-461f-a9ee-8c0573e55792 None None] REQUEST_METHOD: `GET` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:44:08.729595 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f01196-968d-461f-a9ee-8c0573e55792 None None] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:44:08.729700 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f01196-968d-461f-a9ee-8c0573e55792 None None] PATH_INFO: `/` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:44:08.730973 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 531/1073] 10.222.0.84 () {54 vars in 926 bytes} [Wed May 25 14:44:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 14:44:08.737078 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38763bb-3942-408f-845f-063766a96062 None None] REQUEST_METHOD: `POST` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:44:08.737604 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38763bb-3942-408f-845f-063766a96062 None None] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:44:08.737708 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38763bb-3942-408f-845f-063766a96062 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:44:08.755310 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.auth.core [None req-d38763bb-3942-408f-845f-063766a96062 None None] MFA Rules not processed for user `05d87e87798e429aa1c10b24391f915e`. Rule list: `[]` (Enabled: `True`). {{(pid=101893) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:44:08.756535 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.fernet_utils [None req-d38763bb-3942-408f-845f-063766a96062 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=101893) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:44:08.811246 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG dbcounter [-] [101893] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=101893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:44:08.829866 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 543/1074] 10.222.0.84 () {58 vars in 1023 bytes} [Wed May 25 14:44:08 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 25 14:44:08.852816 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f01196-968d-461f-a9ee-8c0573e55792 None None] Authenticating user token {{(pid=101892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:44:08.894163 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG dbcounter [-] [101892] Writing DB stats keystone:SELECT=100 {{(pid=101892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:44:08.961869 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f01196-968d-461f-a9ee-8c0573e55792 None None] Validating token access rules against request {{(pid=101892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:44:08.995461 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8b535ff-3a00-41b1-a7a5-b232c80f941a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:44:08.996354 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b535ff-3a00-41b1-a7a5-b232c80f941a None admin] REQUEST_METHOD: `GET` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:44:08.996640 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b535ff-3a00-41b1-a7a5-b232c80f941a None admin] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:44:08.996912 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b535ff-3a00-41b1-a7a5-b232c80f941a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:44:09.007478 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8b535ff-3a00-41b1-a7a5-b232c80f941a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 14:44:09.014997 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application [None req-c8b535ff-3a00-41b1-a7a5-b232c80f941a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 25 14:44:09.014997 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:44:09.014997 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 14:44:09.014997 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 14:44:09.014997 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 14:44:09.014997 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 14:44:09.014997 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 14:44:09.014997 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 14:44:09.014997 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 14:44:09.014997 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 14:44:09.014997 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 14:44:09.014997 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 14:44:09.014997 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 14:44:09.014997 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 14:44:09.014997 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 14:44:09.014997 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 14:44:09.016157 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 14:44:09.016157 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 14:44:09.016157 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 14:44:09.016157 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 14:44:09.016157 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 14:44:09.016157 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 14:44:09.016157 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 14:44:09.016157 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 14:44:09.016157 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 14:44:09.016157 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application return self.get_or_create( May 25 14:44:09.016157 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 14:44:09.016157 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application with Lock( May 25 14:44:09.016157 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 14:44:09.016157 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application return self._enter() May 25 14:44:09.016157 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 14:44:09.016157 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 14:44:09.022111 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 14:44:09.022111 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application return self.creator() May 25 14:44:09.022111 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 14:44:09.022111 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application created_value = creator( May 25 14:44:09.022111 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 14:44:09.022111 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 14:44:09.022111 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 14:44:09.022111 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 14:44:09.022111 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 14:44:09.022111 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 14:44:09.022111 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 25 14:44:09.022111 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application May 25 14:44:09.022111 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 532/1075] 10.222.0.84 () {56 vars in 1096 bytes} [Wed May 25 14:44:08 2022] GET /identity/v3/roles/admin => generated 83 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 14:44:09.024384 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d38763bb-3942-408f-845f-063766a96062 None None] Authenticating user token {{(pid=101893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:44:09.126790 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d38763bb-3942-408f-845f-063766a96062 None None] Validating token access rules against request {{(pid=101893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:44:09.160980 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-006780e2-0033-4232-8470-92cdea579ef0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:44:09.161647 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-006780e2-0033-4232-8470-92cdea579ef0 None admin] REQUEST_METHOD: `GET` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:44:09.161930 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-006780e2-0033-4232-8470-92cdea579ef0 None admin] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:44:09.162204 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-006780e2-0033-4232-8470-92cdea579ef0 None admin] PATH_INFO: `/v3/roles` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:44:09.162951 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-006780e2-0033-4232-8470-92cdea579ef0 None admin] RBAC: Adding query filter params (name=admin) {{(pid=101893) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:44:09.163260 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-006780e2-0033-4232-8470-92cdea579ef0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:44:09.164700 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-006780e2-0033-4232-8470-92cdea579ef0 None admin] RBAC: Authorization granted {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:44:09.178468 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 544/1076] 10.222.0.84 () {56 vars in 1099 bytes} [Wed May 25 14:44:09 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:44:09.179840 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8b535ff-3a00-41b1-a7a5-b232c80f941a None admin] Authenticating user token {{(pid=101892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:44:09.277667 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG dbcounter [-] [101892] Writing DB stats keystone:SELECT=100 {{(pid=101892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:44:09.284443 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8b535ff-3a00-41b1-a7a5-b232c80f941a None admin] Validating token access rules against request {{(pid=101892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:44:09.318222 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-301ce9ce-6fbe-4015-9f3c-b795c144428c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:44:09.319086 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301ce9ce-6fbe-4015-9f3c-b795c144428c None admin] REQUEST_METHOD: `GET` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:44:09.319367 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301ce9ce-6fbe-4015-9f3c-b795c144428c None admin] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:44:09.319735 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301ce9ce-6fbe-4015-9f3c-b795c144428c None admin] PATH_INFO: `/v3/users/faedece942af4c0182a75ee8d5b6be3c` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:44:09.320902 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-301ce9ce-6fbe-4015-9f3c-b795c144428c None admin] RBAC: Authorizing `identity:get_user(user_id=faedece942af4c0182a75ee8d5b6be3c)` {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:44:09.322324 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-301ce9ce-6fbe-4015-9f3c-b795c144428c None admin] RBAC: Authorization granted {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:44:09.324172 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 533/1077] 10.222.0.84 () {56 vars in 1177 bytes} [Wed May 25 14:44:09 2022] GET /identity/v3/users/faedece942af4c0182a75ee8d5b6be3c => generated 285 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:44:09.329589 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-006780e2-0033-4232-8470-92cdea579ef0 None admin] Authenticating user token {{(pid=101893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:44:09.380901 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG dbcounter [-] [101893] Writing DB stats keystone:SELECT=100 {{(pid=101893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:44:09.439215 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-006780e2-0033-4232-8470-92cdea579ef0 None admin] Validating token access rules against request {{(pid=101893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:44:09.472649 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84ee2b2a-4bbd-4333-a1b9-c269534a4d8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:44:09.473516 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ee2b2a-4bbd-4333-a1b9-c269534a4d8f None admin] REQUEST_METHOD: `GET` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:44:09.473800 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ee2b2a-4bbd-4333-a1b9-c269534a4d8f None admin] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:44:09.474074 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ee2b2a-4bbd-4333-a1b9-c269534a4d8f None admin] PATH_INFO: `/v3/projects/05fdc09bc44e44c0bc6223ba0727907c` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:44:09.475346 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84ee2b2a-4bbd-4333-a1b9-c269534a4d8f None admin] RBAC: Authorizing `identity:get_project(project_id=05fdc09bc44e44c0bc6223ba0727907c)` {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:44:09.476820 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84ee2b2a-4bbd-4333-a1b9-c269534a4d8f None admin] RBAC: Authorization granted {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:44:09.483296 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 545/1078] 10.222.0.84 () {56 vars in 1186 bytes} [Wed May 25 14:44:09 2022] GET /identity/v3/projects/05fdc09bc44e44c0bc6223ba0727907c => generated 311 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:44:09.484456 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-301ce9ce-6fbe-4015-9f3c-b795c144428c None admin] Authenticating user token {{(pid=101892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:44:09.576283 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075148f0-e818-4b72-a568-725ff64bf807 None None] REQUEST_METHOD: `GET` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:44:09.576663 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075148f0-e818-4b72-a568-725ff64bf807 None None] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:44:09.577012 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075148f0-e818-4b72-a568-725ff64bf807 None None] PATH_INFO: `/` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:44:09.578441 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 546/1079] 10.222.0.84 () {54 vars in 926 bytes} [Wed May 25 14:44:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 25 14:44:09.584060 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89d4c29-94bd-490e-9df9-c3d0eba9e27b None None] REQUEST_METHOD: `POST` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:44:09.584488 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89d4c29-94bd-490e-9df9-c3d0eba9e27b None None] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:44:09.584904 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89d4c29-94bd-490e-9df9-c3d0eba9e27b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:44:09.604017 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-301ce9ce-6fbe-4015-9f3c-b795c144428c None admin] Validating token access rules against request {{(pid=101892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:44:09.604982 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.auth.core [None req-d89d4c29-94bd-490e-9df9-c3d0eba9e27b None None] MFA Rules not processed for user `05d87e87798e429aa1c10b24391f915e`. Rule list: `[]` (Enabled: `True`). {{(pid=101893) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:44:09.606200 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.fernet_utils [None req-d89d4c29-94bd-490e-9df9-c3d0eba9e27b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=101893) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:44:09.649198 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac747c5-c80a-4569-8ab3-bd2a9163e128 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:44:09.650166 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac747c5-c80a-4569-8ab3-bd2a9163e128 None admin] REQUEST_METHOD: `PUT` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:44:09.650454 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac747c5-c80a-4569-8ab3-bd2a9163e128 None admin] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:44:09.652812 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac747c5-c80a-4569-8ab3-bd2a9163e128 None admin] PATH_INFO: `/v3/projects/05fdc09bc44e44c0bc6223ba0727907c/users/faedece942af4c0182a75ee8d5b6be3c/roles/a3b78e7d547d4d2d998b4c99a4396bba` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:44:09.654828 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ac747c5-c80a-4569-8ab3-bd2a9163e128 None admin] RBAC: Authorizing `identity:create_grant(project_id=05fdc09bc44e44c0bc6223ba0727907c, user_id=faedece942af4c0182a75ee8d5b6be3c, role_id=a3b78e7d547d4d2d998b4c99a4396bba)` {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:44:09.656750 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ac747c5-c80a-4569-8ab3-bd2a9163e128 None admin] RBAC: Authorization granted {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:44:09.683744 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 547/1080] 10.222.0.84 () {58 vars in 1023 bytes} [Wed May 25 14:44:09 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 25 14:44:09.705607 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d89d4c29-94bd-490e-9df9-c3d0eba9e27b None None] Authenticating user token {{(pid=101893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:44:09.726282 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 534/1081] 10.222.0.84 () {58 vars in 1439 bytes} [Wed May 25 14:44:09 2022] PUT /identity/v3/projects/05fdc09bc44e44c0bc6223ba0727907c/users/faedece942af4c0182a75ee8d5b6be3c/roles/a3b78e7d547d4d2d998b4c99a4396bba => generated 0 bytes in 242 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 14:44:09.757522 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG dbcounter [-] [101893] Writing DB stats keystone:SELECT=100 {{(pid=101893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:44:09.820934 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d89d4c29-94bd-490e-9df9-c3d0eba9e27b None None] Validating token access rules against request {{(pid=101893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:44:09.857119 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f07ca10-1013-415c-8b1c-40b7e43af215 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:44:09.857799 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f07ca10-1013-415c-8b1c-40b7e43af215 None admin] REQUEST_METHOD: `GET` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:44:09.858085 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f07ca10-1013-415c-8b1c-40b7e43af215 None admin] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:44:09.858365 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f07ca10-1013-415c-8b1c-40b7e43af215 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:44:09.933137 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f07ca10-1013-415c-8b1c-40b7e43af215 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:44:09.934818 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f07ca10-1013-415c-8b1c-40b7e43af215 None admin] RBAC: Authorization granted {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:44:09.981434 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG dbcounter [-] [101893] Writing DB stats keystone:SELECT=100 {{(pid=101893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:44:10.045220 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 548/1082] 10.222.0.84 () {58 vars in 1282 bytes} [Wed May 25 14:44:09 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 335 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) May 25 14:44:10.046914 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac747c5-c80a-4569-8ab3-bd2a9163e128 None admin] Authenticating user token {{(pid=101892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:44:10.074630 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG dbcounter [-] [101892] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=101892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:44:10.151439 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac747c5-c80a-4569-8ab3-bd2a9163e128 None admin] Validating token access rules against request {{(pid=101892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:44:10.185771 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e9fb4b4-a057-43d8-97a8-f40c4a0226dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:44:10.186490 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9fb4b4-a057-43d8-97a8-f40c4a0226dc None admin] REQUEST_METHOD: `GET` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:44:10.186774 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9fb4b4-a057-43d8-97a8-f40c4a0226dc None admin] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:44:10.187053 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9fb4b4-a057-43d8-97a8-f40c4a0226dc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:44:10.197844 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e9fb4b4-a057-43d8-97a8-f40c4a0226dc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:44:10.199290 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e9fb4b4-a057-43d8-97a8-f40c4a0226dc None admin] RBAC: Authorization granted {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:44:10.204520 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6ca492-c853-43f1-ad0f-93c044f86b92 None None] REQUEST_METHOD: `GET` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:44:10.204845 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6ca492-c853-43f1-ad0f-93c044f86b92 None None] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:44:10.205085 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6ca492-c853-43f1-ad0f-93c044f86b92 None None] PATH_INFO: `/` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:44:10.206631 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 549/1083] 10.222.0.84 () {54 vars in 926 bytes} [Wed May 25 14:44:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 25 14:44:10.211458 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf7582c-fb0a-4b38-871e-5071ffefc259 None None] REQUEST_METHOD: `POST` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:44:10.211780 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf7582c-fb0a-4b38-871e-5071ffefc259 None None] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:44:10.212058 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf7582c-fb0a-4b38-871e-5071ffefc259 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:44:10.217329 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application [None req-2e9fb4b4-a057-43d8-97a8-f40c4a0226dc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 25 14:44:10.217329 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:44:10.217329 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 14:44:10.217329 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 14:44:10.217329 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 14:44:10.217329 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 14:44:10.217329 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 14:44:10.217329 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 14:44:10.217329 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 14:44:10.217329 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 14:44:10.217329 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 14:44:10.217329 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 14:44:10.217329 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 25 14:44:10.217329 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 25 14:44:10.217329 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 25 14:44:10.218245 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 25 14:44:10.218245 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 14:44:10.218245 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 14:44:10.218245 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 14:44:10.218245 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 14:44:10.218245 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 14:44:10.218245 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application return self.get_or_create( May 25 14:44:10.218245 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 14:44:10.218245 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application with Lock( May 25 14:44:10.218245 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 14:44:10.218245 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application return self._enter() May 25 14:44:10.218245 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 14:44:10.218245 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 14:44:10.218245 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 14:44:10.218245 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application return self.creator() May 25 14:44:10.218245 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 14:44:10.218245 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application created_value = creator( May 25 14:44:10.219183 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 25 14:44:10.219183 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 25 14:44:10.219183 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 25 14:44:10.219183 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application May 25 14:44:10.223505 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 535/1084] 10.222.0.84 () {56 vars in 1108 bytes} [Wed May 25 14:44:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 14:44:10.226507 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e9fb4b4-a057-43d8-97a8-f40c4a0226dc None admin] Authenticating user token {{(pid=101892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:44:10.231492 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.auth.core [None req-bcf7582c-fb0a-4b38-871e-5071ffefc259 None None] MFA Rules not processed for user `05d87e87798e429aa1c10b24391f915e`. Rule list: `[]` (Enabled: `True`). {{(pid=101893) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:44:10.232807 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.fernet_utils [None req-bcf7582c-fb0a-4b38-871e-5071ffefc259 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=101893) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:44:10.304828 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 550/1085] 10.222.0.84 () {58 vars in 1023 bytes} [Wed May 25 14:44:10 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 25 14:44:10.325896 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG dbcounter [-] [101892] Writing DB stats keystone:SELECT=100 {{(pid=101892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:44:10.327537 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcf7582c-fb0a-4b38-871e-5071ffefc259 None None] Authenticating user token {{(pid=101893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:44:10.351365 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e9fb4b4-a057-43d8-97a8-f40c4a0226dc None admin] Validating token access rules against request {{(pid=101892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:44:10.389420 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5edd536-1ff0-4d87-99ab-8246c565aa32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:44:10.390090 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5edd536-1ff0-4d87-99ab-8246c565aa32 None admin] REQUEST_METHOD: `GET` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:44:10.390380 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5edd536-1ff0-4d87-99ab-8246c565aa32 None admin] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:44:10.390661 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5edd536-1ff0-4d87-99ab-8246c565aa32 None admin] PATH_INFO: `/v3/domains` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:44:10.391386 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5edd536-1ff0-4d87-99ab-8246c565aa32 None admin] RBAC: Adding query filter params (name=Default) {{(pid=101892) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:44:10.391746 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5edd536-1ff0-4d87-99ab-8246c565aa32 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:44:10.393680 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5edd536-1ff0-4d87-99ab-8246c565aa32 None admin] RBAC: Authorization granted {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:44:10.406166 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 536/1086] 10.222.0.84 () {56 vars in 1109 bytes} [Wed May 25 14:44:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 14:44:10.406327 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG dbcounter [-] [101893] Writing DB stats keystone:SELECT=100 {{(pid=101893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:44:10.433208 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcf7582c-fb0a-4b38-871e-5071ffefc259 None None] Validating token access rules against request {{(pid=101893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:44:10.472710 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0eb61cd-2eb0-4352-93cf-c886cbf338d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:44:10.473797 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0eb61cd-2eb0-4352-93cf-c886cbf338d9 None admin] REQUEST_METHOD: `GET` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:44:10.474227 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0eb61cd-2eb0-4352-93cf-c886cbf338d9 None admin] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:44:10.474643 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0eb61cd-2eb0-4352-93cf-c886cbf338d9 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:44:10.486754 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0eb61cd-2eb0-4352-93cf-c886cbf338d9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 14:44:10.495808 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application [None req-d0eb61cd-2eb0-4352-93cf-c886cbf338d9 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 25 14:44:10.495808 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:44:10.495808 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 14:44:10.495808 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 14:44:10.495808 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 14:44:10.495808 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 14:44:10.495808 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 14:44:10.495808 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 14:44:10.495808 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 14:44:10.495808 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 14:44:10.495808 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 14:44:10.495808 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 14:44:10.495808 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 14:44:10.495808 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 14:44:10.495808 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 14:44:10.495808 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 14:44:10.496898 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 14:44:10.496898 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 14:44:10.496898 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 14:44:10.496898 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 14:44:10.496898 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 14:44:10.496898 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 14:44:10.496898 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 14:44:10.496898 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 14:44:10.496898 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 14:44:10.496898 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return self.get_or_create( May 25 14:44:10.496898 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 14:44:10.496898 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application with Lock( May 25 14:44:10.496898 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 14:44:10.496898 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return self._enter() May 25 14:44:10.496898 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 14:44:10.496898 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 14:44:10.502735 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 14:44:10.502735 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return self.creator() May 25 14:44:10.502735 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 14:44:10.502735 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application created_value = creator( May 25 14:44:10.502735 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 14:44:10.502735 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 14:44:10.502735 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 14:44:10.502735 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 14:44:10.502735 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 14:44:10.502735 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 14:44:10.502735 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 25 14:44:10.502735 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application May 25 14:44:10.502735 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 551/1087] 10.222.0.84 () {56 vars in 1120 bytes} [Wed May 25 14:44:10 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 25 14:44:10.503973 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5edd536-1ff0-4d87-99ab-8246c565aa32 None admin] Authenticating user token {{(pid=101892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:44:10.618461 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5edd536-1ff0-4d87-99ab-8246c565aa32 None admin] Validating token access rules against request {{(pid=101892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:44:10.660541 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-084e8bb0-6c15-4d08-8249-8ac05a77a8fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:44:10.661519 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084e8bb0-6c15-4d08-8249-8ac05a77a8fb None admin] REQUEST_METHOD: `GET` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:44:10.661799 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084e8bb0-6c15-4d08-8249-8ac05a77a8fb None admin] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:44:10.662071 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084e8bb0-6c15-4d08-8249-8ac05a77a8fb None admin] PATH_INFO: `/v3/roles` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:44:10.662816 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-084e8bb0-6c15-4d08-8249-8ac05a77a8fb None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=101892) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:44:10.663125 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-084e8bb0-6c15-4d08-8249-8ac05a77a8fb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:44:10.664568 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-084e8bb0-6c15-4d08-8249-8ac05a77a8fb None admin] RBAC: Authorization granted {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:44:10.666913 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG dbcounter [-] [101892] Writing DB stats keystone:SELECT=100 {{(pid=101892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:44:10.673361 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 537/1088] 10.222.0.84 () {56 vars in 1115 bytes} [Wed May 25 14:44:10 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 14:44:10.679018 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0eb61cd-2eb0-4352-93cf-c886cbf338d9 None admin] Authenticating user token {{(pid=101893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:44:10.788211 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0eb61cd-2eb0-4352-93cf-c886cbf338d9 None admin] Validating token access rules against request {{(pid=101893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:44:10.820709 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e17cb04-ed60-479d-b825-d1a28a82776d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:44:10.821499 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e17cb04-ed60-479d-b825-d1a28a82776d None admin] REQUEST_METHOD: `GET` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:44:10.821782 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e17cb04-ed60-479d-b825-d1a28a82776d None admin] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:44:10.822055 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e17cb04-ed60-479d-b825-d1a28a82776d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:44:10.823935 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG dbcounter [-] [101893] Writing DB stats keystone:SELECT=100 {{(pid=101893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:44:10.833354 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e17cb04-ed60-479d-b825-d1a28a82776d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:44:10.835730 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e17cb04-ed60-479d-b825-d1a28a82776d None admin] RBAC: Authorization granted {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:44:10.853272 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application [None req-4e17cb04-ed60-479d-b825-d1a28a82776d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 25 14:44:10.853272 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:44:10.853272 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 14:44:10.853272 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 14:44:10.853272 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 14:44:10.853272 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 14:44:10.853272 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 14:44:10.853272 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 14:44:10.853272 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 14:44:10.853272 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 14:44:10.853272 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 14:44:10.853272 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 14:44:10.853272 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 25 14:44:10.853272 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 25 14:44:10.853272 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 25 14:44:10.854269 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 25 14:44:10.854269 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 14:44:10.854269 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 14:44:10.854269 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 14:44:10.854269 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 14:44:10.854269 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 14:44:10.854269 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return self.get_or_create( May 25 14:44:10.854269 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 14:44:10.854269 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application with Lock( May 25 14:44:10.854269 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 14:44:10.854269 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return self._enter() May 25 14:44:10.854269 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 14:44:10.854269 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 14:44:10.854269 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 14:44:10.854269 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return self.creator() May 25 14:44:10.854269 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 14:44:10.854269 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application created_value = creator( May 25 14:44:10.855185 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 25 14:44:10.855185 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 25 14:44:10.855185 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 25 14:44:10.855185 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application May 25 14:44:10.859887 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 552/1089] 10.222.0.84 () {56 vars in 1108 bytes} [Wed May 25 14:44:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 14:44:10.860852 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-084e8bb0-6c15-4d08-8249-8ac05a77a8fb None admin] Authenticating user token {{(pid=101892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:44:10.962588 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-084e8bb0-6c15-4d08-8249-8ac05a77a8fb None admin] Validating token access rules against request {{(pid=101892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:44:10.994917 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab058363-de2f-4df4-b863-2fcbbb862e07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:44:10.995598 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab058363-de2f-4df4-b863-2fcbbb862e07 None admin] REQUEST_METHOD: `GET` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:44:10.995893 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab058363-de2f-4df4-b863-2fcbbb862e07 None admin] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:44:10.996147 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab058363-de2f-4df4-b863-2fcbbb862e07 None admin] PATH_INFO: `/v3/domains` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:44:10.996864 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab058363-de2f-4df4-b863-2fcbbb862e07 None admin] RBAC: Adding query filter params (name=Default) {{(pid=101892) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:44:10.997171 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab058363-de2f-4df4-b863-2fcbbb862e07 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:44:10.998535 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab058363-de2f-4df4-b863-2fcbbb862e07 None admin] RBAC: Authorization granted {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:44:11.010480 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 538/1090] 10.222.0.84 () {56 vars in 1109 bytes} [Wed May 25 14:44:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 14:44:11.016001 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e17cb04-ed60-479d-b825-d1a28a82776d None admin] Authenticating user token {{(pid=101893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:44:11.114894 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e17cb04-ed60-479d-b825-d1a28a82776d None admin] Validating token access rules against request {{(pid=101893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:44:11.147486 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d84f696e-9240-4d06-80a7-a814bea702d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:44:11.148307 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84f696e-9240-4d06-80a7-a814bea702d6 None admin] REQUEST_METHOD: `GET` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:44:11.148594 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84f696e-9240-4d06-80a7-a814bea702d6 None admin] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:44:11.148873 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84f696e-9240-4d06-80a7-a814bea702d6 None admin] PATH_INFO: `/v3/users/nova` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:44:11.156103 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d84f696e-9240-4d06-80a7-a814bea702d6 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:44:11.157564 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d84f696e-9240-4d06-80a7-a814bea702d6 None admin] RBAC: Authorization granted {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:44:11.172180 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application [None req-d84f696e-9240-4d06-80a7-a814bea702d6 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 25 14:44:11.172180 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:44:11.172180 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 14:44:11.172180 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 14:44:11.172180 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 14:44:11.172180 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 14:44:11.172180 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 14:44:11.172180 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 14:44:11.172180 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 14:44:11.172180 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 14:44:11.172180 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 14:44:11.172180 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 14:44:11.172180 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 25 14:44:11.172180 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return self._get_user(user_id) May 25 14:44:11.172180 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 25 14:44:11.172180 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 25 14:44:11.173294 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 14:44:11.173294 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 14:44:11.173294 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 25 14:44:11.173294 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 25 14:44:11.173294 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 25 14:44:11.173294 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 25 14:44:11.173294 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 14:44:11.173294 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 14:44:11.173294 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 14:44:11.173294 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return self.get_or_create( May 25 14:44:11.173294 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 14:44:11.173294 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application with Lock( May 25 14:44:11.173294 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 14:44:11.173294 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return self._enter() May 25 14:44:11.173294 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 14:44:11.173294 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 14:44:11.173294 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 14:44:11.173294 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return self.creator() May 25 14:44:11.174315 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 14:44:11.174315 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application created_value = creator( May 25 14:44:11.174315 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 25 14:44:11.174315 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 25 14:44:11.174315 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 25 14:44:11.174315 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 25 14:44:11.174315 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 25 14:44:11.174315 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 25 14:44:11.174315 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 25 14:44:11.174315 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application May 25 14:44:11.174315 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 553/1091] 10.222.0.84 () {56 vars in 1093 bytes} [Wed May 25 14:44:11 2022] GET /identity/v3/users/nova => generated 82 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 25 14:44:11.179012 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab058363-de2f-4df4-b863-2fcbbb862e07 None admin] Authenticating user token {{(pid=101892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:44:11.249003 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG dbcounter [-] [101892] Writing DB stats keystone:SELECT=100 {{(pid=101892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:44:11.289892 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab058363-de2f-4df4-b863-2fcbbb862e07 None admin] Validating token access rules against request {{(pid=101892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:44:11.337633 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4ab0052-3f06-4ca4-837c-ed486c7fa85a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:44:11.338298 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ab0052-3f06-4ca4-837c-ed486c7fa85a None admin] REQUEST_METHOD: `GET` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:44:11.338581 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ab0052-3f06-4ca4-837c-ed486c7fa85a None admin] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:44:11.338858 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ab0052-3f06-4ca4-837c-ed486c7fa85a None admin] PATH_INFO: `/v3/users` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:44:11.339715 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4ab0052-3f06-4ca4-837c-ed486c7fa85a None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=101892) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:44:11.340027 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4ab0052-3f06-4ca4-837c-ed486c7fa85a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:44:11.341447 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4ab0052-3f06-4ca4-837c-ed486c7fa85a None admin] RBAC: Authorization granted {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:44:11.358615 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 539/1092] 10.222.0.84 () {56 vars in 1133 bytes} [Wed May 25 14:44:11 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:44:11.364364 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d84f696e-9240-4d06-80a7-a814bea702d6 None admin] Authenticating user token {{(pid=101893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:44:11.411274 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG dbcounter [-] [101893] Writing DB stats keystone:SELECT=100 {{(pid=101893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:44:11.463174 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d84f696e-9240-4d06-80a7-a814bea702d6 None admin] Validating token access rules against request {{(pid=101893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:44:11.495411 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-451d72e1-3400-4f64-98f2-78c3934d1c06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:44:11.496081 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451d72e1-3400-4f64-98f2-78c3934d1c06 None admin] REQUEST_METHOD: `GET` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:44:11.496363 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451d72e1-3400-4f64-98f2-78c3934d1c06 None admin] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:44:11.496636 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451d72e1-3400-4f64-98f2-78c3934d1c06 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:44:11.566069 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-451d72e1-3400-4f64-98f2-78c3934d1c06 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:44:11.567531 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-451d72e1-3400-4f64-98f2-78c3934d1c06 None admin] RBAC: Authorization granted {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:44:11.618500 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG dbcounter [-] [101893] Writing DB stats keystone:SELECT=100 {{(pid=101893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:44:11.672067 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 554/1093] 10.222.0.84 () {58 vars in 1282 bytes} [Wed May 25 14:44:11 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 25 14:44:11.677821 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4ab0052-3f06-4ca4-837c-ed486c7fa85a None admin] Authenticating user token {{(pid=101892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:44:11.776655 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4ab0052-3f06-4ca4-837c-ed486c7fa85a None admin] Validating token access rules against request {{(pid=101892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:44:11.794341 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG dbcounter [-] [101892] Writing DB stats keystone:SELECT=100 {{(pid=101892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:44:11.811920 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c5ca18-a4ec-486b-9c2c-da30985b3ef7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:44:11.812709 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c5ca18-a4ec-486b-9c2c-da30985b3ef7 None admin] REQUEST_METHOD: `GET` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:44:11.812989 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c5ca18-a4ec-486b-9c2c-da30985b3ef7 None admin] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:44:11.813263 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c5ca18-a4ec-486b-9c2c-da30985b3ef7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:44:11.824230 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60c5ca18-a4ec-486b-9c2c-da30985b3ef7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:44:11.825688 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60c5ca18-a4ec-486b-9c2c-da30985b3ef7 None admin] RBAC: Authorization granted {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:44:11.843111 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application [None req-60c5ca18-a4ec-486b-9c2c-da30985b3ef7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 25 14:44:11.843111 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:44:11.843111 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 14:44:11.843111 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 14:44:11.843111 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 14:44:11.843111 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 14:44:11.843111 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 14:44:11.843111 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 14:44:11.843111 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 14:44:11.843111 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 14:44:11.843111 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 14:44:11.843111 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 14:44:11.843111 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 25 14:44:11.843111 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 25 14:44:11.843111 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 25 14:44:11.844328 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 25 14:44:11.844328 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 14:44:11.844328 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 14:44:11.844328 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 14:44:11.844328 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 14:44:11.844328 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 14:44:11.844328 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application return self.get_or_create( May 25 14:44:11.844328 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 14:44:11.844328 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application with Lock( May 25 14:44:11.844328 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 14:44:11.844328 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application return self._enter() May 25 14:44:11.844328 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 14:44:11.844328 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 14:44:11.844328 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 14:44:11.844328 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application return self.creator() May 25 14:44:11.844328 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 14:44:11.844328 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application created_value = creator( May 25 14:44:11.845355 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 25 14:44:11.845355 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 25 14:44:11.845355 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 25 14:44:11.845355 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application May 25 14:44:11.845355 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 540/1094] 10.222.0.84 () {56 vars in 1108 bytes} [Wed May 25 14:44:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 14:44:11.850019 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-451d72e1-3400-4f64-98f2-78c3934d1c06 None admin] Authenticating user token {{(pid=101893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:44:11.953188 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-451d72e1-3400-4f64-98f2-78c3934d1c06 None admin] Validating token access rules against request {{(pid=101893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:44:11.957171 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30004e9-1dfd-4a93-b322-067daa37fb3d None None] REQUEST_METHOD: `GET` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:44:11.957459 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30004e9-1dfd-4a93-b322-067daa37fb3d None None] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:44:11.957740 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30004e9-1dfd-4a93-b322-067daa37fb3d None None] PATH_INFO: `/` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:44:11.959128 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 541/1095] 10.222.0.84 () {54 vars in 926 bytes} [Wed May 25 14:44:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 25 14:44:11.964117 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-413272a3-677e-4c36-8cdb-8b317d81bd02 None None] REQUEST_METHOD: `POST` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:44:11.964405 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-413272a3-677e-4c36-8cdb-8b317d81bd02 None None] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:44:11.964684 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-413272a3-677e-4c36-8cdb-8b317d81bd02 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:44:11.981210 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.auth.core [None req-413272a3-677e-4c36-8cdb-8b317d81bd02 None None] MFA Rules not processed for user `05d87e87798e429aa1c10b24391f915e`. Rule list: `[]` (Enabled: `True`). {{(pid=101892) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:44:11.982406 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.fernet_utils [None req-413272a3-677e-4c36-8cdb-8b317d81bd02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=101892) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:44:11.988325 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0eb352f-b17d-44ac-9956-77533bc90357 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:44:11.988982 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0eb352f-b17d-44ac-9956-77533bc90357 None admin] REQUEST_METHOD: `GET` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:44:11.989267 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0eb352f-b17d-44ac-9956-77533bc90357 None admin] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:44:11.989543 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0eb352f-b17d-44ac-9956-77533bc90357 None admin] PATH_INFO: `/v3/domains` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:44:11.990262 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0eb352f-b17d-44ac-9956-77533bc90357 None admin] RBAC: Adding query filter params (name=Default) {{(pid=101893) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:44:11.990570 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0eb352f-b17d-44ac-9956-77533bc90357 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:44:11.991958 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0eb352f-b17d-44ac-9956-77533bc90357 None admin] RBAC: Authorization granted {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:44:12.004063 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 555/1096] 10.222.0.84 () {56 vars in 1109 bytes} [Wed May 25 14:44:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:44:12.009482 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0eb352f-b17d-44ac-9956-77533bc90357 None admin] Authenticating user token {{(pid=101893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:44:12.017966 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG dbcounter [-] [101893] Writing DB stats keystone:SELECT=100 {{(pid=101893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:44:12.050715 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 542/1097] 10.222.0.84 () {58 vars in 1023 bytes} [Wed May 25 14:44:11 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 25 14:44:12.073998 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-413272a3-677e-4c36-8cdb-8b317d81bd02 None None] Authenticating user token {{(pid=101892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:44:12.105742 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0eb352f-b17d-44ac-9956-77533bc90357 None admin] Validating token access rules against request {{(pid=101893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:44:12.139828 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4530563b-b721-4936-870b-f5ea8dc4d8dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:44:12.140611 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4530563b-b721-4936-870b-f5ea8dc4d8dd None admin] REQUEST_METHOD: `GET` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:44:12.140891 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4530563b-b721-4936-870b-f5ea8dc4d8dd None admin] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:44:12.141163 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4530563b-b721-4936-870b-f5ea8dc4d8dd None admin] PATH_INFO: `/v3/projects/service` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:44:12.147953 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4530563b-b721-4936-870b-f5ea8dc4d8dd None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:44:12.149395 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4530563b-b721-4936-870b-f5ea8dc4d8dd None admin] RBAC: Authorization granted {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:44:12.163283 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application [None req-4530563b-b721-4936-870b-f5ea8dc4d8dd None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 25 14:44:12.163283 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:44:12.163283 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 14:44:12.163283 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 14:44:12.163283 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 14:44:12.163283 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 14:44:12.163283 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 14:44:12.163283 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 14:44:12.163283 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 14:44:12.163283 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 14:44:12.163283 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 14:44:12.163283 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 14:44:12.163283 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 25 14:44:12.163283 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return self._get_project(project_id) May 25 14:44:12.163283 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 25 14:44:12.164367 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 25 14:44:12.164367 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 14:44:12.164367 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 14:44:12.164367 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 14:44:12.164367 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 14:44:12.164367 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 14:44:12.164367 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return self.get_or_create( May 25 14:44:12.164367 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 14:44:12.164367 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application with Lock( May 25 14:44:12.164367 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 14:44:12.164367 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return self._enter() May 25 14:44:12.164367 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 14:44:12.164367 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 14:44:12.164367 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 14:44:12.164367 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return self.creator() May 25 14:44:12.164367 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 14:44:12.164367 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application created_value = creator( May 25 14:44:12.165290 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 25 14:44:12.165290 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 25 14:44:12.165290 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 25 14:44:12.165290 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 25 14:44:12.165290 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 25 14:44:12.165290 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 25 14:44:12.165290 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 25 14:44:12.165290 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application May 25 14:44:12.165290 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 556/1098] 10.222.0.84 () {56 vars in 1111 bytes} [Wed May 25 14:44:12 2022] GET /identity/v3/projects/service => generated 88 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 14:44:12.169592 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG dbcounter [-] [101892] Writing DB stats keystone:SELECT=100 {{(pid=101892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:44:12.170322 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4530563b-b721-4936-870b-f5ea8dc4d8dd None admin] Authenticating user token {{(pid=101893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:44:12.173466 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-413272a3-677e-4c36-8cdb-8b317d81bd02 None None] Validating token access rules against request {{(pid=101892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:44:12.208308 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45638c74-9a79-482c-9827-56c8eeb5f97a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:44:12.209037 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45638c74-9a79-482c-9827-56c8eeb5f97a None admin] REQUEST_METHOD: `GET` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:44:12.209302 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45638c74-9a79-482c-9827-56c8eeb5f97a None admin] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:44:12.209577 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45638c74-9a79-482c-9827-56c8eeb5f97a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:44:12.219570 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45638c74-9a79-482c-9827-56c8eeb5f97a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 14:44:12.227587 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application [None req-45638c74-9a79-482c-9827-56c8eeb5f97a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 25 14:44:12.227587 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:44:12.227587 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 14:44:12.227587 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 14:44:12.227587 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 14:44:12.227587 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 14:44:12.227587 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 14:44:12.227587 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 14:44:12.227587 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 14:44:12.227587 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 14:44:12.227587 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 14:44:12.227587 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 14:44:12.227587 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 14:44:12.227587 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 14:44:12.227587 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 14:44:12.227587 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 14:44:12.228765 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 14:44:12.228765 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 14:44:12.228765 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 14:44:12.228765 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 14:44:12.228765 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 14:44:12.228765 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 14:44:12.228765 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 14:44:12.228765 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 14:44:12.228765 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 14:44:12.228765 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application return self.get_or_create( May 25 14:44:12.228765 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 14:44:12.228765 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application with Lock( May 25 14:44:12.228765 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 14:44:12.228765 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application return self._enter() May 25 14:44:12.228765 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 14:44:12.228765 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 14:44:12.229883 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 14:44:12.229883 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application return self.creator() May 25 14:44:12.229883 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 14:44:12.229883 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application created_value = creator( May 25 14:44:12.229883 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 14:44:12.229883 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 14:44:12.229883 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 14:44:12.229883 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 14:44:12.229883 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 14:44:12.229883 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 14:44:12.229883 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 25 14:44:12.229883 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application May 25 14:44:12.229883 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 543/1099] 10.222.0.84 () {56 vars in 1096 bytes} [Wed May 25 14:44:12 2022] GET /identity/v3/roles/admin => generated 83 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 25 14:44:12.234817 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45638c74-9a79-482c-9827-56c8eeb5f97a None admin] Authenticating user token {{(pid=101892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:44:12.238425 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG dbcounter [-] [101893] Writing DB stats keystone:SELECT=100 {{(pid=101893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:44:12.271905 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4530563b-b721-4936-870b-f5ea8dc4d8dd None admin] Validating token access rules against request {{(pid=101893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:44:12.306850 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed7cfc2-0cc5-4941-9914-7d92a3f40dcf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:44:12.307501 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed7cfc2-0cc5-4941-9914-7d92a3f40dcf None admin] REQUEST_METHOD: `GET` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:44:12.307815 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed7cfc2-0cc5-4941-9914-7d92a3f40dcf None admin] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:44:12.308089 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed7cfc2-0cc5-4941-9914-7d92a3f40dcf None admin] PATH_INFO: `/v3/projects` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:44:12.308868 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ed7cfc2-0cc5-4941-9914-7d92a3f40dcf None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=101893) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:44:12.309179 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ed7cfc2-0cc5-4941-9914-7d92a3f40dcf None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:44:12.310618 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ed7cfc2-0cc5-4941-9914-7d92a3f40dcf None admin] RBAC: Authorization granted {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:44:12.321955 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 557/1100] 10.222.0.84 () {56 vars in 1148 bytes} [Wed May 25 14:44:12 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 14:44:12.328128 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed7cfc2-0cc5-4941-9914-7d92a3f40dcf None admin] Authenticating user token {{(pid=101893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:44:12.340593 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45638c74-9a79-482c-9827-56c8eeb5f97a None admin] Validating token access rules against request {{(pid=101892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:44:12.374113 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d03098dd-f6b8-40c2-8958-c0458792d4bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:44:12.374769 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d03098dd-f6b8-40c2-8958-c0458792d4bf None admin] REQUEST_METHOD: `GET` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:44:12.375055 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d03098dd-f6b8-40c2-8958-c0458792d4bf None admin] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:44:12.375325 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d03098dd-f6b8-40c2-8958-c0458792d4bf None admin] PATH_INFO: `/v3/roles` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:44:12.376090 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d03098dd-f6b8-40c2-8958-c0458792d4bf None admin] RBAC: Adding query filter params (name=admin) {{(pid=101892) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:44:12.376397 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d03098dd-f6b8-40c2-8958-c0458792d4bf None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:44:12.377777 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d03098dd-f6b8-40c2-8958-c0458792d4bf None admin] RBAC: Authorization granted {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:44:12.385835 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 544/1101] 10.222.0.84 () {56 vars in 1099 bytes} [Wed May 25 14:44:12 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:44:12.391512 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d03098dd-f6b8-40c2-8958-c0458792d4bf None admin] Authenticating user token {{(pid=101892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:44:12.413812 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG dbcounter [-] [101892] Writing DB stats keystone:SELECT=100 {{(pid=101892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:44:12.427117 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed7cfc2-0cc5-4941-9914-7d92a3f40dcf None admin] Validating token access rules against request {{(pid=101893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:44:12.451272 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG dbcounter [-] [101893] Writing DB stats keystone:SELECT=100 {{(pid=101893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:44:12.460022 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d3b6e48-0c22-49d2-9912-68f7579011d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:44:12.460611 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3b6e48-0c22-49d2-9912-68f7579011d3 None admin] REQUEST_METHOD: `GET` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:44:12.460900 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3b6e48-0c22-49d2-9912-68f7579011d3 None admin] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:44:12.461177 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3b6e48-0c22-49d2-9912-68f7579011d3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:44:12.462002 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d3b6e48-0c22-49d2-9912-68f7579011d3 None admin] RBAC: Adding query filter params (role.id=e36bc54201ab4defa2b100771ec121a4, scope.project.id=a000829c658c4a7cab67f7b6353ba3fa, user.id=2aeb182e6a5b43cfb0cc347ec847c848) {{(pid=101893) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:44:12.462319 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d3b6e48-0c22-49d2-9912-68f7579011d3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:44:12.463780 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d3b6e48-0c22-49d2-9912-68f7579011d3 None admin] RBAC: Authorization granted {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:44:12.469604 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 558/1102] 10.222.0.84 () {56 vars in 1374 bytes} [Wed May 25 14:44:12 2022] GET /identity/v3/role_assignments?user.id=2aeb182e6a5b43cfb0cc347ec847c848&scope.project.id=a000829c658c4a7cab67f7b6353ba3fa&role.id=e36bc54201ab4defa2b100771ec121a4 => generated 608 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 14:44:12.491212 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d03098dd-f6b8-40c2-8958-c0458792d4bf None admin] Validating token access rules against request {{(pid=101892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:44:12.529616 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64adbfc0-bba1-4924-8c35-3f1b15ca34eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:44:12.530511 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64adbfc0-bba1-4924-8c35-3f1b15ca34eb None admin] REQUEST_METHOD: `GET` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:44:12.530797 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64adbfc0-bba1-4924-8c35-3f1b15ca34eb None admin] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:44:12.531077 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64adbfc0-bba1-4924-8c35-3f1b15ca34eb None admin] PATH_INFO: `/v3/users/faedece942af4c0182a75ee8d5b6be3c` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:44:12.532395 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64adbfc0-bba1-4924-8c35-3f1b15ca34eb None admin] RBAC: Authorizing `identity:get_user(user_id=faedece942af4c0182a75ee8d5b6be3c)` {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:44:12.533904 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64adbfc0-bba1-4924-8c35-3f1b15ca34eb None admin] RBAC: Authorization granted {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:44:12.535667 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 545/1103] 10.222.0.84 () {56 vars in 1177 bytes} [Wed May 25 14:44:12 2022] GET /identity/v3/users/faedece942af4c0182a75ee8d5b6be3c => generated 285 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:44:12.541714 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d3b6e48-0c22-49d2-9912-68f7579011d3 None admin] Authenticating user token {{(pid=101893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:44:12.654117 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d3b6e48-0c22-49d2-9912-68f7579011d3 None admin] Validating token access rules against request {{(pid=101893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:44:12.689252 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-334ce1b5-143f-4731-8dff-2ea00e9849f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:44:12.690037 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334ce1b5-143f-4731-8dff-2ea00e9849f8 None admin] REQUEST_METHOD: `GET` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:44:12.690844 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334ce1b5-143f-4731-8dff-2ea00e9849f8 None admin] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:44:12.691119 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334ce1b5-143f-4731-8dff-2ea00e9849f8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:44:12.748380 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG dbcounter [-] [101893] Writing DB stats keystone:SELECT=100 {{(pid=101893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:44:12.759137 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-334ce1b5-143f-4731-8dff-2ea00e9849f8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:44:12.760650 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-334ce1b5-143f-4731-8dff-2ea00e9849f8 None admin] RBAC: Authorization granted {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:44:12.857856 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 559/1104] 10.222.0.84 () {58 vars in 1282 bytes} [Wed May 25 14:44:12 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 317 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 25 14:44:12.864388 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64adbfc0-bba1-4924-8c35-3f1b15ca34eb None admin] Authenticating user token {{(pid=101892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:44:12.955858 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG dbcounter [-] [101892] Writing DB stats keystone:SELECT=100 {{(pid=101892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:44:12.968551 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64adbfc0-bba1-4924-8c35-3f1b15ca34eb None admin] Validating token access rules against request {{(pid=101892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:44:13.003923 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15176f97-8507-4606-aa4d-c70eebba480d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:44:13.004781 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15176f97-8507-4606-aa4d-c70eebba480d None admin] REQUEST_METHOD: `GET` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:44:13.005062 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15176f97-8507-4606-aa4d-c70eebba480d None admin] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:44:13.005338 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15176f97-8507-4606-aa4d-c70eebba480d None admin] PATH_INFO: `/v3/projects/05fdc09bc44e44c0bc6223ba0727907c` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:44:13.006516 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15176f97-8507-4606-aa4d-c70eebba480d None admin] RBAC: Authorizing `identity:get_project(project_id=05fdc09bc44e44c0bc6223ba0727907c)` {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:44:13.007987 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15176f97-8507-4606-aa4d-c70eebba480d None admin] RBAC: Authorization granted {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:44:13.009678 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 546/1105] 10.222.0.84 () {56 vars in 1186 bytes} [Wed May 25 14:44:12 2022] GET /identity/v3/projects/05fdc09bc44e44c0bc6223ba0727907c => generated 311 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:44:13.016270 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-334ce1b5-143f-4731-8dff-2ea00e9849f8 None admin] Authenticating user token {{(pid=101893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:44:13.105444 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG dbcounter [-] [101893] Writing DB stats keystone:SELECT=100 {{(pid=101893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:44:13.115155 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-334ce1b5-143f-4731-8dff-2ea00e9849f8 None admin] Validating token access rules against request {{(pid=101893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:44:13.149013 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1d8e75b-45ad-4a24-ac5d-eec60e3f9897 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:44:13.149662 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d8e75b-45ad-4a24-ac5d-eec60e3f9897 None admin] REQUEST_METHOD: `GET` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:44:13.149941 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d8e75b-45ad-4a24-ac5d-eec60e3f9897 None admin] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:44:13.150219 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d8e75b-45ad-4a24-ac5d-eec60e3f9897 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:44:13.151037 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1d8e75b-45ad-4a24-ac5d-eec60e3f9897 None admin] RBAC: Adding query filter params (role.id=a3b78e7d547d4d2d998b4c99a4396bba, scope.project.id=05fdc09bc44e44c0bc6223ba0727907c, user.id=faedece942af4c0182a75ee8d5b6be3c) {{(pid=101893) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:44:13.151347 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1d8e75b-45ad-4a24-ac5d-eec60e3f9897 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:44:13.152810 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1d8e75b-45ad-4a24-ac5d-eec60e3f9897 None admin] RBAC: Authorization granted {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:44:13.159142 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 560/1106] 10.222.0.84 () {56 vars in 1374 bytes} [Wed May 25 14:44:13 2022] GET /identity/v3/role_assignments?user.id=faedece942af4c0182a75ee8d5b6be3c&scope.project.id=05fdc09bc44e44c0bc6223ba0727907c&role.id=a3b78e7d547d4d2d998b4c99a4396bba => generated 608 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:44:15.377955 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86978a0-15de-46de-932c-bebc5cfa2ec2 None None] REQUEST_METHOD: `GET` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:44:15.378489 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86978a0-15de-46de-932c-bebc5cfa2ec2 None None] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:44:15.378489 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86978a0-15de-46de-932c-bebc5cfa2ec2 None None] PATH_INFO: `/` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:44:15.379897 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 547/1107] 10.222.0.84 () {54 vars in 926 bytes} [Wed May 25 14:44:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 14:44:15.385225 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4bc64d-1e58-43be-8ac5-3ef7ec31c545 None None] REQUEST_METHOD: `POST` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:44:15.385619 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4bc64d-1e58-43be-8ac5-3ef7ec31c545 None None] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:44:15.385792 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4bc64d-1e58-43be-8ac5-3ef7ec31c545 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:44:15.402255 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.auth.core [None req-ff4bc64d-1e58-43be-8ac5-3ef7ec31c545 None None] MFA Rules not processed for user `05d87e87798e429aa1c10b24391f915e`. Rule list: `[]` (Enabled: `True`). {{(pid=101893) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:44:15.403484 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.fernet_utils [None req-ff4bc64d-1e58-43be-8ac5-3ef7ec31c545 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=101893) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:44:15.468132 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 561/1108] 10.222.0.84 () {58 vars in 1023 bytes} [Wed May 25 14:44:15 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 25 14:44:15.493501 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f86978a0-15de-46de-932c-bebc5cfa2ec2 None None] Authenticating user token {{(pid=101892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:44:15.594589 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f86978a0-15de-46de-932c-bebc5cfa2ec2 None None] Validating token access rules against request {{(pid=101892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:44:15.626758 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c898a32-dc7e-4511-b9ed-ac8ebdf4e4e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:44:15.628204 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c898a32-dc7e-4511-b9ed-ac8ebdf4e4e9 None admin] REQUEST_METHOD: `GET` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:44:15.628440 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c898a32-dc7e-4511-b9ed-ac8ebdf4e4e9 None admin] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:44:15.628717 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c898a32-dc7e-4511-b9ed-ac8ebdf4e4e9 None admin] PATH_INFO: `/v3/domains/default` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:44:15.629883 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c898a32-dc7e-4511-b9ed-ac8ebdf4e4e9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:44:15.631310 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c898a32-dc7e-4511-b9ed-ac8ebdf4e4e9 None admin] RBAC: Authorization granted {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:44:15.632942 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 548/1109] 10.222.0.84 () {56 vars in 1108 bytes} [Wed May 25 14:44:15 2022] GET /identity/v3/domains/default => generated 199 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:44:15.638623 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff4bc64d-1e58-43be-8ac5-3ef7ec31c545 None None] Authenticating user token {{(pid=101893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:44:15.718627 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG dbcounter [-] [101893] Writing DB stats keystone:SELECT=100 {{(pid=101893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:44:15.733688 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff4bc64d-1e58-43be-8ac5-3ef7ec31c545 None None] Validating token access rules against request {{(pid=101893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:44:15.767639 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61ade161-d948-4b48-b961-e2dd731fd698 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:44:15.768300 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ade161-d948-4b48-b961-e2dd731fd698 None admin] REQUEST_METHOD: `POST` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:44:15.768579 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ade161-d948-4b48-b961-e2dd731fd698 None admin] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:44:15.768850 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ade161-d948-4b48-b961-e2dd731fd698 None admin] PATH_INFO: `/v3/users` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:44:15.769616 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61ade161-d948-4b48-b961-e2dd731fd698 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:44:15.771036 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61ade161-d948-4b48-b961-e2dd731fd698 None admin] RBAC: Authorization granted {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:44:15.845009 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 562/1110] 10.222.0.84 () {60 vars in 1132 bytes} [Wed May 25 14:44:15 2022] POST /identity/v3/users => generated 286 bytes in 207 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 14:44:18.088261 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a17a62d-d640-4459-9fdf-2ab1661c8f40 None None] REQUEST_METHOD: `GET` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:44:18.088792 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a17a62d-d640-4459-9fdf-2ab1661c8f40 None None] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:44:18.088792 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a17a62d-d640-4459-9fdf-2ab1661c8f40 None None] PATH_INFO: `/` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:44:18.090146 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 549/1111] 10.222.0.84 () {54 vars in 926 bytes} [Wed May 25 14:44:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 14:44:18.095398 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50432c6-bf8e-4a5d-abb0-fdd4258c4463 None None] REQUEST_METHOD: `POST` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:44:18.096549 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50432c6-bf8e-4a5d-abb0-fdd4258c4463 None None] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:44:18.096650 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50432c6-bf8e-4a5d-abb0-fdd4258c4463 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:44:18.112947 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.auth.core [None req-d50432c6-bf8e-4a5d-abb0-fdd4258c4463 None None] MFA Rules not processed for user `05d87e87798e429aa1c10b24391f915e`. Rule list: `[]` (Enabled: `True`). {{(pid=101893) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:44:18.114196 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.fernet_utils [None req-d50432c6-bf8e-4a5d-abb0-fdd4258c4463 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=101893) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:44:18.179281 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 563/1112] 10.222.0.84 () {58 vars in 1023 bytes} [Wed May 25 14:44:18 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 25 14:44:18.202302 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a17a62d-d640-4459-9fdf-2ab1661c8f40 None None] Authenticating user token {{(pid=101892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:44:18.227343 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG dbcounter [-] [101892] Writing DB stats keystone:SELECT=100 {{(pid=101892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:44:18.301473 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a17a62d-d640-4459-9fdf-2ab1661c8f40 None None] Validating token access rules against request {{(pid=101892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:44:18.338250 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb76dd8-43b9-4e67-a82f-981f671cbc55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:44:18.341903 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb76dd8-43b9-4e67-a82f-981f671cbc55 None admin] REQUEST_METHOD: `GET` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:44:18.341903 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb76dd8-43b9-4e67-a82f-981f671cbc55 None admin] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:44:18.341903 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb76dd8-43b9-4e67-a82f-981f671cbc55 None admin] PATH_INFO: `/v3/roles/d3defd94f93b4e76af116df691240185` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:44:18.341903 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eb76dd8-43b9-4e67-a82f-981f671cbc55 None admin] RBAC: Authorizing `identity:get_role(role_id=d3defd94f93b4e76af116df691240185)` {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:44:18.342430 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eb76dd8-43b9-4e67-a82f-981f671cbc55 None admin] RBAC: Authorization granted {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:44:18.343818 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 550/1113] 10.222.0.84 () {56 vars in 1177 bytes} [Wed May 25 14:44:18 2022] GET /identity/v3/roles/d3defd94f93b4e76af116df691240185 => generated 223 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:44:18.349938 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d50432c6-bf8e-4a5d-abb0-fdd4258c4463 None None] Authenticating user token {{(pid=101893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:44:18.417994 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG dbcounter [-] [101893] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=101893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:44:18.447637 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d50432c6-bf8e-4a5d-abb0-fdd4258c4463 None None] Validating token access rules against request {{(pid=101893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:44:18.480708 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2fc4528-bda8-4548-a5d4-b4b5ffe57c84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:44:18.481570 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2fc4528-bda8-4548-a5d4-b4b5ffe57c84 None admin] REQUEST_METHOD: `GET` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:44:18.481855 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2fc4528-bda8-4548-a5d4-b4b5ffe57c84 None admin] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:44:18.482135 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2fc4528-bda8-4548-a5d4-b4b5ffe57c84 None admin] PATH_INFO: `/v3/users/f3caab6acf404d83bcc1e25b892cb8dd` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:44:18.495031 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2fc4528-bda8-4548-a5d4-b4b5ffe57c84 None admin] RBAC: Authorizing `identity:get_user(user_id=f3caab6acf404d83bcc1e25b892cb8dd)` {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:44:18.496552 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2fc4528-bda8-4548-a5d4-b4b5ffe57c84 None admin] RBAC: Authorization granted {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:44:18.498186 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 564/1114] 10.222.0.84 () {56 vars in 1177 bytes} [Wed May 25 14:44:18 2022] GET /identity/v3/users/f3caab6acf404d83bcc1e25b892cb8dd => generated 286 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:44:18.504390 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb76dd8-43b9-4e67-a82f-981f671cbc55 None admin] Authenticating user token {{(pid=101892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:44:18.595262 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG dbcounter [-] [101892] Writing DB stats keystone:SELECT=100 {{(pid=101892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:44:18.603460 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb76dd8-43b9-4e67-a82f-981f671cbc55 None admin] Validating token access rules against request {{(pid=101892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:44:18.636700 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7331c3f4-5d63-4668-8507-d7cf00eb1e5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:44:18.637340 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7331c3f4-5d63-4668-8507-d7cf00eb1e5d None admin] REQUEST_METHOD: `GET` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:44:18.637625 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7331c3f4-5d63-4668-8507-d7cf00eb1e5d None admin] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:44:18.637902 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7331c3f4-5d63-4668-8507-d7cf00eb1e5d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:44:18.702120 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7331c3f4-5d63-4668-8507-d7cf00eb1e5d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:44:18.703587 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7331c3f4-5d63-4668-8507-d7cf00eb1e5d None admin] RBAC: Authorization granted {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:44:18.794175 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG dbcounter [-] [101892] Writing DB stats keystone:SELECT=100 {{(pid=101892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:44:18.803793 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 551/1115] 10.222.0.84 () {58 vars in 1282 bytes} [Wed May 25 14:44:18 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 300 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 25 14:44:18.809605 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2fc4528-bda8-4548-a5d4-b4b5ffe57c84 None admin] Authenticating user token {{(pid=101893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:44:18.905849 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2fc4528-bda8-4548-a5d4-b4b5ffe57c84 None admin] Validating token access rules against request {{(pid=101893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:44:18.931471 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG dbcounter [-] [101893] Writing DB stats keystone:SELECT=100 {{(pid=101893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:44:18.938939 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e982ab66-74b0-4f97-9725-8393cce28d0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:44:18.943509 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e982ab66-74b0-4f97-9725-8393cce28d0a None admin] REQUEST_METHOD: `GET` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:44:18.943509 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e982ab66-74b0-4f97-9725-8393cce28d0a None admin] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:44:18.943509 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e982ab66-74b0-4f97-9725-8393cce28d0a None admin] PATH_INFO: `/v3/projects/05fdc09bc44e44c0bc6223ba0727907c` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:44:18.943509 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e982ab66-74b0-4f97-9725-8393cce28d0a None admin] RBAC: Authorizing `identity:get_project(project_id=05fdc09bc44e44c0bc6223ba0727907c)` {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:44:18.943509 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e982ab66-74b0-4f97-9725-8393cce28d0a None admin] RBAC: Authorization granted {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:44:18.945191 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 565/1116] 10.222.0.84 () {56 vars in 1186 bytes} [Wed May 25 14:44:18 2022] GET /identity/v3/projects/05fdc09bc44e44c0bc6223ba0727907c => generated 311 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:44:18.951185 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7331c3f4-5d63-4668-8507-d7cf00eb1e5d None admin] Authenticating user token {{(pid=101892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:44:19.048165 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7331c3f4-5d63-4668-8507-d7cf00eb1e5d None admin] Validating token access rules against request {{(pid=101892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:44:19.080860 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9037a02c-819d-4335-8cdb-c59c40e87307 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:44:19.081497 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9037a02c-819d-4335-8cdb-c59c40e87307 None admin] REQUEST_METHOD: `GET` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:44:19.081782 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9037a02c-819d-4335-8cdb-c59c40e87307 None admin] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:44:19.082061 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9037a02c-819d-4335-8cdb-c59c40e87307 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:44:19.082880 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9037a02c-819d-4335-8cdb-c59c40e87307 None admin] RBAC: Adding query filter params (role.id=d3defd94f93b4e76af116df691240185, scope.project.id=05fdc09bc44e44c0bc6223ba0727907c, user.id=f3caab6acf404d83bcc1e25b892cb8dd) {{(pid=101892) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:44:19.083199 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9037a02c-819d-4335-8cdb-c59c40e87307 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:44:19.084667 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9037a02c-819d-4335-8cdb-c59c40e87307 None admin] RBAC: Authorization granted {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:44:19.089977 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 552/1117] 10.222.0.84 () {56 vars in 1374 bytes} [Wed May 25 14:44:18 2022] GET /identity/v3/role_assignments?user.id=f3caab6acf404d83bcc1e25b892cb8dd&scope.project.id=05fdc09bc44e44c0bc6223ba0727907c&role.id=d3defd94f93b4e76af116df691240185 => generated 259 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:44:21.238340 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb410a1-eafd-44d9-ad57-d7a2f4b3cefb None None] REQUEST_METHOD: `GET` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:44:21.238877 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb410a1-eafd-44d9-ad57-d7a2f4b3cefb None None] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:44:21.238877 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb410a1-eafd-44d9-ad57-d7a2f4b3cefb None None] PATH_INFO: `/` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:44:21.240299 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 566/1118] 10.222.0.84 () {54 vars in 926 bytes} [Wed May 25 14:44:21 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 14:44:21.245712 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e9b2c1-c29c-4847-a418-4d6b644ba80a None None] REQUEST_METHOD: `POST` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:44:21.246087 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e9b2c1-c29c-4847-a418-4d6b644ba80a None None] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:44:21.246268 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e9b2c1-c29c-4847-a418-4d6b644ba80a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:44:21.262851 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.auth.core [None req-33e9b2c1-c29c-4847-a418-4d6b644ba80a None None] MFA Rules not processed for user `05d87e87798e429aa1c10b24391f915e`. Rule list: `[]` (Enabled: `True`). {{(pid=101892) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:44:21.264072 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.fernet_utils [None req-33e9b2c1-c29c-4847-a418-4d6b644ba80a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=101892) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:44:21.313201 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG dbcounter [-] [101892] Writing DB stats keystone:SELECT=100 {{(pid=101892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:44:21.329144 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 553/1119] 10.222.0.84 () {58 vars in 1023 bytes} [Wed May 25 14:44:21 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 25 14:44:21.351939 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fb410a1-eafd-44d9-ad57-d7a2f4b3cefb None None] Authenticating user token {{(pid=101893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:44:21.450528 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fb410a1-eafd-44d9-ad57-d7a2f4b3cefb None None] Validating token access rules against request {{(pid=101893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:44:21.482894 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e47760d4-a0fe-4dcc-b5c1-bb155b7759a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:44:21.483767 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47760d4-a0fe-4dcc-b5c1-bb155b7759a8 None admin] REQUEST_METHOD: `GET` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:44:21.484053 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47760d4-a0fe-4dcc-b5c1-bb155b7759a8 None admin] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:44:21.484329 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47760d4-a0fe-4dcc-b5c1-bb155b7759a8 None admin] PATH_INFO: `/v3/roles/d3defd94f93b4e76af116df691240185` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:44:21.485785 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e47760d4-a0fe-4dcc-b5c1-bb155b7759a8 None admin] RBAC: Authorizing `identity:get_role(role_id=d3defd94f93b4e76af116df691240185)` {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:44:21.487761 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e47760d4-a0fe-4dcc-b5c1-bb155b7759a8 None admin] RBAC: Authorization granted {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:44:21.489184 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 567/1120] 10.222.0.84 () {56 vars in 1177 bytes} [Wed May 25 14:44:21 2022] GET /identity/v3/roles/d3defd94f93b4e76af116df691240185 => generated 223 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:44:21.495257 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33e9b2c1-c29c-4847-a418-4d6b644ba80a None None] Authenticating user token {{(pid=101892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:44:21.590611 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33e9b2c1-c29c-4847-a418-4d6b644ba80a None None] Validating token access rules against request {{(pid=101892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:44:21.623486 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2bf9292-4280-454e-aba3-e5a031b6b9eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:44:21.624369 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2bf9292-4280-454e-aba3-e5a031b6b9eb None admin] REQUEST_METHOD: `GET` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:44:21.624650 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2bf9292-4280-454e-aba3-e5a031b6b9eb None admin] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:44:21.624925 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2bf9292-4280-454e-aba3-e5a031b6b9eb None admin] PATH_INFO: `/v3/users/f3caab6acf404d83bcc1e25b892cb8dd` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:44:21.626100 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2bf9292-4280-454e-aba3-e5a031b6b9eb None admin] RBAC: Authorizing `identity:get_user(user_id=f3caab6acf404d83bcc1e25b892cb8dd)` {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:44:21.627533 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2bf9292-4280-454e-aba3-e5a031b6b9eb None admin] RBAC: Authorization granted {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:44:21.629168 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 554/1121] 10.222.0.84 () {56 vars in 1177 bytes} [Wed May 25 14:44:21 2022] GET /identity/v3/users/f3caab6acf404d83bcc1e25b892cb8dd => generated 286 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:44:21.634961 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e47760d4-a0fe-4dcc-b5c1-bb155b7759a8 None admin] Authenticating user token {{(pid=101893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:44:21.695276 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG dbcounter [-] [101893] Writing DB stats keystone:SELECT=100 {{(pid=101893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:44:21.731915 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e47760d4-a0fe-4dcc-b5c1-bb155b7759a8 None admin] Validating token access rules against request {{(pid=101893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:44:21.764253 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3457ef88-69ab-47bd-b629-5b19066f4f04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:44:21.765041 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3457ef88-69ab-47bd-b629-5b19066f4f04 None admin] REQUEST_METHOD: `GET` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:44:21.765322 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3457ef88-69ab-47bd-b629-5b19066f4f04 None admin] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:44:21.765594 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3457ef88-69ab-47bd-b629-5b19066f4f04 None admin] PATH_INFO: `/v3/projects/05fdc09bc44e44c0bc6223ba0727907c` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:44:21.766763 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3457ef88-69ab-47bd-b629-5b19066f4f04 None admin] RBAC: Authorizing `identity:get_project(project_id=05fdc09bc44e44c0bc6223ba0727907c)` {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:44:21.768754 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3457ef88-69ab-47bd-b629-5b19066f4f04 None admin] RBAC: Authorization granted {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:44:21.770423 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 568/1122] 10.222.0.84 () {56 vars in 1186 bytes} [Wed May 25 14:44:21 2022] GET /identity/v3/projects/05fdc09bc44e44c0bc6223ba0727907c => generated 311 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:44:21.776351 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2bf9292-4280-454e-aba3-e5a031b6b9eb None admin] Authenticating user token {{(pid=101892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:44:21.830665 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG dbcounter [-] [101892] Writing DB stats keystone:SELECT=100 {{(pid=101892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:44:21.873302 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2bf9292-4280-454e-aba3-e5a031b6b9eb None admin] Validating token access rules against request {{(pid=101892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:44:21.906072 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d6d7d40-a7b7-4d04-89cc-f2239018b750 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:44:21.906947 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6d7d40-a7b7-4d04-89cc-f2239018b750 None admin] REQUEST_METHOD: `PUT` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:44:21.907233 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6d7d40-a7b7-4d04-89cc-f2239018b750 None admin] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:44:21.907515 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6d7d40-a7b7-4d04-89cc-f2239018b750 None admin] PATH_INFO: `/v3/projects/05fdc09bc44e44c0bc6223ba0727907c/users/f3caab6acf404d83bcc1e25b892cb8dd/roles/d3defd94f93b4e76af116df691240185` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:44:21.910248 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d6d7d40-a7b7-4d04-89cc-f2239018b750 None admin] RBAC: Authorizing `identity:create_grant(project_id=05fdc09bc44e44c0bc6223ba0727907c, user_id=f3caab6acf404d83bcc1e25b892cb8dd, role_id=d3defd94f93b4e76af116df691240185)` {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:44:21.911705 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d6d7d40-a7b7-4d04-89cc-f2239018b750 None admin] RBAC: Authorization granted {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:44:22.033568 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 555/1123] 10.222.0.84 () {58 vars in 1439 bytes} [Wed May 25 14:44:21 2022] PUT /identity/v3/projects/05fdc09bc44e44c0bc6223ba0727907c/users/f3caab6acf404d83bcc1e25b892cb8dd/roles/d3defd94f93b4e76af116df691240185 => generated 0 bytes in 257 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 14:44:24.195493 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543aa9ba-650f-4885-a318-eecba721dda2 None None] REQUEST_METHOD: `GET` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:44:24.196224 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543aa9ba-650f-4885-a318-eecba721dda2 None None] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:44:24.196224 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543aa9ba-650f-4885-a318-eecba721dda2 None None] PATH_INFO: `/` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:44:24.197479 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 569/1124] 10.222.0.84 () {54 vars in 926 bytes} [Wed May 25 14:44:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 14:44:24.202691 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00caa032-1f7d-4b49-a4ec-91877070288d None None] REQUEST_METHOD: `POST` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:44:24.203069 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00caa032-1f7d-4b49-a4ec-91877070288d None None] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:44:24.203253 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00caa032-1f7d-4b49-a4ec-91877070288d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:44:24.220303 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.auth.core [None req-00caa032-1f7d-4b49-a4ec-91877070288d None None] MFA Rules not processed for user `05d87e87798e429aa1c10b24391f915e`. Rule list: `[]` (Enabled: `True`). {{(pid=101892) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:44:24.222015 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.fernet_utils [None req-00caa032-1f7d-4b49-a4ec-91877070288d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=101892) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:44:24.286693 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 556/1125] 10.222.0.84 () {58 vars in 1023 bytes} [Wed May 25 14:44:24 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 25 14:44:24.310207 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-543aa9ba-650f-4885-a318-eecba721dda2 None None] Authenticating user token {{(pid=101893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:44:24.410280 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-543aa9ba-650f-4885-a318-eecba721dda2 None None] Validating token access rules against request {{(pid=101893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:44:24.438998 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG dbcounter [-] [101893] Writing DB stats keystone:SELECT=100 {{(pid=101893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:44:24.443759 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2602ff46-b87d-4d29-b519-7f7afda6bceb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:44:24.444607 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2602ff46-b87d-4d29-b519-7f7afda6bceb None admin] REQUEST_METHOD: `GET` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:44:24.444885 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2602ff46-b87d-4d29-b519-7f7afda6bceb None admin] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:44:24.445155 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2602ff46-b87d-4d29-b519-7f7afda6bceb None admin] PATH_INFO: `/v3/roles/d3defd94f93b4e76af116df691240185` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:44:24.446661 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2602ff46-b87d-4d29-b519-7f7afda6bceb None admin] RBAC: Authorizing `identity:get_role(role_id=d3defd94f93b4e76af116df691240185)` {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:44:24.448038 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2602ff46-b87d-4d29-b519-7f7afda6bceb None admin] RBAC: Authorization granted {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:44:24.449409 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 570/1126] 10.222.0.84 () {56 vars in 1177 bytes} [Wed May 25 14:44:24 2022] GET /identity/v3/roles/d3defd94f93b4e76af116df691240185 => generated 223 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:44:24.455140 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00caa032-1f7d-4b49-a4ec-91877070288d None None] Authenticating user token {{(pid=101892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:44:24.499877 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG dbcounter [-] [101892] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=101892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:44:24.552304 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00caa032-1f7d-4b49-a4ec-91877070288d None None] Validating token access rules against request {{(pid=101892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:44:24.586336 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1be1e63-5196-4666-b38d-f943d4e3d5bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:44:24.587205 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1be1e63-5196-4666-b38d-f943d4e3d5bb None admin] REQUEST_METHOD: `GET` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:44:24.587518 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1be1e63-5196-4666-b38d-f943d4e3d5bb None admin] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:44:24.587827 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1be1e63-5196-4666-b38d-f943d4e3d5bb None admin] PATH_INFO: `/v3/users/f3caab6acf404d83bcc1e25b892cb8dd` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:44:24.589010 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1be1e63-5196-4666-b38d-f943d4e3d5bb None admin] RBAC: Authorizing `identity:get_user(user_id=f3caab6acf404d83bcc1e25b892cb8dd)` {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:44:24.590487 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1be1e63-5196-4666-b38d-f943d4e3d5bb None admin] RBAC: Authorization granted {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:44:24.592160 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 557/1127] 10.222.0.84 () {56 vars in 1177 bytes} [Wed May 25 14:44:24 2022] GET /identity/v3/users/f3caab6acf404d83bcc1e25b892cb8dd => generated 286 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:44:24.598612 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2602ff46-b87d-4d29-b519-7f7afda6bceb None admin] Authenticating user token {{(pid=101893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:44:24.696028 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2602ff46-b87d-4d29-b519-7f7afda6bceb None admin] Validating token access rules against request {{(pid=101893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:44:24.729754 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ccff9a7-de12-47f7-8b3c-4408d0433d2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:44:24.730332 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ccff9a7-de12-47f7-8b3c-4408d0433d2f None admin] REQUEST_METHOD: `GET` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:44:24.730613 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ccff9a7-de12-47f7-8b3c-4408d0433d2f None admin] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:44:24.730888 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ccff9a7-de12-47f7-8b3c-4408d0433d2f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:44:24.798703 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG dbcounter [-] [101893] Writing DB stats keystone:SELECT=100 {{(pid=101893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:44:24.801018 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ccff9a7-de12-47f7-8b3c-4408d0433d2f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:44:24.802613 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ccff9a7-de12-47f7-8b3c-4408d0433d2f None admin] RBAC: Authorization granted {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:44:24.897948 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 571/1128] 10.222.0.84 () {58 vars in 1282 bytes} [Wed May 25 14:44:24 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 300 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 25 14:44:24.903851 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1be1e63-5196-4666-b38d-f943d4e3d5bb None admin] Authenticating user token {{(pid=101892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:44:25.000696 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1be1e63-5196-4666-b38d-f943d4e3d5bb None admin] Validating token access rules against request {{(pid=101892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:44:25.013166 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG dbcounter [-] [101892] Writing DB stats keystone:SELECT=100 {{(pid=101892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:44:25.032584 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a96f51a-bf4d-489e-8916-11ee2c642b74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:44:25.034134 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a96f51a-bf4d-489e-8916-11ee2c642b74 None admin] REQUEST_METHOD: `GET` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:44:25.034413 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a96f51a-bf4d-489e-8916-11ee2c642b74 None admin] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:44:25.034685 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a96f51a-bf4d-489e-8916-11ee2c642b74 None admin] PATH_INFO: `/v3/projects/05fdc09bc44e44c0bc6223ba0727907c` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:44:25.035858 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a96f51a-bf4d-489e-8916-11ee2c642b74 None admin] RBAC: Authorizing `identity:get_project(project_id=05fdc09bc44e44c0bc6223ba0727907c)` {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:44:25.037398 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a96f51a-bf4d-489e-8916-11ee2c642b74 None admin] RBAC: Authorization granted {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:44:25.039052 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 558/1129] 10.222.0.84 () {56 vars in 1186 bytes} [Wed May 25 14:44:24 2022] GET /identity/v3/projects/05fdc09bc44e44c0bc6223ba0727907c => generated 311 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:44:25.045132 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ccff9a7-de12-47f7-8b3c-4408d0433d2f None admin] Authenticating user token {{(pid=101893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:44:25.138421 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG dbcounter [-] [101893] Writing DB stats keystone:SELECT=100 {{(pid=101893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:44:25.141232 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ccff9a7-de12-47f7-8b3c-4408d0433d2f None admin] Validating token access rules against request {{(pid=101893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:44:25.174492 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d71f3160-58cd-49f9-8107-8651204e81f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:44:25.175132 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71f3160-58cd-49f9-8107-8651204e81f5 None admin] REQUEST_METHOD: `GET` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:44:25.175411 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71f3160-58cd-49f9-8107-8651204e81f5 None admin] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:44:25.175720 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71f3160-58cd-49f9-8107-8651204e81f5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:44:25.176536 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d71f3160-58cd-49f9-8107-8651204e81f5 None admin] RBAC: Adding query filter params (role.id=d3defd94f93b4e76af116df691240185, scope.project.id=05fdc09bc44e44c0bc6223ba0727907c, user.id=f3caab6acf404d83bcc1e25b892cb8dd) {{(pid=101893) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:44:25.176845 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d71f3160-58cd-49f9-8107-8651204e81f5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:44:25.178268 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d71f3160-58cd-49f9-8107-8651204e81f5 None admin] RBAC: Authorization granted {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:44:25.183921 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 572/1130] 10.222.0.84 () {56 vars in 1374 bytes} [Wed May 25 14:44:25 2022] GET /identity/v3/role_assignments?user.id=f3caab6acf404d83bcc1e25b892cb8dd&scope.project.id=05fdc09bc44e44c0bc6223ba0727907c&role.id=d3defd94f93b4e76af116df691240185 => generated 608 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:44:27.401122 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3fc5967-0d72-4189-a6d1-e26cbc47e9d9 None None] REQUEST_METHOD: `GET` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:44:27.401730 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3fc5967-0d72-4189-a6d1-e26cbc47e9d9 None None] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:44:27.401730 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3fc5967-0d72-4189-a6d1-e26cbc47e9d9 None None] PATH_INFO: `/` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:44:27.403027 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 559/1131] 10.222.0.84 () {54 vars in 926 bytes} [Wed May 25 14:44:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 14:44:27.408221 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd0fe4f-72bc-4ff7-ade0-50e2a0ca2475 None None] REQUEST_METHOD: `POST` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:44:27.408598 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd0fe4f-72bc-4ff7-ade0-50e2a0ca2475 None None] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:44:27.408785 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd0fe4f-72bc-4ff7-ade0-50e2a0ca2475 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:44:27.425058 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.auth.core [None req-9bd0fe4f-72bc-4ff7-ade0-50e2a0ca2475 None None] MFA Rules not processed for user `05d87e87798e429aa1c10b24391f915e`. Rule list: `[]` (Enabled: `True`). {{(pid=101893) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:44:27.426258 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.fernet_utils [None req-9bd0fe4f-72bc-4ff7-ade0-50e2a0ca2475 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=101893) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:44:27.489988 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 573/1132] 10.222.0.84 () {58 vars in 1023 bytes} [Wed May 25 14:44:27 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 25 14:44:27.513631 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3fc5967-0d72-4189-a6d1-e26cbc47e9d9 None None] Authenticating user token {{(pid=101892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:44:27.612220 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3fc5967-0d72-4189-a6d1-e26cbc47e9d9 None None] Validating token access rules against request {{(pid=101892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:44:27.644683 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f30910ce-398e-4dde-8992-7fac933c43ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:44:27.645458 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30910ce-398e-4dde-8992-7fac933c43ea None admin] REQUEST_METHOD: `GET` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:44:27.645742 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30910ce-398e-4dde-8992-7fac933c43ea None admin] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:44:27.646017 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30910ce-398e-4dde-8992-7fac933c43ea None admin] PATH_INFO: `/v3/domains/default` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:44:27.647160 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f30910ce-398e-4dde-8992-7fac933c43ea None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:44:27.648614 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f30910ce-398e-4dde-8992-7fac933c43ea None admin] RBAC: Authorization granted {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:44:27.650194 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 560/1133] 10.222.0.84 () {56 vars in 1108 bytes} [Wed May 25 14:44:27 2022] GET /identity/v3/domains/default => generated 199 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:44:27.655940 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bd0fe4f-72bc-4ff7-ade0-50e2a0ca2475 None None] Authenticating user token {{(pid=101893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:44:27.744631 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG dbcounter [-] [101893] Writing DB stats keystone:SELECT=100 {{(pid=101893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:44:27.750774 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bd0fe4f-72bc-4ff7-ade0-50e2a0ca2475 None None] Validating token access rules against request {{(pid=101893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:44:27.783507 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-319df3e8-bdac-4dc6-b11a-bfe103c252bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:44:27.784182 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319df3e8-bdac-4dc6-b11a-bfe103c252bf None admin] REQUEST_METHOD: `POST` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:44:27.784466 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319df3e8-bdac-4dc6-b11a-bfe103c252bf None admin] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:44:27.784743 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319df3e8-bdac-4dc6-b11a-bfe103c252bf None admin] PATH_INFO: `/v3/projects` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:44:27.785448 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-319df3e8-bdac-4dc6-b11a-bfe103c252bf None admin] RBAC: Authorizing `identity:create_project()` {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:44:27.786872 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-319df3e8-bdac-4dc6-b11a-bfe103c252bf None admin] RBAC: Authorization granted {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:44:27.856592 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 574/1134] 10.222.0.84 () {60 vars in 1141 bytes} [Wed May 25 14:44:27 2022] POST /identity/v3/projects => generated 311 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 14:44:30.071974 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94f4821-c6e5-4055-9a30-e2aa25efa9ce None None] REQUEST_METHOD: `GET` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:44:30.072505 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94f4821-c6e5-4055-9a30-e2aa25efa9ce None None] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:44:30.072505 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94f4821-c6e5-4055-9a30-e2aa25efa9ce None None] PATH_INFO: `/` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:44:30.073887 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 561/1135] 10.222.0.84 () {54 vars in 926 bytes} [Wed May 25 14:44:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 14:44:30.079126 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdee43a9-49c1-40e7-bb44-cb8347731d4a None None] REQUEST_METHOD: `POST` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:44:30.079555 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdee43a9-49c1-40e7-bb44-cb8347731d4a None None] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:44:30.079721 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdee43a9-49c1-40e7-bb44-cb8347731d4a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:44:30.096215 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.auth.core [None req-bdee43a9-49c1-40e7-bb44-cb8347731d4a None None] MFA Rules not processed for user `05d87e87798e429aa1c10b24391f915e`. Rule list: `[]` (Enabled: `True`). {{(pid=101893) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:44:30.097416 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.fernet_utils [None req-bdee43a9-49c1-40e7-bb44-cb8347731d4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=101893) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:44:30.164032 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 575/1136] 10.222.0.84 () {58 vars in 1023 bytes} [Wed May 25 14:44:30 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 25 14:44:30.188754 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c94f4821-c6e5-4055-9a30-e2aa25efa9ce None None] Authenticating user token {{(pid=101892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:44:30.238407 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG dbcounter [-] [101892] Writing DB stats keystone:SELECT=100 {{(pid=101892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:44:30.287405 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c94f4821-c6e5-4055-9a30-e2aa25efa9ce None None] Validating token access rules against request {{(pid=101892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:44:30.319847 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-630bdabc-5e1c-4c6e-a919-3319da3f18e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:44:30.320623 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630bdabc-5e1c-4c6e-a919-3319da3f18e5 None admin] REQUEST_METHOD: `GET` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:44:30.320906 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630bdabc-5e1c-4c6e-a919-3319da3f18e5 None admin] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:44:30.321183 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630bdabc-5e1c-4c6e-a919-3319da3f18e5 None admin] PATH_INFO: `/v3/domains/default` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:44:30.322394 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-630bdabc-5e1c-4c6e-a919-3319da3f18e5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:44:30.323804 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-630bdabc-5e1c-4c6e-a919-3319da3f18e5 None admin] RBAC: Authorization granted {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:44:30.325395 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 562/1137] 10.222.0.84 () {56 vars in 1108 bytes} [Wed May 25 14:44:30 2022] GET /identity/v3/domains/default => generated 199 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:44:30.331059 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdee43a9-49c1-40e7-bb44-cb8347731d4a None None] Authenticating user token {{(pid=101893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:44:30.403004 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG dbcounter [-] [101893] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=101893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:44:30.425926 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdee43a9-49c1-40e7-bb44-cb8347731d4a None None] Validating token access rules against request {{(pid=101893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:44:30.459093 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04e705dd-0fd0-417a-bbeb-d7406717ab70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:44:30.459779 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e705dd-0fd0-417a-bbeb-d7406717ab70 None admin] REQUEST_METHOD: `POST` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:44:30.460069 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e705dd-0fd0-417a-bbeb-d7406717ab70 None admin] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:44:30.460378 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e705dd-0fd0-417a-bbeb-d7406717ab70 None admin] PATH_INFO: `/v3/users` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:44:30.461095 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04e705dd-0fd0-417a-bbeb-d7406717ab70 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:44:30.462531 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04e705dd-0fd0-417a-bbeb-d7406717ab70 None admin] RBAC: Authorization granted {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:44:30.541265 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 576/1138] 10.222.0.84 () {60 vars in 1132 bytes} [Wed May 25 14:44:30 2022] POST /identity/v3/users => generated 286 bytes in 211 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 14:44:32.754845 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1207cdb0-c858-428e-8eac-6bd5fe4ac3c7 None None] REQUEST_METHOD: `GET` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:44:32.755360 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1207cdb0-c858-428e-8eac-6bd5fe4ac3c7 None None] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:44:32.755478 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1207cdb0-c858-428e-8eac-6bd5fe4ac3c7 None None] PATH_INFO: `/` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:44:32.756761 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 563/1139] 10.222.0.84 () {54 vars in 926 bytes} [Wed May 25 14:44:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 14:44:32.762077 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745b3a3c-5d2e-473a-882c-e1474aede5a2 None None] REQUEST_METHOD: `POST` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:44:32.762502 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745b3a3c-5d2e-473a-882c-e1474aede5a2 None None] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:44:32.762636 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745b3a3c-5d2e-473a-882c-e1474aede5a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:44:32.779699 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.auth.core [None req-745b3a3c-5d2e-473a-882c-e1474aede5a2 None None] MFA Rules not processed for user `05d87e87798e429aa1c10b24391f915e`. Rule list: `[]` (Enabled: `True`). {{(pid=101893) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:44:32.780876 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.fernet_utils [None req-745b3a3c-5d2e-473a-882c-e1474aede5a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=101893) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:44:32.851721 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 577/1140] 10.222.0.84 () {58 vars in 1023 bytes} [Wed May 25 14:44:32 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 25 14:44:32.897140 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1207cdb0-c858-428e-8eac-6bd5fe4ac3c7 None None] Authenticating user token {{(pid=101892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:44:33.010281 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1207cdb0-c858-428e-8eac-6bd5fe4ac3c7 None None] Validating token access rules against request {{(pid=101892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:44:33.025854 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG dbcounter [-] [101892] Writing DB stats keystone:SELECT=100 {{(pid=101892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:44:33.042839 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd0ac7b4-16f4-4d61-ae8a-3c6ecb06c566 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:44:33.043721 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd0ac7b4-16f4-4d61-ae8a-3c6ecb06c566 None admin] REQUEST_METHOD: `GET` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:44:33.044006 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd0ac7b4-16f4-4d61-ae8a-3c6ecb06c566 None admin] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:44:33.044283 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd0ac7b4-16f4-4d61-ae8a-3c6ecb06c566 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:44:33.054429 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd0ac7b4-16f4-4d61-ae8a-3c6ecb06c566 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 14:44:33.062079 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application [None req-fd0ac7b4-16f4-4d61-ae8a-3c6ecb06c566 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 25 14:44:33.062079 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:44:33.062079 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 14:44:33.062079 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 14:44:33.062079 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 14:44:33.062079 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 14:44:33.062079 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 14:44:33.062079 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 14:44:33.062079 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 14:44:33.062079 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 14:44:33.062079 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 14:44:33.062079 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 14:44:33.062079 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 14:44:33.062079 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 14:44:33.062079 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 14:44:33.062079 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 14:44:33.063233 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 14:44:33.063233 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 14:44:33.063233 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 14:44:33.063233 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 14:44:33.063233 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 14:44:33.063233 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 14:44:33.063233 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 14:44:33.063233 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 14:44:33.063233 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 14:44:33.063233 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application return self.get_or_create( May 25 14:44:33.063233 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 14:44:33.063233 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application with Lock( May 25 14:44:33.063233 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 14:44:33.063233 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application return self._enter() May 25 14:44:33.063233 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 14:44:33.063233 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 14:44:33.064867 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 14:44:33.064867 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application return self.creator() May 25 14:44:33.064867 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 14:44:33.064867 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application created_value = creator( May 25 14:44:33.064867 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 14:44:33.064867 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 14:44:33.064867 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 14:44:33.064867 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 14:44:33.064867 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 14:44:33.064867 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 14:44:33.064867 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 25 14:44:33.064867 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application May 25 14:44:33.064867 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 564/1141] 10.222.0.84 () {56 vars in 1096 bytes} [Wed May 25 14:44:32 2022] GET /identity/v3/roles/admin => generated 83 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 14:44:33.069864 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-745b3a3c-5d2e-473a-882c-e1474aede5a2 None None] Authenticating user token {{(pid=101893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:44:33.128956 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG dbcounter [-] [101893] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=101893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:44:33.167319 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-745b3a3c-5d2e-473a-882c-e1474aede5a2 None None] Validating token access rules against request {{(pid=101893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:44:33.201115 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae8e9ea4-2463-4341-bd5b-514345261c5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:44:33.201770 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8e9ea4-2463-4341-bd5b-514345261c5c None admin] REQUEST_METHOD: `GET` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:44:33.202055 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8e9ea4-2463-4341-bd5b-514345261c5c None admin] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:44:33.202333 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8e9ea4-2463-4341-bd5b-514345261c5c None admin] PATH_INFO: `/v3/roles` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:44:33.203084 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae8e9ea4-2463-4341-bd5b-514345261c5c None admin] RBAC: Adding query filter params (name=admin) {{(pid=101893) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:44:33.203373 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae8e9ea4-2463-4341-bd5b-514345261c5c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:44:33.204798 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae8e9ea4-2463-4341-bd5b-514345261c5c None admin] RBAC: Authorization granted {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:44:33.212690 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 578/1142] 10.222.0.84 () {56 vars in 1099 bytes} [Wed May 25 14:44:33 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:44:33.218330 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd0ac7b4-16f4-4d61-ae8a-3c6ecb06c566 None admin] Authenticating user token {{(pid=101892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:44:33.317304 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd0ac7b4-16f4-4d61-ae8a-3c6ecb06c566 None admin] Validating token access rules against request {{(pid=101892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:44:33.349657 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1ef3e1b-974f-44a2-846b-bb8f9aa5729c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:44:33.350514 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ef3e1b-974f-44a2-846b-bb8f9aa5729c None admin] REQUEST_METHOD: `GET` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:44:33.350795 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ef3e1b-974f-44a2-846b-bb8f9aa5729c None admin] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:44:33.351066 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ef3e1b-974f-44a2-846b-bb8f9aa5729c None admin] PATH_INFO: `/v3/users/65a29b27ef694fe6b9c3bbba9350fee9` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:44:33.364560 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1ef3e1b-974f-44a2-846b-bb8f9aa5729c None admin] RBAC: Authorizing `identity:get_user(user_id=65a29b27ef694fe6b9c3bbba9350fee9)` {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:44:33.365996 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1ef3e1b-974f-44a2-846b-bb8f9aa5729c None admin] RBAC: Authorization granted {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:44:33.367647 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 565/1143] 10.222.0.84 () {56 vars in 1177 bytes} [Wed May 25 14:44:33 2022] GET /identity/v3/users/65a29b27ef694fe6b9c3bbba9350fee9 => generated 286 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:44:33.373682 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae8e9ea4-2463-4341-bd5b-514345261c5c None admin] Authenticating user token {{(pid=101893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:44:33.474460 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae8e9ea4-2463-4341-bd5b-514345261c5c None admin] Validating token access rules against request {{(pid=101893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:44:33.497418 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG dbcounter [-] [101893] Writing DB stats keystone:SELECT=100 {{(pid=101893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:44:33.507910 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-995850ab-0d04-4206-9ee5-786366cdd660 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:44:33.508560 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-995850ab-0d04-4206-9ee5-786366cdd660 None admin] REQUEST_METHOD: `GET` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:44:33.508838 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-995850ab-0d04-4206-9ee5-786366cdd660 None admin] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:44:33.509111 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-995850ab-0d04-4206-9ee5-786366cdd660 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:44:33.574812 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-995850ab-0d04-4206-9ee5-786366cdd660 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:44:33.576309 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-995850ab-0d04-4206-9ee5-786366cdd660 None admin] RBAC: Authorization granted {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:44:33.670683 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 579/1144] 10.222.0.84 () {58 vars in 1282 bytes} [Wed May 25 14:44:33 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 297 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 25 14:44:33.676499 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1ef3e1b-974f-44a2-846b-bb8f9aa5729c None admin] Authenticating user token {{(pid=101892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:44:33.709373 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG dbcounter [-] [101892] Writing DB stats keystone:SELECT=100 {{(pid=101892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:44:33.773058 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1ef3e1b-974f-44a2-846b-bb8f9aa5729c None admin] Validating token access rules against request {{(pid=101892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:44:33.806890 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e835ad-4805-4c49-878c-afe2ffed05d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:44:33.807774 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e835ad-4805-4c49-878c-afe2ffed05d4 None admin] REQUEST_METHOD: `GET` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:44:33.808059 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e835ad-4805-4c49-878c-afe2ffed05d4 None admin] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:44:33.808335 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e835ad-4805-4c49-878c-afe2ffed05d4 None admin] PATH_INFO: `/v3/projects/3133ad57a6dd4847a9eba7121eac25d7` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:44:33.809501 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73e835ad-4805-4c49-878c-afe2ffed05d4 None admin] RBAC: Authorizing `identity:get_project(project_id=3133ad57a6dd4847a9eba7121eac25d7)` {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:44:33.810930 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73e835ad-4805-4c49-878c-afe2ffed05d4 None admin] RBAC: Authorization granted {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:44:33.812636 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 566/1145] 10.222.0.84 () {56 vars in 1186 bytes} [Wed May 25 14:44:33 2022] GET /identity/v3/projects/3133ad57a6dd4847a9eba7121eac25d7 => generated 311 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:44:33.818785 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-995850ab-0d04-4206-9ee5-786366cdd660 None admin] Authenticating user token {{(pid=101893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:44:33.842987 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG dbcounter [-] [101893] Writing DB stats keystone:SELECT=100 {{(pid=101893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:44:33.915229 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-995850ab-0d04-4206-9ee5-786366cdd660 None admin] Validating token access rules against request {{(pid=101893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:44:33.947397 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-465dbbcf-7454-4bf7-ad97-f1b8e28ef493 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:44:33.948061 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465dbbcf-7454-4bf7-ad97-f1b8e28ef493 None admin] REQUEST_METHOD: `GET` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:44:33.948342 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465dbbcf-7454-4bf7-ad97-f1b8e28ef493 None admin] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:44:33.948613 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465dbbcf-7454-4bf7-ad97-f1b8e28ef493 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:44:33.949422 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-465dbbcf-7454-4bf7-ad97-f1b8e28ef493 None admin] RBAC: Adding query filter params (role.id=a3b78e7d547d4d2d998b4c99a4396bba, scope.project.id=3133ad57a6dd4847a9eba7121eac25d7, user.id=65a29b27ef694fe6b9c3bbba9350fee9) {{(pid=101893) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:44:33.949733 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-465dbbcf-7454-4bf7-ad97-f1b8e28ef493 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:44:33.951155 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-465dbbcf-7454-4bf7-ad97-f1b8e28ef493 None admin] RBAC: Authorization granted {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:44:33.956950 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 580/1146] 10.222.0.84 () {56 vars in 1374 bytes} [Wed May 25 14:44:33 2022] GET /identity/v3/role_assignments?user.id=65a29b27ef694fe6b9c3bbba9350fee9&scope.project.id=3133ad57a6dd4847a9eba7121eac25d7&role.id=a3b78e7d547d4d2d998b4c99a4396bba => generated 259 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 14:44:36.097659 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf7c9d0-3ba7-4215-9f22-ddd53e2baf4f None None] REQUEST_METHOD: `GET` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:44:36.098188 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf7c9d0-3ba7-4215-9f22-ddd53e2baf4f None None] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:44:36.098188 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf7c9d0-3ba7-4215-9f22-ddd53e2baf4f None None] PATH_INFO: `/` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:44:36.099554 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 567/1147] 10.222.0.84 () {54 vars in 926 bytes} [Wed May 25 14:44:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 14:44:36.104691 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14445c3e-4270-4351-a9f1-c90ff6ab870f None None] REQUEST_METHOD: `POST` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:44:36.105118 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14445c3e-4270-4351-a9f1-c90ff6ab870f None None] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:44:36.105258 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14445c3e-4270-4351-a9f1-c90ff6ab870f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:44:36.122506 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.auth.core [None req-14445c3e-4270-4351-a9f1-c90ff6ab870f None None] MFA Rules not processed for user `05d87e87798e429aa1c10b24391f915e`. Rule list: `[]` (Enabled: `True`). {{(pid=101893) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:44:36.123738 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.fernet_utils [None req-14445c3e-4270-4351-a9f1-c90ff6ab870f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=101893) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:44:36.187535 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 581/1148] 10.222.0.84 () {58 vars in 1023 bytes} [Wed May 25 14:44:36 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 25 14:44:36.212714 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cf7c9d0-3ba7-4215-9f22-ddd53e2baf4f None None] Authenticating user token {{(pid=101892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:44:36.311678 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cf7c9d0-3ba7-4215-9f22-ddd53e2baf4f None None] Validating token access rules against request {{(pid=101892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:44:36.313163 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG dbcounter [-] [101892] Writing DB stats keystone:SELECT=100 {{(pid=101892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:44:36.344917 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14faf901-b5c6-4a75-b90e-82c6426cb02b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:44:36.345697 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14faf901-b5c6-4a75-b90e-82c6426cb02b None admin] REQUEST_METHOD: `GET` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:44:36.345980 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14faf901-b5c6-4a75-b90e-82c6426cb02b None admin] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:44:36.346258 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14faf901-b5c6-4a75-b90e-82c6426cb02b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:44:36.356484 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14faf901-b5c6-4a75-b90e-82c6426cb02b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 14:44:36.364062 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application [None req-14faf901-b5c6-4a75-b90e-82c6426cb02b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 25 14:44:36.364062 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:44:36.364062 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 14:44:36.364062 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 14:44:36.364062 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 14:44:36.364062 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 14:44:36.364062 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 14:44:36.364062 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 14:44:36.364062 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 14:44:36.364062 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 14:44:36.364062 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 14:44:36.364062 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 14:44:36.364062 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 14:44:36.364062 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 14:44:36.364062 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 14:44:36.364062 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 14:44:36.365166 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 14:44:36.365166 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 14:44:36.365166 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 14:44:36.365166 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 14:44:36.365166 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 14:44:36.365166 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 14:44:36.365166 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 14:44:36.365166 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 14:44:36.365166 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 14:44:36.365166 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application return self.get_or_create( May 25 14:44:36.365166 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 14:44:36.365166 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application with Lock( May 25 14:44:36.365166 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 14:44:36.365166 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application return self._enter() May 25 14:44:36.365166 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 14:44:36.365166 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 14:44:36.366123 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 14:44:36.366123 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application return self.creator() May 25 14:44:36.366123 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 14:44:36.366123 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application created_value = creator( May 25 14:44:36.366123 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 14:44:36.366123 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 14:44:36.366123 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 14:44:36.366123 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 14:44:36.366123 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 14:44:36.366123 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 14:44:36.366123 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 25 14:44:36.366123 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application May 25 14:44:36.366123 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 568/1149] 10.222.0.84 () {56 vars in 1096 bytes} [Wed May 25 14:44:36 2022] GET /identity/v3/roles/admin => generated 83 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 14:44:36.371470 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14445c3e-4270-4351-a9f1-c90ff6ab870f None None] Authenticating user token {{(pid=101893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:44:36.389741 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG dbcounter [-] [101893] Writing DB stats keystone:SELECT=100 {{(pid=101893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:44:36.467707 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14445c3e-4270-4351-a9f1-c90ff6ab870f None None] Validating token access rules against request {{(pid=101893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:44:36.500442 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05f1d783-e81a-475b-9404-5ff602178082 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:44:36.501616 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f1d783-e81a-475b-9404-5ff602178082 None admin] REQUEST_METHOD: `GET` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:44:36.501903 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f1d783-e81a-475b-9404-5ff602178082 None admin] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:44:36.502183 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f1d783-e81a-475b-9404-5ff602178082 None admin] PATH_INFO: `/v3/roles` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:44:36.502929 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05f1d783-e81a-475b-9404-5ff602178082 None admin] RBAC: Adding query filter params (name=admin) {{(pid=101893) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:44:36.503239 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05f1d783-e81a-475b-9404-5ff602178082 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:44:36.504661 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05f1d783-e81a-475b-9404-5ff602178082 None admin] RBAC: Authorization granted {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:44:36.512645 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 582/1150] 10.222.0.84 () {56 vars in 1099 bytes} [Wed May 25 14:44:36 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:44:36.519183 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14faf901-b5c6-4a75-b90e-82c6426cb02b None admin] Authenticating user token {{(pid=101892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:44:36.615396 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14faf901-b5c6-4a75-b90e-82c6426cb02b None admin] Validating token access rules against request {{(pid=101892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:44:36.647484 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-242e72bf-1a2a-46fd-8c68-76b953b12f2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:44:36.648368 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242e72bf-1a2a-46fd-8c68-76b953b12f2d None admin] REQUEST_METHOD: `GET` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:44:36.648644 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242e72bf-1a2a-46fd-8c68-76b953b12f2d None admin] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:44:36.648912 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242e72bf-1a2a-46fd-8c68-76b953b12f2d None admin] PATH_INFO: `/v3/users/65a29b27ef694fe6b9c3bbba9350fee9` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:44:36.650064 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-242e72bf-1a2a-46fd-8c68-76b953b12f2d None admin] RBAC: Authorizing `identity:get_user(user_id=65a29b27ef694fe6b9c3bbba9350fee9)` {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:44:36.651479 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-242e72bf-1a2a-46fd-8c68-76b953b12f2d None admin] RBAC: Authorization granted {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:44:36.653092 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 569/1151] 10.222.0.84 () {56 vars in 1177 bytes} [Wed May 25 14:44:36 2022] GET /identity/v3/users/65a29b27ef694fe6b9c3bbba9350fee9 => generated 286 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:44:36.658775 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05f1d783-e81a-475b-9404-5ff602178082 None admin] Authenticating user token {{(pid=101893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:44:36.738361 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG dbcounter [-] [101893] Writing DB stats keystone:SELECT=100 {{(pid=101893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:44:36.757047 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05f1d783-e81a-475b-9404-5ff602178082 None admin] Validating token access rules against request {{(pid=101893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:44:36.790455 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73592108-7c97-426e-85c4-dc8cfd11e6e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:44:36.791314 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73592108-7c97-426e-85c4-dc8cfd11e6e0 None admin] REQUEST_METHOD: `GET` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:44:36.791620 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73592108-7c97-426e-85c4-dc8cfd11e6e0 None admin] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:44:36.791902 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73592108-7c97-426e-85c4-dc8cfd11e6e0 None admin] PATH_INFO: `/v3/projects/3133ad57a6dd4847a9eba7121eac25d7` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:44:36.793105 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73592108-7c97-426e-85c4-dc8cfd11e6e0 None admin] RBAC: Authorizing `identity:get_project(project_id=3133ad57a6dd4847a9eba7121eac25d7)` {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:44:36.794539 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73592108-7c97-426e-85c4-dc8cfd11e6e0 None admin] RBAC: Authorization granted {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:44:36.796256 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 583/1152] 10.222.0.84 () {56 vars in 1186 bytes} [Wed May 25 14:44:36 2022] GET /identity/v3/projects/3133ad57a6dd4847a9eba7121eac25d7 => generated 311 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:44:36.802104 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-242e72bf-1a2a-46fd-8c68-76b953b12f2d None admin] Authenticating user token {{(pid=101892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:44:36.832317 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG dbcounter [-] [101892] Writing DB stats keystone:SELECT=100 {{(pid=101892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:44:36.899298 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-242e72bf-1a2a-46fd-8c68-76b953b12f2d None admin] Validating token access rules against request {{(pid=101892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:44:36.931713 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35d1efbc-e3bf-4f2e-ac99-a5048b54bcc0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:44:36.932586 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d1efbc-e3bf-4f2e-ac99-a5048b54bcc0 None admin] REQUEST_METHOD: `PUT` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:44:36.932873 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d1efbc-e3bf-4f2e-ac99-a5048b54bcc0 None admin] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:44:36.933151 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d1efbc-e3bf-4f2e-ac99-a5048b54bcc0 None admin] PATH_INFO: `/v3/projects/3133ad57a6dd4847a9eba7121eac25d7/users/65a29b27ef694fe6b9c3bbba9350fee9/roles/a3b78e7d547d4d2d998b4c99a4396bba` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:44:36.935097 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35d1efbc-e3bf-4f2e-ac99-a5048b54bcc0 None admin] RBAC: Authorizing `identity:create_grant(project_id=3133ad57a6dd4847a9eba7121eac25d7, user_id=65a29b27ef694fe6b9c3bbba9350fee9, role_id=a3b78e7d547d4d2d998b4c99a4396bba)` {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:44:36.936561 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35d1efbc-e3bf-4f2e-ac99-a5048b54bcc0 None admin] RBAC: Authorization granted {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:44:37.031320 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 570/1153] 10.222.0.84 () {58 vars in 1439 bytes} [Wed May 25 14:44:36 2022] PUT /identity/v3/projects/3133ad57a6dd4847a9eba7121eac25d7/users/65a29b27ef694fe6b9c3bbba9350fee9/roles/a3b78e7d547d4d2d998b4c99a4396bba => generated 0 bytes in 230 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 14:44:39.191142 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60cffa0-b3c1-411f-b069-112ffaa5ef87 None None] REQUEST_METHOD: `GET` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:44:39.191821 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60cffa0-b3c1-411f-b069-112ffaa5ef87 None None] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:44:39.191821 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60cffa0-b3c1-411f-b069-112ffaa5ef87 None None] PATH_INFO: `/` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:44:39.193110 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 584/1154] 10.222.0.84 () {54 vars in 926 bytes} [Wed May 25 14:44:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 14:44:39.198440 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff687a36-f584-4b6b-8ce7-2de9bb1cbd23 None None] REQUEST_METHOD: `POST` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:44:39.198822 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff687a36-f584-4b6b-8ce7-2de9bb1cbd23 None None] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:44:39.198999 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff687a36-f584-4b6b-8ce7-2de9bb1cbd23 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:44:39.215622 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.auth.core [None req-ff687a36-f584-4b6b-8ce7-2de9bb1cbd23 None None] MFA Rules not processed for user `05d87e87798e429aa1c10b24391f915e`. Rule list: `[]` (Enabled: `True`). {{(pid=101892) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:44:39.216804 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.fernet_utils [None req-ff687a36-f584-4b6b-8ce7-2de9bb1cbd23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=101892) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:44:39.286220 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 571/1155] 10.222.0.84 () {58 vars in 1023 bytes} [Wed May 25 14:44:39 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 25 14:44:39.310024 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a60cffa0-b3c1-411f-b069-112ffaa5ef87 None None] Authenticating user token {{(pid=101893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:44:39.408619 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a60cffa0-b3c1-411f-b069-112ffaa5ef87 None None] Validating token access rules against request {{(pid=101893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:44:39.440939 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6c0d8fa-af2e-4b88-bc15-e133c38ee8a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:44:39.441769 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c0d8fa-af2e-4b88-bc15-e133c38ee8a4 None admin] REQUEST_METHOD: `GET` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:44:39.442003 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c0d8fa-af2e-4b88-bc15-e133c38ee8a4 None admin] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:44:39.442278 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c0d8fa-af2e-4b88-bc15-e133c38ee8a4 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:44:39.452543 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6c0d8fa-af2e-4b88-bc15-e133c38ee8a4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 14:44:39.460118 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application [None req-a6c0d8fa-af2e-4b88-bc15-e133c38ee8a4 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 25 14:44:39.460118 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:44:39.460118 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 14:44:39.460118 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 14:44:39.460118 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 14:44:39.460118 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 14:44:39.460118 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 14:44:39.460118 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 14:44:39.460118 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 14:44:39.460118 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 14:44:39.460118 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 14:44:39.460118 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 14:44:39.460118 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 14:44:39.460118 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 14:44:39.460118 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 14:44:39.460118 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 14:44:39.461224 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 14:44:39.461224 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 14:44:39.461224 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 14:44:39.461224 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 14:44:39.461224 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 14:44:39.461224 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 14:44:39.461224 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 14:44:39.461224 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 14:44:39.461224 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 14:44:39.461224 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return self.get_or_create( May 25 14:44:39.461224 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 14:44:39.461224 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application with Lock( May 25 14:44:39.461224 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 14:44:39.461224 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return self._enter() May 25 14:44:39.461224 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 14:44:39.461224 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 14:44:39.462445 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 14:44:39.462445 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return self.creator() May 25 14:44:39.462445 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 14:44:39.462445 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application created_value = creator( May 25 14:44:39.462445 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 14:44:39.462445 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 14:44:39.462445 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 14:44:39.462445 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 14:44:39.462445 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 14:44:39.462445 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 14:44:39.462445 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 25 14:44:39.462445 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application May 25 14:44:39.462445 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 585/1156] 10.222.0.84 () {56 vars in 1096 bytes} [Wed May 25 14:44:39 2022] GET /identity/v3/roles/admin => generated 83 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 14:44:39.467188 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff687a36-f584-4b6b-8ce7-2de9bb1cbd23 None None] Authenticating user token {{(pid=101892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:44:39.488685 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG dbcounter [-] [101892] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=101892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:44:39.564391 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff687a36-f584-4b6b-8ce7-2de9bb1cbd23 None None] Validating token access rules against request {{(pid=101892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:44:39.598546 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c019892b-5963-4784-bbc6-04d93d45ab48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:44:39.599214 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c019892b-5963-4784-bbc6-04d93d45ab48 None admin] REQUEST_METHOD: `GET` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:44:39.599499 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c019892b-5963-4784-bbc6-04d93d45ab48 None admin] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:44:39.599808 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c019892b-5963-4784-bbc6-04d93d45ab48 None admin] PATH_INFO: `/v3/roles` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:44:39.600550 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c019892b-5963-4784-bbc6-04d93d45ab48 None admin] RBAC: Adding query filter params (name=admin) {{(pid=101892) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:44:39.600859 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c019892b-5963-4784-bbc6-04d93d45ab48 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:44:39.602224 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c019892b-5963-4784-bbc6-04d93d45ab48 None admin] RBAC: Authorization granted {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:44:39.610116 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 572/1157] 10.222.0.84 () {56 vars in 1099 bytes} [Wed May 25 14:44:39 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:44:39.615815 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6c0d8fa-af2e-4b88-bc15-e133c38ee8a4 None admin] Authenticating user token {{(pid=101893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:44:39.626630 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG dbcounter [-] [101893] Writing DB stats keystone:SELECT=100 {{(pid=101893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:44:39.712341 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6c0d8fa-af2e-4b88-bc15-e133c38ee8a4 None admin] Validating token access rules against request {{(pid=101893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:44:39.745818 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deec1dbf-a0e5-4338-8c2d-4fc316cf0a13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:44:39.746669 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deec1dbf-a0e5-4338-8c2d-4fc316cf0a13 None admin] REQUEST_METHOD: `GET` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:44:39.746950 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deec1dbf-a0e5-4338-8c2d-4fc316cf0a13 None admin] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:44:39.747227 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deec1dbf-a0e5-4338-8c2d-4fc316cf0a13 None admin] PATH_INFO: `/v3/users/65a29b27ef694fe6b9c3bbba9350fee9` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:44:39.748427 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deec1dbf-a0e5-4338-8c2d-4fc316cf0a13 None admin] RBAC: Authorizing `identity:get_user(user_id=65a29b27ef694fe6b9c3bbba9350fee9)` {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:44:39.749859 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deec1dbf-a0e5-4338-8c2d-4fc316cf0a13 None admin] RBAC: Authorization granted {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:44:39.751442 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 586/1158] 10.222.0.84 () {56 vars in 1177 bytes} [Wed May 25 14:44:39 2022] GET /identity/v3/users/65a29b27ef694fe6b9c3bbba9350fee9 => generated 286 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:44:39.757067 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c019892b-5963-4784-bbc6-04d93d45ab48 None admin] Authenticating user token {{(pid=101892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:44:39.836242 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG dbcounter [-] [101892] Writing DB stats keystone:SELECT=100 {{(pid=101892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:44:39.855418 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c019892b-5963-4784-bbc6-04d93d45ab48 None admin] Validating token access rules against request {{(pid=101892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:44:39.887774 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e180850a-d3bc-4bf6-a47f-61691ad7ed65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:44:39.888411 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e180850a-d3bc-4bf6-a47f-61691ad7ed65 None admin] REQUEST_METHOD: `GET` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:44:39.888696 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e180850a-d3bc-4bf6-a47f-61691ad7ed65 None admin] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:44:39.888972 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e180850a-d3bc-4bf6-a47f-61691ad7ed65 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:44:39.953479 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e180850a-d3bc-4bf6-a47f-61691ad7ed65 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:44:39.955517 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e180850a-d3bc-4bf6-a47f-61691ad7ed65 None admin] RBAC: Authorization granted {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:44:40.031335 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG dbcounter [-] [101892] Writing DB stats keystone:SELECT=100 {{(pid=101892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:44:40.049070 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 573/1159] 10.222.0.84 () {58 vars in 1282 bytes} [Wed May 25 14:44:39 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 292 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 25 14:44:40.054939 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deec1dbf-a0e5-4338-8c2d-4fc316cf0a13 None admin] Authenticating user token {{(pid=101893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:44:40.129419 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG dbcounter [-] [101893] Writing DB stats keystone:SELECT=100 {{(pid=101893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:44:40.151421 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deec1dbf-a0e5-4338-8c2d-4fc316cf0a13 None admin] Validating token access rules against request {{(pid=101893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:44:40.184094 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55a524f3-ffed-4870-a8aa-d4d5d13b907b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:44:40.184933 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a524f3-ffed-4870-a8aa-d4d5d13b907b None admin] REQUEST_METHOD: `GET` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:44:40.185212 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a524f3-ffed-4870-a8aa-d4d5d13b907b None admin] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:44:40.185487 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a524f3-ffed-4870-a8aa-d4d5d13b907b None admin] PATH_INFO: `/v3/projects/3133ad57a6dd4847a9eba7121eac25d7` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:44:40.186646 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55a524f3-ffed-4870-a8aa-d4d5d13b907b None admin] RBAC: Authorizing `identity:get_project(project_id=3133ad57a6dd4847a9eba7121eac25d7)` {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:44:40.188622 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55a524f3-ffed-4870-a8aa-d4d5d13b907b None admin] RBAC: Authorization granted {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:44:40.190301 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 587/1160] 10.222.0.84 () {56 vars in 1186 bytes} [Wed May 25 14:44:40 2022] GET /identity/v3/projects/3133ad57a6dd4847a9eba7121eac25d7 => generated 311 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:44:40.196240 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e180850a-d3bc-4bf6-a47f-61691ad7ed65 None admin] Authenticating user token {{(pid=101892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:44:40.291260 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e180850a-d3bc-4bf6-a47f-61691ad7ed65 None admin] Validating token access rules against request {{(pid=101892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:44:40.324499 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d7c58b7-8275-491d-8794-77d96215ef73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:44:40.325144 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7c58b7-8275-491d-8794-77d96215ef73 None admin] REQUEST_METHOD: `GET` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:44:40.325430 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7c58b7-8275-491d-8794-77d96215ef73 None admin] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:44:40.325710 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7c58b7-8275-491d-8794-77d96215ef73 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:44:40.326532 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d7c58b7-8275-491d-8794-77d96215ef73 None admin] RBAC: Adding query filter params (role.id=a3b78e7d547d4d2d998b4c99a4396bba, scope.project.id=3133ad57a6dd4847a9eba7121eac25d7, user.id=65a29b27ef694fe6b9c3bbba9350fee9) {{(pid=101892) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:44:40.326873 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d7c58b7-8275-491d-8794-77d96215ef73 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:44:40.328319 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d7c58b7-8275-491d-8794-77d96215ef73 None admin] RBAC: Authorization granted {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:44:40.333997 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 574/1161] 10.222.0.84 () {56 vars in 1374 bytes} [Wed May 25 14:44:40 2022] GET /identity/v3/role_assignments?user.id=65a29b27ef694fe6b9c3bbba9350fee9&scope.project.id=3133ad57a6dd4847a9eba7121eac25d7&role.id=a3b78e7d547d4d2d998b4c99a4396bba => generated 608 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:44:42.522032 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988ac77b-dd03-4f79-a987-2bdb280517c8 None None] REQUEST_METHOD: `GET` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:44:42.522675 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988ac77b-dd03-4f79-a987-2bdb280517c8 None None] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:44:42.522675 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988ac77b-dd03-4f79-a987-2bdb280517c8 None None] PATH_INFO: `/` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:44:42.524078 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 588/1162] 10.222.0.84 () {54 vars in 926 bytes} [Wed May 25 14:44:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 14:44:42.529823 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab6335e-00ad-4f82-82e7-63406960a82c None None] REQUEST_METHOD: `POST` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:44:42.530374 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab6335e-00ad-4f82-82e7-63406960a82c None None] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:44:42.530374 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab6335e-00ad-4f82-82e7-63406960a82c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:44:42.548361 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.auth.core [None req-0ab6335e-00ad-4f82-82e7-63406960a82c None None] MFA Rules not processed for user `05d87e87798e429aa1c10b24391f915e`. Rule list: `[]` (Enabled: `True`). {{(pid=101892) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:44:42.549725 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.fernet_utils [None req-0ab6335e-00ad-4f82-82e7-63406960a82c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=101892) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:44:42.591726 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG dbcounter [-] [101892] Writing DB stats keystone:SELECT=100 {{(pid=101892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:44:42.615387 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 575/1163] 10.222.0.84 () {58 vars in 1023 bytes} [Wed May 25 14:44:42 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 25 14:44:42.638248 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-988ac77b-dd03-4f79-a987-2bdb280517c8 None None] Authenticating user token {{(pid=101893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:44:42.737228 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-988ac77b-dd03-4f79-a987-2bdb280517c8 None None] Validating token access rules against request {{(pid=101893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:44:42.771119 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b1b346f-ec6f-49ac-b8b5-455bc3906712 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:44:42.771786 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1b346f-ec6f-49ac-b8b5-455bc3906712 None admin] REQUEST_METHOD: `GET` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:44:42.772125 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1b346f-ec6f-49ac-b8b5-455bc3906712 None admin] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:44:42.772357 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1b346f-ec6f-49ac-b8b5-455bc3906712 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:44:42.786813 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG dbcounter [-] [101893] Writing DB stats keystone:SELECT=100 {{(pid=101893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:44:42.837142 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b1b346f-ec6f-49ac-b8b5-455bc3906712 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:44:42.838584 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b1b346f-ec6f-49ac-b8b5-455bc3906712 None admin] RBAC: Authorization granted {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:44:42.933889 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 589/1164] 10.222.0.84 () {58 vars in 1282 bytes} [Wed May 25 14:44:42 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 296 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 25 14:44:42.940436 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ab6335e-00ad-4f82-82e7-63406960a82c None None] Authenticating user token {{(pid=101892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:44:43.041997 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ab6335e-00ad-4f82-82e7-63406960a82c None None] Validating token access rules against request {{(pid=101892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:44:43.074999 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6eb9a90-4fb3-4b76-a171-10a3240d0620 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:44:43.075836 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6eb9a90-4fb3-4b76-a171-10a3240d0620 None admin] REQUEST_METHOD: `GET` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:44:43.076119 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6eb9a90-4fb3-4b76-a171-10a3240d0620 None admin] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:44:43.076392 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6eb9a90-4fb3-4b76-a171-10a3240d0620 None admin] PATH_INFO: `/v3/domains/swift_test` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:44:43.083456 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6eb9a90-4fb3-4b76-a171-10a3240d0620 None admin] RBAC: Authorizing `identity:get_domain(domain_id=swift_test)` {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:44:43.084906 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6eb9a90-4fb3-4b76-a171-10a3240d0620 None admin] RBAC: Authorization granted {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:44:43.098707 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application [None req-a6eb9a90-4fb3-4b76-a171-10a3240d0620 None admin] Could not find domain: swift_test.: keystone.exception.DomainNotFound: Could not find domain: swift_test. May 25 14:44:43.098707 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:44:43.098707 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain May 25 14:44:43.098707 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) May 25 14:44:43.098707 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 25 14:44:43.098707 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 25 14:44:43.098707 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 25 14:44:43.098707 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 25 14:44:43.098707 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: swift_test. May 25 14:44:43.098707 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application May 25 14:44:43.098707 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 25 14:44:43.098707 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application May 25 14:44:43.098707 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:44:43.098707 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 14:44:43.098707 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 14:44:43.098707 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 14:44:43.098707 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 14:44:43.100028 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 14:44:43.100028 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 14:44:43.100028 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 14:44:43.100028 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 14:44:43.100028 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 14:44:43.100028 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 14:44:43.100028 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 25 14:44:43.100028 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 25 14:44:43.100028 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 25 14:44:43.100028 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 25 14:44:43.100028 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 14:44:43.100028 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 14:44:43.100028 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 14:44:43.100028 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 14:44:43.100028 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 14:44:43.100028 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application return self.get_or_create( May 25 14:44:43.101195 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 14:44:43.101195 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application with Lock( May 25 14:44:43.101195 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 14:44:43.101195 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application return self._enter() May 25 14:44:43.101195 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 14:44:43.101195 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 14:44:43.101195 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 14:44:43.101195 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application return self.creator() May 25 14:44:43.101195 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 14:44:43.101195 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application created_value = creator( May 25 14:44:43.101195 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain May 25 14:44:43.101195 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 25 14:44:43.101195 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: swift_test. May 25 14:44:43.101195 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application May 25 14:44:43.101195 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 576/1165] 10.222.0.84 () {56 vars in 1117 bytes} [Wed May 25 14:44:42 2022] GET /identity/v3/domains/swift_test => generated 90 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 14:44:43.106024 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b1b346f-ec6f-49ac-b8b5-455bc3906712 None admin] Authenticating user token {{(pid=101893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:44:43.150474 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG dbcounter [-] [101893] Writing DB stats keystone:SELECT=100 {{(pid=101893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:44:43.202406 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b1b346f-ec6f-49ac-b8b5-455bc3906712 None admin] Validating token access rules against request {{(pid=101893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:44:43.235798 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a57375d1-8a69-42da-8acc-a91110d42e8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:44:43.236448 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57375d1-8a69-42da-8acc-a91110d42e8c None admin] REQUEST_METHOD: `GET` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:44:43.236729 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57375d1-8a69-42da-8acc-a91110d42e8c None admin] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:44:43.237004 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57375d1-8a69-42da-8acc-a91110d42e8c None admin] PATH_INFO: `/v3/domains` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:44:43.237716 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a57375d1-8a69-42da-8acc-a91110d42e8c None admin] RBAC: Adding query filter params (name=swift_test) {{(pid=101893) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:44:43.238023 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a57375d1-8a69-42da-8acc-a91110d42e8c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:44:43.239385 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a57375d1-8a69-42da-8acc-a91110d42e8c None admin] RBAC: Authorization granted {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:44:43.246606 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 590/1166] 10.222.0.84 () {56 vars in 1115 bytes} [Wed May 25 14:44:43 2022] GET /identity/v3/domains?name=swift_test => generated 125 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:44:45.420140 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c34bb72-6a35-4027-90e9-07f0c6355dce None None] REQUEST_METHOD: `GET` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:44:45.420692 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c34bb72-6a35-4027-90e9-07f0c6355dce None None] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:44:45.420692 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c34bb72-6a35-4027-90e9-07f0c6355dce None None] PATH_INFO: `/` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:44:45.422058 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 577/1167] 10.222.0.84 () {54 vars in 926 bytes} [Wed May 25 14:44:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 14:44:45.427228 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b2007b-76c0-4ea3-88c7-b2ab0f091ca0 None None] REQUEST_METHOD: `POST` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:44:45.427662 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b2007b-76c0-4ea3-88c7-b2ab0f091ca0 None None] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:44:45.427809 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b2007b-76c0-4ea3-88c7-b2ab0f091ca0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:44:45.444551 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.auth.core [None req-e7b2007b-76c0-4ea3-88c7-b2ab0f091ca0 None None] MFA Rules not processed for user `05d87e87798e429aa1c10b24391f915e`. Rule list: `[]` (Enabled: `True`). {{(pid=101893) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:44:45.445736 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.fernet_utils [None req-e7b2007b-76c0-4ea3-88c7-b2ab0f091ca0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=101893) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:44:45.509019 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 591/1168] 10.222.0.84 () {58 vars in 1023 bytes} [Wed May 25 14:44:45 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 25 14:44:45.531890 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c34bb72-6a35-4027-90e9-07f0c6355dce None None] Authenticating user token {{(pid=101892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:44:45.568951 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG dbcounter [-] [101892] Writing DB stats keystone:SELECT=100 {{(pid=101892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:44:45.632475 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c34bb72-6a35-4027-90e9-07f0c6355dce None None] Validating token access rules against request {{(pid=101892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:44:45.663748 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26942417-94cd-48f3-a03b-8cf2263aff89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:44:45.664397 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26942417-94cd-48f3-a03b-8cf2263aff89 None admin] REQUEST_METHOD: `POST` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:44:45.664678 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26942417-94cd-48f3-a03b-8cf2263aff89 None admin] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:44:45.664951 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26942417-94cd-48f3-a03b-8cf2263aff89 None admin] PATH_INFO: `/v3/domains` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:44:45.665676 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26942417-94cd-48f3-a03b-8cf2263aff89 None admin] RBAC: Authorizing `identity:create_domain()` {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:44:45.667023 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26942417-94cd-48f3-a03b-8cf2263aff89 None admin] RBAC: Authorization granted {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:44:45.741760 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 578/1169] 10.222.0.84 () {60 vars in 1138 bytes} [Wed May 25 14:44:45 2022] POST /identity/v3/domains => generated 267 bytes in 210 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 14:44:47.945650 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2bd765-fa25-4e36-a6f7-320900cbf6ee None None] REQUEST_METHOD: `GET` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:44:47.946193 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2bd765-fa25-4e36-a6f7-320900cbf6ee None None] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:44:47.946193 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2bd765-fa25-4e36-a6f7-320900cbf6ee None None] PATH_INFO: `/` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:44:47.947597 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 592/1170] 10.222.0.84 () {54 vars in 926 bytes} [Wed May 25 14:44:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 14:44:47.952725 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c4df3d-c963-4ee7-84e0-f2cc9175bbc6 None None] REQUEST_METHOD: `POST` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:44:47.953105 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c4df3d-c963-4ee7-84e0-f2cc9175bbc6 None None] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:44:47.953335 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c4df3d-c963-4ee7-84e0-f2cc9175bbc6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:44:47.969697 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.auth.core [None req-81c4df3d-c963-4ee7-84e0-f2cc9175bbc6 None None] MFA Rules not processed for user `05d87e87798e429aa1c10b24391f915e`. Rule list: `[]` (Enabled: `True`). {{(pid=101892) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:44:47.970897 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.fernet_utils [None req-81c4df3d-c963-4ee7-84e0-f2cc9175bbc6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=101892) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:44:48.046445 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 579/1171] 10.222.0.84 () {58 vars in 1023 bytes} [Wed May 25 14:44:47 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 25 14:44:48.070665 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f2bd765-fa25-4e36-a6f7-320900cbf6ee None None] Authenticating user token {{(pid=101893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:44:48.111417 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG dbcounter [-] [101893] Writing DB stats keystone:SELECT=100 {{(pid=101893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:44:48.169060 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f2bd765-fa25-4e36-a6f7-320900cbf6ee None None] Validating token access rules against request {{(pid=101893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:44:48.202273 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de477264-7c78-4335-8c4a-577eac949f14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:44:48.203067 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de477264-7c78-4335-8c4a-577eac949f14 None admin] REQUEST_METHOD: `GET` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:44:48.203382 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de477264-7c78-4335-8c4a-577eac949f14 None admin] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:44:48.203690 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de477264-7c78-4335-8c4a-577eac949f14 None admin] PATH_INFO: `/v3/domains/b11fc0418c9e4f7dbb8de6a3d75bcd9c` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:44:48.213802 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de477264-7c78-4335-8c4a-577eac949f14 None admin] RBAC: Authorizing `identity:get_domain(domain_id=b11fc0418c9e4f7dbb8de6a3d75bcd9c)` {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:44:48.215265 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de477264-7c78-4335-8c4a-577eac949f14 None admin] RBAC: Authorization granted {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:44:48.216893 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 593/1172] 10.222.0.84 () {56 vars in 1183 bytes} [Wed May 25 14:44:48 2022] GET /identity/v3/domains/b11fc0418c9e4f7dbb8de6a3d75bcd9c => generated 267 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:44:48.223053 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81c4df3d-c963-4ee7-84e0-f2cc9175bbc6 None None] Authenticating user token {{(pid=101892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:44:48.249389 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG dbcounter [-] [101892] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=101892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:44:48.319820 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81c4df3d-c963-4ee7-84e0-f2cc9175bbc6 None None] Validating token access rules against request {{(pid=101892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:44:48.358012 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a41877d-0df4-4fed-a550-85fece260018 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:44:48.358664 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a41877d-0df4-4fed-a550-85fece260018 None admin] REQUEST_METHOD: `POST` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:44:48.358944 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a41877d-0df4-4fed-a550-85fece260018 None admin] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:44:48.359218 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a41877d-0df4-4fed-a550-85fece260018 None admin] PATH_INFO: `/v3/projects` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:44:48.360505 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a41877d-0df4-4fed-a550-85fece260018 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:44:48.361957 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a41877d-0df4-4fed-a550-85fece260018 None admin] RBAC: Authorization granted {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:44:48.436566 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 580/1173] 10.222.0.84 () {60 vars in 1141 bytes} [Wed May 25 14:44:48 2022] POST /identity/v3/projects => generated 361 bytes in 214 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 14:44:50.629288 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80dadd0d-a84e-40c5-8926-747d27920a40 None None] REQUEST_METHOD: `GET` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:44:50.629818 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80dadd0d-a84e-40c5-8926-747d27920a40 None None] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:44:50.629818 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80dadd0d-a84e-40c5-8926-747d27920a40 None None] PATH_INFO: `/` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:44:50.631175 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 594/1174] 10.222.0.84 () {54 vars in 926 bytes} [Wed May 25 14:44:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 25 14:44:50.636340 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c547f5a-504b-4df5-8487-fd2f8aacccd6 None None] REQUEST_METHOD: `POST` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:44:50.636711 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c547f5a-504b-4df5-8487-fd2f8aacccd6 None None] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:44:50.636905 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c547f5a-504b-4df5-8487-fd2f8aacccd6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:44:50.653899 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.auth.core [None req-2c547f5a-504b-4df5-8487-fd2f8aacccd6 None None] MFA Rules not processed for user `05d87e87798e429aa1c10b24391f915e`. Rule list: `[]` (Enabled: `True`). {{(pid=101892) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:44:50.655076 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.fernet_utils [None req-2c547f5a-504b-4df5-8487-fd2f8aacccd6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=101892) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:44:50.719387 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 581/1175] 10.222.0.84 () {58 vars in 1023 bytes} [Wed May 25 14:44:50 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 25 14:44:50.744172 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80dadd0d-a84e-40c5-8926-747d27920a40 None None] Authenticating user token {{(pid=101893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:44:50.840407 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG dbcounter [-] [101893] Writing DB stats keystone:SELECT=100 {{(pid=101893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:44:50.845453 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80dadd0d-a84e-40c5-8926-747d27920a40 None None] Validating token access rules against request {{(pid=101893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:44:50.877286 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2351335-bd26-4b78-8f30-d17c48dec756 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:44:50.878133 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2351335-bd26-4b78-8f30-d17c48dec756 None admin] REQUEST_METHOD: `GET` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:44:50.878416 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2351335-bd26-4b78-8f30-d17c48dec756 None admin] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:44:50.878691 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2351335-bd26-4b78-8f30-d17c48dec756 None admin] PATH_INFO: `/v3/domains/b11fc0418c9e4f7dbb8de6a3d75bcd9c` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:44:50.879895 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2351335-bd26-4b78-8f30-d17c48dec756 None admin] RBAC: Authorizing `identity:get_domain(domain_id=b11fc0418c9e4f7dbb8de6a3d75bcd9c)` {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:44:50.881446 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2351335-bd26-4b78-8f30-d17c48dec756 None admin] RBAC: Authorization granted {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:44:50.883721 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 595/1176] 10.222.0.84 () {56 vars in 1183 bytes} [Wed May 25 14:44:50 2022] GET /identity/v3/domains/b11fc0418c9e4f7dbb8de6a3d75bcd9c => generated 267 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:44:50.888861 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c547f5a-504b-4df5-8487-fd2f8aacccd6 None None] Authenticating user token {{(pid=101892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:44:50.899229 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG dbcounter [-] [101892] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=101892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:44:50.985948 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c547f5a-504b-4df5-8487-fd2f8aacccd6 None None] Validating token access rules against request {{(pid=101892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:44:51.018900 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6db125a-c837-4be2-9495-f0c48e6cd41f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:44:51.019553 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6db125a-c837-4be2-9495-f0c48e6cd41f None admin] REQUEST_METHOD: `POST` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:44:51.019871 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6db125a-c837-4be2-9495-f0c48e6cd41f None admin] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:44:51.020149 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6db125a-c837-4be2-9495-f0c48e6cd41f None admin] PATH_INFO: `/v3/users` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:44:51.020845 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6db125a-c837-4be2-9495-f0c48e6cd41f None admin] RBAC: Authorizing `identity:create_user()` {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:44:51.022271 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6db125a-c837-4be2-9495-f0c48e6cd41f None admin] RBAC: Authorization granted {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:44:51.112968 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 582/1177] 10.222.0.84 () {60 vars in 1132 bytes} [Wed May 25 14:44:50 2022] POST /identity/v3/users => generated 311 bytes in 225 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 14:44:53.340914 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a589450-4e28-4c6b-891d-b3723e779f31 None None] REQUEST_METHOD: `GET` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:44:53.341467 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a589450-4e28-4c6b-891d-b3723e779f31 None None] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:44:53.341467 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a589450-4e28-4c6b-891d-b3723e779f31 None None] PATH_INFO: `/` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:44:53.342842 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 596/1178] 10.222.0.84 () {54 vars in 926 bytes} [Wed May 25 14:44:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 14:44:53.349082 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a7df20-3548-4d9c-8c60-1b838af26c16 None None] REQUEST_METHOD: `POST` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:44:53.349497 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a7df20-3548-4d9c-8c60-1b838af26c16 None None] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:44:53.349651 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a7df20-3548-4d9c-8c60-1b838af26c16 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:44:53.367474 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.auth.core [None req-a5a7df20-3548-4d9c-8c60-1b838af26c16 None None] MFA Rules not processed for user `05d87e87798e429aa1c10b24391f915e`. Rule list: `[]` (Enabled: `True`). {{(pid=101892) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:44:53.368678 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.fernet_utils [None req-a5a7df20-3548-4d9c-8c60-1b838af26c16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=101892) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:44:53.424496 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG dbcounter [-] [101892] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=101892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:44:53.432460 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 583/1179] 10.222.0.84 () {58 vars in 1023 bytes} [Wed May 25 14:44:53 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 25 14:44:53.456299 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a589450-4e28-4c6b-891d-b3723e779f31 None None] Authenticating user token {{(pid=101893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:44:53.556500 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a589450-4e28-4c6b-891d-b3723e779f31 None None] Validating token access rules against request {{(pid=101893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:44:53.590049 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb709879-70c8-41ee-a447-e13d6f9409f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:44:53.590831 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb709879-70c8-41ee-a447-e13d6f9409f8 None admin] REQUEST_METHOD: `GET` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:44:53.591161 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb709879-70c8-41ee-a447-e13d6f9409f8 None admin] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:44:53.591388 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb709879-70c8-41ee-a447-e13d6f9409f8 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:44:53.601277 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb709879-70c8-41ee-a447-e13d6f9409f8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 14:44:53.608872 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application [None req-fb709879-70c8-41ee-a447-e13d6f9409f8 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 25 14:44:53.608872 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:44:53.608872 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 14:44:53.608872 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 14:44:53.608872 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 14:44:53.608872 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 14:44:53.608872 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 14:44:53.608872 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 14:44:53.608872 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 14:44:53.608872 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 14:44:53.608872 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 14:44:53.608872 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 14:44:53.608872 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 14:44:53.608872 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 14:44:53.608872 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 14:44:53.608872 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 14:44:53.610028 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 14:44:53.610028 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 14:44:53.610028 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 14:44:53.610028 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 14:44:53.610028 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 14:44:53.610028 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 14:44:53.610028 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 14:44:53.610028 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 14:44:53.610028 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 14:44:53.610028 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return self.get_or_create( May 25 14:44:53.610028 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 14:44:53.610028 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application with Lock( May 25 14:44:53.610028 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 14:44:53.610028 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return self._enter() May 25 14:44:53.610028 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 14:44:53.610028 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 14:44:53.615872 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 14:44:53.615872 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return self.creator() May 25 14:44:53.615872 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 14:44:53.615872 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application created_value = creator( May 25 14:44:53.615872 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 14:44:53.615872 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 14:44:53.615872 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 14:44:53.615872 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 14:44:53.615872 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 14:44:53.615872 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 14:44:53.615872 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 25 14:44:53.615872 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application May 25 14:44:53.615872 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 597/1180] 10.222.0.84 () {56 vars in 1096 bytes} [Wed May 25 14:44:53 2022] GET /identity/v3/roles/admin => generated 83 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 14:44:53.616817 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5a7df20-3548-4d9c-8c60-1b838af26c16 None None] Authenticating user token {{(pid=101892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:44:53.712523 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5a7df20-3548-4d9c-8c60-1b838af26c16 None None] Validating token access rules against request {{(pid=101892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:44:53.744906 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46631c31-2cb8-4b9f-934a-327449efa78b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:44:53.745564 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46631c31-2cb8-4b9f-934a-327449efa78b None admin] REQUEST_METHOD: `GET` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:44:53.745850 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46631c31-2cb8-4b9f-934a-327449efa78b None admin] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:44:53.746129 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46631c31-2cb8-4b9f-934a-327449efa78b None admin] PATH_INFO: `/v3/roles` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:44:53.746868 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46631c31-2cb8-4b9f-934a-327449efa78b None admin] RBAC: Adding query filter params (name=admin) {{(pid=101892) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:44:53.747177 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46631c31-2cb8-4b9f-934a-327449efa78b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:44:53.748574 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46631c31-2cb8-4b9f-934a-327449efa78b None admin] RBAC: Authorization granted {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:44:53.756831 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 584/1181] 10.222.0.84 () {56 vars in 1099 bytes} [Wed May 25 14:44:53 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:44:53.762463 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb709879-70c8-41ee-a447-e13d6f9409f8 None admin] Authenticating user token {{(pid=101893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:44:53.789831 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG dbcounter [-] [101893] Writing DB stats keystone:SELECT=100 {{(pid=101893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:44:53.858652 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb709879-70c8-41ee-a447-e13d6f9409f8 None admin] Validating token access rules against request {{(pid=101893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:44:53.891468 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e176086-2b6f-4b3c-94aa-490f0df13194 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:44:53.892345 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e176086-2b6f-4b3c-94aa-490f0df13194 None admin] REQUEST_METHOD: `GET` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:44:53.892630 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e176086-2b6f-4b3c-94aa-490f0df13194 None admin] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:44:53.892909 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e176086-2b6f-4b3c-94aa-490f0df13194 None admin] PATH_INFO: `/v3/users/ebea344163514f84b1b6f4825c08220b` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:44:53.905491 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e176086-2b6f-4b3c-94aa-490f0df13194 None admin] RBAC: Authorizing `identity:get_user(user_id=ebea344163514f84b1b6f4825c08220b)` {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:44:53.906949 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e176086-2b6f-4b3c-94aa-490f0df13194 None admin] RBAC: Authorization granted {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:44:53.908588 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 598/1182] 10.222.0.84 () {56 vars in 1177 bytes} [Wed May 25 14:44:53 2022] GET /identity/v3/users/ebea344163514f84b1b6f4825c08220b => generated 311 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:44:53.914221 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46631c31-2cb8-4b9f-934a-327449efa78b None admin] Authenticating user token {{(pid=101892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:44:53.968597 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG dbcounter [-] [101892] Writing DB stats keystone:SELECT=100 {{(pid=101892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:44:54.011164 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46631c31-2cb8-4b9f-934a-327449efa78b None admin] Validating token access rules against request {{(pid=101892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:44:54.042573 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ca3985-3c56-4e5d-84c7-c9f92bfd5221 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:44:54.043203 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ca3985-3c56-4e5d-84c7-c9f92bfd5221 None admin] REQUEST_METHOD: `GET` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:44:54.043488 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ca3985-3c56-4e5d-84c7-c9f92bfd5221 None admin] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:44:54.043791 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ca3985-3c56-4e5d-84c7-c9f92bfd5221 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:44:54.107532 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20ca3985-3c56-4e5d-84c7-c9f92bfd5221 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:44:54.109034 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20ca3985-3c56-4e5d-84c7-c9f92bfd5221 None admin] RBAC: Authorization granted {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:44:54.160967 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG dbcounter [-] [101892] Writing DB stats keystone:SELECT=100 {{(pid=101892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:44:54.203718 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 585/1183] 10.222.0.84 () {58 vars in 1282 bytes} [Wed May 25 14:44:53 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 290 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 25 14:44:54.209516 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e176086-2b6f-4b3c-94aa-490f0df13194 None admin] Authenticating user token {{(pid=101893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:44:54.290842 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG dbcounter [-] [101893] Writing DB stats keystone:SELECT=100 {{(pid=101893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:44:54.306117 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e176086-2b6f-4b3c-94aa-490f0df13194 None admin] Validating token access rules against request {{(pid=101893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:44:54.338714 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b2c2a73-def3-4ab9-bce4-f6f35a8acd2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:44:54.339593 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2c2a73-def3-4ab9-bce4-f6f35a8acd2a None admin] REQUEST_METHOD: `GET` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:44:54.339883 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2c2a73-def3-4ab9-bce4-f6f35a8acd2a None admin] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:44:54.340161 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2c2a73-def3-4ab9-bce4-f6f35a8acd2a None admin] PATH_INFO: `/v3/projects/bd5ec04de362493f9f720a9fadea5c79` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:44:54.341372 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b2c2a73-def3-4ab9-bce4-f6f35a8acd2a None admin] RBAC: Authorizing `identity:get_project(project_id=bd5ec04de362493f9f720a9fadea5c79)` {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:44:54.342801 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b2c2a73-def3-4ab9-bce4-f6f35a8acd2a None admin] RBAC: Authorization granted {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:44:54.345050 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 599/1184] 10.222.0.84 () {56 vars in 1186 bytes} [Wed May 25 14:44:54 2022] GET /identity/v3/projects/bd5ec04de362493f9f720a9fadea5c79 => generated 361 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:44:54.351672 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ca3985-3c56-4e5d-84c7-c9f92bfd5221 None admin] Authenticating user token {{(pid=101892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:44:54.450149 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ca3985-3c56-4e5d-84c7-c9f92bfd5221 None admin] Validating token access rules against request {{(pid=101892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:44:54.483362 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0919cef-b99a-4db1-aa0f-57a9cdc03d87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:44:54.484034 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0919cef-b99a-4db1-aa0f-57a9cdc03d87 None admin] REQUEST_METHOD: `GET` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:44:54.484856 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0919cef-b99a-4db1-aa0f-57a9cdc03d87 None admin] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:44:54.485133 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0919cef-b99a-4db1-aa0f-57a9cdc03d87 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:44:54.485954 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0919cef-b99a-4db1-aa0f-57a9cdc03d87 None admin] RBAC: Adding query filter params (role.id=a3b78e7d547d4d2d998b4c99a4396bba, scope.project.id=bd5ec04de362493f9f720a9fadea5c79, user.id=ebea344163514f84b1b6f4825c08220b) {{(pid=101892) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:44:54.486271 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0919cef-b99a-4db1-aa0f-57a9cdc03d87 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:44:54.487722 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0919cef-b99a-4db1-aa0f-57a9cdc03d87 None admin] RBAC: Authorization granted {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:44:54.493351 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 586/1185] 10.222.0.84 () {56 vars in 1374 bytes} [Wed May 25 14:44:54 2022] GET /identity/v3/role_assignments?user.id=ebea344163514f84b1b6f4825c08220b&scope.project.id=bd5ec04de362493f9f720a9fadea5c79&role.id=a3b78e7d547d4d2d998b4c99a4396bba => generated 259 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:44:56.654888 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd889d5-d082-47d5-bf6d-c60a6811f7fe None None] REQUEST_METHOD: `GET` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:44:56.655390 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd889d5-d082-47d5-bf6d-c60a6811f7fe None None] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:44:56.655516 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd889d5-d082-47d5-bf6d-c60a6811f7fe None None] PATH_INFO: `/` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:44:56.656832 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 600/1186] 10.222.0.84 () {54 vars in 926 bytes} [Wed May 25 14:44:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 14:44:56.662102 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77005eae-dcff-4a97-90ad-0ea49fdaff73 None None] REQUEST_METHOD: `POST` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:44:56.662488 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77005eae-dcff-4a97-90ad-0ea49fdaff73 None None] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:44:56.662652 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77005eae-dcff-4a97-90ad-0ea49fdaff73 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:44:56.679143 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.auth.core [None req-77005eae-dcff-4a97-90ad-0ea49fdaff73 None None] MFA Rules not processed for user `05d87e87798e429aa1c10b24391f915e`. Rule list: `[]` (Enabled: `True`). {{(pid=101892) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:44:56.680351 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.fernet_utils [None req-77005eae-dcff-4a97-90ad-0ea49fdaff73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=101892) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:44:56.694398 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG dbcounter [-] [101892] Writing DB stats keystone:SELECT=100 {{(pid=101892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:44:56.745384 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 587/1187] 10.222.0.84 () {58 vars in 1023 bytes} [Wed May 25 14:44:56 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 25 14:44:56.768578 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bd889d5-d082-47d5-bf6d-c60a6811f7fe None None] Authenticating user token {{(pid=101893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:44:56.866801 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bd889d5-d082-47d5-bf6d-c60a6811f7fe None None] Validating token access rules against request {{(pid=101893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:44:56.899602 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26f9416e-5c4f-41ab-a1ce-55d434cedce7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:44:56.900388 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f9416e-5c4f-41ab-a1ce-55d434cedce7 None admin] REQUEST_METHOD: `GET` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:44:56.900672 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f9416e-5c4f-41ab-a1ce-55d434cedce7 None admin] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:44:56.900947 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f9416e-5c4f-41ab-a1ce-55d434cedce7 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:44:56.910709 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26f9416e-5c4f-41ab-a1ce-55d434cedce7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 14:44:56.918240 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application [None req-26f9416e-5c4f-41ab-a1ce-55d434cedce7 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 25 14:44:56.918240 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:44:56.918240 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 14:44:56.918240 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 14:44:56.918240 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 14:44:56.918240 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 14:44:56.918240 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 14:44:56.918240 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 14:44:56.918240 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 14:44:56.918240 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 14:44:56.918240 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 14:44:56.918240 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 14:44:56.918240 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 14:44:56.918240 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 14:44:56.918240 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 14:44:56.918240 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 14:44:56.919380 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 14:44:56.919380 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 14:44:56.919380 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 14:44:56.919380 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 14:44:56.919380 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 14:44:56.919380 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 14:44:56.919380 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 14:44:56.919380 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 14:44:56.919380 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 14:44:56.919380 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return self.get_or_create( May 25 14:44:56.919380 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 14:44:56.919380 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application with Lock( May 25 14:44:56.919380 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 14:44:56.919380 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return self._enter() May 25 14:44:56.919380 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 14:44:56.919380 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 14:44:56.920345 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 14:44:56.920345 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return self.creator() May 25 14:44:56.920345 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 14:44:56.920345 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application created_value = creator( May 25 14:44:56.920345 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 14:44:56.920345 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 14:44:56.920345 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 14:44:56.920345 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 14:44:56.920345 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 14:44:56.920345 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 14:44:56.920345 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 25 14:44:56.920345 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application May 25 14:44:56.920345 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 601/1188] 10.222.0.84 () {56 vars in 1096 bytes} [Wed May 25 14:44:56 2022] GET /identity/v3/roles/admin => generated 83 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 14:44:56.925865 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77005eae-dcff-4a97-90ad-0ea49fdaff73 None None] Authenticating user token {{(pid=101892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:44:57.020266 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77005eae-dcff-4a97-90ad-0ea49fdaff73 None None] Validating token access rules against request {{(pid=101892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:44:57.052645 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3caf170d-c446-46be-8ba0-0679c7a5e206 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:44:57.053291 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3caf170d-c446-46be-8ba0-0679c7a5e206 None admin] REQUEST_METHOD: `GET` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:44:57.053574 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3caf170d-c446-46be-8ba0-0679c7a5e206 None admin] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:44:57.053847 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3caf170d-c446-46be-8ba0-0679c7a5e206 None admin] PATH_INFO: `/v3/roles` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:44:57.054581 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3caf170d-c446-46be-8ba0-0679c7a5e206 None admin] RBAC: Adding query filter params (name=admin) {{(pid=101892) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:44:57.054888 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3caf170d-c446-46be-8ba0-0679c7a5e206 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:44:57.056265 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3caf170d-c446-46be-8ba0-0679c7a5e206 None admin] RBAC: Authorization granted {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:44:57.064563 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 588/1189] 10.222.0.84 () {56 vars in 1099 bytes} [Wed May 25 14:44:56 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:44:57.070307 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26f9416e-5c4f-41ab-a1ce-55d434cedce7 None admin] Authenticating user token {{(pid=101893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:44:57.085116 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG dbcounter [-] [101893] Writing DB stats keystone:SELECT=100 {{(pid=101893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:44:57.172540 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26f9416e-5c4f-41ab-a1ce-55d434cedce7 None admin] Validating token access rules against request {{(pid=101893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:44:57.206081 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c5b24f-129a-4c4d-8ef9-b84ea79d834b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:44:57.206982 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c5b24f-129a-4c4d-8ef9-b84ea79d834b None admin] REQUEST_METHOD: `GET` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:44:57.207262 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c5b24f-129a-4c4d-8ef9-b84ea79d834b None admin] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:44:57.207534 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c5b24f-129a-4c4d-8ef9-b84ea79d834b None admin] PATH_INFO: `/v3/users/ebea344163514f84b1b6f4825c08220b` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:44:57.208740 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54c5b24f-129a-4c4d-8ef9-b84ea79d834b None admin] RBAC: Authorizing `identity:get_user(user_id=ebea344163514f84b1b6f4825c08220b)` {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:44:57.210188 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54c5b24f-129a-4c4d-8ef9-b84ea79d834b None admin] RBAC: Authorization granted {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:44:57.211839 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 602/1190] 10.222.0.84 () {56 vars in 1177 bytes} [Wed May 25 14:44:57 2022] GET /identity/v3/users/ebea344163514f84b1b6f4825c08220b => generated 311 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:44:57.217506 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3caf170d-c446-46be-8ba0-0679c7a5e206 None admin] Authenticating user token {{(pid=101892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:44:57.232856 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG dbcounter [-] [101892] Writing DB stats keystone:SELECT=100 {{(pid=101892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:44:57.314452 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3caf170d-c446-46be-8ba0-0679c7a5e206 None admin] Validating token access rules against request {{(pid=101892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:44:57.346368 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-041b1437-da4d-44fb-864a-512d91962495 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:44:57.347218 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041b1437-da4d-44fb-864a-512d91962495 None admin] REQUEST_METHOD: `GET` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:44:57.347503 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041b1437-da4d-44fb-864a-512d91962495 None admin] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:44:57.347811 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041b1437-da4d-44fb-864a-512d91962495 None admin] PATH_INFO: `/v3/projects/bd5ec04de362493f9f720a9fadea5c79` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:44:57.348972 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-041b1437-da4d-44fb-864a-512d91962495 None admin] RBAC: Authorizing `identity:get_project(project_id=bd5ec04de362493f9f720a9fadea5c79)` {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:44:57.350390 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-041b1437-da4d-44fb-864a-512d91962495 None admin] RBAC: Authorization granted {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:44:57.352088 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 589/1191] 10.222.0.84 () {56 vars in 1186 bytes} [Wed May 25 14:44:57 2022] GET /identity/v3/projects/bd5ec04de362493f9f720a9fadea5c79 => generated 361 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:44:57.358004 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c5b24f-129a-4c4d-8ef9-b84ea79d834b None admin] Authenticating user token {{(pid=101893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:44:57.441119 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG dbcounter [-] [101893] Writing DB stats keystone:SELECT=100 {{(pid=101893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:44:57.459518 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c5b24f-129a-4c4d-8ef9-b84ea79d834b None admin] Validating token access rules against request {{(pid=101893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:44:57.491860 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f484f11-7fcb-486a-a172-179c70594532 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:44:57.492989 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f484f11-7fcb-486a-a172-179c70594532 None admin] REQUEST_METHOD: `PUT` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:44:57.493269 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f484f11-7fcb-486a-a172-179c70594532 None admin] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:44:57.493543 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f484f11-7fcb-486a-a172-179c70594532 None admin] PATH_INFO: `/v3/projects/bd5ec04de362493f9f720a9fadea5c79/users/ebea344163514f84b1b6f4825c08220b/roles/a3b78e7d547d4d2d998b4c99a4396bba` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:44:57.495468 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f484f11-7fcb-486a-a172-179c70594532 None admin] RBAC: Authorizing `identity:create_grant(project_id=bd5ec04de362493f9f720a9fadea5c79, user_id=ebea344163514f84b1b6f4825c08220b, role_id=a3b78e7d547d4d2d998b4c99a4396bba)` {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:44:57.496930 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f484f11-7fcb-486a-a172-179c70594532 None admin] RBAC: Authorization granted {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:44:57.563146 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 603/1192] 10.222.0.84 () {58 vars in 1439 bytes} [Wed May 25 14:44:57 2022] PUT /identity/v3/projects/bd5ec04de362493f9f720a9fadea5c79/users/ebea344163514f84b1b6f4825c08220b/roles/a3b78e7d547d4d2d998b4c99a4396bba => generated 0 bytes in 206 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 14:44:59.701554 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56905c6c-0a86-4c84-a815-a5df550faf7d None None] REQUEST_METHOD: `GET` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:44:59.702104 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56905c6c-0a86-4c84-a815-a5df550faf7d None None] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:44:59.702104 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56905c6c-0a86-4c84-a815-a5df550faf7d None None] PATH_INFO: `/` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:44:59.703876 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 590/1193] 10.222.0.84 () {54 vars in 926 bytes} [Wed May 25 14:44:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 14:44:59.709060 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b6be46-d9fd-462c-8206-f28c7a8c355e None None] REQUEST_METHOD: `POST` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:44:59.709503 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b6be46-d9fd-462c-8206-f28c7a8c355e None None] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:44:59.709608 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b6be46-d9fd-462c-8206-f28c7a8c355e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:44:59.731897 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.auth.core [None req-b1b6be46-d9fd-462c-8206-f28c7a8c355e None None] MFA Rules not processed for user `05d87e87798e429aa1c10b24391f915e`. Rule list: `[]` (Enabled: `True`). {{(pid=101893) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:44:59.733101 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.fernet_utils [None req-b1b6be46-d9fd-462c-8206-f28c7a8c355e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=101893) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:44:59.805654 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 604/1194] 10.222.0.84 () {58 vars in 1023 bytes} [Wed May 25 14:44:59 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 25 14:44:59.829681 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56905c6c-0a86-4c84-a815-a5df550faf7d None None] Authenticating user token {{(pid=101892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:44:59.909879 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG dbcounter [-] [101892] Writing DB stats keystone:SELECT=100 {{(pid=101892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:44:59.928965 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56905c6c-0a86-4c84-a815-a5df550faf7d None None] Validating token access rules against request {{(pid=101892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:44:59.961606 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85cb3cb2-77b9-4b90-bb10-3a46ebdb2c87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:44:59.962382 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85cb3cb2-77b9-4b90-bb10-3a46ebdb2c87 None admin] REQUEST_METHOD: `GET` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:44:59.962667 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85cb3cb2-77b9-4b90-bb10-3a46ebdb2c87 None admin] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:44:59.962942 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85cb3cb2-77b9-4b90-bb10-3a46ebdb2c87 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:44:59.973262 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85cb3cb2-77b9-4b90-bb10-3a46ebdb2c87 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 14:44:59.980825 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application [None req-85cb3cb2-77b9-4b90-bb10-3a46ebdb2c87 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 25 14:44:59.980825 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:44:59.980825 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 14:44:59.980825 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 14:44:59.980825 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 14:44:59.980825 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 14:44:59.980825 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 14:44:59.980825 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 14:44:59.980825 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 14:44:59.980825 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 14:44:59.980825 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 14:44:59.980825 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 14:44:59.980825 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 14:44:59.980825 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 14:44:59.980825 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 14:44:59.980825 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 14:44:59.981954 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 14:44:59.981954 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 14:44:59.981954 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 14:44:59.981954 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 14:44:59.981954 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 14:44:59.981954 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 14:44:59.981954 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 14:44:59.981954 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 14:44:59.981954 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 14:44:59.981954 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application return self.get_or_create( May 25 14:44:59.981954 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 14:44:59.981954 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application with Lock( May 25 14:44:59.981954 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 14:44:59.981954 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application return self._enter() May 25 14:44:59.981954 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 14:44:59.981954 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 14:44:59.983010 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 14:44:59.983010 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application return self.creator() May 25 14:44:59.983010 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 14:44:59.983010 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application created_value = creator( May 25 14:44:59.983010 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 14:44:59.983010 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 14:44:59.983010 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 14:44:59.983010 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 14:44:59.983010 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 14:44:59.983010 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 14:44:59.983010 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 25 14:44:59.983010 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application May 25 14:44:59.983010 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 591/1195] 10.222.0.84 () {56 vars in 1096 bytes} [Wed May 25 14:44:59 2022] GET /identity/v3/roles/admin => generated 83 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 14:44:59.988071 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1b6be46-d9fd-462c-8206-f28c7a8c355e None None] Authenticating user token {{(pid=101893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:45:00.069003 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG dbcounter [-] [101893] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=101893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:45:00.098742 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1b6be46-d9fd-462c-8206-f28c7a8c355e None None] Validating token access rules against request {{(pid=101893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:45:00.131592 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5328eab5-215a-4487-b7a4-62c2600b864b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:45:00.132263 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5328eab5-215a-4487-b7a4-62c2600b864b None admin] REQUEST_METHOD: `GET` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:45:00.132543 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5328eab5-215a-4487-b7a4-62c2600b864b None admin] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:45:00.132813 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5328eab5-215a-4487-b7a4-62c2600b864b None admin] PATH_INFO: `/v3/roles` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:45:00.133543 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5328eab5-215a-4487-b7a4-62c2600b864b None admin] RBAC: Adding query filter params (name=admin) {{(pid=101893) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:45:00.133846 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5328eab5-215a-4487-b7a4-62c2600b864b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:45:00.135204 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5328eab5-215a-4487-b7a4-62c2600b864b None admin] RBAC: Authorization granted {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:45:00.143583 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 605/1196] 10.222.0.84 () {56 vars in 1099 bytes} [Wed May 25 14:44:59 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 14:45:00.149535 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85cb3cb2-77b9-4b90-bb10-3a46ebdb2c87 None admin] Authenticating user token {{(pid=101892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:45:00.244961 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85cb3cb2-77b9-4b90-bb10-3a46ebdb2c87 None admin] Validating token access rules against request {{(pid=101892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:45:00.277573 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76148ec1-5ceb-457c-aacd-6a07f5b646af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:45:00.278420 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76148ec1-5ceb-457c-aacd-6a07f5b646af None admin] REQUEST_METHOD: `GET` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:45:00.278700 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76148ec1-5ceb-457c-aacd-6a07f5b646af None admin] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:45:00.278973 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76148ec1-5ceb-457c-aacd-6a07f5b646af None admin] PATH_INFO: `/v3/users/ebea344163514f84b1b6f4825c08220b` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:45:00.280156 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76148ec1-5ceb-457c-aacd-6a07f5b646af None admin] RBAC: Authorizing `identity:get_user(user_id=ebea344163514f84b1b6f4825c08220b)` {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:45:00.281596 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76148ec1-5ceb-457c-aacd-6a07f5b646af None admin] RBAC: Authorization granted {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:45:00.283171 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 592/1197] 10.222.0.84 () {56 vars in 1177 bytes} [Wed May 25 14:45:00 2022] GET /identity/v3/users/ebea344163514f84b1b6f4825c08220b => generated 311 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:45:00.288778 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5328eab5-215a-4487-b7a4-62c2600b864b None admin] Authenticating user token {{(pid=101893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:45:00.412628 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5328eab5-215a-4487-b7a4-62c2600b864b None admin] Validating token access rules against request {{(pid=101893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:45:00.441371 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG dbcounter [-] [101893] Writing DB stats keystone:SELECT=100 {{(pid=101893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:45:00.446094 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-885f9ddd-8fe8-4424-87c4-70d4a91c1ced None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:45:00.446783 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-885f9ddd-8fe8-4424-87c4-70d4a91c1ced None admin] REQUEST_METHOD: `GET` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:45:00.447027 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-885f9ddd-8fe8-4424-87c4-70d4a91c1ced None admin] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:45:00.447312 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-885f9ddd-8fe8-4424-87c4-70d4a91c1ced None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:45:00.513225 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-885f9ddd-8fe8-4424-87c4-70d4a91c1ced None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:45:00.514692 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-885f9ddd-8fe8-4424-87c4-70d4a91c1ced None admin] RBAC: Authorization granted {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:45:00.610270 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 606/1198] 10.222.0.84 () {58 vars in 1282 bytes} [Wed May 25 14:45:00 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 322 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 25 14:45:00.616174 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76148ec1-5ceb-457c-aacd-6a07f5b646af None admin] Authenticating user token {{(pid=101892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:45:00.628080 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG dbcounter [-] [101892] Writing DB stats keystone:SELECT=100 {{(pid=101892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:45:00.713385 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76148ec1-5ceb-457c-aacd-6a07f5b646af None admin] Validating token access rules against request {{(pid=101892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:45:00.745589 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c34ff6d9-c090-4b48-b151-6521dd940fbd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:45:00.746441 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34ff6d9-c090-4b48-b151-6521dd940fbd None admin] REQUEST_METHOD: `GET` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:45:00.746723 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34ff6d9-c090-4b48-b151-6521dd940fbd None admin] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:45:00.746999 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34ff6d9-c090-4b48-b151-6521dd940fbd None admin] PATH_INFO: `/v3/projects/bd5ec04de362493f9f720a9fadea5c79` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:45:00.748182 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c34ff6d9-c090-4b48-b151-6521dd940fbd None admin] RBAC: Authorizing `identity:get_project(project_id=bd5ec04de362493f9f720a9fadea5c79)` {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:45:00.750201 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c34ff6d9-c090-4b48-b151-6521dd940fbd None admin] RBAC: Authorization granted {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:45:00.751878 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 593/1199] 10.222.0.84 () {56 vars in 1186 bytes} [Wed May 25 14:45:00 2022] GET /identity/v3/projects/bd5ec04de362493f9f720a9fadea5c79 => generated 361 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:45:00.757751 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-885f9ddd-8fe8-4424-87c4-70d4a91c1ced None admin] Authenticating user token {{(pid=101893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:45:00.787011 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG dbcounter [-] [101893] Writing DB stats keystone:SELECT=100 {{(pid=101893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:45:00.852917 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-885f9ddd-8fe8-4424-87c4-70d4a91c1ced None admin] Validating token access rules against request {{(pid=101893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:45:00.886093 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19042526-b2c7-422d-852b-b5ccf6be089d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:45:00.886732 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19042526-b2c7-422d-852b-b5ccf6be089d None admin] REQUEST_METHOD: `GET` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:45:00.887015 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19042526-b2c7-422d-852b-b5ccf6be089d None admin] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:45:00.887289 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19042526-b2c7-422d-852b-b5ccf6be089d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:45:00.888131 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19042526-b2c7-422d-852b-b5ccf6be089d None admin] RBAC: Adding query filter params (role.id=a3b78e7d547d4d2d998b4c99a4396bba, scope.project.id=bd5ec04de362493f9f720a9fadea5c79, user.id=ebea344163514f84b1b6f4825c08220b) {{(pid=101893) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:45:00.888444 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19042526-b2c7-422d-852b-b5ccf6be089d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:45:00.889857 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19042526-b2c7-422d-852b-b5ccf6be089d None admin] RBAC: Authorization granted {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:45:00.895509 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 607/1200] 10.222.0.84 () {56 vars in 1374 bytes} [Wed May 25 14:45:00 2022] GET /identity/v3/role_assignments?user.id=ebea344163514f84b1b6f4825c08220b&scope.project.id=bd5ec04de362493f9f720a9fadea5c79&role.id=a3b78e7d547d4d2d998b4c99a4396bba => generated 608 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:45:10.741636 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG dbcounter [-] [101892] Writing DB stats keystone:SELECT=62 {{(pid=101892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:45:10.892945 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG dbcounter [-] [101893] Writing DB stats keystone:SELECT=52 {{(pid=101893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:46:18.241938 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92748ef7-ced3-44da-9c13-941d8a490807 None None] REQUEST_METHOD: `GET` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:46:18.242523 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92748ef7-ced3-44da-9c13-941d8a490807 None None] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:46:18.242523 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92748ef7-ced3-44da-9c13-941d8a490807 None None] PATH_INFO: `/` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:46:18.243870 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 594/1201] 10.222.0.84 () {54 vars in 926 bytes} [Wed May 25 14:46:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 14:46:18.249787 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7473f0a2-0794-49d8-b428-493f51261cf9 None None] REQUEST_METHOD: `POST` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:46:18.250216 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7473f0a2-0794-49d8-b428-493f51261cf9 None None] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:46:18.250322 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7473f0a2-0794-49d8-b428-493f51261cf9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:46:18.267611 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.auth.core [None req-7473f0a2-0794-49d8-b428-493f51261cf9 None None] MFA Rules not processed for user `05d87e87798e429aa1c10b24391f915e`. Rule list: `[]` (Enabled: `True`). {{(pid=101893) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:46:18.268789 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.fernet_utils [None req-7473f0a2-0794-49d8-b428-493f51261cf9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=101893) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:46:18.338628 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 608/1202] 10.222.0.84 () {58 vars in 1023 bytes} [Wed May 25 14:46:18 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 25 14:46:18.363179 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92748ef7-ced3-44da-9c13-941d8a490807 None None] Authenticating user token {{(pid=101892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:46:18.474799 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92748ef7-ced3-44da-9c13-941d8a490807 None None] Validating token access rules against request {{(pid=101892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:46:18.508217 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d24dfd67-1811-4452-b127-354c90ae4753 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:46:18.508930 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24dfd67-1811-4452-b127-354c90ae4753 None admin] REQUEST_METHOD: `GET` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:46:18.509213 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24dfd67-1811-4452-b127-354c90ae4753 None admin] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:46:18.509487 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24dfd67-1811-4452-b127-354c90ae4753 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:46:18.519874 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d24dfd67-1811-4452-b127-354c90ae4753 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:46:18.521318 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d24dfd67-1811-4452-b127-354c90ae4753 None admin] RBAC: Authorization granted {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:46:18.538690 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application [None req-d24dfd67-1811-4452-b127-354c90ae4753 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 25 14:46:18.538690 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:46:18.538690 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 14:46:18.538690 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 14:46:18.538690 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 14:46:18.538690 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 14:46:18.538690 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 14:46:18.538690 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 14:46:18.538690 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 14:46:18.538690 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 14:46:18.538690 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 14:46:18.538690 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 14:46:18.538690 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 25 14:46:18.538690 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 25 14:46:18.538690 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 25 14:46:18.539918 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 25 14:46:18.539918 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 14:46:18.539918 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 14:46:18.539918 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 14:46:18.539918 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 14:46:18.539918 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 14:46:18.539918 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application return self.get_or_create( May 25 14:46:18.539918 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 14:46:18.539918 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application with Lock( May 25 14:46:18.539918 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 14:46:18.539918 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application return self._enter() May 25 14:46:18.539918 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 14:46:18.539918 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 14:46:18.539918 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 14:46:18.539918 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application return self.creator() May 25 14:46:18.539918 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 14:46:18.539918 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application created_value = creator( May 25 14:46:18.540922 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 25 14:46:18.540922 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 25 14:46:18.540922 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 25 14:46:18.540922 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application May 25 14:46:18.540922 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 595/1203] 10.222.0.84 () {56 vars in 1108 bytes} [Wed May 25 14:46:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 14:46:18.546633 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7473f0a2-0794-49d8-b428-493f51261cf9 None None] Authenticating user token {{(pid=101893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:46:18.645930 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7473f0a2-0794-49d8-b428-493f51261cf9 None None] Validating token access rules against request {{(pid=101893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:46:18.674866 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG dbcounter [-] [101893] Writing DB stats keystone:SELECT=100 {{(pid=101893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:46:18.680597 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-819def79-15fd-4fc1-a0e0-2101558bc193 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:46:18.681261 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819def79-15fd-4fc1-a0e0-2101558bc193 None admin] REQUEST_METHOD: `GET` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:46:18.681543 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819def79-15fd-4fc1-a0e0-2101558bc193 None admin] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:46:18.681821 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819def79-15fd-4fc1-a0e0-2101558bc193 None admin] PATH_INFO: `/v3/domains` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:46:18.682535 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-819def79-15fd-4fc1-a0e0-2101558bc193 None admin] RBAC: Adding query filter params (name=Default) {{(pid=101893) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:46:18.682843 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-819def79-15fd-4fc1-a0e0-2101558bc193 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:46:18.685409 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-819def79-15fd-4fc1-a0e0-2101558bc193 None admin] RBAC: Authorization granted {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:46:18.696231 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 609/1204] 10.222.0.84 () {56 vars in 1109 bytes} [Wed May 25 14:46:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:46:18.702271 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d24dfd67-1811-4452-b127-354c90ae4753 None admin] Authenticating user token {{(pid=101892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:46:18.755014 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG dbcounter [-] [101892] Writing DB stats keystone:SELECT=100 {{(pid=101892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:46:18.800646 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d24dfd67-1811-4452-b127-354c90ae4753 None admin] Validating token access rules against request {{(pid=101892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:46:18.833401 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f32a3b04-09e7-4264-98ae-5e3a7570fbc9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:46:18.834064 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32a3b04-09e7-4264-98ae-5e3a7570fbc9 None admin] REQUEST_METHOD: `POST` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:46:18.834350 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32a3b04-09e7-4264-98ae-5e3a7570fbc9 None admin] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:46:18.834628 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32a3b04-09e7-4264-98ae-5e3a7570fbc9 None admin] PATH_INFO: `/v3/users` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:46:18.835337 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f32a3b04-09e7-4264-98ae-5e3a7570fbc9 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:46:18.836795 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f32a3b04-09e7-4264-98ae-5e3a7570fbc9 None admin] RBAC: Authorization granted {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:46:18.920421 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 596/1205] 10.222.0.84 () {60 vars in 1132 bytes} [Wed May 25 14:46:18 2022] POST /identity/v3/users => generated 251 bytes in 219 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 25 14:46:21.161178 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce627766-53b5-4673-addd-3c18eec84551 None None] REQUEST_METHOD: `GET` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:46:21.161747 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce627766-53b5-4673-addd-3c18eec84551 None None] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:46:21.161747 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce627766-53b5-4673-addd-3c18eec84551 None None] PATH_INFO: `/` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:46:21.163138 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 610/1206] 10.222.0.84 () {54 vars in 926 bytes} [Wed May 25 14:46:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 14:46:21.168409 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3741abd1-1dee-4ec0-a747-c452169f61a9 None None] REQUEST_METHOD: `POST` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:46:21.172950 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3741abd1-1dee-4ec0-a747-c452169f61a9 None None] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:46:21.172950 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3741abd1-1dee-4ec0-a747-c452169f61a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:46:21.186704 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.auth.core [None req-3741abd1-1dee-4ec0-a747-c452169f61a9 None None] MFA Rules not processed for user `05d87e87798e429aa1c10b24391f915e`. Rule list: `[]` (Enabled: `True`). {{(pid=101892) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:46:21.187968 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.fernet_utils [None req-3741abd1-1dee-4ec0-a747-c452169f61a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=101892) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:46:21.258840 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 597/1207] 10.222.0.84 () {58 vars in 1023 bytes} [Wed May 25 14:46:21 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 25 14:46:21.282850 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce627766-53b5-4673-addd-3c18eec84551 None None] Authenticating user token {{(pid=101893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:46:21.382117 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce627766-53b5-4673-addd-3c18eec84551 None None] Validating token access rules against request {{(pid=101893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:46:21.415727 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-963b41e9-72d6-400a-a8cc-5b2cd080324e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:46:21.416448 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-963b41e9-72d6-400a-a8cc-5b2cd080324e None admin] REQUEST_METHOD: `GET` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:46:21.416733 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-963b41e9-72d6-400a-a8cc-5b2cd080324e None admin] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:46:21.417006 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-963b41e9-72d6-400a-a8cc-5b2cd080324e None admin] PATH_INFO: `/v3/roles/service` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:46:21.427286 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-963b41e9-72d6-400a-a8cc-5b2cd080324e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 14:46:21.435507 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application [None req-963b41e9-72d6-400a-a8cc-5b2cd080324e None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 25 14:46:21.435507 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:46:21.435507 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 14:46:21.435507 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 14:46:21.435507 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 14:46:21.435507 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 14:46:21.435507 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 14:46:21.435507 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 14:46:21.435507 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 14:46:21.435507 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 14:46:21.435507 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 14:46:21.435507 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 14:46:21.435507 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 14:46:21.435507 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 14:46:21.435507 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 14:46:21.435507 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 14:46:21.436677 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 14:46:21.436677 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 14:46:21.436677 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 14:46:21.436677 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 14:46:21.436677 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 14:46:21.436677 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 14:46:21.436677 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 14:46:21.436677 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 14:46:21.436677 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 14:46:21.436677 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return self.get_or_create( May 25 14:46:21.436677 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 14:46:21.436677 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application with Lock( May 25 14:46:21.436677 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 14:46:21.436677 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return self._enter() May 25 14:46:21.436677 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 14:46:21.436677 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 14:46:21.437553 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 14:46:21.437553 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return self.creator() May 25 14:46:21.437553 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 14:46:21.437553 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application created_value = creator( May 25 14:46:21.437553 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 14:46:21.437553 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 14:46:21.437553 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 14:46:21.437553 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 14:46:21.437553 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 14:46:21.437553 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 14:46:21.437553 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 25 14:46:21.437553 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application May 25 14:46:21.437553 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 611/1208] 10.222.0.84 () {56 vars in 1102 bytes} [Wed May 25 14:46:21 2022] GET /identity/v3/roles/service => generated 85 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 14:46:21.443231 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3741abd1-1dee-4ec0-a747-c452169f61a9 None None] Authenticating user token {{(pid=101892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:46:21.483888 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG dbcounter [-] [101892] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=101892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:46:21.546427 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3741abd1-1dee-4ec0-a747-c452169f61a9 None None] Validating token access rules against request {{(pid=101892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:46:21.583696 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b18d73f4-be56-4aff-aab7-09d1ea017a78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:46:21.584473 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18d73f4-be56-4aff-aab7-09d1ea017a78 None admin] REQUEST_METHOD: `GET` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:46:21.584700 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18d73f4-be56-4aff-aab7-09d1ea017a78 None admin] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:46:21.584977 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18d73f4-be56-4aff-aab7-09d1ea017a78 None admin] PATH_INFO: `/v3/roles` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:46:21.585720 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b18d73f4-be56-4aff-aab7-09d1ea017a78 None admin] RBAC: Adding query filter params (name=service) {{(pid=101892) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:46:21.586031 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b18d73f4-be56-4aff-aab7-09d1ea017a78 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:46:21.587397 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b18d73f4-be56-4aff-aab7-09d1ea017a78 None admin] RBAC: Authorization granted {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:46:21.595358 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 598/1209] 10.222.0.84 () {56 vars in 1103 bytes} [Wed May 25 14:46:21 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:46:21.601309 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-963b41e9-72d6-400a-a8cc-5b2cd080324e None admin] Authenticating user token {{(pid=101893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:46:21.652769 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG dbcounter [-] [101893] Writing DB stats keystone:SELECT=100 {{(pid=101893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:46:21.702150 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-963b41e9-72d6-400a-a8cc-5b2cd080324e None admin] Validating token access rules against request {{(pid=101893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:46:21.735513 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a01504a3-fdf2-49f1-9b9f-3a62469ccb08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:46:21.736570 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01504a3-fdf2-49f1-9b9f-3a62469ccb08 None admin] REQUEST_METHOD: `GET` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:46:21.737059 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01504a3-fdf2-49f1-9b9f-3a62469ccb08 None admin] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:46:21.737380 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01504a3-fdf2-49f1-9b9f-3a62469ccb08 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:46:21.748738 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a01504a3-fdf2-49f1-9b9f-3a62469ccb08 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:46:21.750255 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a01504a3-fdf2-49f1-9b9f-3a62469ccb08 None admin] RBAC: Authorization granted {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:46:21.767373 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application [None req-a01504a3-fdf2-49f1-9b9f-3a62469ccb08 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 25 14:46:21.767373 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:46:21.767373 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 14:46:21.767373 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 14:46:21.767373 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 14:46:21.767373 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 14:46:21.767373 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 14:46:21.767373 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 14:46:21.767373 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 14:46:21.767373 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 14:46:21.767373 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 14:46:21.767373 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 14:46:21.767373 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 25 14:46:21.767373 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 25 14:46:21.767373 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 25 14:46:21.768342 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 25 14:46:21.768342 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 14:46:21.768342 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 14:46:21.768342 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 14:46:21.768342 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 14:46:21.768342 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 14:46:21.768342 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return self.get_or_create( May 25 14:46:21.768342 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 14:46:21.768342 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application with Lock( May 25 14:46:21.768342 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 14:46:21.768342 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return self._enter() May 25 14:46:21.768342 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 14:46:21.768342 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 14:46:21.768342 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 14:46:21.768342 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return self.creator() May 25 14:46:21.768342 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 14:46:21.768342 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application created_value = creator( May 25 14:46:21.769320 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 25 14:46:21.769320 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 25 14:46:21.769320 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 25 14:46:21.769320 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application May 25 14:46:21.769320 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 612/1210] 10.222.0.84 () {56 vars in 1108 bytes} [Wed May 25 14:46:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 14:46:21.774431 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b18d73f4-be56-4aff-aab7-09d1ea017a78 None admin] Authenticating user token {{(pid=101892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:46:21.870830 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG dbcounter [-] [101892] Writing DB stats keystone:SELECT=100 {{(pid=101892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:46:21.873739 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b18d73f4-be56-4aff-aab7-09d1ea017a78 None admin] Validating token access rules against request {{(pid=101892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:46:21.906527 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52af6506-1a9d-4eba-9a80-63b25dad88f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:46:21.907185 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52af6506-1a9d-4eba-9a80-63b25dad88f9 None admin] REQUEST_METHOD: `GET` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:46:21.907472 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52af6506-1a9d-4eba-9a80-63b25dad88f9 None admin] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:46:21.907785 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52af6506-1a9d-4eba-9a80-63b25dad88f9 None admin] PATH_INFO: `/v3/domains` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:46:21.908497 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52af6506-1a9d-4eba-9a80-63b25dad88f9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=101892) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:46:21.908809 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52af6506-1a9d-4eba-9a80-63b25dad88f9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:46:21.910167 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52af6506-1a9d-4eba-9a80-63b25dad88f9 None admin] RBAC: Authorization granted {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:46:21.921811 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 599/1211] 10.222.0.84 () {56 vars in 1109 bytes} [Wed May 25 14:46:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:46:21.927703 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a01504a3-fdf2-49f1-9b9f-3a62469ccb08 None admin] Authenticating user token {{(pid=101893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:46:22.026426 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a01504a3-fdf2-49f1-9b9f-3a62469ccb08 None admin] Validating token access rules against request {{(pid=101893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:46:22.028395 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG dbcounter [-] [101893] Writing DB stats keystone:SELECT=100 {{(pid=101893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:46:22.060100 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-545c5168-7334-46df-8a25-2a82f6cb3bb6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:46:22.061124 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545c5168-7334-46df-8a25-2a82f6cb3bb6 None admin] REQUEST_METHOD: `GET` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:46:22.061400 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545c5168-7334-46df-8a25-2a82f6cb3bb6 None admin] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:46:22.061821 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545c5168-7334-46df-8a25-2a82f6cb3bb6 None admin] PATH_INFO: `/v3/users/placement` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:46:22.068760 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-545c5168-7334-46df-8a25-2a82f6cb3bb6 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:46:22.070211 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-545c5168-7334-46df-8a25-2a82f6cb3bb6 None admin] RBAC: Authorization granted {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:46:22.084613 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application [None req-545c5168-7334-46df-8a25-2a82f6cb3bb6 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. May 25 14:46:22.084613 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:46:22.084613 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 14:46:22.084613 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 14:46:22.084613 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 14:46:22.084613 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 14:46:22.084613 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 14:46:22.084613 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 14:46:22.084613 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 14:46:22.084613 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 14:46:22.084613 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 14:46:22.084613 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 14:46:22.084613 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 25 14:46:22.084613 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return self._get_user(user_id) May 25 14:46:22.084613 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 25 14:46:22.084613 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 25 14:46:22.085786 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 14:46:22.085786 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 14:46:22.085786 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 25 14:46:22.085786 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 25 14:46:22.085786 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 25 14:46:22.085786 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 25 14:46:22.085786 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 14:46:22.085786 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 14:46:22.085786 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 14:46:22.085786 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return self.get_or_create( May 25 14:46:22.085786 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 14:46:22.085786 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application with Lock( May 25 14:46:22.085786 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 14:46:22.085786 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return self._enter() May 25 14:46:22.085786 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 14:46:22.085786 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 14:46:22.085786 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 14:46:22.085786 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return self.creator() May 25 14:46:22.087133 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 14:46:22.087133 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application created_value = creator( May 25 14:46:22.087133 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 25 14:46:22.087133 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 25 14:46:22.087133 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 25 14:46:22.087133 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 25 14:46:22.087133 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 25 14:46:22.087133 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 25 14:46:22.087133 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. May 25 14:46:22.087133 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application May 25 14:46:22.087133 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 613/1212] 10.222.0.84 () {56 vars in 1108 bytes} [Wed May 25 14:46:21 2022] GET /identity/v3/users/placement => generated 87 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 14:46:22.092335 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52af6506-1a9d-4eba-9a80-63b25dad88f9 None admin] Authenticating user token {{(pid=101892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:46:22.193035 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52af6506-1a9d-4eba-9a80-63b25dad88f9 None admin] Validating token access rules against request {{(pid=101892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:46:22.227988 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f729d16d-5b28-44a5-a466-6ef7f1287cc6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:46:22.228665 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f729d16d-5b28-44a5-a466-6ef7f1287cc6 None admin] REQUEST_METHOD: `GET` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:46:22.228950 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f729d16d-5b28-44a5-a466-6ef7f1287cc6 None admin] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:46:22.229229 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f729d16d-5b28-44a5-a466-6ef7f1287cc6 None admin] PATH_INFO: `/v3/users` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:46:22.230104 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f729d16d-5b28-44a5-a466-6ef7f1287cc6 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=101892) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:46:22.230418 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f729d16d-5b28-44a5-a466-6ef7f1287cc6 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:46:22.232469 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f729d16d-5b28-44a5-a466-6ef7f1287cc6 None admin] RBAC: Authorization granted {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:46:22.249854 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 600/1213] 10.222.0.84 () {56 vars in 1143 bytes} [Wed May 25 14:46:22 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:46:22.255947 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-545c5168-7334-46df-8a25-2a82f6cb3bb6 None admin] Authenticating user token {{(pid=101893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:46:22.357120 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-545c5168-7334-46df-8a25-2a82f6cb3bb6 None admin] Validating token access rules against request {{(pid=101893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:46:22.391927 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb914a92-cb8e-4bc9-a4a7-80a1efed0598 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:46:22.392590 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb914a92-cb8e-4bc9-a4a7-80a1efed0598 None admin] REQUEST_METHOD: `GET` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:46:22.392873 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb914a92-cb8e-4bc9-a4a7-80a1efed0598 None admin] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:46:22.393150 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb914a92-cb8e-4bc9-a4a7-80a1efed0598 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:46:22.423025 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG dbcounter [-] [101893] Writing DB stats keystone:SELECT=100 {{(pid=101893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:46:22.460333 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb914a92-cb8e-4bc9-a4a7-80a1efed0598 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:46:22.461830 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb914a92-cb8e-4bc9-a4a7-80a1efed0598 None admin] RBAC: Authorization granted {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:46:22.559482 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 614/1214] 10.222.0.84 () {58 vars in 1282 bytes} [Wed May 25 14:46:22 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 304 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 25 14:46:22.565397 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f729d16d-5b28-44a5-a466-6ef7f1287cc6 None admin] Authenticating user token {{(pid=101892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:46:22.586427 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG dbcounter [-] [101892] Writing DB stats keystone:SELECT=100 {{(pid=101892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:46:22.665070 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f729d16d-5b28-44a5-a466-6ef7f1287cc6 None admin] Validating token access rules against request {{(pid=101892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:46:22.700519 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4a8651d-a1cb-4375-8b7c-677400baa4b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:46:22.701363 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a8651d-a1cb-4375-8b7c-677400baa4b5 None admin] REQUEST_METHOD: `GET` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:46:22.701650 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a8651d-a1cb-4375-8b7c-677400baa4b5 None admin] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:46:22.701928 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a8651d-a1cb-4375-8b7c-677400baa4b5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:46:22.712099 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4a8651d-a1cb-4375-8b7c-677400baa4b5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:46:22.713539 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4a8651d-a1cb-4375-8b7c-677400baa4b5 None admin] RBAC: Authorization granted {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:46:22.730883 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application [None req-e4a8651d-a1cb-4375-8b7c-677400baa4b5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 25 14:46:22.730883 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:46:22.730883 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 14:46:22.730883 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 14:46:22.730883 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 14:46:22.730883 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 14:46:22.730883 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 14:46:22.730883 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 14:46:22.730883 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 14:46:22.730883 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 14:46:22.730883 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 14:46:22.730883 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 14:46:22.730883 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 25 14:46:22.730883 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 25 14:46:22.730883 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 25 14:46:22.731982 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 25 14:46:22.731982 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 14:46:22.731982 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 14:46:22.731982 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 14:46:22.731982 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 14:46:22.731982 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 14:46:22.731982 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application return self.get_or_create( May 25 14:46:22.731982 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 14:46:22.731982 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application with Lock( May 25 14:46:22.731982 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 14:46:22.731982 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application return self._enter() May 25 14:46:22.731982 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 14:46:22.731982 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 14:46:22.731982 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 14:46:22.731982 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application return self.creator() May 25 14:46:22.731982 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 14:46:22.731982 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application created_value = creator( May 25 14:46:22.732962 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 25 14:46:22.732962 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 25 14:46:22.732962 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 25 14:46:22.732962 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application May 25 14:46:22.732962 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 601/1215] 10.222.0.84 () {56 vars in 1108 bytes} [Wed May 25 14:46:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 14:46:22.737814 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb914a92-cb8e-4bc9-a4a7-80a1efed0598 None admin] Authenticating user token {{(pid=101893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:46:22.797855 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG dbcounter [-] [101893] Writing DB stats keystone:SELECT=100 {{(pid=101893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:46:22.835318 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb914a92-cb8e-4bc9-a4a7-80a1efed0598 None admin] Validating token access rules against request {{(pid=101893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:46:22.869049 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c47eaa08-9649-4c06-9f42-2668877468fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:46:22.869707 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47eaa08-9649-4c06-9f42-2668877468fb None admin] REQUEST_METHOD: `GET` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:46:22.869992 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47eaa08-9649-4c06-9f42-2668877468fb None admin] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:46:22.870270 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47eaa08-9649-4c06-9f42-2668877468fb None admin] PATH_INFO: `/v3/domains` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:46:22.870989 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c47eaa08-9649-4c06-9f42-2668877468fb None admin] RBAC: Adding query filter params (name=Default) {{(pid=101893) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:46:22.871849 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c47eaa08-9649-4c06-9f42-2668877468fb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:46:22.873233 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c47eaa08-9649-4c06-9f42-2668877468fb None admin] RBAC: Authorization granted {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:46:22.884259 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 615/1216] 10.222.0.84 () {56 vars in 1109 bytes} [Wed May 25 14:46:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:46:22.890738 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4a8651d-a1cb-4375-8b7c-677400baa4b5 None admin] Authenticating user token {{(pid=101892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:46:22.958983 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG dbcounter [-] [101892] Writing DB stats keystone:SELECT=100 {{(pid=101892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:46:22.987877 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4a8651d-a1cb-4375-8b7c-677400baa4b5 None admin] Validating token access rules against request {{(pid=101892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:46:23.021534 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53864015-e33a-499f-be39-c9870209d482 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:46:23.022328 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53864015-e33a-499f-be39-c9870209d482 None admin] REQUEST_METHOD: `GET` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:46:23.022616 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53864015-e33a-499f-be39-c9870209d482 None admin] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:46:23.022894 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53864015-e33a-499f-be39-c9870209d482 None admin] PATH_INFO: `/v3/projects/service` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:46:23.029464 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53864015-e33a-499f-be39-c9870209d482 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:46:23.031018 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53864015-e33a-499f-be39-c9870209d482 None admin] RBAC: Authorization granted {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:46:23.045142 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application [None req-53864015-e33a-499f-be39-c9870209d482 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 25 14:46:23.045142 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:46:23.045142 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 14:46:23.045142 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 14:46:23.045142 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 14:46:23.045142 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 14:46:23.045142 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 14:46:23.045142 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 14:46:23.045142 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 14:46:23.045142 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 14:46:23.045142 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 14:46:23.045142 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 14:46:23.045142 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 25 14:46:23.045142 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application return self._get_project(project_id) May 25 14:46:23.045142 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 25 14:46:23.046213 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 25 14:46:23.046213 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 14:46:23.046213 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 14:46:23.046213 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 14:46:23.046213 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 14:46:23.046213 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 14:46:23.046213 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application return self.get_or_create( May 25 14:46:23.046213 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 14:46:23.046213 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application with Lock( May 25 14:46:23.046213 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 14:46:23.046213 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application return self._enter() May 25 14:46:23.046213 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 14:46:23.046213 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 14:46:23.046213 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 14:46:23.046213 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application return self.creator() May 25 14:46:23.046213 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 14:46:23.046213 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application created_value = creator( May 25 14:46:23.047167 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 25 14:46:23.047167 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 25 14:46:23.047167 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 25 14:46:23.047167 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 25 14:46:23.047167 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 25 14:46:23.047167 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 25 14:46:23.047167 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 25 14:46:23.047167 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application May 25 14:46:23.047167 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 602/1217] 10.222.0.84 () {56 vars in 1111 bytes} [Wed May 25 14:46:22 2022] GET /identity/v3/projects/service => generated 88 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 14:46:23.052228 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c47eaa08-9649-4c06-9f42-2668877468fb None admin] Authenticating user token {{(pid=101893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:46:23.150752 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c47eaa08-9649-4c06-9f42-2668877468fb None admin] Validating token access rules against request {{(pid=101893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:46:23.172819 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG dbcounter [-] [101893] Writing DB stats keystone:SELECT=100 {{(pid=101893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:46:23.184639 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccc5ca30-ffb1-416c-856d-41792709a2bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:46:23.185285 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc5ca30-ffb1-416c-856d-41792709a2bf None admin] REQUEST_METHOD: `GET` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:46:23.185573 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc5ca30-ffb1-416c-856d-41792709a2bf None admin] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:46:23.185845 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc5ca30-ffb1-416c-856d-41792709a2bf None admin] PATH_INFO: `/v3/projects` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:46:23.186625 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccc5ca30-ffb1-416c-856d-41792709a2bf None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=101893) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:46:23.186939 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccc5ca30-ffb1-416c-856d-41792709a2bf None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:46:23.188413 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccc5ca30-ffb1-416c-856d-41792709a2bf None admin] RBAC: Authorization granted {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:46:23.200171 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 616/1218] 10.222.0.84 () {56 vars in 1148 bytes} [Wed May 25 14:46:23 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:46:23.206575 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53864015-e33a-499f-be39-c9870209d482 None admin] Authenticating user token {{(pid=101892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:46:23.309612 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53864015-e33a-499f-be39-c9870209d482 None admin] Validating token access rules against request {{(pid=101892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:46:23.337663 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG dbcounter [-] [101892] Writing DB stats keystone:SELECT=100 {{(pid=101892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:46:23.343720 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-799f05ae-b356-4682-b7d0-4c9be1b8aa2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:46:23.344374 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799f05ae-b356-4682-b7d0-4c9be1b8aa2e None admin] REQUEST_METHOD: `GET` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:46:23.344661 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799f05ae-b356-4682-b7d0-4c9be1b8aa2e None admin] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:46:23.344940 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799f05ae-b356-4682-b7d0-4c9be1b8aa2e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:46:23.345771 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-799f05ae-b356-4682-b7d0-4c9be1b8aa2e None admin] RBAC: Adding query filter params (role.id=fdcb2eda27b84f44a392b7e8b59cc425, scope.project.id=a000829c658c4a7cab67f7b6353ba3fa, user.id=d18c4a1d92b94c0087a203db4fed22f2) {{(pid=101892) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:46:23.346088 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-799f05ae-b356-4682-b7d0-4c9be1b8aa2e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:46:23.347511 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-799f05ae-b356-4682-b7d0-4c9be1b8aa2e None admin] RBAC: Authorization granted {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:46:23.353008 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 603/1219] 10.222.0.84 () {56 vars in 1374 bytes} [Wed May 25 14:46:23 2022] GET /identity/v3/role_assignments?user.id=d18c4a1d92b94c0087a203db4fed22f2&scope.project.id=a000829c658c4a7cab67f7b6353ba3fa&role.id=fdcb2eda27b84f44a392b7e8b59cc425 => generated 259 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:46:25.544604 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f83ecf4-c62a-4392-8837-9e75aa0288e9 None None] REQUEST_METHOD: `GET` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:46:25.545165 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f83ecf4-c62a-4392-8837-9e75aa0288e9 None None] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:46:25.545165 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f83ecf4-c62a-4392-8837-9e75aa0288e9 None None] PATH_INFO: `/` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:46:25.546564 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 617/1220] 10.222.0.84 () {54 vars in 926 bytes} [Wed May 25 14:46:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 14:46:25.551940 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3dc851-b02d-47e3-a220-3e1fc1ade73e None None] REQUEST_METHOD: `POST` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:46:25.552395 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3dc851-b02d-47e3-a220-3e1fc1ade73e None None] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:46:25.552578 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3dc851-b02d-47e3-a220-3e1fc1ade73e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:46:25.569460 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.auth.core [None req-6f3dc851-b02d-47e3-a220-3e1fc1ade73e None None] MFA Rules not processed for user `05d87e87798e429aa1c10b24391f915e`. Rule list: `[]` (Enabled: `True`). {{(pid=101892) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:46:25.570640 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.fernet_utils [None req-6f3dc851-b02d-47e3-a220-3e1fc1ade73e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=101892) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:46:25.636232 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 604/1221] 10.222.0.84 () {58 vars in 1023 bytes} [Wed May 25 14:46:25 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 25 14:46:25.660487 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f83ecf4-c62a-4392-8837-9e75aa0288e9 None None] Authenticating user token {{(pid=101893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:46:25.763630 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f83ecf4-c62a-4392-8837-9e75aa0288e9 None None] Validating token access rules against request {{(pid=101893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:46:25.796827 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7c6d4a1-5c36-4578-bbd1-43d649c1fdf2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:46:25.797540 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c6d4a1-5c36-4578-bbd1-43d649c1fdf2 None admin] REQUEST_METHOD: `GET` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:46:25.798151 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c6d4a1-5c36-4578-bbd1-43d649c1fdf2 None admin] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:46:25.798427 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c6d4a1-5c36-4578-bbd1-43d649c1fdf2 None admin] PATH_INFO: `/v3/roles/service` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:46:25.808361 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7c6d4a1-5c36-4578-bbd1-43d649c1fdf2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 14:46:25.816744 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application [None req-a7c6d4a1-5c36-4578-bbd1-43d649c1fdf2 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 25 14:46:25.816744 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:46:25.816744 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 14:46:25.816744 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 14:46:25.816744 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 14:46:25.816744 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 14:46:25.816744 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 14:46:25.816744 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 14:46:25.816744 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 14:46:25.816744 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 14:46:25.816744 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 14:46:25.816744 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 14:46:25.816744 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 14:46:25.816744 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 14:46:25.816744 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 14:46:25.816744 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 14:46:25.817850 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 14:46:25.817850 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 14:46:25.817850 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 14:46:25.817850 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 14:46:25.817850 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 14:46:25.817850 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 14:46:25.817850 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 14:46:25.817850 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 14:46:25.817850 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 14:46:25.817850 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return self.get_or_create( May 25 14:46:25.817850 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 14:46:25.817850 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application with Lock( May 25 14:46:25.817850 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 14:46:25.817850 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return self._enter() May 25 14:46:25.817850 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 14:46:25.817850 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 14:46:25.818910 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 14:46:25.818910 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return self.creator() May 25 14:46:25.818910 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 14:46:25.818910 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application created_value = creator( May 25 14:46:25.818910 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 14:46:25.818910 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 14:46:25.818910 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 14:46:25.818910 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 14:46:25.818910 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 14:46:25.818910 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 14:46:25.818910 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 25 14:46:25.818910 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application May 25 14:46:25.818910 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 618/1222] 10.222.0.84 () {56 vars in 1102 bytes} [Wed May 25 14:46:25 2022] GET /identity/v3/roles/service => generated 85 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 14:46:25.824040 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f3dc851-b02d-47e3-a220-3e1fc1ade73e None None] Authenticating user token {{(pid=101892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:46:25.919574 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f3dc851-b02d-47e3-a220-3e1fc1ade73e None None] Validating token access rules against request {{(pid=101892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:46:25.943813 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG dbcounter [-] [101892] Writing DB stats keystone:SELECT=100 {{(pid=101892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:46:25.954533 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-700fc242-62ba-4c7c-ba43-74f801075545 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:46:25.955193 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700fc242-62ba-4c7c-ba43-74f801075545 None admin] REQUEST_METHOD: `GET` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:46:25.955474 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700fc242-62ba-4c7c-ba43-74f801075545 None admin] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:46:25.955778 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700fc242-62ba-4c7c-ba43-74f801075545 None admin] PATH_INFO: `/v3/roles` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:46:25.956520 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-700fc242-62ba-4c7c-ba43-74f801075545 None admin] RBAC: Adding query filter params (name=service) {{(pid=101892) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:46:25.956826 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-700fc242-62ba-4c7c-ba43-74f801075545 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:46:25.958181 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-700fc242-62ba-4c7c-ba43-74f801075545 None admin] RBAC: Authorization granted {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:46:25.965751 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 605/1223] 10.222.0.84 () {56 vars in 1103 bytes} [Wed May 25 14:46:25 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:46:25.971839 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7c6d4a1-5c36-4578-bbd1-43d649c1fdf2 None admin] Authenticating user token {{(pid=101893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:46:26.015324 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG dbcounter [-] [101893] Writing DB stats keystone:SELECT=100 {{(pid=101893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:46:26.069252 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7c6d4a1-5c36-4578-bbd1-43d649c1fdf2 None admin] Validating token access rules against request {{(pid=101893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:46:26.101532 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-017861d4-fe75-4d86-b878-72f6805f510c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:46:26.102319 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-017861d4-fe75-4d86-b878-72f6805f510c None admin] REQUEST_METHOD: `GET` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:46:26.102606 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-017861d4-fe75-4d86-b878-72f6805f510c None admin] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:46:26.102887 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-017861d4-fe75-4d86-b878-72f6805f510c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:46:26.114124 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-017861d4-fe75-4d86-b878-72f6805f510c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:46:26.115622 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-017861d4-fe75-4d86-b878-72f6805f510c None admin] RBAC: Authorization granted {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:46:26.133144 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application [None req-017861d4-fe75-4d86-b878-72f6805f510c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 25 14:46:26.133144 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:46:26.133144 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 14:46:26.133144 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 14:46:26.133144 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 14:46:26.133144 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 14:46:26.133144 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 14:46:26.133144 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 14:46:26.133144 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 14:46:26.133144 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 14:46:26.133144 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 14:46:26.133144 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 14:46:26.133144 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 25 14:46:26.133144 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 25 14:46:26.133144 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 25 14:46:26.134236 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 25 14:46:26.134236 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 14:46:26.134236 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 14:46:26.134236 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 14:46:26.134236 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 14:46:26.134236 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 14:46:26.134236 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return self.get_or_create( May 25 14:46:26.134236 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 14:46:26.134236 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application with Lock( May 25 14:46:26.134236 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 14:46:26.134236 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return self._enter() May 25 14:46:26.134236 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 14:46:26.134236 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 14:46:26.134236 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 14:46:26.134236 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return self.creator() May 25 14:46:26.134236 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 14:46:26.134236 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application created_value = creator( May 25 14:46:26.135214 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 25 14:46:26.135214 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 25 14:46:26.135214 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 25 14:46:26.135214 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application May 25 14:46:26.135214 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 619/1224] 10.222.0.84 () {56 vars in 1108 bytes} [Wed May 25 14:46:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 14:46:26.140375 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-700fc242-62ba-4c7c-ba43-74f801075545 None admin] Authenticating user token {{(pid=101892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:46:26.240836 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-700fc242-62ba-4c7c-ba43-74f801075545 None admin] Validating token access rules against request {{(pid=101892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:46:26.281908 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c84d44ec-9fb4-4cbd-9f5e-bf8a5540e93d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:46:26.282559 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84d44ec-9fb4-4cbd-9f5e-bf8a5540e93d None admin] REQUEST_METHOD: `GET` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:46:26.282840 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84d44ec-9fb4-4cbd-9f5e-bf8a5540e93d None admin] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:46:26.283115 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84d44ec-9fb4-4cbd-9f5e-bf8a5540e93d None admin] PATH_INFO: `/v3/domains` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:46:26.283866 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c84d44ec-9fb4-4cbd-9f5e-bf8a5540e93d None admin] RBAC: Adding query filter params (name=Default) {{(pid=101892) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:46:26.284171 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c84d44ec-9fb4-4cbd-9f5e-bf8a5540e93d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:46:26.285533 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c84d44ec-9fb4-4cbd-9f5e-bf8a5540e93d None admin] RBAC: Authorization granted {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:46:26.297848 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 606/1225] 10.222.0.84 () {56 vars in 1109 bytes} [Wed May 25 14:46:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:46:26.303825 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-017861d4-fe75-4d86-b878-72f6805f510c None admin] Authenticating user token {{(pid=101893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:46:26.396157 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG dbcounter [-] [101893] Writing DB stats keystone:SELECT=100 {{(pid=101893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:46:26.403154 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-017861d4-fe75-4d86-b878-72f6805f510c None admin] Validating token access rules against request {{(pid=101893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:46:26.436179 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a37f5512-1af5-44da-8232-6894adef9ce6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:46:26.436975 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a37f5512-1af5-44da-8232-6894adef9ce6 None admin] REQUEST_METHOD: `GET` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:46:26.437257 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a37f5512-1af5-44da-8232-6894adef9ce6 None admin] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:46:26.437533 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a37f5512-1af5-44da-8232-6894adef9ce6 None admin] PATH_INFO: `/v3/users/placement` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:46:26.444288 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a37f5512-1af5-44da-8232-6894adef9ce6 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:46:26.445737 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a37f5512-1af5-44da-8232-6894adef9ce6 None admin] RBAC: Authorization granted {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:46:26.461175 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application [None req-a37f5512-1af5-44da-8232-6894adef9ce6 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. May 25 14:46:26.461175 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:46:26.461175 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 14:46:26.461175 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 14:46:26.461175 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 14:46:26.461175 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 14:46:26.461175 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 14:46:26.461175 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 14:46:26.461175 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 14:46:26.461175 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 14:46:26.461175 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 14:46:26.461175 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 14:46:26.461175 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 25 14:46:26.461175 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return self._get_user(user_id) May 25 14:46:26.461175 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 25 14:46:26.461175 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 25 14:46:26.462324 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 14:46:26.462324 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 14:46:26.462324 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 25 14:46:26.462324 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 25 14:46:26.462324 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 25 14:46:26.462324 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 25 14:46:26.462324 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 14:46:26.462324 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 14:46:26.462324 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 14:46:26.462324 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return self.get_or_create( May 25 14:46:26.462324 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 14:46:26.462324 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application with Lock( May 25 14:46:26.462324 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 14:46:26.462324 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return self._enter() May 25 14:46:26.462324 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 14:46:26.462324 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 14:46:26.462324 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 14:46:26.462324 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return self.creator() May 25 14:46:26.463522 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 14:46:26.463522 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application created_value = creator( May 25 14:46:26.463522 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 25 14:46:26.463522 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 25 14:46:26.463522 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 25 14:46:26.463522 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 25 14:46:26.463522 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 25 14:46:26.463522 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 25 14:46:26.463522 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. May 25 14:46:26.463522 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application May 25 14:46:26.463522 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 620/1226] 10.222.0.84 () {56 vars in 1108 bytes} [Wed May 25 14:46:26 2022] GET /identity/v3/users/placement => generated 87 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 14:46:26.468975 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c84d44ec-9fb4-4cbd-9f5e-bf8a5540e93d None admin] Authenticating user token {{(pid=101892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:46:26.516985 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG dbcounter [-] [101892] Writing DB stats keystone:SELECT=100 {{(pid=101892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:46:26.568340 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c84d44ec-9fb4-4cbd-9f5e-bf8a5540e93d None admin] Validating token access rules against request {{(pid=101892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:46:26.601612 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceea40b6-d3e1-4975-b4f0-89772f3c9b29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:46:26.602276 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceea40b6-d3e1-4975-b4f0-89772f3c9b29 None admin] REQUEST_METHOD: `GET` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:46:26.602615 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceea40b6-d3e1-4975-b4f0-89772f3c9b29 None admin] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:46:26.602931 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceea40b6-d3e1-4975-b4f0-89772f3c9b29 None admin] PATH_INFO: `/v3/users` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:46:26.603751 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceea40b6-d3e1-4975-b4f0-89772f3c9b29 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=101892) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:46:26.604123 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceea40b6-d3e1-4975-b4f0-89772f3c9b29 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:46:26.605551 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceea40b6-d3e1-4975-b4f0-89772f3c9b29 None admin] RBAC: Authorization granted {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:46:26.622891 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 607/1227] 10.222.0.84 () {56 vars in 1143 bytes} [Wed May 25 14:46:26 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:46:26.628561 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a37f5512-1af5-44da-8232-6894adef9ce6 None admin] Authenticating user token {{(pid=101893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:46:26.725688 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a37f5512-1af5-44da-8232-6894adef9ce6 None admin] Validating token access rules against request {{(pid=101893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:46:26.758819 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c21c337-b4c5-4d08-9ea5-06a1e334d66c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:46:26.759628 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c21c337-b4c5-4d08-9ea5-06a1e334d66c None admin] REQUEST_METHOD: `GET` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:46:26.759914 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c21c337-b4c5-4d08-9ea5-06a1e334d66c None admin] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:46:26.760193 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c21c337-b4c5-4d08-9ea5-06a1e334d66c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:46:26.769988 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c21c337-b4c5-4d08-9ea5-06a1e334d66c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:46:26.771438 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c21c337-b4c5-4d08-9ea5-06a1e334d66c None admin] RBAC: Authorization granted {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:46:26.788906 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application [None req-2c21c337-b4c5-4d08-9ea5-06a1e334d66c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 25 14:46:26.788906 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:46:26.788906 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 14:46:26.788906 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 14:46:26.788906 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 14:46:26.788906 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 14:46:26.788906 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 14:46:26.788906 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 14:46:26.788906 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 14:46:26.788906 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 14:46:26.788906 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 14:46:26.788906 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 14:46:26.788906 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 25 14:46:26.788906 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 25 14:46:26.788906 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 25 14:46:26.789857 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 25 14:46:26.789857 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 14:46:26.789857 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 14:46:26.789857 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 14:46:26.789857 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 14:46:26.789857 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 14:46:26.789857 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return self.get_or_create( May 25 14:46:26.789857 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 14:46:26.789857 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application with Lock( May 25 14:46:26.789857 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 14:46:26.789857 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return self._enter() May 25 14:46:26.789857 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 14:46:26.789857 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 14:46:26.789857 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 14:46:26.789857 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return self.creator() May 25 14:46:26.789857 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 14:46:26.789857 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application created_value = creator( May 25 14:46:26.791246 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 25 14:46:26.791246 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 25 14:46:26.791246 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 25 14:46:26.791246 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application May 25 14:46:26.791246 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 621/1228] 10.222.0.84 () {56 vars in 1108 bytes} [Wed May 25 14:46:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 14:46:26.796401 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceea40b6-d3e1-4975-b4f0-89772f3c9b29 None admin] Authenticating user token {{(pid=101892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:46:26.893547 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceea40b6-d3e1-4975-b4f0-89772f3c9b29 None admin] Validating token access rules against request {{(pid=101892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:46:26.895844 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG dbcounter [-] [101892] Writing DB stats keystone:SELECT=100 {{(pid=101892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:46:26.926378 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a4578c9-54a4-4f2a-9024-f8a824fb8960 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:46:26.927118 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4578c9-54a4-4f2a-9024-f8a824fb8960 None admin] REQUEST_METHOD: `GET` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:46:26.927374 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4578c9-54a4-4f2a-9024-f8a824fb8960 None admin] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:46:26.927932 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4578c9-54a4-4f2a-9024-f8a824fb8960 None admin] PATH_INFO: `/v3/domains` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:46:26.928869 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a4578c9-54a4-4f2a-9024-f8a824fb8960 None admin] RBAC: Adding query filter params (name=Default) {{(pid=101892) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:46:26.929515 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a4578c9-54a4-4f2a-9024-f8a824fb8960 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:46:26.930913 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a4578c9-54a4-4f2a-9024-f8a824fb8960 None admin] RBAC: Authorization granted {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:46:26.942255 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 608/1229] 10.222.0.84 () {56 vars in 1109 bytes} [Wed May 25 14:46:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:46:26.948039 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c21c337-b4c5-4d08-9ea5-06a1e334d66c None admin] Authenticating user token {{(pid=101893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:46:26.957172 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG dbcounter [-] [101893] Writing DB stats keystone:SELECT=100 {{(pid=101893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:46:27.045605 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c21c337-b4c5-4d08-9ea5-06a1e334d66c None admin] Validating token access rules against request {{(pid=101893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:46:27.079725 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f6238af-37cb-47e7-b6d2-d48b0378bf22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:46:27.080514 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6238af-37cb-47e7-b6d2-d48b0378bf22 None admin] REQUEST_METHOD: `GET` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:46:27.080796 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6238af-37cb-47e7-b6d2-d48b0378bf22 None admin] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:46:27.081070 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6238af-37cb-47e7-b6d2-d48b0378bf22 None admin] PATH_INFO: `/v3/projects/service` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:46:27.087523 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f6238af-37cb-47e7-b6d2-d48b0378bf22 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:46:27.088995 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f6238af-37cb-47e7-b6d2-d48b0378bf22 None admin] RBAC: Authorization granted {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:46:27.103054 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application [None req-3f6238af-37cb-47e7-b6d2-d48b0378bf22 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 25 14:46:27.103054 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:46:27.103054 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 14:46:27.103054 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 14:46:27.103054 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 14:46:27.103054 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 14:46:27.103054 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 14:46:27.103054 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 14:46:27.103054 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 14:46:27.103054 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 14:46:27.103054 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 14:46:27.103054 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 14:46:27.103054 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 25 14:46:27.103054 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return self._get_project(project_id) May 25 14:46:27.103054 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 25 14:46:27.104110 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 25 14:46:27.104110 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 14:46:27.104110 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 14:46:27.104110 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 14:46:27.104110 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 14:46:27.104110 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 14:46:27.104110 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return self.get_or_create( May 25 14:46:27.104110 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 14:46:27.104110 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application with Lock( May 25 14:46:27.104110 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 14:46:27.104110 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return self._enter() May 25 14:46:27.104110 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 14:46:27.104110 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 14:46:27.104110 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 14:46:27.104110 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return self.creator() May 25 14:46:27.104110 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 14:46:27.104110 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application created_value = creator( May 25 14:46:27.105456 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 25 14:46:27.105456 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 25 14:46:27.105456 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 25 14:46:27.105456 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 25 14:46:27.105456 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 25 14:46:27.105456 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 25 14:46:27.105456 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 25 14:46:27.105456 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application May 25 14:46:27.105456 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 622/1230] 10.222.0.84 () {56 vars in 1111 bytes} [Wed May 25 14:46:26 2022] GET /identity/v3/projects/service => generated 88 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 14:46:27.110102 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a4578c9-54a4-4f2a-9024-f8a824fb8960 None admin] Authenticating user token {{(pid=101892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:46:27.209737 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a4578c9-54a4-4f2a-9024-f8a824fb8960 None admin] Validating token access rules against request {{(pid=101892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:46:27.242450 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03047a4b-eb1a-4c3f-be36-cd02d48ef79d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:46:27.243099 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03047a4b-eb1a-4c3f-be36-cd02d48ef79d None admin] REQUEST_METHOD: `GET` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:46:27.243386 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03047a4b-eb1a-4c3f-be36-cd02d48ef79d None admin] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:46:27.243692 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03047a4b-eb1a-4c3f-be36-cd02d48ef79d None admin] PATH_INFO: `/v3/projects` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:46:27.244476 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03047a4b-eb1a-4c3f-be36-cd02d48ef79d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=101892) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:46:27.244784 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03047a4b-eb1a-4c3f-be36-cd02d48ef79d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:46:27.246727 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03047a4b-eb1a-4c3f-be36-cd02d48ef79d None admin] RBAC: Authorization granted {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:46:27.259292 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 609/1231] 10.222.0.84 () {56 vars in 1148 bytes} [Wed May 25 14:46:27 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:46:27.265985 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f6238af-37cb-47e7-b6d2-d48b0378bf22 None admin] Authenticating user token {{(pid=101893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:46:27.330790 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG dbcounter [-] [101893] Writing DB stats keystone:SELECT=100 {{(pid=101893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:46:27.363868 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f6238af-37cb-47e7-b6d2-d48b0378bf22 None admin] Validating token access rules against request {{(pid=101893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:46:27.397400 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc6837de-2de3-402e-a7a2-e26713a89f5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:46:27.398285 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6837de-2de3-402e-a7a2-e26713a89f5c None admin] REQUEST_METHOD: `PUT` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:46:27.398571 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6837de-2de3-402e-a7a2-e26713a89f5c None admin] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:46:27.398856 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6837de-2de3-402e-a7a2-e26713a89f5c None admin] PATH_INFO: `/v3/projects/a000829c658c4a7cab67f7b6353ba3fa/users/d18c4a1d92b94c0087a203db4fed22f2/roles/fdcb2eda27b84f44a392b7e8b59cc425` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:46:27.412700 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc6837de-2de3-402e-a7a2-e26713a89f5c None admin] RBAC: Authorizing `identity:create_grant(project_id=a000829c658c4a7cab67f7b6353ba3fa, user_id=d18c4a1d92b94c0087a203db4fed22f2, role_id=fdcb2eda27b84f44a392b7e8b59cc425)` {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:46:27.414216 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc6837de-2de3-402e-a7a2-e26713a89f5c None admin] RBAC: Authorization granted {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:46:27.520465 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 623/1232] 10.222.0.84 () {58 vars in 1439 bytes} [Wed May 25 14:46:27 2022] PUT /identity/v3/projects/a000829c658c4a7cab67f7b6353ba3fa/users/d18c4a1d92b94c0087a203db4fed22f2/roles/fdcb2eda27b84f44a392b7e8b59cc425 => generated 0 bytes in 255 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 14:46:29.676359 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49e8cc2-e88a-4ecf-8f85-2dcfd5faad82 None None] REQUEST_METHOD: `GET` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:46:29.676905 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49e8cc2-e88a-4ecf-8f85-2dcfd5faad82 None None] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:46:29.676905 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49e8cc2-e88a-4ecf-8f85-2dcfd5faad82 None None] PATH_INFO: `/` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:46:29.678240 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 610/1233] 10.222.0.84 () {54 vars in 926 bytes} [Wed May 25 14:46:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 14:46:29.683399 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef4680b-cefc-4009-b510-acd0f2aaa25c None None] REQUEST_METHOD: `POST` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:46:29.684353 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef4680b-cefc-4009-b510-acd0f2aaa25c None None] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:46:29.684498 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef4680b-cefc-4009-b510-acd0f2aaa25c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:46:29.701033 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.auth.core [None req-9ef4680b-cefc-4009-b510-acd0f2aaa25c None None] MFA Rules not processed for user `05d87e87798e429aa1c10b24391f915e`. Rule list: `[]` (Enabled: `True`). {{(pid=101893) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:46:29.702258 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.fernet_utils [None req-9ef4680b-cefc-4009-b510-acd0f2aaa25c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=101893) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:46:29.767022 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 624/1234] 10.222.0.84 () {58 vars in 1023 bytes} [Wed May 25 14:46:29 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 25 14:46:29.790893 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a49e8cc2-e88a-4ecf-8f85-2dcfd5faad82 None None] Authenticating user token {{(pid=101892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:46:29.817582 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG dbcounter [-] [101892] Writing DB stats keystone:SELECT=100 {{(pid=101892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:46:29.891619 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a49e8cc2-e88a-4ecf-8f85-2dcfd5faad82 None None] Validating token access rules against request {{(pid=101892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:46:29.924596 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d37723-9560-4335-a547-a733a77b20b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:46:29.925383 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d37723-9560-4335-a547-a733a77b20b1 None admin] REQUEST_METHOD: `GET` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:46:29.925670 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d37723-9560-4335-a547-a733a77b20b1 None admin] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:46:29.925952 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d37723-9560-4335-a547-a733a77b20b1 None admin] PATH_INFO: `/v3/roles/service` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:46:29.935850 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87d37723-9560-4335-a547-a733a77b20b1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 14:46:29.943479 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application [None req-87d37723-9560-4335-a547-a733a77b20b1 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 25 14:46:29.943479 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:46:29.943479 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 14:46:29.943479 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 14:46:29.943479 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 14:46:29.943479 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 14:46:29.943479 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 14:46:29.943479 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 14:46:29.943479 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 14:46:29.943479 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 14:46:29.943479 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 14:46:29.943479 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 14:46:29.943479 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 14:46:29.943479 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 14:46:29.943479 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 14:46:29.943479 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 14:46:29.944765 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 14:46:29.944765 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 14:46:29.944765 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 14:46:29.944765 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 14:46:29.944765 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 14:46:29.944765 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 14:46:29.944765 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 14:46:29.944765 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 14:46:29.944765 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 14:46:29.944765 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application return self.get_or_create( May 25 14:46:29.944765 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 14:46:29.944765 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application with Lock( May 25 14:46:29.944765 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 14:46:29.944765 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application return self._enter() May 25 14:46:29.944765 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 14:46:29.944765 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 14:46:29.945782 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 14:46:29.945782 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application return self.creator() May 25 14:46:29.945782 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 14:46:29.945782 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application created_value = creator( May 25 14:46:29.945782 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 14:46:29.945782 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 14:46:29.945782 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 14:46:29.945782 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 14:46:29.945782 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 14:46:29.945782 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 14:46:29.945782 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 25 14:46:29.945782 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application May 25 14:46:29.945782 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 611/1235] 10.222.0.84 () {56 vars in 1102 bytes} [Wed May 25 14:46:29 2022] GET /identity/v3/roles/service => generated 85 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 14:46:29.951178 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef4680b-cefc-4009-b510-acd0f2aaa25c None None] Authenticating user token {{(pid=101893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:46:29.996276 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG dbcounter [-] [101893] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=101893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:46:30.047586 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef4680b-cefc-4009-b510-acd0f2aaa25c None None] Validating token access rules against request {{(pid=101893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:46:30.080376 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a05363b-3dda-4eba-98da-d7e052af5bce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:46:30.080974 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a05363b-3dda-4eba-98da-d7e052af5bce None admin] REQUEST_METHOD: `GET` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:46:30.081256 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a05363b-3dda-4eba-98da-d7e052af5bce None admin] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:46:30.081532 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a05363b-3dda-4eba-98da-d7e052af5bce None admin] PATH_INFO: `/v3/roles` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:46:30.082267 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a05363b-3dda-4eba-98da-d7e052af5bce None admin] RBAC: Adding query filter params (name=service) {{(pid=101893) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:46:30.082577 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a05363b-3dda-4eba-98da-d7e052af5bce None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:46:30.083978 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a05363b-3dda-4eba-98da-d7e052af5bce None admin] RBAC: Authorization granted {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:46:30.092705 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 625/1236] 10.222.0.84 () {56 vars in 1103 bytes} [Wed May 25 14:46:29 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:46:30.098440 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d37723-9560-4335-a547-a733a77b20b1 None admin] Authenticating user token {{(pid=101892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:46:30.183962 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG dbcounter [-] [101892] Writing DB stats keystone:SELECT=100 {{(pid=101892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:46:30.199161 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d37723-9560-4335-a547-a733a77b20b1 None admin] Validating token access rules against request {{(pid=101892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:46:30.232500 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e968cd-7bcd-492c-99ec-6504076cfd2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:46:30.233284 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e968cd-7bcd-492c-99ec-6504076cfd2e None admin] REQUEST_METHOD: `GET` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:46:30.233568 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e968cd-7bcd-492c-99ec-6504076cfd2e None admin] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:46:30.233844 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e968cd-7bcd-492c-99ec-6504076cfd2e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:46:30.244224 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91e968cd-7bcd-492c-99ec-6504076cfd2e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:46:30.245660 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91e968cd-7bcd-492c-99ec-6504076cfd2e None admin] RBAC: Authorization granted {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:46:30.262250 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application [None req-91e968cd-7bcd-492c-99ec-6504076cfd2e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 25 14:46:30.262250 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:46:30.262250 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 14:46:30.262250 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 14:46:30.262250 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 14:46:30.262250 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 14:46:30.262250 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 14:46:30.262250 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 14:46:30.262250 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 14:46:30.262250 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 14:46:30.262250 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 14:46:30.262250 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 14:46:30.262250 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 25 14:46:30.262250 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 25 14:46:30.262250 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 25 14:46:30.263294 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 25 14:46:30.263294 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 14:46:30.263294 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 14:46:30.263294 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 14:46:30.263294 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 14:46:30.263294 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 14:46:30.263294 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application return self.get_or_create( May 25 14:46:30.263294 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 14:46:30.263294 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application with Lock( May 25 14:46:30.263294 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 14:46:30.263294 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application return self._enter() May 25 14:46:30.263294 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 14:46:30.263294 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 14:46:30.263294 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 14:46:30.263294 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application return self.creator() May 25 14:46:30.263294 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 14:46:30.263294 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application created_value = creator( May 25 14:46:30.264464 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 25 14:46:30.264464 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 25 14:46:30.264464 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 25 14:46:30.264464 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application May 25 14:46:30.264464 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 612/1237] 10.222.0.84 () {56 vars in 1108 bytes} [Wed May 25 14:46:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 14:46:30.269237 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a05363b-3dda-4eba-98da-d7e052af5bce None admin] Authenticating user token {{(pid=101893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:46:30.374803 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a05363b-3dda-4eba-98da-d7e052af5bce None admin] Validating token access rules against request {{(pid=101893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:46:30.383809 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG dbcounter [-] [101893] Writing DB stats keystone:SELECT=100 {{(pid=101893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:46:30.407776 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8a3385c-ef79-47d0-a20e-0c6abb10b731 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:46:30.408442 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a3385c-ef79-47d0-a20e-0c6abb10b731 None admin] REQUEST_METHOD: `GET` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:46:30.408728 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a3385c-ef79-47d0-a20e-0c6abb10b731 None admin] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:46:30.409005 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a3385c-ef79-47d0-a20e-0c6abb10b731 None admin] PATH_INFO: `/v3/domains` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:46:30.409729 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8a3385c-ef79-47d0-a20e-0c6abb10b731 None admin] RBAC: Adding query filter params (name=Default) {{(pid=101893) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:46:30.410039 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8a3385c-ef79-47d0-a20e-0c6abb10b731 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:46:30.411428 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8a3385c-ef79-47d0-a20e-0c6abb10b731 None admin] RBAC: Authorization granted {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:46:30.422856 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 626/1238] 10.222.0.84 () {56 vars in 1109 bytes} [Wed May 25 14:46:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:46:30.428632 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e968cd-7bcd-492c-99ec-6504076cfd2e None admin] Authenticating user token {{(pid=101892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:46:30.527331 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e968cd-7bcd-492c-99ec-6504076cfd2e None admin] Validating token access rules against request {{(pid=101892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:46:30.562812 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac4757ce-a748-4859-a7d3-ddc263e2102f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:46:30.563769 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4757ce-a748-4859-a7d3-ddc263e2102f None admin] REQUEST_METHOD: `GET` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:46:30.563924 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4757ce-a748-4859-a7d3-ddc263e2102f None admin] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:46:30.564198 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4757ce-a748-4859-a7d3-ddc263e2102f None admin] PATH_INFO: `/v3/users/placement` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:46:30.566912 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG dbcounter [-] [101892] Writing DB stats keystone:SELECT=100 {{(pid=101892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:46:30.572041 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac4757ce-a748-4859-a7d3-ddc263e2102f None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:46:30.573480 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac4757ce-a748-4859-a7d3-ddc263e2102f None admin] RBAC: Authorization granted {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:46:30.587404 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application [None req-ac4757ce-a748-4859-a7d3-ddc263e2102f None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. May 25 14:46:30.587404 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:46:30.587404 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 14:46:30.587404 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 14:46:30.587404 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 14:46:30.587404 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 14:46:30.587404 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 14:46:30.587404 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 14:46:30.587404 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 14:46:30.587404 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 14:46:30.587404 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 14:46:30.587404 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 14:46:30.587404 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 25 14:46:30.587404 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application return self._get_user(user_id) May 25 14:46:30.587404 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 25 14:46:30.587404 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 25 14:46:30.590150 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 14:46:30.590150 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 14:46:30.590150 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 25 14:46:30.590150 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 25 14:46:30.590150 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 25 14:46:30.590150 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 25 14:46:30.590150 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 14:46:30.590150 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 14:46:30.590150 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 14:46:30.590150 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application return self.get_or_create( May 25 14:46:30.590150 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 14:46:30.590150 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application with Lock( May 25 14:46:30.590150 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 14:46:30.590150 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application return self._enter() May 25 14:46:30.590150 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 14:46:30.590150 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 14:46:30.590150 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 14:46:30.590150 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application return self.creator() May 25 14:46:30.591232 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 14:46:30.591232 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application created_value = creator( May 25 14:46:30.591232 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 25 14:46:30.591232 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 25 14:46:30.591232 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 25 14:46:30.591232 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 25 14:46:30.591232 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 25 14:46:30.591232 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 25 14:46:30.591232 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. May 25 14:46:30.591232 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application May 25 14:46:30.591232 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 613/1239] 10.222.0.84 () {56 vars in 1108 bytes} [Wed May 25 14:46:30 2022] GET /identity/v3/users/placement => generated 87 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 14:46:30.594677 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8a3385c-ef79-47d0-a20e-0c6abb10b731 None admin] Authenticating user token {{(pid=101893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:46:30.692513 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8a3385c-ef79-47d0-a20e-0c6abb10b731 None admin] Validating token access rules against request {{(pid=101893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:46:30.724692 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72fa93af-049f-4b4a-892f-0d63eb07d487 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:46:30.725355 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72fa93af-049f-4b4a-892f-0d63eb07d487 None admin] REQUEST_METHOD: `GET` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:46:30.725639 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72fa93af-049f-4b4a-892f-0d63eb07d487 None admin] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:46:30.725915 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72fa93af-049f-4b4a-892f-0d63eb07d487 None admin] PATH_INFO: `/v3/users` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:46:30.726745 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72fa93af-049f-4b4a-892f-0d63eb07d487 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=101893) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:46:30.727057 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72fa93af-049f-4b4a-892f-0d63eb07d487 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:46:30.728513 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72fa93af-049f-4b4a-892f-0d63eb07d487 None admin] RBAC: Authorization granted {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:46:30.746068 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 627/1240] 10.222.0.84 () {56 vars in 1143 bytes} [Wed May 25 14:46:30 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:46:30.752627 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac4757ce-a748-4859-a7d3-ddc263e2102f None admin] Authenticating user token {{(pid=101892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:46:30.849186 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac4757ce-a748-4859-a7d3-ddc263e2102f None admin] Validating token access rules against request {{(pid=101892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:46:30.881553 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e8531d9-5643-44b2-8ac2-53b9c263a78a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:46:30.882207 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8531d9-5643-44b2-8ac2-53b9c263a78a None admin] REQUEST_METHOD: `GET` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:46:30.882493 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8531d9-5643-44b2-8ac2-53b9c263a78a None admin] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:46:30.882769 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8531d9-5643-44b2-8ac2-53b9c263a78a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:46:30.947773 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG dbcounter [-] [101892] Writing DB stats keystone:SELECT=100 {{(pid=101892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:46:30.954609 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e8531d9-5643-44b2-8ac2-53b9c263a78a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:46:30.956104 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e8531d9-5643-44b2-8ac2-53b9c263a78a None admin] RBAC: Authorization granted {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:46:31.050792 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 614/1241] 10.222.0.84 () {58 vars in 1282 bytes} [Wed May 25 14:46:30 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 299 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 25 14:46:31.057016 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72fa93af-049f-4b4a-892f-0d63eb07d487 None admin] Authenticating user token {{(pid=101893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:46:31.085647 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG dbcounter [-] [101893] Writing DB stats keystone:SELECT=100 {{(pid=101893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:46:31.154943 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72fa93af-049f-4b4a-892f-0d63eb07d487 None admin] Validating token access rules against request {{(pid=101893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:46:31.188367 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-626a575e-aafe-4fa0-973c-dd766ea007d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:46:31.189164 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-626a575e-aafe-4fa0-973c-dd766ea007d8 None admin] REQUEST_METHOD: `GET` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:46:31.189454 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-626a575e-aafe-4fa0-973c-dd766ea007d8 None admin] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:46:31.189731 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-626a575e-aafe-4fa0-973c-dd766ea007d8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:46:31.200502 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-626a575e-aafe-4fa0-973c-dd766ea007d8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:46:31.201931 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-626a575e-aafe-4fa0-973c-dd766ea007d8 None admin] RBAC: Authorization granted {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:46:31.219042 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application [None req-626a575e-aafe-4fa0-973c-dd766ea007d8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 25 14:46:31.219042 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:46:31.219042 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 14:46:31.219042 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 14:46:31.219042 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 14:46:31.219042 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 14:46:31.219042 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 14:46:31.219042 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 14:46:31.219042 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 14:46:31.219042 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 14:46:31.219042 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 14:46:31.219042 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 14:46:31.219042 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 25 14:46:31.219042 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 25 14:46:31.219042 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 25 14:46:31.228598 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 25 14:46:31.228598 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 14:46:31.228598 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 14:46:31.228598 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 14:46:31.228598 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 14:46:31.228598 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 14:46:31.228598 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return self.get_or_create( May 25 14:46:31.228598 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 14:46:31.228598 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application with Lock( May 25 14:46:31.228598 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 14:46:31.228598 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return self._enter() May 25 14:46:31.228598 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 14:46:31.228598 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 14:46:31.228598 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 14:46:31.228598 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return self.creator() May 25 14:46:31.228598 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 14:46:31.228598 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application created_value = creator( May 25 14:46:31.229573 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 25 14:46:31.229573 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 25 14:46:31.229573 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 25 14:46:31.229573 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application May 25 14:46:31.229573 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 628/1242] 10.222.0.84 () {56 vars in 1108 bytes} [Wed May 25 14:46:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 14:46:31.229873 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e8531d9-5643-44b2-8ac2-53b9c263a78a None admin] Authenticating user token {{(pid=101892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:46:31.322465 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG dbcounter [-] [101892] Writing DB stats keystone:SELECT=100 {{(pid=101892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:46:31.328137 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e8531d9-5643-44b2-8ac2-53b9c263a78a None admin] Validating token access rules against request {{(pid=101892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:46:31.360646 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20e27ed1-b61f-4f93-86fb-5a846a24c29d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:46:31.361332 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e27ed1-b61f-4f93-86fb-5a846a24c29d None admin] REQUEST_METHOD: `GET` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:46:31.361611 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e27ed1-b61f-4f93-86fb-5a846a24c29d None admin] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:46:31.361891 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e27ed1-b61f-4f93-86fb-5a846a24c29d None admin] PATH_INFO: `/v3/domains` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:46:31.367545 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20e27ed1-b61f-4f93-86fb-5a846a24c29d None admin] RBAC: Adding query filter params (name=Default) {{(pid=101892) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:46:31.367545 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20e27ed1-b61f-4f93-86fb-5a846a24c29d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:46:31.367545 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20e27ed1-b61f-4f93-86fb-5a846a24c29d None admin] RBAC: Authorization granted {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:46:31.376325 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 615/1243] 10.222.0.84 () {56 vars in 1109 bytes} [Wed May 25 14:46:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:46:31.382206 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-626a575e-aafe-4fa0-973c-dd766ea007d8 None admin] Authenticating user token {{(pid=101893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:46:31.460794 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG dbcounter [-] [101893] Writing DB stats keystone:SELECT=100 {{(pid=101893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:46:31.482093 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-626a575e-aafe-4fa0-973c-dd766ea007d8 None admin] Validating token access rules against request {{(pid=101893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:46:31.515796 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25140bec-3fc7-4aef-be2d-fd6932e6d59d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:46:31.516584 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25140bec-3fc7-4aef-be2d-fd6932e6d59d None admin] REQUEST_METHOD: `GET` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:46:31.516871 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25140bec-3fc7-4aef-be2d-fd6932e6d59d None admin] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:46:31.517150 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25140bec-3fc7-4aef-be2d-fd6932e6d59d None admin] PATH_INFO: `/v3/projects/service` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:46:31.523718 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25140bec-3fc7-4aef-be2d-fd6932e6d59d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:46:31.525186 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25140bec-3fc7-4aef-be2d-fd6932e6d59d None admin] RBAC: Authorization granted {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:46:31.538593 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application [None req-25140bec-3fc7-4aef-be2d-fd6932e6d59d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 25 14:46:31.538593 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:46:31.538593 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 14:46:31.538593 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 14:46:31.538593 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 14:46:31.538593 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 14:46:31.538593 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 14:46:31.538593 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 14:46:31.538593 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 14:46:31.538593 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 14:46:31.538593 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 14:46:31.538593 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 14:46:31.538593 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 25 14:46:31.538593 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return self._get_project(project_id) May 25 14:46:31.538593 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 25 14:46:31.539705 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 25 14:46:31.539705 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 14:46:31.539705 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 14:46:31.539705 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 14:46:31.539705 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 14:46:31.539705 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 14:46:31.539705 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return self.get_or_create( May 25 14:46:31.539705 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 14:46:31.539705 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application with Lock( May 25 14:46:31.539705 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 14:46:31.539705 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return self._enter() May 25 14:46:31.539705 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 14:46:31.539705 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 14:46:31.539705 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 14:46:31.539705 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return self.creator() May 25 14:46:31.539705 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 14:46:31.539705 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application created_value = creator( May 25 14:46:31.540986 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 25 14:46:31.540986 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 25 14:46:31.540986 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 25 14:46:31.540986 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 25 14:46:31.540986 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 25 14:46:31.540986 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 25 14:46:31.540986 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 25 14:46:31.540986 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application May 25 14:46:31.540986 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 629/1244] 10.222.0.84 () {56 vars in 1111 bytes} [Wed May 25 14:46:31 2022] GET /identity/v3/projects/service => generated 88 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 14:46:31.546280 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20e27ed1-b61f-4f93-86fb-5a846a24c29d None admin] Authenticating user token {{(pid=101892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:46:31.651630 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20e27ed1-b61f-4f93-86fb-5a846a24c29d None admin] Validating token access rules against request {{(pid=101892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:46:31.685063 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8219fb3-c2c3-4bdb-979a-0a8a3e697ba2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:46:31.685720 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8219fb3-c2c3-4bdb-979a-0a8a3e697ba2 None admin] REQUEST_METHOD: `GET` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:46:31.686007 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8219fb3-c2c3-4bdb-979a-0a8a3e697ba2 None admin] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:46:31.686287 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8219fb3-c2c3-4bdb-979a-0a8a3e697ba2 None admin] PATH_INFO: `/v3/projects` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:46:31.687129 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8219fb3-c2c3-4bdb-979a-0a8a3e697ba2 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=101892) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:46:31.687427 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8219fb3-c2c3-4bdb-979a-0a8a3e697ba2 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:46:31.688892 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8219fb3-c2c3-4bdb-979a-0a8a3e697ba2 None admin] RBAC: Authorization granted {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:46:31.701325 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 616/1245] 10.222.0.84 () {56 vars in 1148 bytes} [Wed May 25 14:46:31 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:46:31.707463 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25140bec-3fc7-4aef-be2d-fd6932e6d59d None admin] Authenticating user token {{(pid=101893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:46:31.811194 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25140bec-3fc7-4aef-be2d-fd6932e6d59d None admin] Validating token access rules against request {{(pid=101893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:46:31.844484 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e9b2517-0189-4dd9-a5b1-bdcd47c10182 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:46:31.845163 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9b2517-0189-4dd9-a5b1-bdcd47c10182 None admin] REQUEST_METHOD: `GET` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:46:31.845440 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9b2517-0189-4dd9-a5b1-bdcd47c10182 None admin] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:46:31.845711 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9b2517-0189-4dd9-a5b1-bdcd47c10182 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:46:31.846525 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e9b2517-0189-4dd9-a5b1-bdcd47c10182 None admin] RBAC: Adding query filter params (role.id=fdcb2eda27b84f44a392b7e8b59cc425, scope.project.id=a000829c658c4a7cab67f7b6353ba3fa, user.id=d18c4a1d92b94c0087a203db4fed22f2) {{(pid=101893) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:46:31.846835 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e9b2517-0189-4dd9-a5b1-bdcd47c10182 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:46:31.848295 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e9b2517-0189-4dd9-a5b1-bdcd47c10182 None admin] RBAC: Authorization granted {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:46:31.853991 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 630/1246] 10.222.0.84 () {56 vars in 1374 bytes} [Wed May 25 14:46:31 2022] GET /identity/v3/role_assignments?user.id=d18c4a1d92b94c0087a203db4fed22f2&scope.project.id=a000829c658c4a7cab67f7b6353ba3fa&role.id=fdcb2eda27b84f44a392b7e8b59cc425 => generated 608 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 14:46:34.139132 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869e294e-3de8-473c-9da3-acda492551b0 None None] REQUEST_METHOD: `GET` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:46:34.139691 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869e294e-3de8-473c-9da3-acda492551b0 None None] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:46:34.139691 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869e294e-3de8-473c-9da3-acda492551b0 None None] PATH_INFO: `/` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:46:34.141101 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 617/1247] 10.222.0.84 () {54 vars in 926 bytes} [Wed May 25 14:46:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 14:46:34.146538 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a3079f-3901-4b75-acfd-cca6f2246447 None None] REQUEST_METHOD: `POST` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:46:34.146958 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a3079f-3901-4b75-acfd-cca6f2246447 None None] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:46:34.147148 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a3079f-3901-4b75-acfd-cca6f2246447 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:46:34.152186 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG dbcounter [-] [101893] Writing DB stats keystone:SELECT=100 {{(pid=101893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:46:34.164799 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.auth.core [None req-b8a3079f-3901-4b75-acfd-cca6f2246447 None None] MFA Rules not processed for user `05d87e87798e429aa1c10b24391f915e`. Rule list: `[]` (Enabled: `True`). {{(pid=101893) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:46:34.165984 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.fernet_utils [None req-b8a3079f-3901-4b75-acfd-cca6f2246447 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=101893) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:46:34.233771 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 631/1248] 10.222.0.84 () {58 vars in 1023 bytes} [Wed May 25 14:46:34 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 25 14:46:34.257657 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-869e294e-3de8-473c-9da3-acda492551b0 None None] Authenticating user token {{(pid=101892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:46:34.275930 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG dbcounter [-] [101892] Writing DB stats keystone:SELECT=100 {{(pid=101892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:46:34.368515 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-869e294e-3de8-473c-9da3-acda492551b0 None None] Validating token access rules against request {{(pid=101892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:46:34.403553 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-609e7473-7630-4a3e-b311-45fd24a72dec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:46:34.404373 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609e7473-7630-4a3e-b311-45fd24a72dec None admin] REQUEST_METHOD: `GET` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:46:34.404662 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609e7473-7630-4a3e-b311-45fd24a72dec None admin] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:46:34.404942 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609e7473-7630-4a3e-b311-45fd24a72dec None admin] PATH_INFO: `/v3/roles/admin` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:46:34.415912 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-609e7473-7630-4a3e-b311-45fd24a72dec None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 14:46:34.424498 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application [None req-609e7473-7630-4a3e-b311-45fd24a72dec None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 25 14:46:34.424498 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:46:34.424498 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 14:46:34.424498 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 14:46:34.424498 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 14:46:34.424498 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 14:46:34.424498 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 14:46:34.424498 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 14:46:34.424498 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 14:46:34.424498 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 14:46:34.424498 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 14:46:34.424498 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 14:46:34.424498 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 14:46:34.424498 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 14:46:34.424498 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 14:46:34.424498 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 14:46:34.425604 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 14:46:34.425604 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 14:46:34.425604 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 14:46:34.425604 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 14:46:34.425604 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 14:46:34.425604 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 14:46:34.425604 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 14:46:34.425604 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 14:46:34.425604 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 14:46:34.425604 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application return self.get_or_create( May 25 14:46:34.425604 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 14:46:34.425604 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application with Lock( May 25 14:46:34.425604 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 14:46:34.425604 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application return self._enter() May 25 14:46:34.425604 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 14:46:34.425604 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 14:46:34.426516 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 14:46:34.426516 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application return self.creator() May 25 14:46:34.426516 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 14:46:34.426516 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application created_value = creator( May 25 14:46:34.426516 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 14:46:34.426516 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 14:46:34.426516 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 14:46:34.426516 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 14:46:34.426516 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 14:46:34.426516 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 14:46:34.426516 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 25 14:46:34.426516 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application May 25 14:46:34.426516 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 618/1249] 10.222.0.84 () {56 vars in 1096 bytes} [Wed May 25 14:46:34 2022] GET /identity/v3/roles/admin => generated 83 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 14:46:34.431783 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8a3079f-3901-4b75-acfd-cca6f2246447 None None] Authenticating user token {{(pid=101893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:46:34.529296 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8a3079f-3901-4b75-acfd-cca6f2246447 None None] Validating token access rules against request {{(pid=101893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:46:34.559730 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG dbcounter [-] [101893] Writing DB stats keystone:SELECT=100 {{(pid=101893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:46:34.587636 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0ec1014-c17b-44b3-831e-fcf3cbe2591d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:46:34.587636 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ec1014-c17b-44b3-831e-fcf3cbe2591d None admin] REQUEST_METHOD: `GET` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:46:34.587636 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ec1014-c17b-44b3-831e-fcf3cbe2591d None admin] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:46:34.587636 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ec1014-c17b-44b3-831e-fcf3cbe2591d None admin] PATH_INFO: `/v3/roles` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:46:34.588007 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0ec1014-c17b-44b3-831e-fcf3cbe2591d None admin] RBAC: Adding query filter params (name=admin) {{(pid=101893) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:46:34.588007 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0ec1014-c17b-44b3-831e-fcf3cbe2591d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:46:34.588007 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0ec1014-c17b-44b3-831e-fcf3cbe2591d None admin] RBAC: Authorization granted {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:46:34.588007 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 632/1250] 10.222.0.84 () {56 vars in 1099 bytes} [Wed May 25 14:46:34 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:46:34.588336 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-609e7473-7630-4a3e-b311-45fd24a72dec None admin] Authenticating user token {{(pid=101892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:46:34.660193 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG dbcounter [-] [101892] Writing DB stats keystone:SELECT=100 {{(pid=101892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:46:34.681657 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-609e7473-7630-4a3e-b311-45fd24a72dec None admin] Validating token access rules against request {{(pid=101892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:46:34.715254 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-374e765f-8f67-47c4-aa4b-049d30de451f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:46:34.716123 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374e765f-8f67-47c4-aa4b-049d30de451f None admin] REQUEST_METHOD: `GET` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:46:34.716413 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374e765f-8f67-47c4-aa4b-049d30de451f None admin] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:46:34.716695 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374e765f-8f67-47c4-aa4b-049d30de451f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:46:34.727916 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-374e765f-8f67-47c4-aa4b-049d30de451f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:46:34.731058 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-374e765f-8f67-47c4-aa4b-049d30de451f None admin] RBAC: Authorization granted {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:46:34.746990 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application [None req-374e765f-8f67-47c4-aa4b-049d30de451f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 25 14:46:34.746990 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:46:34.746990 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 14:46:34.746990 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 14:46:34.746990 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 14:46:34.746990 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 14:46:34.746990 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 14:46:34.746990 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 14:46:34.746990 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 14:46:34.746990 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 14:46:34.746990 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 14:46:34.746990 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 14:46:34.746990 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 25 14:46:34.746990 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 25 14:46:34.746990 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 25 14:46:34.747951 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 25 14:46:34.747951 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 14:46:34.747951 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 14:46:34.747951 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 14:46:34.747951 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 14:46:34.747951 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 14:46:34.747951 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application return self.get_or_create( May 25 14:46:34.747951 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 14:46:34.747951 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application with Lock( May 25 14:46:34.747951 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 14:46:34.747951 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application return self._enter() May 25 14:46:34.747951 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 14:46:34.747951 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 14:46:34.747951 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 14:46:34.747951 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application return self.creator() May 25 14:46:34.747951 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 14:46:34.747951 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application created_value = creator( May 25 14:46:34.749280 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 25 14:46:34.749280 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 25 14:46:34.749280 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 25 14:46:34.749280 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application May 25 14:46:34.749280 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 619/1251] 10.222.0.84 () {56 vars in 1108 bytes} [Wed May 25 14:46:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 14:46:34.753990 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0ec1014-c17b-44b3-831e-fcf3cbe2591d None admin] Authenticating user token {{(pid=101893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:46:34.850495 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0ec1014-c17b-44b3-831e-fcf3cbe2591d None admin] Validating token access rules against request {{(pid=101893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:46:34.883464 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-825ae278-459d-42e8-88d6-45563f1988f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:46:34.884158 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825ae278-459d-42e8-88d6-45563f1988f2 None admin] REQUEST_METHOD: `GET` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:46:34.884429 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825ae278-459d-42e8-88d6-45563f1988f2 None admin] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:46:34.884707 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825ae278-459d-42e8-88d6-45563f1988f2 None admin] PATH_INFO: `/v3/domains` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:46:34.885424 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-825ae278-459d-42e8-88d6-45563f1988f2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=101893) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:46:34.885732 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-825ae278-459d-42e8-88d6-45563f1988f2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:46:34.887673 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-825ae278-459d-42e8-88d6-45563f1988f2 None admin] RBAC: Authorization granted {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:46:34.899023 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 633/1252] 10.222.0.84 () {56 vars in 1109 bytes} [Wed May 25 14:46:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:46:34.904827 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-374e765f-8f67-47c4-aa4b-049d30de451f None admin] Authenticating user token {{(pid=101892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:46:35.004718 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-374e765f-8f67-47c4-aa4b-049d30de451f None admin] Validating token access rules against request {{(pid=101892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:46:35.030006 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG dbcounter [-] [101892] Writing DB stats keystone:SELECT=100 {{(pid=101892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:46:35.037666 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d487e47d-c4f9-406e-8401-74ef68966827 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:46:35.038462 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d487e47d-c4f9-406e-8401-74ef68966827 None admin] REQUEST_METHOD: `GET` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:46:35.038743 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d487e47d-c4f9-406e-8401-74ef68966827 None admin] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:46:35.039019 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d487e47d-c4f9-406e-8401-74ef68966827 None admin] PATH_INFO: `/v3/users/placement` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:46:35.046807 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d487e47d-c4f9-406e-8401-74ef68966827 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:46:35.050137 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d487e47d-c4f9-406e-8401-74ef68966827 None admin] RBAC: Authorization granted {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:46:35.062787 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application [None req-d487e47d-c4f9-406e-8401-74ef68966827 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. May 25 14:46:35.062787 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:46:35.062787 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 14:46:35.062787 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 14:46:35.062787 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 14:46:35.062787 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 14:46:35.062787 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 14:46:35.062787 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 14:46:35.062787 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 14:46:35.062787 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 14:46:35.062787 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 14:46:35.062787 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 14:46:35.062787 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 25 14:46:35.062787 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application return self._get_user(user_id) May 25 14:46:35.062787 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 25 14:46:35.062787 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 25 14:46:35.063967 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 14:46:35.063967 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 14:46:35.063967 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 25 14:46:35.063967 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 25 14:46:35.063967 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 25 14:46:35.063967 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 25 14:46:35.063967 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 14:46:35.063967 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 14:46:35.063967 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 14:46:35.063967 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application return self.get_or_create( May 25 14:46:35.063967 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 14:46:35.063967 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application with Lock( May 25 14:46:35.063967 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 14:46:35.063967 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application return self._enter() May 25 14:46:35.063967 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 14:46:35.063967 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 14:46:35.063967 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 14:46:35.063967 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application return self.creator() May 25 14:46:35.064990 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 14:46:35.064990 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application created_value = creator( May 25 14:46:35.064990 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 25 14:46:35.064990 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 25 14:46:35.064990 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 25 14:46:35.064990 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 25 14:46:35.064990 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 25 14:46:35.064990 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 25 14:46:35.064990 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. May 25 14:46:35.064990 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application May 25 14:46:35.064990 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 620/1253] 10.222.0.84 () {56 vars in 1108 bytes} [Wed May 25 14:46:34 2022] GET /identity/v3/users/placement => generated 87 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 14:46:35.069899 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-825ae278-459d-42e8-88d6-45563f1988f2 None admin] Authenticating user token {{(pid=101893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:46:35.124678 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG dbcounter [-] [101893] Writing DB stats keystone:SELECT=100 {{(pid=101893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:46:35.166801 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-825ae278-459d-42e8-88d6-45563f1988f2 None admin] Validating token access rules against request {{(pid=101893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:46:35.201311 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c916e2-9bd7-4e17-93f4-24c9e3dd7255 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:46:35.201987 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c916e2-9bd7-4e17-93f4-24c9e3dd7255 None admin] REQUEST_METHOD: `GET` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:46:35.202278 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c916e2-9bd7-4e17-93f4-24c9e3dd7255 None admin] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:46:35.202561 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c916e2-9bd7-4e17-93f4-24c9e3dd7255 None admin] PATH_INFO: `/v3/users` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:46:35.203433 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40c916e2-9bd7-4e17-93f4-24c9e3dd7255 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=101893) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:46:35.203778 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40c916e2-9bd7-4e17-93f4-24c9e3dd7255 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:46:35.205215 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40c916e2-9bd7-4e17-93f4-24c9e3dd7255 None admin] RBAC: Authorization granted {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:46:35.221737 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 634/1254] 10.222.0.84 () {56 vars in 1143 bytes} [Wed May 25 14:46:35 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:46:35.227477 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d487e47d-c4f9-406e-8401-74ef68966827 None admin] Authenticating user token {{(pid=101892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:46:35.325042 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d487e47d-c4f9-406e-8401-74ef68966827 None admin] Validating token access rules against request {{(pid=101892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:46:35.358205 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ff2da90-f025-4b27-8bd3-6b3171d95ecc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:46:35.358850 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff2da90-f025-4b27-8bd3-6b3171d95ecc None admin] REQUEST_METHOD: `GET` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:46:35.359132 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff2da90-f025-4b27-8bd3-6b3171d95ecc None admin] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:46:35.359405 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff2da90-f025-4b27-8bd3-6b3171d95ecc None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:46:35.413760 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG dbcounter [-] [101892] Writing DB stats keystone:SELECT=100 {{(pid=101892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:46:35.425994 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ff2da90-f025-4b27-8bd3-6b3171d95ecc None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:46:35.427507 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ff2da90-f025-4b27-8bd3-6b3171d95ecc None admin] RBAC: Authorization granted {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:46:35.524295 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 621/1255] 10.222.0.84 () {58 vars in 1282 bytes} [Wed May 25 14:46:35 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 297 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 25 14:46:35.530573 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c916e2-9bd7-4e17-93f4-24c9e3dd7255 None admin] Authenticating user token {{(pid=101893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:46:35.630390 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c916e2-9bd7-4e17-93f4-24c9e3dd7255 None admin] Validating token access rules against request {{(pid=101893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:46:35.644345 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG dbcounter [-] [101893] Writing DB stats keystone:SELECT=100 {{(pid=101893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:46:35.666573 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdd1d668-3861-4ff5-9727-137926deb33a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:46:35.667361 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd1d668-3861-4ff5-9727-137926deb33a None admin] REQUEST_METHOD: `GET` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:46:35.667673 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd1d668-3861-4ff5-9727-137926deb33a None admin] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:46:35.667945 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd1d668-3861-4ff5-9727-137926deb33a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:46:35.678588 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdd1d668-3861-4ff5-9727-137926deb33a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:46:35.680086 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdd1d668-3861-4ff5-9727-137926deb33a None admin] RBAC: Authorization granted {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:46:35.697121 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application [None req-bdd1d668-3861-4ff5-9727-137926deb33a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 25 14:46:35.697121 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:46:35.697121 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 14:46:35.697121 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 14:46:35.697121 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 14:46:35.697121 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 14:46:35.697121 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 14:46:35.697121 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 14:46:35.697121 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 14:46:35.697121 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 14:46:35.697121 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 14:46:35.697121 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 14:46:35.697121 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 25 14:46:35.697121 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 25 14:46:35.697121 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 25 14:46:35.698290 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 25 14:46:35.698290 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 14:46:35.698290 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 14:46:35.698290 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 14:46:35.698290 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 14:46:35.698290 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 14:46:35.698290 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return self.get_or_create( May 25 14:46:35.698290 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 14:46:35.698290 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application with Lock( May 25 14:46:35.698290 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 14:46:35.698290 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return self._enter() May 25 14:46:35.698290 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 14:46:35.698290 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 14:46:35.698290 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 14:46:35.698290 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return self.creator() May 25 14:46:35.698290 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 14:46:35.698290 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application created_value = creator( May 25 14:46:35.699531 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 25 14:46:35.699531 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 25 14:46:35.699531 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 25 14:46:35.699531 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application May 25 14:46:35.699531 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 635/1256] 10.222.0.84 () {56 vars in 1108 bytes} [Wed May 25 14:46:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 14:46:35.704148 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ff2da90-f025-4b27-8bd3-6b3171d95ecc None admin] Authenticating user token {{(pid=101892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:46:35.790756 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG dbcounter [-] [101892] Writing DB stats keystone:SELECT=100 {{(pid=101892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:46:35.802966 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ff2da90-f025-4b27-8bd3-6b3171d95ecc None admin] Validating token access rules against request {{(pid=101892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:46:35.836034 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50e20893-6f84-4d94-b740-45d34462a411 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:46:35.836714 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e20893-6f84-4d94-b740-45d34462a411 None admin] REQUEST_METHOD: `GET` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:46:35.836997 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e20893-6f84-4d94-b740-45d34462a411 None admin] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:46:35.837272 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e20893-6f84-4d94-b740-45d34462a411 None admin] PATH_INFO: `/v3/domains` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:46:35.837979 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50e20893-6f84-4d94-b740-45d34462a411 None admin] RBAC: Adding query filter params (name=Default) {{(pid=101892) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:46:35.838285 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50e20893-6f84-4d94-b740-45d34462a411 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:46:35.839671 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50e20893-6f84-4d94-b740-45d34462a411 None admin] RBAC: Authorization granted {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:46:35.851191 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 622/1257] 10.222.0.84 () {56 vars in 1109 bytes} [Wed May 25 14:46:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:46:35.856860 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdd1d668-3861-4ff5-9727-137926deb33a None admin] Authenticating user token {{(pid=101893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:46:35.954916 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdd1d668-3861-4ff5-9727-137926deb33a None admin] Validating token access rules against request {{(pid=101893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:46:35.988072 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-719ca5ec-0a9e-415c-820e-8c03ebdbc852 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:46:35.989109 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719ca5ec-0a9e-415c-820e-8c03ebdbc852 None admin] REQUEST_METHOD: `GET` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:46:35.989390 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719ca5ec-0a9e-415c-820e-8c03ebdbc852 None admin] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:46:35.989662 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719ca5ec-0a9e-415c-820e-8c03ebdbc852 None admin] PATH_INFO: `/v3/projects/service` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:46:35.996184 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-719ca5ec-0a9e-415c-820e-8c03ebdbc852 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:46:35.997728 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-719ca5ec-0a9e-415c-820e-8c03ebdbc852 None admin] RBAC: Authorization granted {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:46:36.011654 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application [None req-719ca5ec-0a9e-415c-820e-8c03ebdbc852 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 25 14:46:36.011654 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:46:36.011654 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 14:46:36.011654 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 14:46:36.011654 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 14:46:36.011654 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 14:46:36.011654 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 14:46:36.011654 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 14:46:36.011654 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 14:46:36.011654 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 14:46:36.011654 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 14:46:36.011654 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 14:46:36.011654 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 25 14:46:36.011654 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return self._get_project(project_id) May 25 14:46:36.011654 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 25 14:46:36.013304 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 25 14:46:36.013304 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 14:46:36.013304 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 14:46:36.013304 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 14:46:36.013304 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 14:46:36.013304 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 14:46:36.013304 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return self.get_or_create( May 25 14:46:36.013304 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 14:46:36.013304 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application with Lock( May 25 14:46:36.013304 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 14:46:36.013304 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return self._enter() May 25 14:46:36.013304 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 14:46:36.013304 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 14:46:36.013304 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 14:46:36.013304 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return self.creator() May 25 14:46:36.013304 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 14:46:36.013304 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application created_value = creator( May 25 14:46:36.014221 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 25 14:46:36.014221 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 25 14:46:36.014221 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 25 14:46:36.014221 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 25 14:46:36.014221 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 25 14:46:36.014221 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 25 14:46:36.014221 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 25 14:46:36.014221 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application May 25 14:46:36.014221 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 636/1258] 10.222.0.84 () {56 vars in 1111 bytes} [Wed May 25 14:46:35 2022] GET /identity/v3/projects/service => generated 88 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 14:46:36.019240 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50e20893-6f84-4d94-b740-45d34462a411 None admin] Authenticating user token {{(pid=101892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:46:36.117820 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50e20893-6f84-4d94-b740-45d34462a411 None admin] Validating token access rules against request {{(pid=101892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:46:36.150429 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10037d30-df90-447f-9289-39ab9e0419ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:46:36.151079 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10037d30-df90-447f-9289-39ab9e0419ba None admin] REQUEST_METHOD: `GET` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:46:36.151361 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10037d30-df90-447f-9289-39ab9e0419ba None admin] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:46:36.151663 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10037d30-df90-447f-9289-39ab9e0419ba None admin] PATH_INFO: `/v3/projects` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:46:36.152526 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10037d30-df90-447f-9289-39ab9e0419ba None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=101892) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:46:36.153331 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10037d30-df90-447f-9289-39ab9e0419ba None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:46:36.154760 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10037d30-df90-447f-9289-39ab9e0419ba None admin] RBAC: Authorization granted {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:46:36.167332 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 623/1259] 10.222.0.84 () {56 vars in 1148 bytes} [Wed May 25 14:46:36 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:46:36.173625 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-719ca5ec-0a9e-415c-820e-8c03ebdbc852 None admin] Authenticating user token {{(pid=101893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:46:36.200713 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG dbcounter [-] [101893] Writing DB stats keystone:SELECT=100 {{(pid=101893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:46:36.273516 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-719ca5ec-0a9e-415c-820e-8c03ebdbc852 None admin] Validating token access rules against request {{(pid=101893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:46:36.305335 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c457f27-a553-4958-a724-5adb51f1dfa5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:46:36.305981 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c457f27-a553-4958-a724-5adb51f1dfa5 None admin] REQUEST_METHOD: `GET` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:46:36.306264 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c457f27-a553-4958-a724-5adb51f1dfa5 None admin] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:46:36.306537 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c457f27-a553-4958-a724-5adb51f1dfa5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:46:36.307378 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c457f27-a553-4958-a724-5adb51f1dfa5 None admin] RBAC: Adding query filter params (role.id=a3b78e7d547d4d2d998b4c99a4396bba, scope.project.id=a000829c658c4a7cab67f7b6353ba3fa, user.id=d18c4a1d92b94c0087a203db4fed22f2) {{(pid=101893) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:46:36.307696 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c457f27-a553-4958-a724-5adb51f1dfa5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:46:36.309637 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c457f27-a553-4958-a724-5adb51f1dfa5 None admin] RBAC: Authorization granted {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:46:36.315013 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 637/1260] 10.222.0.84 () {56 vars in 1374 bytes} [Wed May 25 14:46:36 2022] GET /identity/v3/role_assignments?user.id=d18c4a1d92b94c0087a203db4fed22f2&scope.project.id=a000829c658c4a7cab67f7b6353ba3fa&role.id=a3b78e7d547d4d2d998b4c99a4396bba => generated 259 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:46:38.531509 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156c6363-afb9-42be-9038-f487171a6073 None None] REQUEST_METHOD: `GET` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:46:38.532072 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156c6363-afb9-42be-9038-f487171a6073 None None] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:46:38.532072 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156c6363-afb9-42be-9038-f487171a6073 None None] PATH_INFO: `/` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:46:38.533437 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 624/1261] 10.222.0.84 () {54 vars in 926 bytes} [Wed May 25 14:46:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 14:46:38.538912 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2aa1221-74fc-41ff-9663-5cde410a8591 None None] REQUEST_METHOD: `POST` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:46:38.539322 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2aa1221-74fc-41ff-9663-5cde410a8591 None None] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:46:38.539472 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2aa1221-74fc-41ff-9663-5cde410a8591 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:46:38.556338 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.auth.core [None req-f2aa1221-74fc-41ff-9663-5cde410a8591 None None] MFA Rules not processed for user `05d87e87798e429aa1c10b24391f915e`. Rule list: `[]` (Enabled: `True`). {{(pid=101893) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:46:38.557451 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.fernet_utils [None req-f2aa1221-74fc-41ff-9663-5cde410a8591 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=101893) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:46:38.628098 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 638/1262] 10.222.0.84 () {58 vars in 1023 bytes} [Wed May 25 14:46:38 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 25 14:46:38.651527 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-156c6363-afb9-42be-9038-f487171a6073 None None] Authenticating user token {{(pid=101892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:46:38.662399 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG dbcounter [-] [101892] Writing DB stats keystone:SELECT=100 {{(pid=101892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:46:38.756247 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-156c6363-afb9-42be-9038-f487171a6073 None None] Validating token access rules against request {{(pid=101892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:46:38.789969 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-035f4af3-72e6-472b-a866-d1f4b7cbdfe1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:46:38.790743 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035f4af3-72e6-472b-a866-d1f4b7cbdfe1 None admin] REQUEST_METHOD: `GET` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:46:38.791030 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035f4af3-72e6-472b-a866-d1f4b7cbdfe1 None admin] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:46:38.791349 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035f4af3-72e6-472b-a866-d1f4b7cbdfe1 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:46:38.801982 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-035f4af3-72e6-472b-a866-d1f4b7cbdfe1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 14:46:38.810278 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application [None req-035f4af3-72e6-472b-a866-d1f4b7cbdfe1 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 25 14:46:38.810278 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:46:38.810278 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 14:46:38.810278 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 14:46:38.810278 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 14:46:38.810278 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 14:46:38.810278 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 14:46:38.810278 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 14:46:38.810278 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 14:46:38.810278 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 14:46:38.810278 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 14:46:38.810278 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 14:46:38.810278 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 14:46:38.810278 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 14:46:38.810278 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 14:46:38.810278 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 14:46:38.811420 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 14:46:38.811420 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 14:46:38.811420 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 14:46:38.811420 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 14:46:38.811420 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 14:46:38.811420 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 14:46:38.811420 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 14:46:38.811420 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 14:46:38.811420 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 14:46:38.811420 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application return self.get_or_create( May 25 14:46:38.811420 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 14:46:38.811420 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application with Lock( May 25 14:46:38.811420 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 14:46:38.811420 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application return self._enter() May 25 14:46:38.811420 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 14:46:38.811420 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 14:46:38.812998 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 14:46:38.812998 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application return self.creator() May 25 14:46:38.812998 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 14:46:38.812998 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application created_value = creator( May 25 14:46:38.812998 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 14:46:38.812998 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 14:46:38.812998 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 14:46:38.812998 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 14:46:38.812998 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 14:46:38.812998 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 14:46:38.812998 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 25 14:46:38.812998 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application May 25 14:46:38.812998 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 625/1263] 10.222.0.84 () {56 vars in 1096 bytes} [Wed May 25 14:46:38 2022] GET /identity/v3/roles/admin => generated 83 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 14:46:38.817540 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2aa1221-74fc-41ff-9663-5cde410a8591 None None] Authenticating user token {{(pid=101893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:46:38.835640 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG dbcounter [-] [101893] Writing DB stats keystone:SELECT=100 {{(pid=101893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:46:38.915837 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2aa1221-74fc-41ff-9663-5cde410a8591 None None] Validating token access rules against request {{(pid=101893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:46:38.950790 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71a5f232-7926-4a2a-9b94-a3d2ded4474e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:46:38.951452 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a5f232-7926-4a2a-9b94-a3d2ded4474e None admin] REQUEST_METHOD: `GET` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:46:38.951768 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a5f232-7926-4a2a-9b94-a3d2ded4474e None admin] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:46:38.952048 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a5f232-7926-4a2a-9b94-a3d2ded4474e None admin] PATH_INFO: `/v3/roles` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:46:38.952791 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71a5f232-7926-4a2a-9b94-a3d2ded4474e None admin] RBAC: Adding query filter params (name=admin) {{(pid=101893) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:46:38.953102 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71a5f232-7926-4a2a-9b94-a3d2ded4474e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:46:38.954557 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71a5f232-7926-4a2a-9b94-a3d2ded4474e None admin] RBAC: Authorization granted {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:46:38.962645 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 639/1264] 10.222.0.84 () {56 vars in 1099 bytes} [Wed May 25 14:46:38 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:46:38.969087 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-035f4af3-72e6-472b-a866-d1f4b7cbdfe1 None admin] Authenticating user token {{(pid=101892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:46:39.035701 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG dbcounter [-] [101892] Writing DB stats keystone:SELECT=100 {{(pid=101892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:46:39.068615 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-035f4af3-72e6-472b-a866-d1f4b7cbdfe1 None admin] Validating token access rules against request {{(pid=101892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:46:39.102108 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-064247e0-00f6-441e-a64d-3fe2489f7c2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:46:39.102899 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064247e0-00f6-441e-a64d-3fe2489f7c2d None admin] REQUEST_METHOD: `GET` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:46:39.103185 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064247e0-00f6-441e-a64d-3fe2489f7c2d None admin] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:46:39.103463 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064247e0-00f6-441e-a64d-3fe2489f7c2d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:46:39.115481 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-064247e0-00f6-441e-a64d-3fe2489f7c2d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:46:39.117700 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-064247e0-00f6-441e-a64d-3fe2489f7c2d None admin] RBAC: Authorization granted {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:46:39.135873 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application [None req-064247e0-00f6-441e-a64d-3fe2489f7c2d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 25 14:46:39.135873 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:46:39.135873 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 14:46:39.135873 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 14:46:39.135873 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 14:46:39.135873 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 14:46:39.135873 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 14:46:39.135873 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 14:46:39.135873 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 14:46:39.135873 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 14:46:39.135873 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 14:46:39.135873 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 14:46:39.135873 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 25 14:46:39.135873 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 25 14:46:39.135873 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 25 14:46:39.137486 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 25 14:46:39.137486 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 14:46:39.137486 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 14:46:39.137486 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 14:46:39.137486 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 14:46:39.137486 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 14:46:39.137486 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application return self.get_or_create( May 25 14:46:39.137486 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 14:46:39.137486 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application with Lock( May 25 14:46:39.137486 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 14:46:39.137486 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application return self._enter() May 25 14:46:39.137486 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 14:46:39.137486 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 14:46:39.137486 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 14:46:39.137486 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application return self.creator() May 25 14:46:39.137486 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 14:46:39.137486 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application created_value = creator( May 25 14:46:39.138646 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 25 14:46:39.138646 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 25 14:46:39.138646 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 25 14:46:39.138646 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application May 25 14:46:39.138646 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 626/1265] 10.222.0.84 () {56 vars in 1108 bytes} [Wed May 25 14:46:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 14:46:39.143493 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71a5f232-7926-4a2a-9b94-a3d2ded4474e None admin] Authenticating user token {{(pid=101893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:46:39.223078 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG dbcounter [-] [101893] Writing DB stats keystone:SELECT=100 {{(pid=101893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:46:39.243322 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71a5f232-7926-4a2a-9b94-a3d2ded4474e None admin] Validating token access rules against request {{(pid=101893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:46:39.277867 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-347e1ab0-e6d2-4c73-8416-3b6853f81067 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:46:39.278631 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347e1ab0-e6d2-4c73-8416-3b6853f81067 None admin] REQUEST_METHOD: `GET` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:46:39.278952 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347e1ab0-e6d2-4c73-8416-3b6853f81067 None admin] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:46:39.279230 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347e1ab0-e6d2-4c73-8416-3b6853f81067 None admin] PATH_INFO: `/v3/domains` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:46:39.280003 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-347e1ab0-e6d2-4c73-8416-3b6853f81067 None admin] RBAC: Adding query filter params (name=Default) {{(pid=101893) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:46:39.280307 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-347e1ab0-e6d2-4c73-8416-3b6853f81067 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:46:39.281779 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-347e1ab0-e6d2-4c73-8416-3b6853f81067 None admin] RBAC: Authorization granted {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:46:39.294337 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 640/1266] 10.222.0.84 () {56 vars in 1109 bytes} [Wed May 25 14:46:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:46:39.300368 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-064247e0-00f6-441e-a64d-3fe2489f7c2d None admin] Authenticating user token {{(pid=101892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:46:39.399711 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-064247e0-00f6-441e-a64d-3fe2489f7c2d None admin] Validating token access rules against request {{(pid=101892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:46:39.419033 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG dbcounter [-] [101892] Writing DB stats keystone:SELECT=100 {{(pid=101892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:46:39.433066 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a44305ac-a858-41e8-a533-09ddeff20d9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:46:39.434485 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44305ac-a858-41e8-a533-09ddeff20d9c None admin] REQUEST_METHOD: `GET` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:46:39.434824 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44305ac-a858-41e8-a533-09ddeff20d9c None admin] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:46:39.435110 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44305ac-a858-41e8-a533-09ddeff20d9c None admin] PATH_INFO: `/v3/users/placement` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:46:39.442991 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a44305ac-a858-41e8-a533-09ddeff20d9c None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:46:39.445302 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a44305ac-a858-41e8-a533-09ddeff20d9c None admin] RBAC: Authorization granted {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:46:39.459522 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application [None req-a44305ac-a858-41e8-a533-09ddeff20d9c None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. May 25 14:46:39.459522 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:46:39.459522 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 14:46:39.459522 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 14:46:39.459522 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 14:46:39.459522 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 14:46:39.459522 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 14:46:39.459522 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 14:46:39.459522 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 14:46:39.459522 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 14:46:39.459522 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 14:46:39.459522 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 14:46:39.459522 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 25 14:46:39.459522 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application return self._get_user(user_id) May 25 14:46:39.459522 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 25 14:46:39.459522 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 25 14:46:39.460720 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 14:46:39.460720 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 14:46:39.460720 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 25 14:46:39.460720 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 25 14:46:39.460720 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 25 14:46:39.460720 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 25 14:46:39.460720 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 14:46:39.460720 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 14:46:39.460720 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 14:46:39.460720 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application return self.get_or_create( May 25 14:46:39.460720 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 14:46:39.460720 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application with Lock( May 25 14:46:39.460720 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 14:46:39.460720 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application return self._enter() May 25 14:46:39.460720 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 14:46:39.460720 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 14:46:39.460720 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 14:46:39.460720 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application return self.creator() May 25 14:46:39.461947 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 14:46:39.461947 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application created_value = creator( May 25 14:46:39.461947 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 25 14:46:39.461947 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 25 14:46:39.461947 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 25 14:46:39.461947 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 25 14:46:39.461947 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 25 14:46:39.461947 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 25 14:46:39.461947 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. May 25 14:46:39.461947 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application May 25 14:46:39.461947 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 627/1267] 10.222.0.84 () {56 vars in 1108 bytes} [Wed May 25 14:46:39 2022] GET /identity/v3/users/placement => generated 87 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 14:46:39.466529 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-347e1ab0-e6d2-4c73-8416-3b6853f81067 None admin] Authenticating user token {{(pid=101893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:46:39.566662 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-347e1ab0-e6d2-4c73-8416-3b6853f81067 None admin] Validating token access rules against request {{(pid=101893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:46:39.599798 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9667e969-9ec0-4dce-af0f-a129017a565e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:46:39.600464 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9667e969-9ec0-4dce-af0f-a129017a565e None admin] REQUEST_METHOD: `GET` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:46:39.600749 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9667e969-9ec0-4dce-af0f-a129017a565e None admin] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:46:39.601028 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9667e969-9ec0-4dce-af0f-a129017a565e None admin] PATH_INFO: `/v3/users` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:46:39.601854 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9667e969-9ec0-4dce-af0f-a129017a565e None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=101893) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:46:39.602164 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9667e969-9ec0-4dce-af0f-a129017a565e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:46:39.603627 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9667e969-9ec0-4dce-af0f-a129017a565e None admin] RBAC: Authorization granted {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:46:39.612513 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG dbcounter [-] [101893] Writing DB stats keystone:SELECT=100 {{(pid=101893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:46:39.622213 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 641/1268] 10.222.0.84 () {56 vars in 1143 bytes} [Wed May 25 14:46:39 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:46:39.627917 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a44305ac-a858-41e8-a533-09ddeff20d9c None admin] Authenticating user token {{(pid=101892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:46:39.726716 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a44305ac-a858-41e8-a533-09ddeff20d9c None admin] Validating token access rules against request {{(pid=101892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:46:39.760891 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7bd3f7b-4bee-49d5-834d-8ae031446fa0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:46:39.761671 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7bd3f7b-4bee-49d5-834d-8ae031446fa0 None admin] REQUEST_METHOD: `GET` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:46:39.761982 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7bd3f7b-4bee-49d5-834d-8ae031446fa0 None admin] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:46:39.762257 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7bd3f7b-4bee-49d5-834d-8ae031446fa0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:46:39.772427 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7bd3f7b-4bee-49d5-834d-8ae031446fa0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:46:39.773867 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7bd3f7b-4bee-49d5-834d-8ae031446fa0 None admin] RBAC: Authorization granted {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:46:39.790393 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application [None req-b7bd3f7b-4bee-49d5-834d-8ae031446fa0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 25 14:46:39.790393 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:46:39.790393 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 14:46:39.790393 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 14:46:39.790393 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 14:46:39.790393 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 14:46:39.790393 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 14:46:39.790393 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 14:46:39.790393 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 14:46:39.790393 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 14:46:39.790393 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 14:46:39.790393 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 14:46:39.790393 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 25 14:46:39.790393 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 25 14:46:39.790393 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 25 14:46:39.791638 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 25 14:46:39.791638 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 14:46:39.791638 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 14:46:39.791638 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 14:46:39.791638 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 14:46:39.791638 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 14:46:39.791638 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application return self.get_or_create( May 25 14:46:39.791638 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 14:46:39.791638 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application with Lock( May 25 14:46:39.791638 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 14:46:39.791638 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application return self._enter() May 25 14:46:39.791638 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 14:46:39.791638 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 14:46:39.791638 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 14:46:39.791638 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application return self.creator() May 25 14:46:39.791638 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 14:46:39.791638 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application created_value = creator( May 25 14:46:39.792803 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 25 14:46:39.792803 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 25 14:46:39.792803 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 25 14:46:39.792803 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application May 25 14:46:39.792803 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 628/1269] 10.222.0.84 () {56 vars in 1108 bytes} [Wed May 25 14:46:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 14:46:39.797820 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9667e969-9ec0-4dce-af0f-a129017a565e None admin] Authenticating user token {{(pid=101893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:46:39.899740 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9667e969-9ec0-4dce-af0f-a129017a565e None admin] Validating token access rules against request {{(pid=101893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:46:39.935993 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7c3169e-82d6-4131-9102-fc5e1d07edb5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:46:39.936656 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c3169e-82d6-4131-9102-fc5e1d07edb5 None admin] REQUEST_METHOD: `GET` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:46:39.937006 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c3169e-82d6-4131-9102-fc5e1d07edb5 None admin] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:46:39.939735 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c3169e-82d6-4131-9102-fc5e1d07edb5 None admin] PATH_INFO: `/v3/domains` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:46:39.939735 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7c3169e-82d6-4131-9102-fc5e1d07edb5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=101893) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:46:39.939735 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7c3169e-82d6-4131-9102-fc5e1d07edb5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:46:39.940156 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7c3169e-82d6-4131-9102-fc5e1d07edb5 None admin] RBAC: Authorization granted {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:46:39.952392 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 642/1270] 10.222.0.84 () {56 vars in 1109 bytes} [Wed May 25 14:46:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 14:46:39.958052 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7bd3f7b-4bee-49d5-834d-8ae031446fa0 None admin] Authenticating user token {{(pid=101892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:46:39.991344 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG dbcounter [-] [101892] Writing DB stats keystone:SELECT=100 {{(pid=101892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:46:40.056785 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7bd3f7b-4bee-49d5-834d-8ae031446fa0 None admin] Validating token access rules against request {{(pid=101892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:46:40.088431 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-117670db-aa0e-4247-8c0e-494a28bdcb0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:46:40.089217 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117670db-aa0e-4247-8c0e-494a28bdcb0d None admin] REQUEST_METHOD: `GET` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:46:40.089502 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117670db-aa0e-4247-8c0e-494a28bdcb0d None admin] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:46:40.089780 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117670db-aa0e-4247-8c0e-494a28bdcb0d None admin] PATH_INFO: `/v3/projects/service` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:46:40.096953 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-117670db-aa0e-4247-8c0e-494a28bdcb0d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:46:40.100194 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-117670db-aa0e-4247-8c0e-494a28bdcb0d None admin] RBAC: Authorization granted {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:46:40.112962 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application [None req-117670db-aa0e-4247-8c0e-494a28bdcb0d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 25 14:46:40.112962 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:46:40.112962 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 14:46:40.112962 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 14:46:40.112962 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 14:46:40.112962 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 14:46:40.112962 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 14:46:40.112962 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 14:46:40.112962 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 14:46:40.112962 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 14:46:40.112962 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 14:46:40.112962 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 14:46:40.112962 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 25 14:46:40.112962 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application return self._get_project(project_id) May 25 14:46:40.112962 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 25 14:46:40.114275 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 25 14:46:40.114275 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 14:46:40.114275 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 14:46:40.114275 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 14:46:40.114275 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 14:46:40.114275 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 14:46:40.114275 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application return self.get_or_create( May 25 14:46:40.114275 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 14:46:40.114275 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application with Lock( May 25 14:46:40.114275 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 14:46:40.114275 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application return self._enter() May 25 14:46:40.114275 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 14:46:40.114275 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 14:46:40.114275 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 14:46:40.114275 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application return self.creator() May 25 14:46:40.114275 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 14:46:40.114275 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application created_value = creator( May 25 14:46:40.115582 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 25 14:46:40.115582 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 25 14:46:40.115582 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 25 14:46:40.115582 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 25 14:46:40.115582 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 25 14:46:40.115582 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 25 14:46:40.115582 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 25 14:46:40.115582 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application May 25 14:46:40.115582 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 629/1271] 10.222.0.84 () {56 vars in 1111 bytes} [Wed May 25 14:46:39 2022] GET /identity/v3/projects/service => generated 88 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 14:46:40.120178 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7c3169e-82d6-4131-9102-fc5e1d07edb5 None admin] Authenticating user token {{(pid=101893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:46:40.179025 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG dbcounter [-] [101893] Writing DB stats keystone:SELECT=100 {{(pid=101893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:46:40.219095 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7c3169e-82d6-4131-9102-fc5e1d07edb5 None admin] Validating token access rules against request {{(pid=101893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:46:40.253219 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5b58608-b65a-4ab8-81db-416fc9592bd7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:46:40.253811 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b58608-b65a-4ab8-81db-416fc9592bd7 None admin] REQUEST_METHOD: `GET` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:46:40.254096 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b58608-b65a-4ab8-81db-416fc9592bd7 None admin] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:46:40.254372 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b58608-b65a-4ab8-81db-416fc9592bd7 None admin] PATH_INFO: `/v3/projects` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:46:40.255153 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5b58608-b65a-4ab8-81db-416fc9592bd7 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=101893) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:46:40.255464 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5b58608-b65a-4ab8-81db-416fc9592bd7 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:46:40.256940 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5b58608-b65a-4ab8-81db-416fc9592bd7 None admin] RBAC: Authorization granted {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:46:40.268675 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 643/1272] 10.222.0.84 () {56 vars in 1148 bytes} [Wed May 25 14:46:40 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:46:40.274758 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-117670db-aa0e-4247-8c0e-494a28bdcb0d None admin] Authenticating user token {{(pid=101892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:46:40.366661 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG dbcounter [-] [101892] Writing DB stats keystone:SELECT=100 {{(pid=101892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:46:40.375525 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-117670db-aa0e-4247-8c0e-494a28bdcb0d None admin] Validating token access rules against request {{(pid=101892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:46:40.412381 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bf0b1fb-4bce-49b7-97ab-02c7bb59e22d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:46:40.413575 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf0b1fb-4bce-49b7-97ab-02c7bb59e22d None admin] REQUEST_METHOD: `PUT` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:46:40.414084 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf0b1fb-4bce-49b7-97ab-02c7bb59e22d None admin] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:46:40.414378 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf0b1fb-4bce-49b7-97ab-02c7bb59e22d None admin] PATH_INFO: `/v3/projects/a000829c658c4a7cab67f7b6353ba3fa/users/d18c4a1d92b94c0087a203db4fed22f2/roles/a3b78e7d547d4d2d998b4c99a4396bba` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:46:40.416941 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bf0b1fb-4bce-49b7-97ab-02c7bb59e22d None admin] RBAC: Authorizing `identity:create_grant(project_id=a000829c658c4a7cab67f7b6353ba3fa, user_id=d18c4a1d92b94c0087a203db4fed22f2, role_id=a3b78e7d547d4d2d998b4c99a4396bba)` {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:46:40.418399 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bf0b1fb-4bce-49b7-97ab-02c7bb59e22d None admin] RBAC: Authorization granted {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:46:40.540728 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 630/1273] 10.222.0.84 () {58 vars in 1439 bytes} [Wed May 25 14:46:40 2022] PUT /identity/v3/projects/a000829c658c4a7cab67f7b6353ba3fa/users/d18c4a1d92b94c0087a203db4fed22f2/roles/a3b78e7d547d4d2d998b4c99a4396bba => generated 0 bytes in 266 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 14:46:42.697979 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec75cf9-72f6-4dc9-8c00-8732cb924237 None None] REQUEST_METHOD: `GET` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:46:42.698538 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec75cf9-72f6-4dc9-8c00-8732cb924237 None None] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:46:42.698538 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec75cf9-72f6-4dc9-8c00-8732cb924237 None None] PATH_INFO: `/` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:46:42.700168 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 644/1274] 10.222.0.84 () {54 vars in 926 bytes} [Wed May 25 14:46:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 14:46:42.705664 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039bc41b-0a0a-4d17-84ca-2d7947d19075 None None] REQUEST_METHOD: `POST` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:46:42.714995 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039bc41b-0a0a-4d17-84ca-2d7947d19075 None None] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:46:42.714995 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039bc41b-0a0a-4d17-84ca-2d7947d19075 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:46:42.722438 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.auth.core [None req-039bc41b-0a0a-4d17-84ca-2d7947d19075 None None] MFA Rules not processed for user `05d87e87798e429aa1c10b24391f915e`. Rule list: `[]` (Enabled: `True`). {{(pid=101892) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:46:42.723647 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.fernet_utils [None req-039bc41b-0a0a-4d17-84ca-2d7947d19075 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=101892) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:46:42.789463 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 631/1275] 10.222.0.84 () {58 vars in 1023 bytes} [Wed May 25 14:46:42 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 25 14:46:42.814158 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec75cf9-72f6-4dc9-8c00-8732cb924237 None None] Authenticating user token {{(pid=101893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:46:42.917233 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec75cf9-72f6-4dc9-8c00-8732cb924237 None None] Validating token access rules against request {{(pid=101893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:46:42.934569 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG dbcounter [-] [101893] Writing DB stats keystone:SELECT=100 {{(pid=101893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:46:42.950918 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49d364c0-1b21-4c1c-9510-5a9740e7d552 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:46:42.951739 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d364c0-1b21-4c1c-9510-5a9740e7d552 None admin] REQUEST_METHOD: `GET` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:46:42.952026 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d364c0-1b21-4c1c-9510-5a9740e7d552 None admin] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:46:42.952306 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d364c0-1b21-4c1c-9510-5a9740e7d552 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:46:42.962051 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49d364c0-1b21-4c1c-9510-5a9740e7d552 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 14:46:42.970244 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application [None req-49d364c0-1b21-4c1c-9510-5a9740e7d552 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 25 14:46:42.970244 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:46:42.970244 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 14:46:42.970244 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 14:46:42.970244 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 14:46:42.970244 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 14:46:42.970244 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 14:46:42.970244 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 14:46:42.970244 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 14:46:42.970244 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 14:46:42.970244 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 14:46:42.970244 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 14:46:42.970244 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 14:46:42.970244 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 14:46:42.970244 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 14:46:42.970244 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 14:46:42.973903 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 14:46:42.973903 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 14:46:42.973903 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 14:46:42.973903 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 14:46:42.973903 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 14:46:42.973903 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 14:46:42.973903 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 14:46:42.973903 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 14:46:42.973903 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 14:46:42.973903 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return self.get_or_create( May 25 14:46:42.973903 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 14:46:42.973903 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application with Lock( May 25 14:46:42.973903 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 14:46:42.973903 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return self._enter() May 25 14:46:42.973903 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 14:46:42.973903 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 14:46:42.974895 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 14:46:42.974895 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return self.creator() May 25 14:46:42.974895 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 14:46:42.974895 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application created_value = creator( May 25 14:46:42.974895 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 14:46:42.974895 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 14:46:42.974895 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 14:46:42.974895 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 14:46:42.974895 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 14:46:42.974895 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 14:46:42.974895 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 25 14:46:42.974895 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application May 25 14:46:42.974895 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 645/1276] 10.222.0.84 () {56 vars in 1096 bytes} [Wed May 25 14:46:42 2022] GET /identity/v3/roles/admin => generated 83 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 14:46:42.977429 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-039bc41b-0a0a-4d17-84ca-2d7947d19075 None None] Authenticating user token {{(pid=101892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:46:43.058956 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG dbcounter [-] [101892] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=101892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:46:43.076028 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-039bc41b-0a0a-4d17-84ca-2d7947d19075 None None] Validating token access rules against request {{(pid=101892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:46:43.109402 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c26dc1b-dc97-479f-900d-ab835b43e084 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:46:43.110063 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c26dc1b-dc97-479f-900d-ab835b43e084 None admin] REQUEST_METHOD: `GET` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:46:43.110351 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c26dc1b-dc97-479f-900d-ab835b43e084 None admin] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:46:43.110629 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c26dc1b-dc97-479f-900d-ab835b43e084 None admin] PATH_INFO: `/v3/roles` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:46:43.111366 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c26dc1b-dc97-479f-900d-ab835b43e084 None admin] RBAC: Adding query filter params (name=admin) {{(pid=101892) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:46:43.111709 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c26dc1b-dc97-479f-900d-ab835b43e084 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:46:43.113072 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c26dc1b-dc97-479f-900d-ab835b43e084 None admin] RBAC: Authorization granted {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:46:43.121120 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 632/1277] 10.222.0.84 () {56 vars in 1099 bytes} [Wed May 25 14:46:42 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:46:43.126832 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49d364c0-1b21-4c1c-9510-5a9740e7d552 None admin] Authenticating user token {{(pid=101893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:46:43.228633 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49d364c0-1b21-4c1c-9510-5a9740e7d552 None admin] Validating token access rules against request {{(pid=101893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:46:43.264936 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83b004cb-529f-4892-8d04-21c66b711d6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:46:43.265727 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b004cb-529f-4892-8d04-21c66b711d6c None admin] REQUEST_METHOD: `GET` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:46:43.266014 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b004cb-529f-4892-8d04-21c66b711d6c None admin] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:46:43.266290 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b004cb-529f-4892-8d04-21c66b711d6c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:46:43.276573 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83b004cb-529f-4892-8d04-21c66b711d6c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:46:43.278577 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83b004cb-529f-4892-8d04-21c66b711d6c None admin] RBAC: Authorization granted {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:46:43.295391 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application [None req-83b004cb-529f-4892-8d04-21c66b711d6c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 25 14:46:43.295391 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:46:43.295391 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 14:46:43.295391 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 14:46:43.295391 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 14:46:43.295391 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 14:46:43.295391 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 14:46:43.295391 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 14:46:43.295391 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 14:46:43.295391 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 14:46:43.295391 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 14:46:43.295391 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 14:46:43.295391 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 25 14:46:43.295391 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 25 14:46:43.295391 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 25 14:46:43.296457 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 25 14:46:43.296457 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 14:46:43.296457 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 14:46:43.296457 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 14:46:43.296457 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 14:46:43.296457 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 14:46:43.296457 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return self.get_or_create( May 25 14:46:43.296457 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 14:46:43.296457 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application with Lock( May 25 14:46:43.296457 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 14:46:43.296457 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return self._enter() May 25 14:46:43.296457 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 14:46:43.296457 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 14:46:43.296457 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 14:46:43.296457 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return self.creator() May 25 14:46:43.296457 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 14:46:43.296457 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application created_value = creator( May 25 14:46:43.297952 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 25 14:46:43.297952 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 25 14:46:43.297952 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 25 14:46:43.297952 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application May 25 14:46:43.297952 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 646/1278] 10.222.0.84 () {56 vars in 1108 bytes} [Wed May 25 14:46:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 14:46:43.302366 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c26dc1b-dc97-479f-900d-ab835b43e084 None admin] Authenticating user token {{(pid=101892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:46:43.399433 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c26dc1b-dc97-479f-900d-ab835b43e084 None admin] Validating token access rules against request {{(pid=101892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:46:43.433324 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-828b59ac-7395-4e39-94ef-802d525c638f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:46:43.433980 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828b59ac-7395-4e39-94ef-802d525c638f None admin] REQUEST_METHOD: `GET` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:46:43.434305 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828b59ac-7395-4e39-94ef-802d525c638f None admin] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:46:43.434587 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828b59ac-7395-4e39-94ef-802d525c638f None admin] PATH_INFO: `/v3/domains` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:46:43.435304 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-828b59ac-7395-4e39-94ef-802d525c638f None admin] RBAC: Adding query filter params (name=Default) {{(pid=101892) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:46:43.435643 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-828b59ac-7395-4e39-94ef-802d525c638f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:46:43.437010 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-828b59ac-7395-4e39-94ef-802d525c638f None admin] RBAC: Authorization granted {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:46:43.448814 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 633/1279] 10.222.0.84 () {56 vars in 1109 bytes} [Wed May 25 14:46:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:46:43.454933 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83b004cb-529f-4892-8d04-21c66b711d6c None admin] Authenticating user token {{(pid=101893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:46:43.490750 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG dbcounter [-] [101893] Writing DB stats keystone:SELECT=100 {{(pid=101893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:46:43.559863 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83b004cb-529f-4892-8d04-21c66b711d6c None admin] Validating token access rules against request {{(pid=101893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:46:43.593639 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deac93ed-8844-42b5-b3d9-adc3bbce12fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:46:43.594430 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deac93ed-8844-42b5-b3d9-adc3bbce12fd None admin] REQUEST_METHOD: `GET` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:46:43.594712 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deac93ed-8844-42b5-b3d9-adc3bbce12fd None admin] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:46:43.594985 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deac93ed-8844-42b5-b3d9-adc3bbce12fd None admin] PATH_INFO: `/v3/users/placement` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:46:43.602310 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deac93ed-8844-42b5-b3d9-adc3bbce12fd None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:46:43.603828 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deac93ed-8844-42b5-b3d9-adc3bbce12fd None admin] RBAC: Authorization granted {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:46:43.618040 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application [None req-deac93ed-8844-42b5-b3d9-adc3bbce12fd None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. May 25 14:46:43.618040 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:46:43.618040 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 14:46:43.618040 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 14:46:43.618040 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 14:46:43.618040 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 14:46:43.618040 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 14:46:43.618040 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 14:46:43.618040 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 14:46:43.618040 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 14:46:43.618040 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 14:46:43.618040 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 14:46:43.618040 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 25 14:46:43.618040 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return self._get_user(user_id) May 25 14:46:43.618040 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 25 14:46:43.618040 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 25 14:46:43.619161 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 14:46:43.619161 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 14:46:43.619161 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 25 14:46:43.619161 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 25 14:46:43.619161 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 25 14:46:43.619161 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 25 14:46:43.619161 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 14:46:43.619161 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 14:46:43.619161 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 14:46:43.619161 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return self.get_or_create( May 25 14:46:43.619161 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 14:46:43.619161 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application with Lock( May 25 14:46:43.619161 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 14:46:43.619161 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return self._enter() May 25 14:46:43.619161 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 14:46:43.619161 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 14:46:43.619161 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 14:46:43.619161 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return self.creator() May 25 14:46:43.625547 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 14:46:43.625547 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application created_value = creator( May 25 14:46:43.625547 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 25 14:46:43.625547 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 25 14:46:43.625547 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 25 14:46:43.625547 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 25 14:46:43.625547 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 25 14:46:43.625547 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 25 14:46:43.625547 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. May 25 14:46:43.625547 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application May 25 14:46:43.625547 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 647/1280] 10.222.0.84 () {56 vars in 1108 bytes} [Wed May 25 14:46:43 2022] GET /identity/v3/users/placement => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 14:46:43.626331 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-828b59ac-7395-4e39-94ef-802d525c638f None admin] Authenticating user token {{(pid=101892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:46:43.628828 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG dbcounter [-] [101892] Writing DB stats keystone:SELECT=100 {{(pid=101892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:46:43.721031 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-828b59ac-7395-4e39-94ef-802d525c638f None admin] Validating token access rules against request {{(pid=101892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:46:43.754043 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-451573fb-0f9d-407a-95dd-1cbd145bdaab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:46:43.756541 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451573fb-0f9d-407a-95dd-1cbd145bdaab None admin] REQUEST_METHOD: `GET` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:46:43.756541 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451573fb-0f9d-407a-95dd-1cbd145bdaab None admin] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:46:43.756541 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451573fb-0f9d-407a-95dd-1cbd145bdaab None admin] PATH_INFO: `/v3/users` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:46:43.756541 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-451573fb-0f9d-407a-95dd-1cbd145bdaab None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=101892) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:46:43.756541 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-451573fb-0f9d-407a-95dd-1cbd145bdaab None admin] RBAC: Authorizing `identity:list_users()` {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:46:43.757801 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-451573fb-0f9d-407a-95dd-1cbd145bdaab None admin] RBAC: Authorization granted {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:46:43.774637 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 634/1281] 10.222.0.84 () {56 vars in 1143 bytes} [Wed May 25 14:46:43 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:46:43.780343 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deac93ed-8844-42b5-b3d9-adc3bbce12fd None admin] Authenticating user token {{(pid=101893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:46:43.875867 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG dbcounter [-] [101893] Writing DB stats keystone:SELECT=100 {{(pid=101893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:46:43.885283 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deac93ed-8844-42b5-b3d9-adc3bbce12fd None admin] Validating token access rules against request {{(pid=101893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:46:43.917676 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30f1918b-df07-4ff6-909d-353ee60d41b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:46:43.918323 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f1918b-df07-4ff6-909d-353ee60d41b4 None admin] REQUEST_METHOD: `GET` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:46:43.918696 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f1918b-df07-4ff6-909d-353ee60d41b4 None admin] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:46:43.918977 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f1918b-df07-4ff6-909d-353ee60d41b4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:46:43.983048 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30f1918b-df07-4ff6-909d-353ee60d41b4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:46:43.984448 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30f1918b-df07-4ff6-909d-353ee60d41b4 None admin] RBAC: Authorization granted {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:46:44.069825 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG dbcounter [-] [101893] Writing DB stats keystone:SELECT=100 {{(pid=101893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:46:44.080444 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 648/1282] 10.222.0.84 () {58 vars in 1282 bytes} [Wed May 25 14:46:43 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 301 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 25 14:46:44.086214 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-451573fb-0f9d-407a-95dd-1cbd145bdaab None admin] Authenticating user token {{(pid=101892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:46:44.150546 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG dbcounter [-] [101892] Writing DB stats keystone:SELECT=100 {{(pid=101892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:46:44.187396 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-451573fb-0f9d-407a-95dd-1cbd145bdaab None admin] Validating token access rules against request {{(pid=101892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:46:44.221147 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccf49ce7-5e4a-453b-bf85-422bb1f87aab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:46:44.221935 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf49ce7-5e4a-453b-bf85-422bb1f87aab None admin] REQUEST_METHOD: `GET` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:46:44.222216 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf49ce7-5e4a-453b-bf85-422bb1f87aab None admin] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:46:44.222567 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf49ce7-5e4a-453b-bf85-422bb1f87aab None admin] PATH_INFO: `/v3/domains/Default` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:46:44.232845 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccf49ce7-5e4a-453b-bf85-422bb1f87aab None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:46:44.234332 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccf49ce7-5e4a-453b-bf85-422bb1f87aab None admin] RBAC: Authorization granted {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:46:44.251599 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application [None req-ccf49ce7-5e4a-453b-bf85-422bb1f87aab None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 25 14:46:44.251599 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:46:44.251599 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 14:46:44.251599 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 14:46:44.251599 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 14:46:44.251599 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 14:46:44.251599 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 14:46:44.251599 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 14:46:44.251599 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 14:46:44.251599 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 14:46:44.251599 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 14:46:44.251599 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 14:46:44.251599 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 25 14:46:44.251599 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 25 14:46:44.251599 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 25 14:46:44.252689 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 25 14:46:44.252689 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 14:46:44.252689 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 14:46:44.252689 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 14:46:44.252689 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 14:46:44.252689 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 14:46:44.252689 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application return self.get_or_create( May 25 14:46:44.252689 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 14:46:44.252689 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application with Lock( May 25 14:46:44.252689 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 14:46:44.252689 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application return self._enter() May 25 14:46:44.252689 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 14:46:44.252689 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 14:46:44.252689 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 14:46:44.252689 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application return self.creator() May 25 14:46:44.252689 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 14:46:44.252689 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application created_value = creator( May 25 14:46:44.253923 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 25 14:46:44.253923 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 25 14:46:44.253923 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 25 14:46:44.253923 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application May 25 14:46:44.253923 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 635/1283] 10.222.0.84 () {56 vars in 1108 bytes} [Wed May 25 14:46:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 14:46:44.258452 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30f1918b-df07-4ff6-909d-353ee60d41b4 None admin] Authenticating user token {{(pid=101893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:46:44.355707 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30f1918b-df07-4ff6-909d-353ee60d41b4 None admin] Validating token access rules against request {{(pid=101893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:46:44.388848 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f79eed-8516-44f0-b63e-433f626a1945 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:46:44.389497 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f79eed-8516-44f0-b63e-433f626a1945 None admin] REQUEST_METHOD: `GET` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:46:44.389776 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f79eed-8516-44f0-b63e-433f626a1945 None admin] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:46:44.390072 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f79eed-8516-44f0-b63e-433f626a1945 None admin] PATH_INFO: `/v3/domains` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:46:44.390782 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3f79eed-8516-44f0-b63e-433f626a1945 None admin] RBAC: Adding query filter params (name=Default) {{(pid=101893) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:46:44.391086 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3f79eed-8516-44f0-b63e-433f626a1945 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:46:44.392482 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3f79eed-8516-44f0-b63e-433f626a1945 None admin] RBAC: Authorization granted {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:46:44.404036 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 649/1284] 10.222.0.84 () {56 vars in 1109 bytes} [Wed May 25 14:46:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:46:44.409700 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccf49ce7-5e4a-453b-bf85-422bb1f87aab None admin] Authenticating user token {{(pid=101892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:46:44.516846 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccf49ce7-5e4a-453b-bf85-422bb1f87aab None admin] Validating token access rules against request {{(pid=101892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:46:44.531567 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG dbcounter [-] [101892] Writing DB stats keystone:SELECT=100 {{(pid=101892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:46:44.551317 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df948328-4cbf-4b9c-a324-c112b4fe4bd0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:46:44.552206 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df948328-4cbf-4b9c-a324-c112b4fe4bd0 None admin] REQUEST_METHOD: `GET` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:46:44.552488 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df948328-4cbf-4b9c-a324-c112b4fe4bd0 None admin] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:46:44.552761 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df948328-4cbf-4b9c-a324-c112b4fe4bd0 None admin] PATH_INFO: `/v3/projects/service` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:46:44.559591 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df948328-4cbf-4b9c-a324-c112b4fe4bd0 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:46:44.564862 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df948328-4cbf-4b9c-a324-c112b4fe4bd0 None admin] RBAC: Authorization granted {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:46:44.575418 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application [None req-df948328-4cbf-4b9c-a324-c112b4fe4bd0 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 25 14:46:44.575418 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:46:44.575418 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 14:46:44.575418 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 14:46:44.575418 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 14:46:44.575418 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 14:46:44.575418 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 14:46:44.575418 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 14:46:44.575418 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 14:46:44.575418 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 14:46:44.575418 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 14:46:44.575418 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 14:46:44.575418 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 25 14:46:44.575418 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application return self._get_project(project_id) May 25 14:46:44.575418 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 25 14:46:44.576543 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 25 14:46:44.576543 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 14:46:44.576543 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 14:46:44.576543 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 14:46:44.576543 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 14:46:44.576543 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 14:46:44.576543 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application return self.get_or_create( May 25 14:46:44.576543 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 14:46:44.576543 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application with Lock( May 25 14:46:44.576543 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 14:46:44.576543 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application return self._enter() May 25 14:46:44.576543 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 14:46:44.576543 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 14:46:44.576543 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 14:46:44.576543 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application return self.creator() May 25 14:46:44.576543 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 14:46:44.576543 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application created_value = creator( May 25 14:46:44.577635 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 25 14:46:44.577635 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 25 14:46:44.577635 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 25 14:46:44.577635 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 25 14:46:44.577635 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 25 14:46:44.577635 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 25 14:46:44.577635 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 25 14:46:44.577635 dv-cinder-803823-9-smb devstack@keystone.service[101892]: ERROR keystone.server.flask.application May 25 14:46:44.577635 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 636/1285] 10.222.0.84 () {56 vars in 1111 bytes} [Wed May 25 14:46:44 2022] GET /identity/v3/projects/service => generated 88 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 14:46:44.582650 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f79eed-8516-44f0-b63e-433f626a1945 None admin] Authenticating user token {{(pid=101893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:46:44.632565 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG dbcounter [-] [101893] Writing DB stats keystone:SELECT=100 {{(pid=101893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:46:44.680554 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f79eed-8516-44f0-b63e-433f626a1945 None admin] Validating token access rules against request {{(pid=101893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:46:44.713087 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-308d71b5-33d7-4c01-9cb1-460935dfe3a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:46:44.713745 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308d71b5-33d7-4c01-9cb1-460935dfe3a3 None admin] REQUEST_METHOD: `GET` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:46:44.714030 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308d71b5-33d7-4c01-9cb1-460935dfe3a3 None admin] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:46:44.714311 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308d71b5-33d7-4c01-9cb1-460935dfe3a3 None admin] PATH_INFO: `/v3/projects` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:46:44.715096 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-308d71b5-33d7-4c01-9cb1-460935dfe3a3 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=101893) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:46:44.715498 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-308d71b5-33d7-4c01-9cb1-460935dfe3a3 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:46:44.717603 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-308d71b5-33d7-4c01-9cb1-460935dfe3a3 None admin] RBAC: Authorization granted {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:46:44.729326 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 650/1286] 10.222.0.84 () {56 vars in 1148 bytes} [Wed May 25 14:46:44 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:46:44.735316 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df948328-4cbf-4b9c-a324-c112b4fe4bd0 None admin] Authenticating user token {{(pid=101892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:46:44.837675 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df948328-4cbf-4b9c-a324-c112b4fe4bd0 None admin] Validating token access rules against request {{(pid=101892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:46:44.870855 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9278dee6-c95a-47ac-a5ae-ba772b06eeb7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:46:44.871506 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9278dee6-c95a-47ac-a5ae-ba772b06eeb7 None admin] REQUEST_METHOD: `GET` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:46:44.872374 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9278dee6-c95a-47ac-a5ae-ba772b06eeb7 None admin] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:46:44.872630 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9278dee6-c95a-47ac-a5ae-ba772b06eeb7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:46:44.873453 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9278dee6-c95a-47ac-a5ae-ba772b06eeb7 None admin] RBAC: Adding query filter params (role.id=a3b78e7d547d4d2d998b4c99a4396bba, scope.project.id=a000829c658c4a7cab67f7b6353ba3fa, user.id=d18c4a1d92b94c0087a203db4fed22f2) {{(pid=101892) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:46:44.873771 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9278dee6-c95a-47ac-a5ae-ba772b06eeb7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:46:44.875230 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9278dee6-c95a-47ac-a5ae-ba772b06eeb7 None admin] RBAC: Authorization granted {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:46:44.881046 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 637/1287] 10.222.0.84 () {56 vars in 1374 bytes} [Wed May 25 14:46:44 2022] GET /identity/v3/role_assignments?user.id=d18c4a1d92b94c0087a203db4fed22f2&scope.project.id=a000829c658c4a7cab67f7b6353ba3fa&role.id=a3b78e7d547d4d2d998b4c99a4396bba => generated 608 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:46:47.077499 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c04695-cc6b-40a7-88f6-b2ffe994c921 None None] REQUEST_METHOD: `GET` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:46:47.078080 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c04695-cc6b-40a7-88f6-b2ffe994c921 None None] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:46:47.078080 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c04695-cc6b-40a7-88f6-b2ffe994c921 None None] PATH_INFO: `/` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:46:47.079397 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 651/1288] 10.222.0.84 () {54 vars in 926 bytes} [Wed May 25 14:46:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 14:46:47.084808 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40673db-612f-4c67-b90e-45a472716160 None None] REQUEST_METHOD: `POST` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:46:47.085185 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40673db-612f-4c67-b90e-45a472716160 None None] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:46:47.085369 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40673db-612f-4c67-b90e-45a472716160 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:46:47.102078 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.auth.core [None req-d40673db-612f-4c67-b90e-45a472716160 None None] MFA Rules not processed for user `05d87e87798e429aa1c10b24391f915e`. Rule list: `[]` (Enabled: `True`). {{(pid=101892) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:46:47.103275 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.fernet_utils [None req-d40673db-612f-4c67-b90e-45a472716160 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=101892) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:46:47.132388 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG dbcounter [-] [101892] Writing DB stats keystone:SELECT=100 {{(pid=101892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:46:47.170306 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 638/1289] 10.222.0.84 () {58 vars in 1023 bytes} [Wed May 25 14:46:47 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 25 14:46:47.192975 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c04695-cc6b-40a7-88f6-b2ffe994c921 None None] Authenticating user token {{(pid=101893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:46:47.295893 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c04695-cc6b-40a7-88f6-b2ffe994c921 None None] Validating token access rules against request {{(pid=101893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:46:47.306234 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG dbcounter [-] [101893] Writing DB stats keystone:SELECT=100 {{(pid=101893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:46:47.331225 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa3861ae-0173-4514-b9d2-6280868e396d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:46:47.331953 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3861ae-0173-4514-b9d2-6280868e396d None admin] REQUEST_METHOD: `GET` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:46:47.332237 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3861ae-0173-4514-b9d2-6280868e396d None admin] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:46:47.332510 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3861ae-0173-4514-b9d2-6280868e396d None admin] PATH_INFO: `/v3/services/placement` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:46:47.333153 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa3861ae-0173-4514-b9d2-6280868e396d None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:46:47.334520 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa3861ae-0173-4514-b9d2-6280868e396d None admin] RBAC: Authorization granted {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:46:47.346435 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application [None req-aa3861ae-0173-4514-b9d2-6280868e396d None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. May 25 14:46:47.346435 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:46:47.346435 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 25 14:46:47.346435 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 25 14:46:47.346435 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 25 14:46:47.346435 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 25 14:46:47.346435 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 25 14:46:47.346435 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 25 14:46:47.346435 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. May 25 14:46:47.346435 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application May 25 14:46:47.346435 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 25 14:46:47.346435 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application May 25 14:46:47.346435 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:46:47.346435 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 14:46:47.346435 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 14:46:47.346435 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 14:46:47.346435 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 14:46:47.357380 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 14:46:47.357380 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 14:46:47.357380 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 14:46:47.357380 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 14:46:47.357380 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 14:46:47.357380 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 14:46:47.357380 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 25 14:46:47.357380 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return self._get_service(service_id) May 25 14:46:47.357380 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 25 14:46:47.357380 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 25 14:46:47.357380 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 14:46:47.357380 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 14:46:47.357380 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 14:46:47.357380 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 14:46:47.357380 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 14:46:47.357380 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return self.get_or_create( May 25 14:46:47.358607 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 14:46:47.358607 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application with Lock( May 25 14:46:47.358607 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 14:46:47.358607 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return self._enter() May 25 14:46:47.358607 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 14:46:47.358607 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 14:46:47.358607 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 14:46:47.358607 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return self.creator() May 25 14:46:47.358607 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 14:46:47.358607 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application created_value = creator( May 25 14:46:47.358607 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 25 14:46:47.358607 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 25 14:46:47.358607 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. May 25 14:46:47.358607 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application May 25 14:46:47.358607 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 652/1290] 10.222.0.84 () {56 vars in 1117 bytes} [Wed May 25 14:46:47 2022] GET /identity/v3/services/placement => generated 90 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 14:46:47.359846 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d40673db-612f-4c67-b90e-45a472716160 None None] Authenticating user token {{(pid=101892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:46:47.450526 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d40673db-612f-4c67-b90e-45a472716160 None None] Validating token access rules against request {{(pid=101892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:46:47.483570 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b655c774-ea2e-4d09-9830-e2b3d0963bb7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:46:47.484245 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b655c774-ea2e-4d09-9830-e2b3d0963bb7 None admin] REQUEST_METHOD: `GET` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:46:47.484530 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b655c774-ea2e-4d09-9830-e2b3d0963bb7 None admin] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:46:47.484807 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b655c774-ea2e-4d09-9830-e2b3d0963bb7 None admin] PATH_INFO: `/v3/services` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:46:47.485526 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b655c774-ea2e-4d09-9830-e2b3d0963bb7 None admin] RBAC: Adding query filter params (name=placement) {{(pid=101892) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:46:47.485849 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b655c774-ea2e-4d09-9830-e2b3d0963bb7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:46:47.487214 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b655c774-ea2e-4d09-9830-e2b3d0963bb7 None admin] RBAC: Authorization granted {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:46:47.492290 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 639/1291] 10.222.0.84 () {56 vars in 1116 bytes} [Wed May 25 14:46:47 2022] GET /identity/v3/services?name=placement => generated 126 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 14:46:47.498696 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa3861ae-0173-4514-b9d2-6280868e396d None admin] Authenticating user token {{(pid=101893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:46:47.613220 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa3861ae-0173-4514-b9d2-6280868e396d None admin] Validating token access rules against request {{(pid=101893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:46:47.646371 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b56d43a6-3301-40d2-8d97-230deb7c57b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:46:47.647116 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56d43a6-3301-40d2-8d97-230deb7c57b6 None admin] REQUEST_METHOD: `GET` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:46:47.647405 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56d43a6-3301-40d2-8d97-230deb7c57b6 None admin] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:46:47.647730 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56d43a6-3301-40d2-8d97-230deb7c57b6 None admin] PATH_INFO: `/v3/services` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:46:47.648440 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b56d43a6-3301-40d2-8d97-230deb7c57b6 None admin] RBAC: Adding query filter params (type=placement) {{(pid=101893) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:46:47.648751 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b56d43a6-3301-40d2-8d97-230deb7c57b6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:46:47.650215 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b56d43a6-3301-40d2-8d97-230deb7c57b6 None admin] RBAC: Authorization granted {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:46:47.654698 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 653/1292] 10.222.0.84 () {56 vars in 1116 bytes} [Wed May 25 14:46:47 2022] GET /identity/v3/services?type=placement => generated 126 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:46:49.860726 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d58f8938-92b1-465a-96c9-27360f334d28 None None] REQUEST_METHOD: `GET` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:46:49.861907 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d58f8938-92b1-465a-96c9-27360f334d28 None None] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:46:49.861907 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d58f8938-92b1-465a-96c9-27360f334d28 None None] PATH_INFO: `/` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:46:49.862639 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 640/1293] 10.222.0.84 () {54 vars in 926 bytes} [Wed May 25 14:46:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 14:46:49.868357 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c9c6a2-290d-4414-9e8c-66f863b9de90 None None] REQUEST_METHOD: `POST` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:46:49.868751 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c9c6a2-290d-4414-9e8c-66f863b9de90 None None] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:46:49.868912 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c9c6a2-290d-4414-9e8c-66f863b9de90 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:46:49.885829 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.auth.core [None req-07c9c6a2-290d-4414-9e8c-66f863b9de90 None None] MFA Rules not processed for user `05d87e87798e429aa1c10b24391f915e`. Rule list: `[]` (Enabled: `True`). {{(pid=101893) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:46:49.887017 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.fernet_utils [None req-07c9c6a2-290d-4414-9e8c-66f863b9de90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=101893) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:46:49.916710 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG dbcounter [-] [101893] Writing DB stats keystone:SELECT=100 {{(pid=101893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:46:49.953936 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 654/1294] 10.222.0.84 () {58 vars in 1023 bytes} [Wed May 25 14:46:49 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 25 14:46:49.976019 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d58f8938-92b1-465a-96c9-27360f334d28 None None] Authenticating user token {{(pid=101892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:46:50.007186 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG dbcounter [-] [101892] Writing DB stats keystone:SELECT=100 {{(pid=101892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:46:50.073406 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d58f8938-92b1-465a-96c9-27360f334d28 None None] Validating token access rules against request {{(pid=101892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:46:50.107782 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59686dd3-25b5-4a5a-9efc-16656591766b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:46:50.108434 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59686dd3-25b5-4a5a-9efc-16656591766b None admin] REQUEST_METHOD: `POST` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:46:50.108716 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59686dd3-25b5-4a5a-9efc-16656591766b None admin] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:46:50.108989 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59686dd3-25b5-4a5a-9efc-16656591766b None admin] PATH_INFO: `/v3/services` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:46:50.109708 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59686dd3-25b5-4a5a-9efc-16656591766b None admin] RBAC: Authorizing `identity:create_service()` {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:46:50.111139 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59686dd3-25b5-4a5a-9efc-16656591766b None admin] RBAC: Authorization granted {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:46:50.220413 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 641/1295] 10.222.0.84 () {60 vars in 1141 bytes} [Wed May 25 14:46:49 2022] POST /identity/v3/services => generated 246 bytes in 245 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 25 14:46:52.447222 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd878d9-3e96-49e4-a868-115c2fa21a45 None None] REQUEST_METHOD: `GET` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:46:52.447811 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd878d9-3e96-49e4-a868-115c2fa21a45 None None] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:46:52.447811 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd878d9-3e96-49e4-a868-115c2fa21a45 None None] PATH_INFO: `/` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:46:52.449192 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 655/1296] 10.222.0.84 () {54 vars in 926 bytes} [Wed May 25 14:46:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 14:46:52.455215 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebfb240d-2438-4eb7-a523-5ef0df4bfc7b None None] REQUEST_METHOD: `POST` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:46:52.455641 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebfb240d-2438-4eb7-a523-5ef0df4bfc7b None None] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:46:52.455846 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebfb240d-2438-4eb7-a523-5ef0df4bfc7b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:46:52.471982 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.auth.core [None req-ebfb240d-2438-4eb7-a523-5ef0df4bfc7b None None] MFA Rules not processed for user `05d87e87798e429aa1c10b24391f915e`. Rule list: `[]` (Enabled: `True`). {{(pid=101892) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:46:52.473169 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.fernet_utils [None req-ebfb240d-2438-4eb7-a523-5ef0df4bfc7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=101892) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:46:52.543157 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 642/1297] 10.222.0.84 () {58 vars in 1023 bytes} [Wed May 25 14:46:52 2022] POST /identity/v3/auth/tokens => generated 2211 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 25 14:46:52.570491 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cd878d9-3e96-49e4-a868-115c2fa21a45 None None] Authenticating user token {{(pid=101893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:46:52.675229 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cd878d9-3e96-49e4-a868-115c2fa21a45 None None] Validating token access rules against request {{(pid=101893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:46:52.710461 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d89375de-a945-4cba-8a76-8eaaface1d1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:46:52.711173 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89375de-a945-4cba-8a76-8eaaface1d1d None admin] REQUEST_METHOD: `GET` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:46:52.711453 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89375de-a945-4cba-8a76-8eaaface1d1d None admin] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:46:52.711762 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89375de-a945-4cba-8a76-8eaaface1d1d None admin] PATH_INFO: `/v3/services/placement` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:46:52.712412 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d89375de-a945-4cba-8a76-8eaaface1d1d None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:46:52.713770 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d89375de-a945-4cba-8a76-8eaaface1d1d None admin] RBAC: Authorization granted {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:46:52.725438 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application [None req-d89375de-a945-4cba-8a76-8eaaface1d1d None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. May 25 14:46:52.725438 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:46:52.725438 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 25 14:46:52.725438 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 25 14:46:52.725438 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 25 14:46:52.725438 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 25 14:46:52.725438 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 25 14:46:52.725438 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 25 14:46:52.725438 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. May 25 14:46:52.725438 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application May 25 14:46:52.725438 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 25 14:46:52.725438 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application May 25 14:46:52.725438 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:46:52.725438 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 14:46:52.725438 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 14:46:52.725438 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 14:46:52.725438 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 14:46:52.729381 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 14:46:52.729381 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 14:46:52.729381 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 14:46:52.729381 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 14:46:52.729381 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 14:46:52.729381 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 14:46:52.729381 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 25 14:46:52.729381 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return self._get_service(service_id) May 25 14:46:52.729381 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 25 14:46:52.729381 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 25 14:46:52.729381 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 14:46:52.729381 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 14:46:52.729381 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 14:46:52.729381 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 14:46:52.729381 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 14:46:52.729381 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return self.get_or_create( May 25 14:46:52.730256 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 14:46:52.730256 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application with Lock( May 25 14:46:52.730256 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 14:46:52.730256 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return self._enter() May 25 14:46:52.730256 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 14:46:52.730256 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 14:46:52.730256 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 14:46:52.730256 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return self.creator() May 25 14:46:52.730256 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 14:46:52.730256 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application created_value = creator( May 25 14:46:52.730256 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 25 14:46:52.730256 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 25 14:46:52.730256 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. May 25 14:46:52.730256 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application May 25 14:46:52.730256 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 656/1298] 10.222.0.84 () {56 vars in 1117 bytes} [Wed May 25 14:46:52 2022] GET /identity/v3/services/placement => generated 90 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 14:46:52.733268 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebfb240d-2438-4eb7-a523-5ef0df4bfc7b None None] Authenticating user token {{(pid=101892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:46:52.752131 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG dbcounter [-] [101892] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=101892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:46:52.828371 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebfb240d-2438-4eb7-a523-5ef0df4bfc7b None None] Validating token access rules against request {{(pid=101892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:46:52.860576 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9658d9c9-fa4e-4ddd-99d0-c37369f5127b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:46:52.861231 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9658d9c9-fa4e-4ddd-99d0-c37369f5127b None admin] REQUEST_METHOD: `GET` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:46:52.861513 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9658d9c9-fa4e-4ddd-99d0-c37369f5127b None admin] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:46:52.861791 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9658d9c9-fa4e-4ddd-99d0-c37369f5127b None admin] PATH_INFO: `/v3/services` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:46:52.862488 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9658d9c9-fa4e-4ddd-99d0-c37369f5127b None admin] RBAC: Adding query filter params (name=placement) {{(pid=101892) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:46:52.862814 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9658d9c9-fa4e-4ddd-99d0-c37369f5127b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:46:52.864577 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9658d9c9-fa4e-4ddd-99d0-c37369f5127b None admin] RBAC: Authorization granted {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:46:52.870300 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 643/1299] 10.222.0.84 () {56 vars in 1116 bytes} [Wed May 25 14:46:52 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:46:52.876916 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d89375de-a945-4cba-8a76-8eaaface1d1d None admin] Authenticating user token {{(pid=101893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:46:52.907036 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG dbcounter [-] [101893] Writing DB stats keystone:SELECT=100 {{(pid=101893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:46:52.973267 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d89375de-a945-4cba-8a76-8eaaface1d1d None admin] Validating token access rules against request {{(pid=101893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:46:53.006111 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80307672-e7a0-45fd-8cf6-98cd9ba5dffe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:46:53.006753 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80307672-e7a0-45fd-8cf6-98cd9ba5dffe None admin] REQUEST_METHOD: `GET` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:46:53.007035 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80307672-e7a0-45fd-8cf6-98cd9ba5dffe None admin] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:46:53.007306 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80307672-e7a0-45fd-8cf6-98cd9ba5dffe None admin] PATH_INFO: `/v3/endpoints` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:46:53.008113 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80307672-e7a0-45fd-8cf6-98cd9ba5dffe None admin] RBAC: Adding query filter params (interface=public, service_id=280f6d6ec4fb424ca4142b4db17cbd1d, region_id=RegionOne) {{(pid=101893) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:46:53.009405 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80307672-e7a0-45fd-8cf6-98cd9ba5dffe None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:46:53.009782 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80307672-e7a0-45fd-8cf6-98cd9ba5dffe None admin] RBAC: Authorization granted {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:46:53.014678 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 657/1300] 10.222.0.84 () {56 vars in 1251 bytes} [Wed May 25 14:46:52 2022] GET /identity/v3/endpoints?service_id=280f6d6ec4fb424ca4142b4db17cbd1d&interface=public®ion_id=RegionOne => generated 194 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:46:53.020313 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9658d9c9-fa4e-4ddd-99d0-c37369f5127b None admin] Authenticating user token {{(pid=101892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:46:53.100667 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG dbcounter [-] [101892] Writing DB stats keystone:SELECT=100 {{(pid=101892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:46:53.118571 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9658d9c9-fa4e-4ddd-99d0-c37369f5127b None admin] Validating token access rules against request {{(pid=101892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:46:53.150653 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ed33029-e99b-4523-bdb3-727240863c9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:46:53.151317 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed33029-e99b-4523-bdb3-727240863c9d None admin] REQUEST_METHOD: `GET` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:46:53.151629 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed33029-e99b-4523-bdb3-727240863c9d None admin] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:46:53.151914 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed33029-e99b-4523-bdb3-727240863c9d None admin] PATH_INFO: `/v3/services` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:46:53.152593 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ed33029-e99b-4523-bdb3-727240863c9d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:46:53.154481 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ed33029-e99b-4523-bdb3-727240863c9d None admin] RBAC: Authorization granted {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:46:53.161099 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 644/1301] 10.222.0.84 () {56 vars in 1087 bytes} [Wed May 25 14:46:53 2022] GET /identity/v3/services => generated 2191 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 25 14:46:55.342707 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a81d845-7660-4787-8c02-00644e1a6730 None None] REQUEST_METHOD: `GET` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:46:55.343273 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a81d845-7660-4787-8c02-00644e1a6730 None None] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:46:55.343273 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a81d845-7660-4787-8c02-00644e1a6730 None None] PATH_INFO: `/` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:46:55.344665 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 658/1302] 10.222.0.84 () {54 vars in 926 bytes} [Wed May 25 14:46:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 14:46:55.349848 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ff8912-513d-458d-bf2f-8febad8d17e8 None None] REQUEST_METHOD: `POST` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:46:55.350287 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ff8912-513d-458d-bf2f-8febad8d17e8 None None] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:46:55.350399 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ff8912-513d-458d-bf2f-8febad8d17e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:46:55.367894 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.auth.core [None req-51ff8912-513d-458d-bf2f-8febad8d17e8 None None] MFA Rules not processed for user `05d87e87798e429aa1c10b24391f915e`. Rule list: `[]` (Enabled: `True`). {{(pid=101892) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:46:55.369085 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.fernet_utils [None req-51ff8912-513d-458d-bf2f-8febad8d17e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=101892) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:46:55.435244 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 645/1303] 10.222.0.84 () {58 vars in 1023 bytes} [Wed May 25 14:46:55 2022] POST /identity/v3/auth/tokens => generated 2211 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 25 14:46:55.457989 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a81d845-7660-4787-8c02-00644e1a6730 None None] Authenticating user token {{(pid=101893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:46:55.553819 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG dbcounter [-] [101893] Writing DB stats keystone:SELECT=100 {{(pid=101893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:46:55.560446 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a81d845-7660-4787-8c02-00644e1a6730 None None] Validating token access rules against request {{(pid=101893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:46:55.593238 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1045c718-2dab-4ddb-b657-67f21f19a0f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:46:55.593970 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1045c718-2dab-4ddb-b657-67f21f19a0f1 None admin] REQUEST_METHOD: `GET` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:46:55.594250 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1045c718-2dab-4ddb-b657-67f21f19a0f1 None admin] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:46:55.594526 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1045c718-2dab-4ddb-b657-67f21f19a0f1 None admin] PATH_INFO: `/v3/services/placement` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:46:55.595173 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1045c718-2dab-4ddb-b657-67f21f19a0f1 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:46:55.596575 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1045c718-2dab-4ddb-b657-67f21f19a0f1 None admin] RBAC: Authorization granted {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:46:55.608692 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application [None req-1045c718-2dab-4ddb-b657-67f21f19a0f1 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. May 25 14:46:55.608692 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:46:55.608692 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 25 14:46:55.608692 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 25 14:46:55.608692 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 25 14:46:55.608692 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 25 14:46:55.608692 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 25 14:46:55.608692 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 25 14:46:55.608692 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. May 25 14:46:55.608692 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application May 25 14:46:55.608692 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 25 14:46:55.608692 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application May 25 14:46:55.608692 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:46:55.608692 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 14:46:55.608692 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 14:46:55.608692 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 14:46:55.608692 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 14:46:55.609821 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 14:46:55.609821 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 14:46:55.609821 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 14:46:55.609821 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 14:46:55.609821 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 14:46:55.609821 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 14:46:55.609821 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 25 14:46:55.609821 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return self._get_service(service_id) May 25 14:46:55.609821 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 25 14:46:55.609821 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 25 14:46:55.609821 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 14:46:55.609821 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 14:46:55.609821 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 14:46:55.609821 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 14:46:55.609821 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 14:46:55.609821 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return self.get_or_create( May 25 14:46:55.610888 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 14:46:55.610888 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application with Lock( May 25 14:46:55.610888 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 14:46:55.610888 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return self._enter() May 25 14:46:55.610888 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 14:46:55.610888 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 14:46:55.610888 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 14:46:55.610888 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application return self.creator() May 25 14:46:55.610888 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 14:46:55.610888 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application created_value = creator( May 25 14:46:55.610888 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 25 14:46:55.610888 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 25 14:46:55.610888 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. May 25 14:46:55.610888 dv-cinder-803823-9-smb devstack@keystone.service[101893]: ERROR keystone.server.flask.application May 25 14:46:55.610888 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 659/1304] 10.222.0.84 () {56 vars in 1117 bytes} [Wed May 25 14:46:55 2022] GET /identity/v3/services/placement => generated 90 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 14:46:55.616314 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ff8912-513d-458d-bf2f-8febad8d17e8 None None] Authenticating user token {{(pid=101892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:46:55.690823 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG dbcounter [-] [101892] Writing DB stats keystone:SELECT=100 {{(pid=101892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:46:55.713087 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ff8912-513d-458d-bf2f-8febad8d17e8 None None] Validating token access rules against request {{(pid=101892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:46:55.746026 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b15c66f9-3fd4-414f-8ab1-ac8af0d51a3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:46:55.746681 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15c66f9-3fd4-414f-8ab1-ac8af0d51a3d None admin] REQUEST_METHOD: `GET` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:46:55.746967 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15c66f9-3fd4-414f-8ab1-ac8af0d51a3d None admin] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:46:55.747241 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15c66f9-3fd4-414f-8ab1-ac8af0d51a3d None admin] PATH_INFO: `/v3/services` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:46:55.748010 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b15c66f9-3fd4-414f-8ab1-ac8af0d51a3d None admin] RBAC: Adding query filter params (name=placement) {{(pid=101892) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:46:55.748320 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b15c66f9-3fd4-414f-8ab1-ac8af0d51a3d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:46:55.749700 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b15c66f9-3fd4-414f-8ab1-ac8af0d51a3d None admin] RBAC: Authorization granted {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:46:55.754686 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 646/1305] 10.222.0.84 () {56 vars in 1116 bytes} [Wed May 25 14:46:55 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:46:55.760387 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1045c718-2dab-4ddb-b657-67f21f19a0f1 None admin] Authenticating user token {{(pid=101893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:46:55.862991 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1045c718-2dab-4ddb-b657-67f21f19a0f1 None admin] Validating token access rules against request {{(pid=101893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:46:55.895665 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2199fe0-c9c9-499a-9ed2-6a06653fbcff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:46:55.896311 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2199fe0-c9c9-499a-9ed2-6a06653fbcff None admin] REQUEST_METHOD: `POST` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:46:55.896590 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2199fe0-c9c9-499a-9ed2-6a06653fbcff None admin] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:46:55.896861 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2199fe0-c9c9-499a-9ed2-6a06653fbcff None admin] PATH_INFO: `/v3/endpoints` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:46:55.897603 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2199fe0-c9c9-499a-9ed2-6a06653fbcff None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:46:55.898965 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2199fe0-c9c9-499a-9ed2-6a06653fbcff None admin] RBAC: Authorization granted {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:46:56.032407 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 660/1306] 10.222.0.84 () {60 vars in 1144 bytes} [Wed May 25 14:46:55 2022] POST /identity/v3/endpoints => generated 331 bytes in 272 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 14:47:05.751702 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG dbcounter [-] [101892] Writing DB stats keystone:SELECT=30 {{(pid=101892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:47:06.027095 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG dbcounter [-] [101893] Writing DB stats keystone:SELECT=91,keystone:INSERT=1 {{(pid=101893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:53:25.502863 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d68d387c-df24-40cc-99be-c8614a4d7578 None None] REQUEST_METHOD: `GET` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:53:25.508935 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d68d387c-df24-40cc-99be-c8614a4d7578 None None] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:53:25.508935 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d68d387c-df24-40cc-99be-c8614a4d7578 None None] PATH_INFO: `/` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:53:25.508935 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 647/1307] 10.222.0.84 () {54 vars in 926 bytes} [Wed May 25 14:53:25 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 14:53:25.513197 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e4ede8-3424-4b32-9106-ff44238ea606 None None] REQUEST_METHOD: `POST` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:53:25.513579 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e4ede8-3424-4b32-9106-ff44238ea606 None None] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:53:25.513579 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e4ede8-3424-4b32-9106-ff44238ea606 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:53:25.596110 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.auth.core [None req-e7e4ede8-3424-4b32-9106-ff44238ea606 None None] MFA Rules not processed for user `05d87e87798e429aa1c10b24391f915e`. Rule list: `[]` (Enabled: `True`). {{(pid=101893) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:53:25.597328 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.fernet_utils [None req-e7e4ede8-3424-4b32-9106-ff44238ea606 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=101893) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:53:25.724018 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 661/1308] 10.222.0.84 () {58 vars in 1023 bytes} [Wed May 25 14:53:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 213 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 14:53:25.763307 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba8668b-62e4-4325-9f82-b877ca43fda3 None None] REQUEST_METHOD: `GET` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:53:25.763615 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba8668b-62e4-4325-9f82-b877ca43fda3 None None] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:53:25.763899 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba8668b-62e4-4325-9f82-b877ca43fda3 None None] PATH_INFO: `/` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:53:25.766714 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 648/1309] 10.222.0.84 () {54 vars in 964 bytes} [Wed May 25 14:53:25 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 14:53:25.774120 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147306cd-13dd-45e7-8084-66966cff5e7a None None] REQUEST_METHOD: `POST` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:53:25.774465 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147306cd-13dd-45e7-8084-66966cff5e7a None None] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:53:25.774915 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147306cd-13dd-45e7-8084-66966cff5e7a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:53:25.901432 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.auth.core [None req-147306cd-13dd-45e7-8084-66966cff5e7a None None] MFA Rules not processed for user `9ce28b25b907473588ccb87dc4acc06a`. Rule list: `[]` (Enabled: `True`). {{(pid=101893) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:53:25.903437 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.fernet_utils [None req-147306cd-13dd-45e7-8084-66966cff5e7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=101893) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:53:25.928848 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG dbcounter [-] [101893] Writing DB stats keystone:SELECT=100 {{(pid=101893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:53:26.030775 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba8668b-62e4-4325-9f82-b877ca43fda3 None None] Authenticating user token {{(pid=101892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:53:26.033444 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.fernet_utils [None req-4ba8668b-62e4-4325-9f82-b877ca43fda3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=101892) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:53:26.037592 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 662/1310] 10.222.0.84 () {58 vars in 1061 bytes} [Wed May 25 14:53:25 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 264 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 14:53:26.158382 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba8668b-62e4-4325-9f82-b877ca43fda3 None None] Validating token access rules against request {{(pid=101892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:53:26.241983 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7382edf-ab48-4a59-9768-543ed712434a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ce28b25b907473588ccb87dc4acc06a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a000829c658c4a7cab67f7b6353ba3fa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:53:26.242923 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7382edf-ab48-4a59-9768-543ed712434a service neutron] REQUEST_METHOD: `GET` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:53:26.243375 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7382edf-ab48-4a59-9768-543ed712434a service neutron] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:53:26.243842 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7382edf-ab48-4a59-9768-543ed712434a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:53:26.245635 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.fernet_utils [None req-e7382edf-ab48-4a59-9768-543ed712434a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=101892) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:53:26.307534 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG dbcounter [-] [101892] Writing DB stats keystone:SELECT=100 {{(pid=101892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:53:26.367913 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7382edf-ab48-4a59-9768-543ed712434a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:53:26.369517 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7382edf-ab48-4a59-9768-543ed712434a service neutron] RBAC: Authorization granted {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:53:26.391973 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 649/1311] 10.222.0.84 () {60 vars in 1365 bytes} [Wed May 25 14:53:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 362 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 25 14:53:28.991688 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5747a60c-5bf9-4bb6-9f58-dd2f9a6286c0 None None] REQUEST_METHOD: `GET` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:53:28.992238 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5747a60c-5bf9-4bb6-9f58-dd2f9a6286c0 None None] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:53:28.992238 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5747a60c-5bf9-4bb6-9f58-dd2f9a6286c0 None None] PATH_INFO: `/` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:53:28.993632 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 663/1312] 10.222.0.84 () {54 vars in 926 bytes} [Wed May 25 14:53:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 14:53:28.998910 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d314f15-a559-4e14-872e-3dcd998863b8 None None] REQUEST_METHOD: `POST` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:53:28.999317 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d314f15-a559-4e14-872e-3dcd998863b8 None None] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:53:29.000178 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d314f15-a559-4e14-872e-3dcd998863b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:53:29.149087 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.auth.core [None req-2d314f15-a559-4e14-872e-3dcd998863b8 None None] MFA Rules not processed for user `05d87e87798e429aa1c10b24391f915e`. Rule list: `[]` (Enabled: `True`). {{(pid=101892) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:53:29.150276 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.fernet_utils [None req-2d314f15-a559-4e14-872e-3dcd998863b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=101892) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:53:29.256385 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 650/1313] 10.222.0.84 () {58 vars in 1023 bytes} [Wed May 25 14:53:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 259 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 14:53:29.294220 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5747a60c-5bf9-4bb6-9f58-dd2f9a6286c0 None None] Authenticating user token {{(pid=101893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:53:29.295786 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.fernet_utils [None req-5747a60c-5bf9-4bb6-9f58-dd2f9a6286c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=101893) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:53:29.408212 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5747a60c-5bf9-4bb6-9f58-dd2f9a6286c0 None None] Validating token access rules against request {{(pid=101893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:53:29.480462 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG dbcounter [-] [101893] Writing DB stats keystone:SELECT=100 {{(pid=101893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:53:29.483035 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7b06307-3824-4969-83bc-a7ed51b35aa8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ce28b25b907473588ccb87dc4acc06a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a000829c658c4a7cab67f7b6353ba3fa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:53:29.483712 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b06307-3824-4969-83bc-a7ed51b35aa8 service neutron] REQUEST_METHOD: `GET` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:53:29.484570 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b06307-3824-4969-83bc-a7ed51b35aa8 service neutron] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:53:29.484848 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b06307-3824-4969-83bc-a7ed51b35aa8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:53:29.486500 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.fernet_utils [None req-f7b06307-3824-4969-83bc-a7ed51b35aa8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=101893) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:53:29.598395 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7b06307-3824-4969-83bc-a7ed51b35aa8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:53:29.599869 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7b06307-3824-4969-83bc-a7ed51b35aa8 service neutron] RBAC: Authorization granted {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:53:29.618657 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 664/1314] 10.222.0.84 () {60 vars in 1365 bytes} [Wed May 25 14:53:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 325 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 14:53:32.420751 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf4ab9a-30be-47c1-8a54-2aadb02a5f8f None None] REQUEST_METHOD: `GET` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:53:32.421859 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf4ab9a-30be-47c1-8a54-2aadb02a5f8f None None] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:53:32.421962 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf4ab9a-30be-47c1-8a54-2aadb02a5f8f None None] PATH_INFO: `/` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:53:32.423265 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 651/1315] 10.222.0.84 () {54 vars in 926 bytes} [Wed May 25 14:53:32 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 14:53:32.428492 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af66948e-30f7-47b7-aa5a-caee4b5881b2 None None] REQUEST_METHOD: `POST` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:53:32.428913 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af66948e-30f7-47b7-aa5a-caee4b5881b2 None None] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:53:32.429047 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af66948e-30f7-47b7-aa5a-caee4b5881b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:53:32.497428 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.auth.core [None req-af66948e-30f7-47b7-aa5a-caee4b5881b2 None None] MFA Rules not processed for user `376a0503e64e47c795f924714268e715`. Rule list: `[]` (Enabled: `True`). {{(pid=101893) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:53:32.498661 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.fernet_utils [None req-af66948e-30f7-47b7-aa5a-caee4b5881b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=101893) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:53:32.550824 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG dbcounter [-] [101893] Writing DB stats keystone:SELECT=100 {{(pid=101893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:53:32.594253 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 665/1316] 10.222.0.84 () {58 vars in 1023 bytes} [Wed May 25 14:53:32 2022] POST /identity/v3/auth/tokens => generated 3233 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 25 14:53:32.633867 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faf4ab9a-30be-47c1-8a54-2aadb02a5f8f None None] Authenticating user token {{(pid=101892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:53:32.635422 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.fernet_utils [None req-faf4ab9a-30be-47c1-8a54-2aadb02a5f8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=101892) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:53:32.645058 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG dbcounter [-] [101892] Writing DB stats keystone:SELECT=100 {{(pid=101892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:53:32.740535 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faf4ab9a-30be-47c1-8a54-2aadb02a5f8f None None] Validating token access rules against request {{(pid=101892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:53:32.811140 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6ca4d6e-2d98-4967-bc1a-4c202fd981e8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ce28b25b907473588ccb87dc4acc06a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a000829c658c4a7cab67f7b6353ba3fa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:53:32.811822 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ca4d6e-2d98-4967-bc1a-4c202fd981e8 service neutron] REQUEST_METHOD: `GET` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:53:32.812107 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ca4d6e-2d98-4967-bc1a-4c202fd981e8 service neutron] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:53:32.812384 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ca4d6e-2d98-4967-bc1a-4c202fd981e8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:53:32.814031 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.fernet_utils [None req-c6ca4d6e-2d98-4967-bc1a-4c202fd981e8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=101892) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:53:32.874713 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG dbcounter [-] [101892] Writing DB stats keystone:SELECT=100 {{(pid=101892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:53:32.919981 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6ca4d6e-2d98-4967-bc1a-4c202fd981e8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:53:32.921450 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6ca4d6e-2d98-4967-bc1a-4c202fd981e8 service neutron] RBAC: Authorization granted {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:53:32.940582 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 652/1317] 10.222.0.84 () {60 vars in 1365 bytes} [Wed May 25 14:53:32 2022] GET /identity/v3/auth/tokens => generated 3233 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 14:53:35.927128 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df1dab6-e564-4074-9543-bef4ab95d424 None None] REQUEST_METHOD: `GET` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:53:35.927703 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df1dab6-e564-4074-9543-bef4ab95d424 None None] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:53:35.927820 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df1dab6-e564-4074-9543-bef4ab95d424 None None] PATH_INFO: `/` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:53:35.929109 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 666/1318] 10.222.0.84 () {54 vars in 926 bytes} [Wed May 25 14:53:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 14:53:35.934361 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8823f6-08c2-465f-9877-be2716720cd6 None None] REQUEST_METHOD: `POST` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:53:35.934765 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8823f6-08c2-465f-9877-be2716720cd6 None None] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:53:35.934924 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8823f6-08c2-465f-9877-be2716720cd6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:53:36.000372 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.auth.core [None req-ab8823f6-08c2-465f-9877-be2716720cd6 None None] MFA Rules not processed for user `05d87e87798e429aa1c10b24391f915e`. Rule list: `[]` (Enabled: `True`). {{(pid=101892) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:53:36.001605 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.fernet_utils [None req-ab8823f6-08c2-465f-9877-be2716720cd6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=101892) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:53:36.095135 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 653/1319] 10.222.0.84 () {58 vars in 1023 bytes} [Wed May 25 14:53:35 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 14:53:36.149172 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45795227-d5e6-4f74-b96e-94792e62c2cd None None] REQUEST_METHOD: `GET` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:53:36.149459 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45795227-d5e6-4f74-b96e-94792e62c2cd None None] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:53:36.149737 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45795227-d5e6-4f74-b96e-94792e62c2cd None None] PATH_INFO: `/` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:53:36.151108 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 667/1320] 10.222.0.84 () {54 vars in 964 bytes} [Wed May 25 14:53:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 14:53:36.157025 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95015ef1-3911-477d-80a5-b9f1292cf997 None None] REQUEST_METHOD: `POST` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:53:36.157316 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95015ef1-3911-477d-80a5-b9f1292cf997 None None] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:53:36.157593 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95015ef1-3911-477d-80a5-b9f1292cf997 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:53:36.177797 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG dbcounter [-] [101892] Writing DB stats keystone:SELECT=100 {{(pid=101892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:53:36.230593 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.auth.core [None req-95015ef1-3911-477d-80a5-b9f1292cf997 None None] MFA Rules not processed for user `9ce28b25b907473588ccb87dc4acc06a`. Rule list: `[]` (Enabled: `True`). {{(pid=101892) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:53:36.231821 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.fernet_utils [None req-95015ef1-3911-477d-80a5-b9f1292cf997 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=101892) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:53:36.305341 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 654/1321] 10.222.0.84 () {58 vars in 1061 bytes} [Wed May 25 14:53:36 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 25 14:53:36.314674 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45795227-d5e6-4f74-b96e-94792e62c2cd None None] Authenticating user token {{(pid=101893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:53:36.316207 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.fernet_utils [None req-45795227-d5e6-4f74-b96e-94792e62c2cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=101893) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:53:36.417003 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45795227-d5e6-4f74-b96e-94792e62c2cd None None] Validating token access rules against request {{(pid=101893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:53:36.488450 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ab9631-e59f-4b8e-a4ba-d8d9afb90814 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ce28b25b907473588ccb87dc4acc06a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a000829c658c4a7cab67f7b6353ba3fa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:53:36.489026 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ab9631-e59f-4b8e-a4ba-d8d9afb90814 service neutron] REQUEST_METHOD: `GET` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:53:36.489311 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ab9631-e59f-4b8e-a4ba-d8d9afb90814 service neutron] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:53:36.489589 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ab9631-e59f-4b8e-a4ba-d8d9afb90814 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:53:36.491206 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.fernet_utils [None req-02ab9631-e59f-4b8e-a4ba-d8d9afb90814 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=101893) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:53:36.498525 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG dbcounter [-] [101893] Writing DB stats keystone:SELECT=100 {{(pid=101893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:53:36.598957 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02ab9631-e59f-4b8e-a4ba-d8d9afb90814 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:53:36.600434 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02ab9631-e59f-4b8e-a4ba-d8d9afb90814 service neutron] RBAC: Authorization granted {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:53:36.618794 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 668/1322] 10.222.0.84 () {60 vars in 1365 bytes} [Wed May 25 14:53:36 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 305 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 14:53:40.184514 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef19da0-bf83-421a-b1ca-f3d126e072da None None] REQUEST_METHOD: `GET` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:53:40.185083 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef19da0-bf83-421a-b1ca-f3d126e072da None None] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:53:40.185083 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef19da0-bf83-421a-b1ca-f3d126e072da None None] PATH_INFO: `/` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:53:40.186944 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 655/1323] 10.222.0.84 () {54 vars in 926 bytes} [Wed May 25 14:53:40 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 14:53:40.192475 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab2c027-4371-4ea0-bcb1-327696cf7a4f None None] REQUEST_METHOD: `POST` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:53:40.192884 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab2c027-4371-4ea0-bcb1-327696cf7a4f None None] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:53:40.193037 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab2c027-4371-4ea0-bcb1-327696cf7a4f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:53:40.257893 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.auth.core [None req-6ab2c027-4371-4ea0-bcb1-327696cf7a4f None None] MFA Rules not processed for user `05d87e87798e429aa1c10b24391f915e`. Rule list: `[]` (Enabled: `True`). {{(pid=101893) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:53:40.259126 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.fernet_utils [None req-6ab2c027-4371-4ea0-bcb1-327696cf7a4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=101893) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:53:40.317877 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG dbcounter [-] [101893] Writing DB stats keystone:SELECT=100 {{(pid=101893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:53:40.356604 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 669/1324] 10.222.0.84 () {58 vars in 1023 bytes} [Wed May 25 14:53:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 14:53:40.392664 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bef19da0-bf83-421a-b1ca-f3d126e072da None None] Authenticating user token {{(pid=101892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:53:40.394188 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.fernet_utils [None req-bef19da0-bf83-421a-b1ca-f3d126e072da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=101892) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:53:40.499867 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bef19da0-bf83-421a-b1ca-f3d126e072da None None] Validating token access rules against request {{(pid=101892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:53:40.512196 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG dbcounter [-] [101892] Writing DB stats keystone:SELECT=100 {{(pid=101892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:53:40.579786 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74426335-6a96-4df5-9c67-f855fabf8451 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ce28b25b907473588ccb87dc4acc06a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a000829c658c4a7cab67f7b6353ba3fa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:53:40.580436 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74426335-6a96-4df5-9c67-f855fabf8451 service neutron] REQUEST_METHOD: `GET` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:53:40.580715 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74426335-6a96-4df5-9c67-f855fabf8451 service neutron] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:53:40.580988 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74426335-6a96-4df5-9c67-f855fabf8451 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:53:40.582618 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.fernet_utils [None req-74426335-6a96-4df5-9c67-f855fabf8451 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=101892) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:53:40.691022 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74426335-6a96-4df5-9c67-f855fabf8451 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:53:40.692484 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74426335-6a96-4df5-9c67-f855fabf8451 service neutron] RBAC: Authorization granted {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:53:40.710801 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 656/1325] 10.222.0.84 () {60 vars in 1365 bytes} [Wed May 25 14:53:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 319 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 14:53:42.984873 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3ac653-31ef-4b99-9800-871e8b3db1d3 None None] REQUEST_METHOD: `GET` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:53:42.985419 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3ac653-31ef-4b99-9800-871e8b3db1d3 None None] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:53:42.985419 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3ac653-31ef-4b99-9800-871e8b3db1d3 None None] PATH_INFO: `/` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:53:42.986775 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 670/1326] 10.222.0.84 () {54 vars in 926 bytes} [Wed May 25 14:53:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 14:53:42.991979 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc5ff9e-306f-4406-8273-bd6d9282e4ca None None] REQUEST_METHOD: `POST` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:53:42.992453 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc5ff9e-306f-4406-8273-bd6d9282e4ca None None] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:53:42.992550 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc5ff9e-306f-4406-8273-bd6d9282e4ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:53:43.039957 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG dbcounter [-] [101892] Writing DB stats keystone:SELECT=100 {{(pid=101892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:53:43.059031 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.auth.core [None req-8dc5ff9e-306f-4406-8273-bd6d9282e4ca None None] MFA Rules not processed for user `05d87e87798e429aa1c10b24391f915e`. Rule list: `[]` (Enabled: `True`). {{(pid=101892) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:53:43.060398 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.fernet_utils [None req-8dc5ff9e-306f-4406-8273-bd6d9282e4ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=101892) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:53:43.160919 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 657/1327] 10.222.0.84 () {58 vars in 1023 bytes} [Wed May 25 14:53:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 14:53:43.196607 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd3ac653-31ef-4b99-9800-871e8b3db1d3 None None] Authenticating user token {{(pid=101893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:53:43.198146 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.fernet_utils [None req-dd3ac653-31ef-4b99-9800-871e8b3db1d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=101893) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:53:43.305954 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd3ac653-31ef-4b99-9800-871e8b3db1d3 None None] Validating token access rules against request {{(pid=101893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:53:43.380404 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54642c2c-cb8b-4321-9fff-14205f47205e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ce28b25b907473588ccb87dc4acc06a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a000829c658c4a7cab67f7b6353ba3fa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:53:43.381057 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54642c2c-cb8b-4321-9fff-14205f47205e service neutron] REQUEST_METHOD: `GET` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:53:43.381343 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54642c2c-cb8b-4321-9fff-14205f47205e service neutron] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:53:43.381623 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54642c2c-cb8b-4321-9fff-14205f47205e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:53:43.383265 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.fernet_utils [None req-54642c2c-cb8b-4321-9fff-14205f47205e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=101893) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:53:43.400119 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG dbcounter [-] [101893] Writing DB stats keystone:SELECT=100 {{(pid=101893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:53:43.490418 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54642c2c-cb8b-4321-9fff-14205f47205e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:53:43.492008 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54642c2c-cb8b-4321-9fff-14205f47205e service neutron] RBAC: Authorization granted {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:53:43.511170 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 671/1328] 10.222.0.84 () {60 vars in 1365 bytes} [Wed May 25 14:53:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 14:53:45.778387 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04456f22-1128-41dc-bed7-f89cad3f209d None None] REQUEST_METHOD: `GET` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:53:45.778893 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04456f22-1128-41dc-bed7-f89cad3f209d None None] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:53:45.778893 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04456f22-1128-41dc-bed7-f89cad3f209d None None] PATH_INFO: `/` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:53:45.780821 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 658/1329] 10.222.0.84 () {54 vars in 926 bytes} [Wed May 25 14:53:45 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 14:53:45.785949 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0dc9eb-7905-4260-b64c-dfc764e59383 None None] REQUEST_METHOD: `POST` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:53:45.786378 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0dc9eb-7905-4260-b64c-dfc764e59383 None None] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:53:45.786514 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0dc9eb-7905-4260-b64c-dfc764e59383 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:53:45.851716 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.auth.core [None req-bc0dc9eb-7905-4260-b64c-dfc764e59383 None None] MFA Rules not processed for user `376a0503e64e47c795f924714268e715`. Rule list: `[]` (Enabled: `True`). {{(pid=101893) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:53:45.853130 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.fernet_utils [None req-bc0dc9eb-7905-4260-b64c-dfc764e59383 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=101893) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:53:45.919710 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG dbcounter [-] [101893] Writing DB stats keystone:SELECT=100 {{(pid=101893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:53:45.951097 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 672/1330] 10.222.0.84 () {58 vars in 1023 bytes} [Wed May 25 14:53:45 2022] POST /identity/v3/auth/tokens => generated 3233 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 14:53:45.988194 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04456f22-1128-41dc-bed7-f89cad3f209d None None] Authenticating user token {{(pid=101892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:53:45.989756 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.fernet_utils [None req-04456f22-1128-41dc-bed7-f89cad3f209d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=101892) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:53:46.094025 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04456f22-1128-41dc-bed7-f89cad3f209d None None] Validating token access rules against request {{(pid=101892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:53:46.113740 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG dbcounter [-] [101892] Writing DB stats keystone:SELECT=100 {{(pid=101892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:53:46.168894 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0814e2e-b4a9-46f6-90bb-911d83d56346 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ce28b25b907473588ccb87dc4acc06a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a000829c658c4a7cab67f7b6353ba3fa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:53:46.169538 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0814e2e-b4a9-46f6-90bb-911d83d56346 service neutron] REQUEST_METHOD: `GET` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:53:46.169820 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0814e2e-b4a9-46f6-90bb-911d83d56346 service neutron] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:53:46.170096 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0814e2e-b4a9-46f6-90bb-911d83d56346 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:53:46.171760 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.fernet_utils [None req-d0814e2e-b4a9-46f6-90bb-911d83d56346 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=101892) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:53:46.288249 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0814e2e-b4a9-46f6-90bb-911d83d56346 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:53:46.289719 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0814e2e-b4a9-46f6-90bb-911d83d56346 service neutron] RBAC: Authorization granted {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:53:46.309021 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 659/1331] 10.222.0.84 () {60 vars in 1365 bytes} [Wed May 25 14:53:45 2022] GET /identity/v3/auth/tokens => generated 3233 bytes in 321 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 14:53:48.910245 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa24f483-d0b6-44ae-91ec-c834415fe98c None None] REQUEST_METHOD: `GET` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:53:48.910707 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa24f483-d0b6-44ae-91ec-c834415fe98c None None] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:53:48.910871 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa24f483-d0b6-44ae-91ec-c834415fe98c None None] PATH_INFO: `/` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:53:48.912301 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 673/1332] 10.222.0.84 () {54 vars in 926 bytes} [Wed May 25 14:53:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 14:53:48.917983 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0a31d9-99ec-46d0-81bb-e23ae57cacbc None None] REQUEST_METHOD: `POST` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:53:48.918469 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0a31d9-99ec-46d0-81bb-e23ae57cacbc None None] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:53:48.918577 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0a31d9-99ec-46d0-81bb-e23ae57cacbc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:53:48.989616 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG dbcounter [-] [101892] Writing DB stats keystone:SELECT=100 {{(pid=101892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:53:48.993214 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.auth.core [None req-2e0a31d9-99ec-46d0-81bb-e23ae57cacbc None None] MFA Rules not processed for user `05d87e87798e429aa1c10b24391f915e`. Rule list: `[]` (Enabled: `True`). {{(pid=101892) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:53:48.994517 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.fernet_utils [None req-2e0a31d9-99ec-46d0-81bb-e23ae57cacbc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=101892) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:53:49.093917 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 660/1333] 10.222.0.84 () {58 vars in 1023 bytes} [Wed May 25 14:53:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 14:53:49.130516 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa24f483-d0b6-44ae-91ec-c834415fe98c None None] Authenticating user token {{(pid=101893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:53:49.132107 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.fernet_utils [None req-aa24f483-d0b6-44ae-91ec-c834415fe98c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=101893) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:53:49.242827 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa24f483-d0b6-44ae-91ec-c834415fe98c None None] Validating token access rules against request {{(pid=101893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:53:49.322745 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6383b4d5-7fc5-4a63-b0ca-df20d529706d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ce28b25b907473588ccb87dc4acc06a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a000829c658c4a7cab67f7b6353ba3fa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:53:49.323396 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6383b4d5-7fc5-4a63-b0ca-df20d529706d service neutron] REQUEST_METHOD: `GET` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:53:49.323709 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6383b4d5-7fc5-4a63-b0ca-df20d529706d service neutron] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:53:49.323983 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6383b4d5-7fc5-4a63-b0ca-df20d529706d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:53:49.325613 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.fernet_utils [None req-6383b4d5-7fc5-4a63-b0ca-df20d529706d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=101893) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:53:49.352558 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG dbcounter [-] [101893] Writing DB stats keystone:SELECT=100 {{(pid=101893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:53:49.437803 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6383b4d5-7fc5-4a63-b0ca-df20d529706d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:53:49.439280 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6383b4d5-7fc5-4a63-b0ca-df20d529706d service neutron] RBAC: Authorization granted {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:53:49.458138 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 674/1334] 10.222.0.84 () {60 vars in 1365 bytes} [Wed May 25 14:53:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 328 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 14:53:51.747064 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d85302-0e87-43f9-afc8-461f6c1e7bfb None None] REQUEST_METHOD: `GET` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:53:51.747656 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d85302-0e87-43f9-afc8-461f6c1e7bfb None None] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:53:51.747656 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d85302-0e87-43f9-afc8-461f6c1e7bfb None None] PATH_INFO: `/` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:53:51.749579 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 661/1335] 10.222.0.84 () {54 vars in 926 bytes} [Wed May 25 14:53:51 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 14:53:51.754883 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70592268-854e-4009-950a-79b3298df7b2 None None] REQUEST_METHOD: `POST` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:53:51.755287 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70592268-854e-4009-950a-79b3298df7b2 None None] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:53:51.755571 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70592268-854e-4009-950a-79b3298df7b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:53:51.820305 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.auth.core [None req-70592268-854e-4009-950a-79b3298df7b2 None None] MFA Rules not processed for user `05d87e87798e429aa1c10b24391f915e`. Rule list: `[]` (Enabled: `True`). {{(pid=101893) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:53:51.821488 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.fernet_utils [None req-70592268-854e-4009-950a-79b3298df7b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=101893) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:53:51.895214 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG dbcounter [-] [101893] Writing DB stats keystone:SELECT=100 {{(pid=101893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:53:51.917427 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 675/1336] 10.222.0.84 () {58 vars in 1023 bytes} [Wed May 25 14:53:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 25 14:53:51.956711 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d85302-0e87-43f9-afc8-461f6c1e7bfb None None] Authenticating user token {{(pid=101892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:53:51.958233 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.fernet_utils [None req-a4d85302-0e87-43f9-afc8-461f6c1e7bfb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=101892) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:53:52.067373 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d85302-0e87-43f9-afc8-461f6c1e7bfb None None] Validating token access rules against request {{(pid=101892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:53:52.095507 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG dbcounter [-] [101892] Writing DB stats keystone:SELECT=100 {{(pid=101892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:53:52.139926 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-050c0d90-4f22-4a07-bc04-12f9ba342e27 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ce28b25b907473588ccb87dc4acc06a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a000829c658c4a7cab67f7b6353ba3fa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:53:52.140565 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050c0d90-4f22-4a07-bc04-12f9ba342e27 service neutron] REQUEST_METHOD: `GET` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:53:52.140843 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050c0d90-4f22-4a07-bc04-12f9ba342e27 service neutron] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:53:52.141114 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050c0d90-4f22-4a07-bc04-12f9ba342e27 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:53:52.142722 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.fernet_utils [None req-050c0d90-4f22-4a07-bc04-12f9ba342e27 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=101892) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:53:52.250418 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-050c0d90-4f22-4a07-bc04-12f9ba342e27 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:53:52.251862 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-050c0d90-4f22-4a07-bc04-12f9ba342e27 service neutron] RBAC: Authorization granted {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:53:52.270360 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 662/1337] 10.222.0.84 () {60 vars in 1365 bytes} [Wed May 25 14:53:51 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 14:53:55.045040 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f927fe-107a-4a70-8442-57b50f69fea4 None None] REQUEST_METHOD: `GET` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:53:55.045599 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f927fe-107a-4a70-8442-57b50f69fea4 None None] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:53:55.045715 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f927fe-107a-4a70-8442-57b50f69fea4 None None] PATH_INFO: `/` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:53:55.047055 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 676/1338] 10.222.0.84 () {54 vars in 926 bytes} [Wed May 25 14:53:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 14:53:55.052569 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96e5613-a846-4e3b-acae-648c759567c7 None None] REQUEST_METHOD: `POST` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:53:55.052989 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96e5613-a846-4e3b-acae-648c759567c7 None None] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:53:55.053134 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96e5613-a846-4e3b-acae-648c759567c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:53:55.117976 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.auth.core [None req-c96e5613-a846-4e3b-acae-648c759567c7 None None] MFA Rules not processed for user `05d87e87798e429aa1c10b24391f915e`. Rule list: `[]` (Enabled: `True`). {{(pid=101892) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:53:55.119214 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.fernet_utils [None req-c96e5613-a846-4e3b-acae-648c759567c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=101892) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:53:55.128358 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG dbcounter [-] [101892] Writing DB stats keystone:SELECT=100 {{(pid=101892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:53:55.226420 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 663/1339] 10.222.0.84 () {58 vars in 1023 bytes} [Wed May 25 14:53:55 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 14:53:55.262497 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f927fe-107a-4a70-8442-57b50f69fea4 None None] Authenticating user token {{(pid=101893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:53:55.264577 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.fernet_utils [None req-c6f927fe-107a-4a70-8442-57b50f69fea4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=101893) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:53:55.369676 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f927fe-107a-4a70-8442-57b50f69fea4 None None] Validating token access rules against request {{(pid=101893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:53:55.442387 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b415a52e-cfdc-4c59-93db-c073b75bdd1c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ce28b25b907473588ccb87dc4acc06a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a000829c658c4a7cab67f7b6353ba3fa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:53:55.443025 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b415a52e-cfdc-4c59-93db-c073b75bdd1c service neutron] REQUEST_METHOD: `GET` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:53:55.443304 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b415a52e-cfdc-4c59-93db-c073b75bdd1c service neutron] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:53:55.443595 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b415a52e-cfdc-4c59-93db-c073b75bdd1c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:53:55.445213 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.fernet_utils [None req-b415a52e-cfdc-4c59-93db-c073b75bdd1c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=101893) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:53:55.482168 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG dbcounter [-] [101893] Writing DB stats keystone:SELECT=100 {{(pid=101893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:53:55.557057 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b415a52e-cfdc-4c59-93db-c073b75bdd1c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:53:55.558520 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b415a52e-cfdc-4c59-93db-c073b75bdd1c service neutron] RBAC: Authorization granted {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:53:55.577657 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 677/1340] 10.222.0.84 () {60 vars in 1365 bytes} [Wed May 25 14:53:55 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 14:54:00.041482 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d5e6b6-fa17-4b85-9801-653c376fcd25 None None] REQUEST_METHOD: `GET` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:54:00.042056 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d5e6b6-fa17-4b85-9801-653c376fcd25 None None] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:54:00.042056 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d5e6b6-fa17-4b85-9801-653c376fcd25 None None] PATH_INFO: `/` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:54:00.043393 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 664/1341] 10.222.0.84 () {54 vars in 926 bytes} [Wed May 25 14:54:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 14:54:00.048706 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d815599-c576-461b-b9ae-9c8b64dbee35 None None] REQUEST_METHOD: `POST` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:54:00.049172 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d815599-c576-461b-b9ae-9c8b64dbee35 None None] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:54:00.049276 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d815599-c576-461b-b9ae-9c8b64dbee35 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:54:00.125410 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.auth.core [None req-7d815599-c576-461b-b9ae-9c8b64dbee35 None None] MFA Rules not processed for user `05d87e87798e429aa1c10b24391f915e`. Rule list: `[]` (Enabled: `True`). {{(pid=101893) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:54:00.126625 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.fernet_utils [None req-7d815599-c576-461b-b9ae-9c8b64dbee35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=101893) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:54:00.218856 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG dbcounter [-] [101893] Writing DB stats keystone:SELECT=100 {{(pid=101893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:54:00.231498 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 678/1342] 10.222.0.84 () {58 vars in 1023 bytes} [Wed May 25 14:54:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 14:54:00.269516 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3d5e6b6-fa17-4b85-9801-653c376fcd25 None None] Authenticating user token {{(pid=101892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:54:00.271611 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.fernet_utils [None req-f3d5e6b6-fa17-4b85-9801-653c376fcd25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=101892) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:54:00.365482 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3d5e6b6-fa17-4b85-9801-653c376fcd25 None None] Validating token access rules against request {{(pid=101892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:54:00.369134 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78aaa8f0-8324-4dc3-b7cc-8f13f0f28358 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ce28b25b907473588ccb87dc4acc06a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a000829c658c4a7cab67f7b6353ba3fa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:54:00.369787 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78aaa8f0-8324-4dc3-b7cc-8f13f0f28358 service neutron] REQUEST_METHOD: `GET` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:54:00.370074 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78aaa8f0-8324-4dc3-b7cc-8f13f0f28358 service neutron] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:54:00.370354 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78aaa8f0-8324-4dc3-b7cc-8f13f0f28358 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:54:00.380009 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78aaa8f0-8324-4dc3-b7cc-8f13f0f28358 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:54:00.381379 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78aaa8f0-8324-4dc3-b7cc-8f13f0f28358 service neutron] RBAC: Authorization granted {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:54:00.394865 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 665/1343] 10.222.0.84 () {60 vars in 1365 bytes} [Wed May 25 14:54:00 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 14:54:03.545295 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3bff64-2b95-4a91-b3d4-f23541455d61 None None] REQUEST_METHOD: `GET` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:54:03.545841 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3bff64-2b95-4a91-b3d4-f23541455d61 None None] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:54:03.545954 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3bff64-2b95-4a91-b3d4-f23541455d61 None None] PATH_INFO: `/` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:54:03.547256 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 679/1344] 10.222.0.84 () {54 vars in 926 bytes} [Wed May 25 14:54:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 14:54:03.553840 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358d8f48-effc-4a86-a3dd-7e1da404ecdf None None] REQUEST_METHOD: `POST` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:54:03.554336 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358d8f48-effc-4a86-a3dd-7e1da404ecdf None None] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:54:03.554336 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358d8f48-effc-4a86-a3dd-7e1da404ecdf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:54:03.582059 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.auth.core [None req-358d8f48-effc-4a86-a3dd-7e1da404ecdf None None] MFA Rules not processed for user `05d87e87798e429aa1c10b24391f915e`. Rule list: `[]` (Enabled: `True`). {{(pid=101892) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:54:03.583243 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.fernet_utils [None req-358d8f48-effc-4a86-a3dd-7e1da404ecdf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=101892) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:54:03.611620 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG dbcounter [-] [101892] Writing DB stats keystone:SELECT=100 {{(pid=101892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:54:03.661281 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 666/1345] 10.222.0.84 () {58 vars in 1023 bytes} [Wed May 25 14:54:03 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 14:54:03.698277 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb3bff64-2b95-4a91-b3d4-f23541455d61 None None] Authenticating user token {{(pid=101893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:54:03.700023 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.fernet_utils [None req-cb3bff64-2b95-4a91-b3d4-f23541455d61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=101893) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:54:03.713653 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb3bff64-2b95-4a91-b3d4-f23541455d61 None None] Validating token access rules against request {{(pid=101893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:54:03.717803 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee99333f-bb6f-4ac3-95ce-53561aafc400 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ce28b25b907473588ccb87dc4acc06a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a000829c658c4a7cab67f7b6353ba3fa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:54:03.718444 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee99333f-bb6f-4ac3-95ce-53561aafc400 service neutron] REQUEST_METHOD: `GET` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:54:03.718727 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee99333f-bb6f-4ac3-95ce-53561aafc400 service neutron] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:54:03.719006 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee99333f-bb6f-4ac3-95ce-53561aafc400 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:54:03.728127 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee99333f-bb6f-4ac3-95ce-53561aafc400 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:54:03.729557 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee99333f-bb6f-4ac3-95ce-53561aafc400 service neutron] RBAC: Authorization granted {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:54:03.739149 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 680/1346] 10.222.0.84 () {60 vars in 1365 bytes} [Wed May 25 14:54:03 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 14:54:08.399089 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce3412fb-59ac-492b-8033-9d2341e5d05c None None] REQUEST_METHOD: `GET` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:54:08.399674 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce3412fb-59ac-492b-8033-9d2341e5d05c None None] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:54:08.399674 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce3412fb-59ac-492b-8033-9d2341e5d05c None None] PATH_INFO: `/` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:54:08.401043 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 667/1347] 10.222.0.84 () {54 vars in 926 bytes} [Wed May 25 14:54:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 14:54:08.406994 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc5cd99-d08a-4cd7-a6e5-56e0bd01f8c5 None None] REQUEST_METHOD: `POST` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:54:08.407434 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc5cd99-d08a-4cd7-a6e5-56e0bd01f8c5 None None] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:54:08.407543 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc5cd99-d08a-4cd7-a6e5-56e0bd01f8c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:54:08.425788 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.auth.core [None req-ccc5cd99-d08a-4cd7-a6e5-56e0bd01f8c5 None None] MFA Rules not processed for user `05d87e87798e429aa1c10b24391f915e`. Rule list: `[]` (Enabled: `True`). {{(pid=101893) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:54:08.426999 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.fernet_utils [None req-ccc5cd99-d08a-4cd7-a6e5-56e0bd01f8c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=101893) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:54:08.434864 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 681/1348] 10.222.0.84 () {58 vars in 1023 bytes} [Wed May 25 14:54:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 14:54:08.472925 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce3412fb-59ac-492b-8033-9d2341e5d05c None None] Authenticating user token {{(pid=101892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:54:08.484367 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce3412fb-59ac-492b-8033-9d2341e5d05c None None] Validating token access rules against request {{(pid=101892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:54:08.487839 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd4693b1-75dc-4b30-a2ba-6bb0766bc3dd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ce28b25b907473588ccb87dc4acc06a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a000829c658c4a7cab67f7b6353ba3fa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:54:08.488472 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4693b1-75dc-4b30-a2ba-6bb0766bc3dd service neutron] REQUEST_METHOD: `GET` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:54:08.488753 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4693b1-75dc-4b30-a2ba-6bb0766bc3dd service neutron] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:54:08.489030 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4693b1-75dc-4b30-a2ba-6bb0766bc3dd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:54:08.498232 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd4693b1-75dc-4b30-a2ba-6bb0766bc3dd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:54:08.499694 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd4693b1-75dc-4b30-a2ba-6bb0766bc3dd service neutron] RBAC: Authorization granted {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:54:08.508883 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 668/1349] 10.222.0.84 () {60 vars in 1365 bytes} [Wed May 25 14:54:08 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 14:54:13.900178 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93457b2a-c06d-413e-b333-ad9edf7ccdd6 None None] REQUEST_METHOD: `GET` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:54:13.900978 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93457b2a-c06d-413e-b333-ad9edf7ccdd6 None None] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:54:13.901440 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93457b2a-c06d-413e-b333-ad9edf7ccdd6 None None] PATH_INFO: `/` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:54:13.902994 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 682/1350] 10.222.0.84 () {54 vars in 921 bytes} [Wed May 25 14:54:13 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 14:54:13.908389 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40ade45-89a9-4626-b6aa-8bf254c72591 None None] REQUEST_METHOD: `POST` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:54:13.909203 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40ade45-89a9-4626-b6aa-8bf254c72591 None None] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:54:13.909669 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40ade45-89a9-4626-b6aa-8bf254c72591 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:54:14.048445 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.auth.core [None req-d40ade45-89a9-4626-b6aa-8bf254c72591 None None] MFA Rules not processed for user `d18c4a1d92b94c0087a203db4fed22f2`. Rule list: `[]` (Enabled: `True`). {{(pid=101892) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:54:14.050330 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.fernet_utils [None req-d40ade45-89a9-4626-b6aa-8bf254c72591 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=101892) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:54:14.174109 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 669/1351] 10.222.0.84 () {58 vars in 1018 bytes} [Wed May 25 14:54:13 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 267 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 14:54:18.421658 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG dbcounter [-] [101893] Writing DB stats keystone:SELECT=13 {{(pid=101893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:54:18.475247 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a595959-0ad8-481e-acbb-7725fec0e4eb None None] REQUEST_METHOD: `GET` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:54:18.475698 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a595959-0ad8-481e-acbb-7725fec0e4eb None None] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:54:18.476012 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a595959-0ad8-481e-acbb-7725fec0e4eb None None] PATH_INFO: `/` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:54:18.477691 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 683/1352] 10.222.0.84 () {54 vars in 921 bytes} [Wed May 25 14:54:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 14:54:18.483238 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bfa8206-1905-455f-802f-e3e768c578d0 None None] REQUEST_METHOD: `POST` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:54:18.483772 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bfa8206-1905-455f-802f-e3e768c578d0 None None] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:54:18.484048 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bfa8206-1905-455f-802f-e3e768c578d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:54:18.502685 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.auth.core [None req-2bfa8206-1905-455f-802f-e3e768c578d0 None None] MFA Rules not processed for user `d18c4a1d92b94c0087a203db4fed22f2`. Rule list: `[]` (Enabled: `True`). {{(pid=101892) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:54:18.504070 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.fernet_utils [None req-2bfa8206-1905-455f-802f-e3e768c578d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=101892) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:54:18.513287 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 670/1353] 10.222.0.84 () {58 vars in 1018 bytes} [Wed May 25 14:54:18 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 14:54:19.881204 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30cf218-2e34-44f3-8a53-196ba14a4e2b None None] REQUEST_METHOD: `GET` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:54:19.881739 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30cf218-2e34-44f3-8a53-196ba14a4e2b None None] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:54:19.882065 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30cf218-2e34-44f3-8a53-196ba14a4e2b None None] PATH_INFO: `/` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:54:19.887249 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 684/1354] 10.222.0.84 () {54 vars in 921 bytes} [Wed May 25 14:54:19 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 14:54:19.888493 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f920d981-0ba5-47b9-a5e8-478640d1491d None None] REQUEST_METHOD: `POST` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:54:19.888921 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f920d981-0ba5-47b9-a5e8-478640d1491d None None] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:54:19.889061 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f920d981-0ba5-47b9-a5e8-478640d1491d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:54:19.907768 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.auth.core [None req-f920d981-0ba5-47b9-a5e8-478640d1491d None None] MFA Rules not processed for user `d18c4a1d92b94c0087a203db4fed22f2`. Rule list: `[]` (Enabled: `True`). {{(pid=101892) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:54:19.908968 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.fernet_utils [None req-f920d981-0ba5-47b9-a5e8-478640d1491d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=101892) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:54:19.917512 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 671/1355] 10.222.0.84 () {58 vars in 1018 bytes} [Wed May 25 14:54:19 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 25 14:54:23.960816 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a80ead-21fb-4801-be6a-c9ae26db85ae None None] REQUEST_METHOD: `GET` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:54:23.961368 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a80ead-21fb-4801-be6a-c9ae26db85ae None None] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:54:23.961368 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a80ead-21fb-4801-be6a-c9ae26db85ae None None] PATH_INFO: `/` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:54:23.962832 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 685/1356] 10.222.0.84 () {54 vars in 926 bytes} [Wed May 25 14:54:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 14:54:23.968288 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3f0ccb-6a35-49aa-9f08-4ec5d47533a1 None None] REQUEST_METHOD: `POST` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:54:23.969084 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3f0ccb-6a35-49aa-9f08-4ec5d47533a1 None None] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:54:23.969587 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3f0ccb-6a35-49aa-9f08-4ec5d47533a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:54:23.988699 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.auth.core [None req-5f3f0ccb-6a35-49aa-9f08-4ec5d47533a1 None None] MFA Rules not processed for user `05d87e87798e429aa1c10b24391f915e`. Rule list: `[]` (Enabled: `True`). {{(pid=101892) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:54:23.990169 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.fernet_utils [None req-5f3f0ccb-6a35-49aa-9f08-4ec5d47533a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=101892) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:54:23.999236 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 672/1357] 10.222.0.84 () {58 vars in 1023 bytes} [Wed May 25 14:54:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 14:54:24.054432 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634d9b11-82e7-4aac-905c-007f123abfa5 None None] REQUEST_METHOD: `GET` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:54:24.056054 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634d9b11-82e7-4aac-905c-007f123abfa5 None None] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:54:24.056982 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634d9b11-82e7-4aac-905c-007f123abfa5 None None] PATH_INFO: `/` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:54:24.060104 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 686/1358] 10.222.0.84 () {54 vars in 961 bytes} [Wed May 25 14:54:24 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 14:54:24.069085 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b096536-3ae4-44bf-9658-0c91e8d4b59d None None] REQUEST_METHOD: `POST` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:54:24.069639 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b096536-3ae4-44bf-9658-0c91e8d4b59d None None] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:54:24.070140 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b096536-3ae4-44bf-9658-0c91e8d4b59d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:54:24.117011 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG dbcounter [-] [101892] Writing DB stats keystone:SELECT=100 {{(pid=101892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:54:24.125220 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.auth.core [None req-5b096536-3ae4-44bf-9658-0c91e8d4b59d None None] MFA Rules not processed for user `2aeb182e6a5b43cfb0cc347ec847c848`. Rule list: `[]` (Enabled: `True`). {{(pid=101892) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:54:24.126510 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.fernet_utils [None req-5b096536-3ae4-44bf-9658-0c91e8d4b59d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=101892) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:54:24.223802 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 673/1359] 10.222.0.84 () {58 vars in 1058 bytes} [Wed May 25 14:54:24 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 14:54:24.230546 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-634d9b11-82e7-4aac-905c-007f123abfa5 None None] Authenticating user token {{(pid=101893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:54:24.246928 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-634d9b11-82e7-4aac-905c-007f123abfa5 None None] Validating token access rules against request {{(pid=101893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:54:24.252912 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e863c34-2d72-42be-bbc2-b215dbd09204 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2aeb182e6a5b43cfb0cc347ec847c848', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a000829c658c4a7cab67f7b6353ba3fa', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:54:24.253886 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e863c34-2d72-42be-bbc2-b215dbd09204 service nova] REQUEST_METHOD: `GET` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:54:24.254405 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e863c34-2d72-42be-bbc2-b215dbd09204 service nova] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:54:24.254891 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e863c34-2d72-42be-bbc2-b215dbd09204 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:54:24.264299 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e863c34-2d72-42be-bbc2-b215dbd09204 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:54:24.267191 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e863c34-2d72-42be-bbc2-b215dbd09204 service nova] RBAC: Authorization granted {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:54:24.277514 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 687/1360] 10.222.0.84 () {60 vars in 1365 bytes} [Wed May 25 14:54:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 14:54:26.739511 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3657372-bc26-48fd-8b08-26b62c0cbd29 None None] REQUEST_METHOD: `GET` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:54:26.740116 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3657372-bc26-48fd-8b08-26b62c0cbd29 None None] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:54:26.740116 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3657372-bc26-48fd-8b08-26b62c0cbd29 None None] PATH_INFO: `/` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:54:26.741688 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 674/1361] 10.222.0.84 () {54 vars in 926 bytes} [Wed May 25 14:54:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 14:54:26.747303 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c656a8-1856-46a1-98d2-3046f128d632 None None] REQUEST_METHOD: `POST` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:54:26.747763 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c656a8-1856-46a1-98d2-3046f128d632 None None] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:54:26.747877 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c656a8-1856-46a1-98d2-3046f128d632 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:54:26.766613 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.auth.core [None req-c3c656a8-1856-46a1-98d2-3046f128d632 None None] MFA Rules not processed for user `05d87e87798e429aa1c10b24391f915e`. Rule list: `[]` (Enabled: `True`). {{(pid=101893) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:54:26.767856 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.fernet_utils [None req-c3c656a8-1856-46a1-98d2-3046f128d632 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=101893) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:54:26.776242 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 688/1362] 10.222.0.84 () {58 vars in 1023 bytes} [Wed May 25 14:54:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 14:54:26.822179 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3657372-bc26-48fd-8b08-26b62c0cbd29 None None] Authenticating user token {{(pid=101892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:54:26.838640 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3657372-bc26-48fd-8b08-26b62c0cbd29 None None] Validating token access rules against request {{(pid=101892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:54:26.844622 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae51f2e0-29fd-4320-bfde-d2c7de18d3ea service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2aeb182e6a5b43cfb0cc347ec847c848', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a000829c658c4a7cab67f7b6353ba3fa', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:54:26.845659 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae51f2e0-29fd-4320-bfde-d2c7de18d3ea service nova] REQUEST_METHOD: `GET` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:54:26.846143 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae51f2e0-29fd-4320-bfde-d2c7de18d3ea service nova] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:54:26.846639 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae51f2e0-29fd-4320-bfde-d2c7de18d3ea service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:54:26.856882 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae51f2e0-29fd-4320-bfde-d2c7de18d3ea service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:54:26.858713 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae51f2e0-29fd-4320-bfde-d2c7de18d3ea service nova] RBAC: Authorization granted {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:54:26.870017 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 675/1363] 10.222.0.84 () {60 vars in 1365 bytes} [Wed May 25 14:54:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 14:54:29.571520 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e9f11b-7d1d-45a2-b41e-892fbf8d83d0 None None] REQUEST_METHOD: `GET` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:54:29.571983 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e9f11b-7d1d-45a2-b41e-892fbf8d83d0 None None] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:54:29.572116 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e9f11b-7d1d-45a2-b41e-892fbf8d83d0 None None] PATH_INFO: `/` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:54:29.573509 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 689/1364] 10.222.0.84 () {54 vars in 926 bytes} [Wed May 25 14:54:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 14:54:29.579457 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff51fc59-4e4b-42b1-ab9d-f1f371115051 None None] REQUEST_METHOD: `POST` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:54:29.580074 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff51fc59-4e4b-42b1-ab9d-f1f371115051 None None] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:54:29.580371 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff51fc59-4e4b-42b1-ab9d-f1f371115051 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:54:29.598729 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.auth.core [None req-ff51fc59-4e4b-42b1-ab9d-f1f371115051 None None] MFA Rules not processed for user `05d87e87798e429aa1c10b24391f915e`. Rule list: `[]` (Enabled: `True`). {{(pid=101892) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:54:29.600225 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.fernet_utils [None req-ff51fc59-4e4b-42b1-ab9d-f1f371115051 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=101892) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:54:29.609104 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 676/1365] 10.222.0.84 () {58 vars in 1023 bytes} [Wed May 25 14:54:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 14:54:29.662779 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85db32e-4eef-428f-9f90-6625086cdaa7 None None] REQUEST_METHOD: `GET` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:54:29.663071 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85db32e-4eef-428f-9f90-6625086cdaa7 None None] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:54:29.663359 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85db32e-4eef-428f-9f90-6625086cdaa7 None None] PATH_INFO: `/` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:54:29.665091 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 690/1366] 10.222.0.84 () {54 vars in 961 bytes} [Wed May 25 14:54:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 14:54:29.670676 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f8ad16-d3e6-4a9b-8505-e2fffb5fba49 None None] REQUEST_METHOD: `POST` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:54:29.676206 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f8ad16-d3e6-4a9b-8505-e2fffb5fba49 None None] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:54:29.676206 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f8ad16-d3e6-4a9b-8505-e2fffb5fba49 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:54:29.692831 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.auth.core [None req-39f8ad16-d3e6-4a9b-8505-e2fffb5fba49 None None] MFA Rules not processed for user `2aeb182e6a5b43cfb0cc347ec847c848`. Rule list: `[]` (Enabled: `True`). {{(pid=101892) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:54:29.694067 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.fernet_utils [None req-39f8ad16-d3e6-4a9b-8505-e2fffb5fba49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=101892) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:54:29.703923 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 677/1367] 10.222.0.84 () {58 vars in 1058 bytes} [Wed May 25 14:54:29 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 14:54:29.711779 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c85db32e-4eef-428f-9f90-6625086cdaa7 None None] Authenticating user token {{(pid=101893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:54:29.726411 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c85db32e-4eef-428f-9f90-6625086cdaa7 None None] Validating token access rules against request {{(pid=101893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:54:29.731854 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ff388ff-940f-4363-a663-12d9d5d8224c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2aeb182e6a5b43cfb0cc347ec847c848', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a000829c658c4a7cab67f7b6353ba3fa', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:54:29.732493 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff388ff-940f-4363-a663-12d9d5d8224c service nova] REQUEST_METHOD: `GET` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:54:29.732778 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff388ff-940f-4363-a663-12d9d5d8224c service nova] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:54:29.733057 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff388ff-940f-4363-a663-12d9d5d8224c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:54:29.741348 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ff388ff-940f-4363-a663-12d9d5d8224c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:54:29.742966 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ff388ff-940f-4363-a663-12d9d5d8224c service nova] RBAC: Authorization granted {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:54:29.753151 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 691/1368] 10.222.0.84 () {60 vars in 1365 bytes} [Wed May 25 14:54:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 14:54:32.141772 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce3f16f-6852-4670-a948-ebefc6467421 None None] REQUEST_METHOD: `GET` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:54:32.142318 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce3f16f-6852-4670-a948-ebefc6467421 None None] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:54:32.142716 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce3f16f-6852-4670-a948-ebefc6467421 None None] PATH_INFO: `/` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:54:32.144306 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 678/1369] 10.222.0.84 () {54 vars in 926 bytes} [Wed May 25 14:54:32 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 14:54:32.149679 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48b2aa7-4f3e-4f3c-b786-0c3a49bbbdc7 None None] REQUEST_METHOD: `POST` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:54:32.150117 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48b2aa7-4f3e-4f3c-b786-0c3a49bbbdc7 None None] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:54:32.150234 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48b2aa7-4f3e-4f3c-b786-0c3a49bbbdc7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:54:32.168907 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.auth.core [None req-e48b2aa7-4f3e-4f3c-b786-0c3a49bbbdc7 None None] MFA Rules not processed for user `05d87e87798e429aa1c10b24391f915e`. Rule list: `[]` (Enabled: `True`). {{(pid=101893) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:54:32.170379 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.fernet_utils [None req-e48b2aa7-4f3e-4f3c-b786-0c3a49bbbdc7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=101893) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:54:32.179717 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 692/1370] 10.222.0.84 () {58 vars in 1023 bytes} [Wed May 25 14:54:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 14:54:32.223932 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce3f16f-6852-4670-a948-ebefc6467421 None None] Authenticating user token {{(pid=101892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:54:32.241894 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce3f16f-6852-4670-a948-ebefc6467421 None None] Validating token access rules against request {{(pid=101892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:54:32.248426 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b7e429-cc9f-46d6-91a4-876ba54e06f6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2aeb182e6a5b43cfb0cc347ec847c848', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a000829c658c4a7cab67f7b6353ba3fa', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:54:32.249310 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b7e429-cc9f-46d6-91a4-876ba54e06f6 service nova] REQUEST_METHOD: `GET` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:54:32.249665 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b7e429-cc9f-46d6-91a4-876ba54e06f6 service nova] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:54:32.250013 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b7e429-cc9f-46d6-91a4-876ba54e06f6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:54:32.259519 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8b7e429-cc9f-46d6-91a4-876ba54e06f6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:54:32.262020 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8b7e429-cc9f-46d6-91a4-876ba54e06f6 service nova] RBAC: Authorization granted {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:54:32.272800 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 679/1371] 10.222.0.84 () {60 vars in 1365 bytes} [Wed May 25 14:54:32 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 14:54:32.403384 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be2a4bf-4026-4593-896c-e3ebb571d1bb None None] REQUEST_METHOD: `GET` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:54:32.403617 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be2a4bf-4026-4593-896c-e3ebb571d1bb None None] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:54:32.403877 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be2a4bf-4026-4593-896c-e3ebb571d1bb None None] PATH_INFO: `/` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:54:32.405257 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 693/1372] 10.222.0.84 () {54 vars in 926 bytes} [Wed May 25 14:54:32 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 14:54:32.410729 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b6bf3b-04dd-44ad-b4ae-fd02c40c6503 None None] REQUEST_METHOD: `POST` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:54:32.411021 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b6bf3b-04dd-44ad-b4ae-fd02c40c6503 None None] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:54:32.411332 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b6bf3b-04dd-44ad-b4ae-fd02c40c6503 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:54:32.429884 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.auth.core [None req-a0b6bf3b-04dd-44ad-b4ae-fd02c40c6503 None None] MFA Rules not processed for user `05d87e87798e429aa1c10b24391f915e`. Rule list: `[]` (Enabled: `True`). {{(pid=101892) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:54:32.435215 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.fernet_utils [None req-a0b6bf3b-04dd-44ad-b4ae-fd02c40c6503 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=101892) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:54:32.440513 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 680/1373] 10.222.0.84 () {58 vars in 1023 bytes} [Wed May 25 14:54:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 14:54:32.761165 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6caebad1-502e-4885-911f-fbd5482bda98 None None] REQUEST_METHOD: `GET` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:54:32.761457 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6caebad1-502e-4885-911f-fbd5482bda98 None None] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:54:32.761741 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6caebad1-502e-4885-911f-fbd5482bda98 None None] PATH_INFO: `/` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:54:32.763742 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 694/1374] 10.222.0.84 () {54 vars in 963 bytes} [Wed May 25 14:54:32 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 14:54:32.770005 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e93ab17-a032-455b-add1-355f697f237a None None] REQUEST_METHOD: `POST` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:54:32.770331 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e93ab17-a032-455b-add1-355f697f237a None None] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:54:32.770699 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e93ab17-a032-455b-add1-355f697f237a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:54:32.826598 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.auth.core [None req-5e93ab17-a032-455b-add1-355f697f237a None None] MFA Rules not processed for user `e079f89a5e524ab6ad4183e4f690de07`. Rule list: `[]` (Enabled: `True`). {{(pid=101892) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:54:32.827819 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.fernet_utils [None req-5e93ab17-a032-455b-add1-355f697f237a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=101892) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:54:32.892996 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 681/1375] 10.222.0.84 () {58 vars in 1060 bytes} [Wed May 25 14:54:32 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 14:54:32.900462 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6caebad1-502e-4885-911f-fbd5482bda98 None None] Authenticating user token {{(pid=101893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:54:32.913537 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6caebad1-502e-4885-911f-fbd5482bda98 None None] Validating token access rules against request {{(pid=101893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:54:32.917944 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9f23405-8522-47c9-89bd-7247164364ac service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e079f89a5e524ab6ad4183e4f690de07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a000829c658c4a7cab67f7b6353ba3fa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:54:32.919217 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f23405-8522-47c9-89bd-7247164364ac service cinder] REQUEST_METHOD: `GET` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:54:32.919506 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f23405-8522-47c9-89bd-7247164364ac service cinder] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:54:32.919815 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f23405-8522-47c9-89bd-7247164364ac service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:54:32.936400 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9f23405-8522-47c9-89bd-7247164364ac service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:54:32.937857 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9f23405-8522-47c9-89bd-7247164364ac service cinder] RBAC: Authorization granted {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:54:32.948188 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 695/1376] 10.222.0.84 () {60 vars in 1365 bytes} [Wed May 25 14:54:32 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 14:54:34.724745 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da58320-f2a0-428c-9613-3795c88ad3aa None None] REQUEST_METHOD: `GET` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:54:34.725322 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da58320-f2a0-428c-9613-3795c88ad3aa None None] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:54:34.725322 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da58320-f2a0-428c-9613-3795c88ad3aa None None] PATH_INFO: `/` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:54:34.726854 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 682/1377] 10.222.0.84 () {54 vars in 926 bytes} [Wed May 25 14:54:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 14:54:34.732958 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ac3162-b850-4453-9f89-eeccdaa45181 None None] REQUEST_METHOD: `POST` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:54:34.733409 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ac3162-b850-4453-9f89-eeccdaa45181 None None] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:54:34.733523 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ac3162-b850-4453-9f89-eeccdaa45181 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:54:34.752331 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.auth.core [None req-41ac3162-b850-4453-9f89-eeccdaa45181 None None] MFA Rules not processed for user `05d87e87798e429aa1c10b24391f915e`. Rule list: `[]` (Enabled: `True`). {{(pid=101893) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:54:34.754083 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.fernet_utils [None req-41ac3162-b850-4453-9f89-eeccdaa45181 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=101893) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:54:34.762746 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 696/1378] 10.222.0.84 () {58 vars in 1023 bytes} [Wed May 25 14:54:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 14:54:34.808099 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da58320-f2a0-428c-9613-3795c88ad3aa None None] Authenticating user token {{(pid=101892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:54:34.822785 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da58320-f2a0-428c-9613-3795c88ad3aa None None] Validating token access rules against request {{(pid=101892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:54:34.828531 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae3132eb-0e48-40a7-bbfb-bffc4e99ff82 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2aeb182e6a5b43cfb0cc347ec847c848', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a000829c658c4a7cab67f7b6353ba3fa', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:54:34.829200 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3132eb-0e48-40a7-bbfb-bffc4e99ff82 service nova] REQUEST_METHOD: `GET` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:54:34.829488 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3132eb-0e48-40a7-bbfb-bffc4e99ff82 service nova] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:54:34.829767 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3132eb-0e48-40a7-bbfb-bffc4e99ff82 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:54:34.838898 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae3132eb-0e48-40a7-bbfb-bffc4e99ff82 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:54:34.841100 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae3132eb-0e48-40a7-bbfb-bffc4e99ff82 service nova] RBAC: Authorization granted {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:54:34.845546 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG dbcounter [-] [101892] Writing DB stats keystone:SELECT=100 {{(pid=101892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:54:34.852589 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 683/1379] 10.222.0.84 () {60 vars in 1365 bytes} [Wed May 25 14:54:34 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 14:54:37.256854 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400af2e7-69b9-4474-8108-392944bbc767 None None] REQUEST_METHOD: `GET` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:54:37.257395 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400af2e7-69b9-4474-8108-392944bbc767 None None] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:54:37.257395 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400af2e7-69b9-4474-8108-392944bbc767 None None] PATH_INFO: `/` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:54:37.258837 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 697/1380] 10.222.0.84 () {54 vars in 926 bytes} [Wed May 25 14:54:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 14:54:37.264708 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a340c8-779d-4092-95c7-adac634928eb None None] REQUEST_METHOD: `POST` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:54:37.265141 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a340c8-779d-4092-95c7-adac634928eb None None] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:54:37.265447 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a340c8-779d-4092-95c7-adac634928eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:54:37.284310 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.auth.core [None req-d6a340c8-779d-4092-95c7-adac634928eb None None] MFA Rules not processed for user `05d87e87798e429aa1c10b24391f915e`. Rule list: `[]` (Enabled: `True`). {{(pid=101892) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:54:37.285638 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.fernet_utils [None req-d6a340c8-779d-4092-95c7-adac634928eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=101892) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:54:37.294567 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 684/1381] 10.222.0.84 () {58 vars in 1023 bytes} [Wed May 25 14:54:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 14:54:37.340978 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-400af2e7-69b9-4474-8108-392944bbc767 None None] Authenticating user token {{(pid=101893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:54:37.357630 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-400af2e7-69b9-4474-8108-392944bbc767 None None] Validating token access rules against request {{(pid=101893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:54:37.366319 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fd46183-9f24-4207-b50d-92639268bd14 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2aeb182e6a5b43cfb0cc347ec847c848', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a000829c658c4a7cab67f7b6353ba3fa', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:54:37.367479 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd46183-9f24-4207-b50d-92639268bd14 service nova] REQUEST_METHOD: `GET` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:54:37.368036 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd46183-9f24-4207-b50d-92639268bd14 service nova] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:54:37.368502 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd46183-9f24-4207-b50d-92639268bd14 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:54:37.380362 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fd46183-9f24-4207-b50d-92639268bd14 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:54:37.382387 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fd46183-9f24-4207-b50d-92639268bd14 service nova] RBAC: Authorization granted {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:54:37.399445 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 698/1382] 10.222.0.84 () {60 vars in 1365 bytes} [Wed May 25 14:54:37 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 60 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 14:54:39.777990 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe380628-58b1-4904-9654-134c5a787bc7 None None] REQUEST_METHOD: `GET` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:54:39.778544 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe380628-58b1-4904-9654-134c5a787bc7 None None] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:54:39.778544 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe380628-58b1-4904-9654-134c5a787bc7 None None] PATH_INFO: `/` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:54:39.779955 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 685/1383] 10.222.0.84 () {54 vars in 926 bytes} [Wed May 25 14:54:39 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 25 14:54:39.786171 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57516f73-36e2-49ce-9028-fc7eea7b85d6 None None] REQUEST_METHOD: `POST` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:54:39.786672 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57516f73-36e2-49ce-9028-fc7eea7b85d6 None None] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:54:39.786783 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57516f73-36e2-49ce-9028-fc7eea7b85d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:54:39.807658 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.auth.core [None req-57516f73-36e2-49ce-9028-fc7eea7b85d6 None None] MFA Rules not processed for user `05d87e87798e429aa1c10b24391f915e`. Rule list: `[]` (Enabled: `True`). {{(pid=101893) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:54:39.809039 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.fernet_utils [None req-57516f73-36e2-49ce-9028-fc7eea7b85d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=101893) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:54:39.817348 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 699/1384] 10.222.0.84 () {58 vars in 1023 bytes} [Wed May 25 14:54:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 25 14:54:39.860914 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe380628-58b1-4904-9654-134c5a787bc7 None None] Authenticating user token {{(pid=101892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:54:39.876498 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe380628-58b1-4904-9654-134c5a787bc7 None None] Validating token access rules against request {{(pid=101892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:54:39.882242 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f344dfe-5a37-40f3-9625-c2cb61839d5b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2aeb182e6a5b43cfb0cc347ec847c848', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a000829c658c4a7cab67f7b6353ba3fa', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:54:39.882917 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f344dfe-5a37-40f3-9625-c2cb61839d5b service nova] REQUEST_METHOD: `GET` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:54:39.883228 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f344dfe-5a37-40f3-9625-c2cb61839d5b service nova] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:54:39.883476 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f344dfe-5a37-40f3-9625-c2cb61839d5b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:54:39.892885 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f344dfe-5a37-40f3-9625-c2cb61839d5b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:54:39.894715 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f344dfe-5a37-40f3-9625-c2cb61839d5b service nova] RBAC: Authorization granted {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:54:39.905310 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 686/1385] 10.222.0.84 () {60 vars in 1365 bytes} [Wed May 25 14:54:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 14:54:42.360576 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd128d8c-807c-4daa-834c-8b13958f9afc None None] REQUEST_METHOD: `GET` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:54:42.361128 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd128d8c-807c-4daa-834c-8b13958f9afc None None] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:54:42.361128 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd128d8c-807c-4daa-834c-8b13958f9afc None None] PATH_INFO: `/` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:54:42.362521 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 700/1386] 10.222.0.84 () {54 vars in 926 bytes} [Wed May 25 14:54:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 14:54:42.368008 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677e2f10-d99f-4a5e-8a9f-8b4656093100 None None] REQUEST_METHOD: `POST` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:54:42.368448 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677e2f10-d99f-4a5e-8a9f-8b4656093100 None None] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:54:42.368561 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677e2f10-d99f-4a5e-8a9f-8b4656093100 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:54:42.390637 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.auth.core [None req-677e2f10-d99f-4a5e-8a9f-8b4656093100 None None] MFA Rules not processed for user `05d87e87798e429aa1c10b24391f915e`. Rule list: `[]` (Enabled: `True`). {{(pid=101892) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:54:42.392166 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.fernet_utils [None req-677e2f10-d99f-4a5e-8a9f-8b4656093100 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=101892) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:54:42.401777 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 687/1387] 10.222.0.84 () {58 vars in 1023 bytes} [Wed May 25 14:54:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 14:54:42.456503 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd128d8c-807c-4daa-834c-8b13958f9afc None None] Authenticating user token {{(pid=101893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:54:42.470765 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd128d8c-807c-4daa-834c-8b13958f9afc None None] Validating token access rules against request {{(pid=101893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:54:42.476609 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a5893ac-7550-4485-9325-a284f511df74 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2aeb182e6a5b43cfb0cc347ec847c848', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a000829c658c4a7cab67f7b6353ba3fa', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:54:42.477246 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5893ac-7550-4485-9325-a284f511df74 service nova] REQUEST_METHOD: `GET` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:54:42.477574 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5893ac-7550-4485-9325-a284f511df74 service nova] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:54:42.477799 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5893ac-7550-4485-9325-a284f511df74 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:54:42.486731 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a5893ac-7550-4485-9325-a284f511df74 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:54:42.488394 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a5893ac-7550-4485-9325-a284f511df74 service nova] RBAC: Authorization granted {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:54:42.498556 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 701/1388] 10.222.0.84 () {60 vars in 1365 bytes} [Wed May 25 14:54:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 14:54:44.881875 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410ef881-5118-4b86-9162-8cc9afa98ddf None None] REQUEST_METHOD: `GET` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:54:44.882428 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410ef881-5118-4b86-9162-8cc9afa98ddf None None] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:54:44.882580 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410ef881-5118-4b86-9162-8cc9afa98ddf None None] PATH_INFO: `/` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:54:44.884545 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 688/1389] 10.222.0.84 () {54 vars in 926 bytes} [Wed May 25 14:54:44 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 14:54:44.889832 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2a87e1-0369-4af9-89ce-33f21133627d None None] REQUEST_METHOD: `POST` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:54:44.890281 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2a87e1-0369-4af9-89ce-33f21133627d None None] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:54:44.890392 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2a87e1-0369-4af9-89ce-33f21133627d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:54:44.908382 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.auth.core [None req-8d2a87e1-0369-4af9-89ce-33f21133627d None None] MFA Rules not processed for user `05d87e87798e429aa1c10b24391f915e`. Rule list: `[]` (Enabled: `True`). {{(pid=101893) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:54:44.909586 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.fernet_utils [None req-8d2a87e1-0369-4af9-89ce-33f21133627d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=101893) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:54:44.917986 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 702/1390] 10.222.0.84 () {58 vars in 1023 bytes} [Wed May 25 14:54:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 14:54:44.963065 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-410ef881-5118-4b86-9162-8cc9afa98ddf None None] Authenticating user token {{(pid=101892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:54:44.977963 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-410ef881-5118-4b86-9162-8cc9afa98ddf None None] Validating token access rules against request {{(pid=101892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:54:44.983965 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae4b4d7f-314b-45a4-aa57-ea2c611dc9a1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2aeb182e6a5b43cfb0cc347ec847c848', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a000829c658c4a7cab67f7b6353ba3fa', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:54:44.984602 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4b4d7f-314b-45a4-aa57-ea2c611dc9a1 service nova] REQUEST_METHOD: `GET` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:54:44.984883 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4b4d7f-314b-45a4-aa57-ea2c611dc9a1 service nova] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:54:44.985164 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4b4d7f-314b-45a4-aa57-ea2c611dc9a1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:54:44.993807 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae4b4d7f-314b-45a4-aa57-ea2c611dc9a1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:54:44.995441 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae4b4d7f-314b-45a4-aa57-ea2c611dc9a1 service nova] RBAC: Authorization granted {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:54:45.007077 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 689/1391] 10.222.0.84 () {60 vars in 1365 bytes} [Wed May 25 14:54:44 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 14:54:47.441024 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31758c0-e156-4d88-a60b-573473760e80 None None] REQUEST_METHOD: `GET` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:54:47.441687 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31758c0-e156-4d88-a60b-573473760e80 None None] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:54:47.441687 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31758c0-e156-4d88-a60b-573473760e80 None None] PATH_INFO: `/` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:54:47.442955 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 703/1392] 10.222.0.84 () {54 vars in 926 bytes} [Wed May 25 14:54:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 14:54:47.448477 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7398cfc1-bfd9-4103-9d1f-ff9606a25bec None None] REQUEST_METHOD: `POST` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:54:47.449455 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7398cfc1-bfd9-4103-9d1f-ff9606a25bec None None] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:54:47.449652 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7398cfc1-bfd9-4103-9d1f-ff9606a25bec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:54:47.471198 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.auth.core [None req-7398cfc1-bfd9-4103-9d1f-ff9606a25bec None None] MFA Rules not processed for user `05d87e87798e429aa1c10b24391f915e`. Rule list: `[]` (Enabled: `True`). {{(pid=101892) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:54:47.472515 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.fernet_utils [None req-7398cfc1-bfd9-4103-9d1f-ff9606a25bec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=101892) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:54:47.480805 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 690/1393] 10.222.0.84 () {58 vars in 1023 bytes} [Wed May 25 14:54:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 14:54:47.524946 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c31758c0-e156-4d88-a60b-573473760e80 None None] Authenticating user token {{(pid=101893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:54:47.539466 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c31758c0-e156-4d88-a60b-573473760e80 None None] Validating token access rules against request {{(pid=101893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:54:47.544830 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22984f58-7347-4f0d-a113-57bae1710e6b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2aeb182e6a5b43cfb0cc347ec847c848', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a000829c658c4a7cab67f7b6353ba3fa', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:54:47.545461 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22984f58-7347-4f0d-a113-57bae1710e6b service nova] REQUEST_METHOD: `GET` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:54:47.545739 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22984f58-7347-4f0d-a113-57bae1710e6b service nova] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:54:47.546009 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22984f58-7347-4f0d-a113-57bae1710e6b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:54:47.555219 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22984f58-7347-4f0d-a113-57bae1710e6b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:54:47.556859 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22984f58-7347-4f0d-a113-57bae1710e6b service nova] RBAC: Authorization granted {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:54:47.568021 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 704/1394] 10.222.0.84 () {60 vars in 1365 bytes} [Wed May 25 14:54:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 14:54:49.286214 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cfc608b-24f5-47d6-9289-d0a31cd2e17e None None] REQUEST_METHOD: `GET` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:54:49.286800 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cfc608b-24f5-47d6-9289-d0a31cd2e17e None None] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:54:49.286800 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cfc608b-24f5-47d6-9289-d0a31cd2e17e None None] PATH_INFO: `/` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:54:49.288235 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 691/1395] 10.222.0.84 () {54 vars in 926 bytes} [Wed May 25 14:54:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 14:54:49.294013 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd28b8ae-0d5e-482d-aefa-33be1b05f53a None None] REQUEST_METHOD: `POST` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:54:49.294446 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd28b8ae-0d5e-482d-aefa-33be1b05f53a None None] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:54:49.294548 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd28b8ae-0d5e-482d-aefa-33be1b05f53a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:54:49.300621 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG dbcounter [-] [101893] Writing DB stats keystone:SELECT=52 {{(pid=101893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:54:49.313113 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.auth.core [None req-cd28b8ae-0d5e-482d-aefa-33be1b05f53a None None] MFA Rules not processed for user `05d87e87798e429aa1c10b24391f915e`. Rule list: `[]` (Enabled: `True`). {{(pid=101893) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:54:49.315217 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.fernet_utils [None req-cd28b8ae-0d5e-482d-aefa-33be1b05f53a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=101893) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:54:49.322481 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 705/1396] 10.222.0.84 () {58 vars in 1023 bytes} [Wed May 25 14:54:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 14:54:49.378971 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d240f8c5-1679-43fa-bd47-13eff32549f3 None None] REQUEST_METHOD: `GET` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:54:49.379260 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d240f8c5-1679-43fa-bd47-13eff32549f3 None None] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:54:49.379542 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d240f8c5-1679-43fa-bd47-13eff32549f3 None None] PATH_INFO: `/` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:54:49.380951 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 692/1397] 10.222.0.84 () {54 vars in 962 bytes} [Wed May 25 14:54:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 14:54:49.386105 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3a8229-0ae9-409c-b630-8d9a62a4ba5b None None] REQUEST_METHOD: `POST` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:54:49.386398 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3a8229-0ae9-409c-b630-8d9a62a4ba5b None None] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:54:49.386675 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3a8229-0ae9-409c-b630-8d9a62a4ba5b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:54:49.435473 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.auth.core [None req-7b3a8229-0ae9-409c-b630-8d9a62a4ba5b None None] MFA Rules not processed for user `971542599734491aa112b815fc4cc5c2`. Rule list: `[]` (Enabled: `True`). {{(pid=101893) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:54:49.436681 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.fernet_utils [None req-7b3a8229-0ae9-409c-b630-8d9a62a4ba5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=101893) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:54:49.502530 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 706/1398] 10.222.0.84 () {58 vars in 1059 bytes} [Wed May 25 14:54:49 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 14:54:49.511300 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d240f8c5-1679-43fa-bd47-13eff32549f3 None None] Authenticating user token {{(pid=101892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:54:49.521823 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d240f8c5-1679-43fa-bd47-13eff32549f3 None None] Validating token access rules against request {{(pid=101892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:54:49.525339 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74397f7b-580e-437d-9dc1-c88edc9c428c service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '971542599734491aa112b815fc4cc5c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a000829c658c4a7cab67f7b6353ba3fa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:54:49.526100 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74397f7b-580e-437d-9dc1-c88edc9c428c service glance] REQUEST_METHOD: `GET` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:54:49.526447 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74397f7b-580e-437d-9dc1-c88edc9c428c service glance] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:54:49.526793 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74397f7b-580e-437d-9dc1-c88edc9c428c service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:54:49.535547 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74397f7b-580e-437d-9dc1-c88edc9c428c service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:54:49.537045 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74397f7b-580e-437d-9dc1-c88edc9c428c service glance] RBAC: Authorization granted {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:54:49.559685 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 693/1399] 10.222.0.84 () {60 vars in 1365 bytes} [Wed May 25 14:54:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 14:54:49.944160 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f9aed85-2978-4072-9596-2e9eef0b977c None None] REQUEST_METHOD: `GET` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:54:49.944449 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f9aed85-2978-4072-9596-2e9eef0b977c None None] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:54:49.944838 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f9aed85-2978-4072-9596-2e9eef0b977c None None] PATH_INFO: `/` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:54:49.946454 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 707/1400] 10.222.0.84 () {54 vars in 926 bytes} [Wed May 25 14:54:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 14:54:49.951866 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f09c5d4-b4e1-4315-ab6e-896786f2a6a8 None None] REQUEST_METHOD: `POST` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:54:49.952251 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f09c5d4-b4e1-4315-ab6e-896786f2a6a8 None None] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:54:49.952589 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f09c5d4-b4e1-4315-ab6e-896786f2a6a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:54:49.971517 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.auth.core [None req-0f09c5d4-b4e1-4315-ab6e-896786f2a6a8 None None] MFA Rules not processed for user `05d87e87798e429aa1c10b24391f915e`. Rule list: `[]` (Enabled: `True`). {{(pid=101892) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:54:49.972811 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.fernet_utils [None req-0f09c5d4-b4e1-4315-ab6e-896786f2a6a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=101892) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:54:49.983609 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 694/1401] 10.222.0.84 () {58 vars in 1023 bytes} [Wed May 25 14:54:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 14:54:50.026315 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f9aed85-2978-4072-9596-2e9eef0b977c None None] Authenticating user token {{(pid=101893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:54:50.041447 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f9aed85-2978-4072-9596-2e9eef0b977c None None] Validating token access rules against request {{(pid=101893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:54:50.047157 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66c3596c-04ef-4dd0-8ad1-950da19a8193 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2aeb182e6a5b43cfb0cc347ec847c848', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a000829c658c4a7cab67f7b6353ba3fa', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:54:50.047825 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c3596c-04ef-4dd0-8ad1-950da19a8193 service nova] REQUEST_METHOD: `GET` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:54:50.048114 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c3596c-04ef-4dd0-8ad1-950da19a8193 service nova] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:54:50.048392 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c3596c-04ef-4dd0-8ad1-950da19a8193 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:54:50.057359 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66c3596c-04ef-4dd0-8ad1-950da19a8193 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:54:50.058946 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66c3596c-04ef-4dd0-8ad1-950da19a8193 service nova] RBAC: Authorization granted {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:54:50.070018 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 708/1402] 10.222.0.84 () {60 vars in 1365 bytes} [Wed May 25 14:54:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 14:54:50.218800 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a04f6f-a55c-4a79-a720-ade3a9a25afd None None] REQUEST_METHOD: `POST` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:54:50.219091 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a04f6f-a55c-4a79-a720-ade3a9a25afd None None] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:54:50.219395 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a04f6f-a55c-4a79-a720-ade3a9a25afd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:54:50.273642 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.auth.core [None req-57a04f6f-a55c-4a79-a720-ade3a9a25afd None None] MFA Rules not processed for user `049a7ab3f95f460e908f79cc321176fd`. Rule list: `[]` (Enabled: `True`). {{(pid=101892) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:54:50.274456 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.fernet_utils [None req-57a04f6f-a55c-4a79-a720-ade3a9a25afd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=101892) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:54:50.346855 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 695/1403] 10.222.0.84 () {58 vars in 1009 bytes} [Wed May 25 14:54:50 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 14:54:50.391924 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975d571d-1abd-48d2-9853-22b2e811cf16 None None] REQUEST_METHOD: `GET` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:54:50.392567 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975d571d-1abd-48d2-9853-22b2e811cf16 None None] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:54:50.392567 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975d571d-1abd-48d2-9853-22b2e811cf16 None None] PATH_INFO: `/` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:54:50.393879 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 709/1404] 10.222.0.84 () {54 vars in 942 bytes} [Wed May 25 14:54:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 14:54:50.400912 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0c9c97-015e-4cdf-b2fe-350c3b7af362 None None] REQUEST_METHOD: `POST` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:54:50.401204 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0c9c97-015e-4cdf-b2fe-350c3b7af362 None None] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:54:50.401574 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0c9c97-015e-4cdf-b2fe-350c3b7af362 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:54:50.456745 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.auth.core [None req-3e0c9c97-015e-4cdf-b2fe-350c3b7af362 None None] MFA Rules not processed for user `e196f0897b98455c9e164271d7d0070a`. Rule list: `[]` (Enabled: `True`). {{(pid=101892) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:54:50.457903 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.fernet_utils [None req-3e0c9c97-015e-4cdf-b2fe-350c3b7af362 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=101892) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:54:50.493248 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG dbcounter [-] [101892] Writing DB stats keystone:SELECT=100 {{(pid=101892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:54:50.532109 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 696/1405] 10.222.0.84 () {58 vars in 1039 bytes} [Wed May 25 14:54:50 2022] POST /identity/v3/auth/tokens => generated 3294 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 14:54:50.541426 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-975d571d-1abd-48d2-9853-22b2e811cf16 None None] Authenticating user token {{(pid=101893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:54:50.559668 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-975d571d-1abd-48d2-9853-22b2e811cf16 None None] Validating token access rules against request {{(pid=101893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:54:50.564662 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e11e7d-f5e8-48c1-b2a7-ac6153b8afcb service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e196f0897b98455c9e164271d7d0070a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a000829c658c4a7cab67f7b6353ba3fa', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:54:50.565388 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e11e7d-f5e8-48c1-b2a7-ac6153b8afcb service swift] REQUEST_METHOD: `GET` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:54:50.565735 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e11e7d-f5e8-48c1-b2a7-ac6153b8afcb service swift] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:54:50.566077 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e11e7d-f5e8-48c1-b2a7-ac6153b8afcb service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:54:50.576919 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91e11e7d-f5e8-48c1-b2a7-ac6153b8afcb service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:54:50.578657 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91e11e7d-f5e8-48c1-b2a7-ac6153b8afcb service swift] RBAC: Authorization granted {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:54:50.592517 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 710/1406] 10.222.0.84 () {60 vars in 1384 bytes} [Wed May 25 14:54:50 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 25 14:54:52.497298 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a55988-4d81-4dbe-87b7-2950828b237c None None] REQUEST_METHOD: `GET` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:54:52.498462 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a55988-4d81-4dbe-87b7-2950828b237c None None] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:54:52.498946 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a55988-4d81-4dbe-87b7-2950828b237c None None] PATH_INFO: `/` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:54:52.501238 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 697/1407] 10.222.0.84 () {54 vars in 926 bytes} [Wed May 25 14:54:52 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 14:54:52.506333 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e5725f-c145-47af-b150-ceb0bc4d6c04 None None] REQUEST_METHOD: `POST` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:54:52.507387 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e5725f-c145-47af-b150-ceb0bc4d6c04 None None] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:54:52.507946 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e5725f-c145-47af-b150-ceb0bc4d6c04 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:54:52.534246 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.auth.core [None req-13e5725f-c145-47af-b150-ceb0bc4d6c04 None None] MFA Rules not processed for user `05d87e87798e429aa1c10b24391f915e`. Rule list: `[]` (Enabled: `True`). {{(pid=101893) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:54:52.535897 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.fernet_utils [None req-13e5725f-c145-47af-b150-ceb0bc4d6c04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=101893) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:54:52.565620 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 711/1408] 10.222.0.84 () {58 vars in 1023 bytes} [Wed May 25 14:54:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 60 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 14:54:52.596246 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a55988-4d81-4dbe-87b7-2950828b237c None None] Authenticating user token {{(pid=101892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:54:52.615128 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a55988-4d81-4dbe-87b7-2950828b237c None None] Validating token access rules against request {{(pid=101892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:54:52.621473 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dc4f650-5bfb-43f1-97e6-83f080287a95 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2aeb182e6a5b43cfb0cc347ec847c848', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a000829c658c4a7cab67f7b6353ba3fa', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:54:52.622589 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc4f650-5bfb-43f1-97e6-83f080287a95 service nova] REQUEST_METHOD: `GET` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:54:52.622981 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc4f650-5bfb-43f1-97e6-83f080287a95 service nova] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:54:52.623336 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc4f650-5bfb-43f1-97e6-83f080287a95 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:54:52.637829 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dc4f650-5bfb-43f1-97e6-83f080287a95 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:54:52.639576 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dc4f650-5bfb-43f1-97e6-83f080287a95 service nova] RBAC: Authorization granted {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:54:52.650532 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 698/1409] 10.222.0.84 () {60 vars in 1365 bytes} [Wed May 25 14:54:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 14:55:02.527341 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG dbcounter [-] [101893] Writing DB stats keystone:SELECT=55 {{(pid=101893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:55:02.646229 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG dbcounter [-] [101892] Writing DB stats keystone:SELECT=21 {{(pid=101892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:55:15.079297 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6082a841-be74-4771-879e-3a0a477c5f86 None None] REQUEST_METHOD: `GET` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:55:15.079978 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6082a841-be74-4771-879e-3a0a477c5f86 None None] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:55:15.079978 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6082a841-be74-4771-879e-3a0a477c5f86 None None] PATH_INFO: `/` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:55:15.081337 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 712/1410] 10.222.0.84 () {54 vars in 918 bytes} [Wed May 25 14:55:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 25 14:55:15.086502 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd22c3fc-73b7-45c5-a4c3-2fd120098085 None None] REQUEST_METHOD: `POST` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:55:15.086991 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd22c3fc-73b7-45c5-a4c3-2fd120098085 None None] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:55:15.087091 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd22c3fc-73b7-45c5-a4c3-2fd120098085 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:55:15.105583 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.auth.core [None req-bd22c3fc-73b7-45c5-a4c3-2fd120098085 None None] MFA Rules not processed for user `d18c4a1d92b94c0087a203db4fed22f2`. Rule list: `[]` (Enabled: `True`). {{(pid=101892) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:55:15.106770 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.fernet_utils [None req-bd22c3fc-73b7-45c5-a4c3-2fd120098085 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=101892) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:55:15.115146 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 699/1411] 10.222.0.84 () {58 vars in 1015 bytes} [Wed May 25 14:55:15 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 14:55:15.129563 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15e3b20-c6fc-41f4-a2d6-b51ed2301a8b None None] REQUEST_METHOD: `GET` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:55:15.129855 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15e3b20-c6fc-41f4-a2d6-b51ed2301a8b None None] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:55:15.130137 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15e3b20-c6fc-41f4-a2d6-b51ed2301a8b None None] PATH_INFO: `/` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:55:15.131550 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 713/1412] 10.222.0.84 () {54 vars in 918 bytes} [Wed May 25 14:55:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 25 14:55:15.136353 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf7b9f4-cf57-4152-b1d8-39118ba9c84e None None] REQUEST_METHOD: `POST` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:55:15.136641 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf7b9f4-cf57-4152-b1d8-39118ba9c84e None None] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:55:15.136919 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf7b9f4-cf57-4152-b1d8-39118ba9c84e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:55:15.155233 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.auth.core [None req-ddf7b9f4-cf57-4152-b1d8-39118ba9c84e None None] MFA Rules not processed for user `2aeb182e6a5b43cfb0cc347ec847c848`. Rule list: `[]` (Enabled: `True`). {{(pid=101892) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:55:15.156451 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.fernet_utils [None req-ddf7b9f4-cf57-4152-b1d8-39118ba9c84e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=101892) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:55:15.165561 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 700/1413] 10.222.0.84 () {58 vars in 1015 bytes} [Wed May 25 14:55:15 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 14:55:17.933402 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15f65dc-7d66-45a8-b1b0-6f2ece722887 None None] REQUEST_METHOD: `GET` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:55:17.934020 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15f65dc-7d66-45a8-b1b0-6f2ece722887 None None] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:55:17.934020 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15f65dc-7d66-45a8-b1b0-6f2ece722887 None None] PATH_INFO: `/` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:55:17.935324 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 714/1414] 127.0.0.1 () {54 vars in 916 bytes} [Wed May 25 14:55:17 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 14:55:17.940803 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fce56ea-8266-494b-95d5-d1754a18f674 None None] REQUEST_METHOD: `POST` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:55:17.941227 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fce56ea-8266-494b-95d5-d1754a18f674 None None] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:55:17.941411 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fce56ea-8266-494b-95d5-d1754a18f674 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:55:17.958927 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.auth.core [None req-4fce56ea-8266-494b-95d5-d1754a18f674 None None] MFA Rules not processed for user `05d87e87798e429aa1c10b24391f915e`. Rule list: `[]` (Enabled: `True`). {{(pid=101892) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:55:17.960179 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.fernet_utils [None req-4fce56ea-8266-494b-95d5-d1754a18f674 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=101892) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:55:17.967931 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 701/1415] 127.0.0.1 () {58 vars in 1013 bytes} [Wed May 25 14:55:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 14:55:18.011701 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c15f65dc-7d66-45a8-b1b0-6f2ece722887 None None] Authenticating user token {{(pid=101893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:55:18.025862 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c15f65dc-7d66-45a8-b1b0-6f2ece722887 None None] Validating token access rules against request {{(pid=101893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:55:18.031275 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1cfe0b2-0001-4b31-8ba2-d3e01eeb7a80 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2aeb182e6a5b43cfb0cc347ec847c848', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a000829c658c4a7cab67f7b6353ba3fa', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:55:18.031939 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1cfe0b2-0001-4b31-8ba2-d3e01eeb7a80 service nova] REQUEST_METHOD: `GET` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:55:18.032228 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1cfe0b2-0001-4b31-8ba2-d3e01eeb7a80 service nova] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:55:18.032506 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1cfe0b2-0001-4b31-8ba2-d3e01eeb7a80 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:55:18.041225 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1cfe0b2-0001-4b31-8ba2-d3e01eeb7a80 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:55:18.042848 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1cfe0b2-0001-4b31-8ba2-d3e01eeb7a80 service nova] RBAC: Authorization granted {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:55:18.052369 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 715/1416] 10.222.0.84 () {60 vars in 1365 bytes} [Wed May 25 14:55:18 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 14:55:19.019645 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d29e312b-5fb9-4c46-a8a5-1adf9b1807f9 None None] REQUEST_METHOD: `GET` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:55:19.020311 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d29e312b-5fb9-4c46-a8a5-1adf9b1807f9 None None] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:55:19.020311 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d29e312b-5fb9-4c46-a8a5-1adf9b1807f9 None None] PATH_INFO: `/` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:55:19.021576 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 702/1417] 127.0.0.1 () {54 vars in 901 bytes} [Wed May 25 14:55:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 14:55:19.027135 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add204cd-e877-4ff0-b82f-ecdb64446570 None None] REQUEST_METHOD: `POST` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:55:19.027594 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add204cd-e877-4ff0-b82f-ecdb64446570 None None] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:55:19.027736 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add204cd-e877-4ff0-b82f-ecdb64446570 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:55:19.046048 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.auth.core [None req-add204cd-e877-4ff0-b82f-ecdb64446570 None None] MFA Rules not processed for user `05d87e87798e429aa1c10b24391f915e`. Rule list: `[]` (Enabled: `True`). {{(pid=101893) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:55:19.047241 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.fernet_utils [None req-add204cd-e877-4ff0-b82f-ecdb64446570 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=101893) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:55:19.055082 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 716/1418] 127.0.0.1 () {58 vars in 998 bytes} [Wed May 25 14:55:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 14:55:19.233803 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d29e312b-5fb9-4c46-a8a5-1adf9b1807f9 None None] Authenticating user token {{(pid=101892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:55:19.247949 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d29e312b-5fb9-4c46-a8a5-1adf9b1807f9 None None] Validating token access rules against request {{(pid=101892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:55:19.253285 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ea21407-2893-4747-b7fc-be691f6d97bd service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2aeb182e6a5b43cfb0cc347ec847c848', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a000829c658c4a7cab67f7b6353ba3fa', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:55:19.253948 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea21407-2893-4747-b7fc-be691f6d97bd service nova] REQUEST_METHOD: `GET` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:55:19.254236 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea21407-2893-4747-b7fc-be691f6d97bd service nova] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:55:19.254515 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea21407-2893-4747-b7fc-be691f6d97bd service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:55:19.263250 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ea21407-2893-4747-b7fc-be691f6d97bd service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:55:19.264924 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ea21407-2893-4747-b7fc-be691f6d97bd service nova] RBAC: Authorization granted {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:55:19.274363 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 703/1419] 10.222.0.84 () {60 vars in 1365 bytes} [Wed May 25 14:55:19 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 14:55:20.198639 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea471bb-1e34-41c7-953c-6b010d987407 None None] REQUEST_METHOD: `GET` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:55:20.199187 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea471bb-1e34-41c7-953c-6b010d987407 None None] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:55:20.199187 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea471bb-1e34-41c7-953c-6b010d987407 None None] PATH_INFO: `/` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:55:20.200655 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 717/1420] 127.0.0.1 () {54 vars in 901 bytes} [Wed May 25 14:55:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 14:55:20.205666 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36287ecc-93af-4953-b0a5-c90df5400a0b None None] REQUEST_METHOD: `POST` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:55:20.206051 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36287ecc-93af-4953-b0a5-c90df5400a0b None None] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:55:20.206237 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36287ecc-93af-4953-b0a5-c90df5400a0b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:55:20.224008 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.auth.core [None req-36287ecc-93af-4953-b0a5-c90df5400a0b None None] MFA Rules not processed for user `05d87e87798e429aa1c10b24391f915e`. Rule list: `[]` (Enabled: `True`). {{(pid=101892) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:55:20.225190 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.fernet_utils [None req-36287ecc-93af-4953-b0a5-c90df5400a0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=101892) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:55:20.233384 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 704/1421] 127.0.0.1 () {58 vars in 998 bytes} [Wed May 25 14:55:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 14:55:20.382561 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ea471bb-1e34-41c7-953c-6b010d987407 None None] Authenticating user token {{(pid=101893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:55:20.396654 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ea471bb-1e34-41c7-953c-6b010d987407 None None] Validating token access rules against request {{(pid=101893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:55:20.402742 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd00379-3e4f-4249-bec3-ffcbbde737c4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2aeb182e6a5b43cfb0cc347ec847c848', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a000829c658c4a7cab67f7b6353ba3fa', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:55:20.403374 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd00379-3e4f-4249-bec3-ffcbbde737c4 service nova] REQUEST_METHOD: `GET` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:55:20.403698 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd00379-3e4f-4249-bec3-ffcbbde737c4 service nova] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:55:20.403980 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd00379-3e4f-4249-bec3-ffcbbde737c4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:55:20.412053 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fd00379-3e4f-4249-bec3-ffcbbde737c4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:55:20.413680 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fd00379-3e4f-4249-bec3-ffcbbde737c4 service nova] RBAC: Authorization granted {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:55:20.424154 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 718/1422] 10.222.0.84 () {60 vars in 1365 bytes} [Wed May 25 14:55:20 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 14:55:21.319968 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62cc0f3-e702-4f57-aeab-235a32c68022 None None] REQUEST_METHOD: `GET` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:55:21.320518 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62cc0f3-e702-4f57-aeab-235a32c68022 None None] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:55:21.320518 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62cc0f3-e702-4f57-aeab-235a32c68022 None None] PATH_INFO: `/` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:55:21.322477 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 705/1423] 127.0.0.1 () {54 vars in 901 bytes} [Wed May 25 14:55:21 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 14:55:21.327503 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb17259-143d-4a5c-a3e1-606f430adc19 None None] REQUEST_METHOD: `POST` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:55:21.327988 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb17259-143d-4a5c-a3e1-606f430adc19 None None] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:55:21.328096 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb17259-143d-4a5c-a3e1-606f430adc19 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:55:21.345605 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.auth.core [None req-bdb17259-143d-4a5c-a3e1-606f430adc19 None None] MFA Rules not processed for user `05d87e87798e429aa1c10b24391f915e`. Rule list: `[]` (Enabled: `True`). {{(pid=101893) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:55:21.346801 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.fernet_utils [None req-bdb17259-143d-4a5c-a3e1-606f430adc19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=101893) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:55:21.354790 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 719/1424] 127.0.0.1 () {58 vars in 998 bytes} [Wed May 25 14:55:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 14:55:21.502479 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c62cc0f3-e702-4f57-aeab-235a32c68022 None None] Authenticating user token {{(pid=101892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:55:21.517302 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c62cc0f3-e702-4f57-aeab-235a32c68022 None None] Validating token access rules against request {{(pid=101892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:55:21.531341 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d02f26b-371f-40fa-a579-3c0ee5ac0173 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2aeb182e6a5b43cfb0cc347ec847c848', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a000829c658c4a7cab67f7b6353ba3fa', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:55:21.532161 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d02f26b-371f-40fa-a579-3c0ee5ac0173 service nova] REQUEST_METHOD: `GET` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:55:21.532549 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d02f26b-371f-40fa-a579-3c0ee5ac0173 service nova] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:55:21.532915 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d02f26b-371f-40fa-a579-3c0ee5ac0173 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:55:21.542887 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d02f26b-371f-40fa-a579-3c0ee5ac0173 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:55:21.544495 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d02f26b-371f-40fa-a579-3c0ee5ac0173 service nova] RBAC: Authorization granted {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:55:21.558059 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 706/1425] 10.222.0.84 () {60 vars in 1365 bytes} [Wed May 25 14:55:21 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 14:55:22.479688 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e935a8-6710-42e4-95a7-3d24ad020852 None None] REQUEST_METHOD: `GET` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:55:22.479688 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e935a8-6710-42e4-95a7-3d24ad020852 None None] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:55:22.479688 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e935a8-6710-42e4-95a7-3d24ad020852 None None] PATH_INFO: `/` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:55:22.479688 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 720/1426] 127.0.0.1 () {54 vars in 901 bytes} [Wed May 25 14:55:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 25 14:55:22.484841 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b076f667-3d97-4767-9bf1-901bdbf11db7 None None] REQUEST_METHOD: `POST` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:55:22.485237 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b076f667-3d97-4767-9bf1-901bdbf11db7 None None] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:55:22.485404 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b076f667-3d97-4767-9bf1-901bdbf11db7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:55:22.504240 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.auth.core [None req-b076f667-3d97-4767-9bf1-901bdbf11db7 None None] MFA Rules not processed for user `05d87e87798e429aa1c10b24391f915e`. Rule list: `[]` (Enabled: `True`). {{(pid=101892) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:55:22.505450 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.fernet_utils [None req-b076f667-3d97-4767-9bf1-901bdbf11db7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=101892) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:55:22.513898 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 707/1427] 127.0.0.1 () {58 vars in 998 bytes} [Wed May 25 14:55:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 14:55:22.670145 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32e935a8-6710-42e4-95a7-3d24ad020852 None None] Authenticating user token {{(pid=101893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:55:22.685212 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32e935a8-6710-42e4-95a7-3d24ad020852 None None] Validating token access rules against request {{(pid=101893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:55:22.690450 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87951d37-5fee-42f1-aa05-2b5b4401f608 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2aeb182e6a5b43cfb0cc347ec847c848', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a000829c658c4a7cab67f7b6353ba3fa', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:55:22.691082 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87951d37-5fee-42f1-aa05-2b5b4401f608 service nova] REQUEST_METHOD: `GET` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:55:22.691362 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87951d37-5fee-42f1-aa05-2b5b4401f608 service nova] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:55:22.691672 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87951d37-5fee-42f1-aa05-2b5b4401f608 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:55:22.700186 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87951d37-5fee-42f1-aa05-2b5b4401f608 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:55:22.701749 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87951d37-5fee-42f1-aa05-2b5b4401f608 service nova] RBAC: Authorization granted {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:55:22.710857 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 721/1428] 10.222.0.84 () {60 vars in 1365 bytes} [Wed May 25 14:55:22 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 14:55:23.614304 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37cab985-cbfe-4355-bb65-a6d21e123444 None None] REQUEST_METHOD: `GET` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:55:23.614807 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37cab985-cbfe-4355-bb65-a6d21e123444 None None] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:55:23.614902 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37cab985-cbfe-4355-bb65-a6d21e123444 None None] PATH_INFO: `/` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:55:23.616238 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 708/1429] 127.0.0.1 () {54 vars in 901 bytes} [Wed May 25 14:55:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 14:55:23.621054 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e6c586-f57b-43a2-a127-d10f0db7039c None None] REQUEST_METHOD: `POST` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:55:23.621465 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e6c586-f57b-43a2-a127-d10f0db7039c None None] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:55:23.621619 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e6c586-f57b-43a2-a127-d10f0db7039c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:55:23.639335 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.auth.core [None req-17e6c586-f57b-43a2-a127-d10f0db7039c None None] MFA Rules not processed for user `05d87e87798e429aa1c10b24391f915e`. Rule list: `[]` (Enabled: `True`). {{(pid=101893) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:55:23.640566 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.fernet_utils [None req-17e6c586-f57b-43a2-a127-d10f0db7039c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=101893) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:55:23.648406 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 722/1430] 127.0.0.1 () {58 vars in 998 bytes} [Wed May 25 14:55:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 14:55:23.797118 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37cab985-cbfe-4355-bb65-a6d21e123444 None None] Authenticating user token {{(pid=101892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:55:23.811457 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37cab985-cbfe-4355-bb65-a6d21e123444 None None] Validating token access rules against request {{(pid=101892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:55:23.816726 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deb5fca4-065f-4afa-94f7-bb4e3654e203 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2aeb182e6a5b43cfb0cc347ec847c848', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a000829c658c4a7cab67f7b6353ba3fa', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:55:23.817369 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb5fca4-065f-4afa-94f7-bb4e3654e203 service nova] REQUEST_METHOD: `GET` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:55:23.817652 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb5fca4-065f-4afa-94f7-bb4e3654e203 service nova] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:55:23.817929 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb5fca4-065f-4afa-94f7-bb4e3654e203 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:55:23.826486 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deb5fca4-065f-4afa-94f7-bb4e3654e203 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:55:23.828121 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deb5fca4-065f-4afa-94f7-bb4e3654e203 service nova] RBAC: Authorization granted {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:55:23.837412 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 709/1431] 10.222.0.84 () {60 vars in 1365 bytes} [Wed May 25 14:55:23 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 14:55:24.771187 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc75b1d-b662-4b78-864a-52fea572ee7e None None] REQUEST_METHOD: `GET` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:55:24.771758 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc75b1d-b662-4b78-864a-52fea572ee7e None None] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:55:24.771758 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc75b1d-b662-4b78-864a-52fea572ee7e None None] PATH_INFO: `/` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:55:24.773074 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 723/1432] 127.0.0.1 () {54 vars in 901 bytes} [Wed May 25 14:55:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 14:55:24.778170 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de22ca01-d0ca-4c44-83d8-7d8c608c3b8b None None] REQUEST_METHOD: `POST` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:55:24.778587 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de22ca01-d0ca-4c44-83d8-7d8c608c3b8b None None] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:55:24.798098 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de22ca01-d0ca-4c44-83d8-7d8c608c3b8b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:55:24.798098 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.auth.core [None req-de22ca01-d0ca-4c44-83d8-7d8c608c3b8b None None] MFA Rules not processed for user `05d87e87798e429aa1c10b24391f915e`. Rule list: `[]` (Enabled: `True`). {{(pid=101892) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:55:24.798847 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.fernet_utils [None req-de22ca01-d0ca-4c44-83d8-7d8c608c3b8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=101892) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:55:24.806690 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 710/1433] 127.0.0.1 () {58 vars in 998 bytes} [Wed May 25 14:55:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 25 14:55:24.956626 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc75b1d-b662-4b78-864a-52fea572ee7e None None] Authenticating user token {{(pid=101893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:55:24.971684 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc75b1d-b662-4b78-864a-52fea572ee7e None None] Validating token access rules against request {{(pid=101893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:55:24.977454 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1eed617-b5f8-4045-9116-48caefa3ce95 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2aeb182e6a5b43cfb0cc347ec847c848', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a000829c658c4a7cab67f7b6353ba3fa', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:55:24.978092 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1eed617-b5f8-4045-9116-48caefa3ce95 service nova] REQUEST_METHOD: `GET` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:55:24.978377 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1eed617-b5f8-4045-9116-48caefa3ce95 service nova] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:55:24.979223 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1eed617-b5f8-4045-9116-48caefa3ce95 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:55:24.987656 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1eed617-b5f8-4045-9116-48caefa3ce95 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:55:24.989251 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1eed617-b5f8-4045-9116-48caefa3ce95 service nova] RBAC: Authorization granted {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:55:24.998653 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 724/1434] 10.222.0.84 () {60 vars in 1365 bytes} [Wed May 25 14:55:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 14:55:25.945502 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e705ced2-a638-41cb-8afd-a45585a1e44c None None] REQUEST_METHOD: `GET` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:55:25.946128 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e705ced2-a638-41cb-8afd-a45585a1e44c None None] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:55:25.946128 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e705ced2-a638-41cb-8afd-a45585a1e44c None None] PATH_INFO: `/` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:55:25.948128 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 711/1435] 127.0.0.1 () {54 vars in 901 bytes} [Wed May 25 14:55:25 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 14:55:25.953287 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79118453-08ab-44ba-b0a0-cff13a33f667 None None] REQUEST_METHOD: `POST` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:55:25.953725 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79118453-08ab-44ba-b0a0-cff13a33f667 None None] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:55:25.953844 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79118453-08ab-44ba-b0a0-cff13a33f667 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:55:25.971474 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.auth.core [None req-79118453-08ab-44ba-b0a0-cff13a33f667 None None] MFA Rules not processed for user `05d87e87798e429aa1c10b24391f915e`. Rule list: `[]` (Enabled: `True`). {{(pid=101893) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:55:25.972705 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.fernet_utils [None req-79118453-08ab-44ba-b0a0-cff13a33f667 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=101893) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:55:25.981121 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 725/1436] 127.0.0.1 () {58 vars in 998 bytes} [Wed May 25 14:55:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 14:55:26.128906 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e705ced2-a638-41cb-8afd-a45585a1e44c None None] Authenticating user token {{(pid=101892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:55:26.143042 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e705ced2-a638-41cb-8afd-a45585a1e44c None None] Validating token access rules against request {{(pid=101892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:55:26.148496 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21bc1b58-f3d6-4934-be35-a6940ea9fc50 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2aeb182e6a5b43cfb0cc347ec847c848', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a000829c658c4a7cab67f7b6353ba3fa', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:55:26.149134 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21bc1b58-f3d6-4934-be35-a6940ea9fc50 service nova] REQUEST_METHOD: `GET` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:55:26.149418 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21bc1b58-f3d6-4934-be35-a6940ea9fc50 service nova] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:55:26.149697 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21bc1b58-f3d6-4934-be35-a6940ea9fc50 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:55:26.157709 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21bc1b58-f3d6-4934-be35-a6940ea9fc50 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:55:26.159289 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21bc1b58-f3d6-4934-be35-a6940ea9fc50 service nova] RBAC: Authorization granted {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:55:26.169103 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 712/1437] 10.222.0.84 () {60 vars in 1365 bytes} [Wed May 25 14:55:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 14:55:27.093369 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f38016-9da4-48a1-87a9-cad07896be31 None None] REQUEST_METHOD: `GET` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:55:27.094001 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f38016-9da4-48a1-87a9-cad07896be31 None None] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:55:27.094001 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f38016-9da4-48a1-87a9-cad07896be31 None None] PATH_INFO: `/` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:55:27.095299 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 726/1438] 127.0.0.1 () {54 vars in 901 bytes} [Wed May 25 14:55:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 14:55:27.100807 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd542e3-9364-42a5-96b6-80a8e3bc55dc None None] REQUEST_METHOD: `POST` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:55:27.101219 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd542e3-9364-42a5-96b6-80a8e3bc55dc None None] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:55:27.101363 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd542e3-9364-42a5-96b6-80a8e3bc55dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:55:27.119015 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.auth.core [None req-0cd542e3-9364-42a5-96b6-80a8e3bc55dc None None] MFA Rules not processed for user `05d87e87798e429aa1c10b24391f915e`. Rule list: `[]` (Enabled: `True`). {{(pid=101892) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:55:27.120742 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.fernet_utils [None req-0cd542e3-9364-42a5-96b6-80a8e3bc55dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=101892) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:55:27.128488 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 713/1439] 127.0.0.1 () {58 vars in 998 bytes} [Wed May 25 14:55:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 14:55:27.275799 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57f38016-9da4-48a1-87a9-cad07896be31 None None] Authenticating user token {{(pid=101893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:55:27.290084 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57f38016-9da4-48a1-87a9-cad07896be31 None None] Validating token access rules against request {{(pid=101893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:55:27.295441 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e27823f4-2abf-42a9-afaa-424b3ba1259e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2aeb182e6a5b43cfb0cc347ec847c848', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a000829c658c4a7cab67f7b6353ba3fa', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:55:27.296124 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27823f4-2abf-42a9-afaa-424b3ba1259e service nova] REQUEST_METHOD: `GET` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:55:27.296407 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27823f4-2abf-42a9-afaa-424b3ba1259e service nova] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:55:27.296680 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27823f4-2abf-42a9-afaa-424b3ba1259e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:55:27.304623 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e27823f4-2abf-42a9-afaa-424b3ba1259e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:55:27.306210 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e27823f4-2abf-42a9-afaa-424b3ba1259e service nova] RBAC: Authorization granted {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:55:27.315956 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 727/1440] 10.222.0.84 () {60 vars in 1365 bytes} [Wed May 25 14:55:27 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 14:55:29.408003 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8fcfc9-f58a-49b4-a2a1-98d39aefcf3a None None] REQUEST_METHOD: `GET` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:55:29.408576 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8fcfc9-f58a-49b4-a2a1-98d39aefcf3a None None] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:55:29.408576 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8fcfc9-f58a-49b4-a2a1-98d39aefcf3a None None] PATH_INFO: `/` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:55:29.409900 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 714/1441] 127.0.0.1 () {54 vars in 916 bytes} [Wed May 25 14:55:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 14:55:29.415273 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-508857aa-3910-44ce-a8da-3d655d372331 None None] REQUEST_METHOD: `POST` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:55:29.415688 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-508857aa-3910-44ce-a8da-3d655d372331 None None] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:55:29.416503 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-508857aa-3910-44ce-a8da-3d655d372331 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:55:29.433783 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.auth.core [None req-508857aa-3910-44ce-a8da-3d655d372331 None None] MFA Rules not processed for user `05d87e87798e429aa1c10b24391f915e`. Rule list: `[]` (Enabled: `True`). {{(pid=101893) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:55:29.436016 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.fernet_utils [None req-508857aa-3910-44ce-a8da-3d655d372331 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=101893) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:55:29.443172 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 728/1442] 127.0.0.1 () {58 vars in 1013 bytes} [Wed May 25 14:55:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 14:55:29.481526 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec8fcfc9-f58a-49b4-a2a1-98d39aefcf3a None None] Authenticating user token {{(pid=101892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:55:29.492085 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec8fcfc9-f58a-49b4-a2a1-98d39aefcf3a None None] Validating token access rules against request {{(pid=101892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:55:29.495987 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c28a3d57-f0d0-4e71-801e-48e23f129f5b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ce28b25b907473588ccb87dc4acc06a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a000829c658c4a7cab67f7b6353ba3fa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:55:29.496716 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28a3d57-f0d0-4e71-801e-48e23f129f5b service neutron] REQUEST_METHOD: `GET` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:55:29.497010 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28a3d57-f0d0-4e71-801e-48e23f129f5b service neutron] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:55:29.497322 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28a3d57-f0d0-4e71-801e-48e23f129f5b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:55:29.506452 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c28a3d57-f0d0-4e71-801e-48e23f129f5b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:55:29.507895 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c28a3d57-f0d0-4e71-801e-48e23f129f5b service neutron] RBAC: Authorization granted {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:55:29.517125 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 715/1443] 10.222.0.84 () {60 vars in 1365 bytes} [Wed May 25 14:55:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 14:55:31.860660 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8711168-56da-4f85-be1d-55847d603754 None None] REQUEST_METHOD: `GET` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:55:31.861294 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8711168-56da-4f85-be1d-55847d603754 None None] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:55:31.861294 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8711168-56da-4f85-be1d-55847d603754 None None] PATH_INFO: `/` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:55:31.862660 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 729/1444] 127.0.0.1 () {54 vars in 916 bytes} [Wed May 25 14:55:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 14:55:31.868084 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647926df-de85-4858-a422-28bbb469d28a None None] REQUEST_METHOD: `POST` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:55:31.868488 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647926df-de85-4858-a422-28bbb469d28a None None] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:55:31.868652 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647926df-de85-4858-a422-28bbb469d28a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:55:31.887825 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.auth.core [None req-647926df-de85-4858-a422-28bbb469d28a None None] MFA Rules not processed for user `05d87e87798e429aa1c10b24391f915e`. Rule list: `[]` (Enabled: `True`). {{(pid=101892) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:55:31.889032 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.fernet_utils [None req-647926df-de85-4858-a422-28bbb469d28a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=101892) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:55:31.896818 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 716/1445] 127.0.0.1 () {58 vars in 1013 bytes} [Wed May 25 14:55:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 14:55:31.936157 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8711168-56da-4f85-be1d-55847d603754 None None] Authenticating user token {{(pid=101893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:55:31.946810 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8711168-56da-4f85-be1d-55847d603754 None None] Validating token access rules against request {{(pid=101893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:55:31.950867 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8882596-e819-47dd-896d-80673a89a4b2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ce28b25b907473588ccb87dc4acc06a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a000829c658c4a7cab67f7b6353ba3fa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:55:31.951501 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8882596-e819-47dd-896d-80673a89a4b2 service neutron] REQUEST_METHOD: `GET` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:55:31.951816 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8882596-e819-47dd-896d-80673a89a4b2 service neutron] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:55:31.952094 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8882596-e819-47dd-896d-80673a89a4b2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:55:31.960937 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8882596-e819-47dd-896d-80673a89a4b2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:55:31.962359 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8882596-e819-47dd-896d-80673a89a4b2 service neutron] RBAC: Authorization granted {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:55:31.971681 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 730/1446] 10.222.0.84 () {60 vars in 1365 bytes} [Wed May 25 14:55:31 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 14:55:34.620404 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1a6654-66a5-4e9f-ace6-14ee86914073 None None] REQUEST_METHOD: `GET` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:55:34.621016 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1a6654-66a5-4e9f-ace6-14ee86914073 None None] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:55:34.621016 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1a6654-66a5-4e9f-ace6-14ee86914073 None None] PATH_INFO: `/` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:55:34.622356 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 717/1447] 127.0.0.1 () {54 vars in 916 bytes} [Wed May 25 14:55:34 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 14:55:34.627582 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f823b855-0ebf-4428-bb33-f9ed3c05403d None None] REQUEST_METHOD: `POST` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:55:34.627997 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f823b855-0ebf-4428-bb33-f9ed3c05403d None None] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:55:34.628167 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f823b855-0ebf-4428-bb33-f9ed3c05403d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:55:34.647044 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.auth.core [None req-f823b855-0ebf-4428-bb33-f9ed3c05403d None None] MFA Rules not processed for user `05d87e87798e429aa1c10b24391f915e`. Rule list: `[]` (Enabled: `True`). {{(pid=101893) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:55:34.648340 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.fernet_utils [None req-f823b855-0ebf-4428-bb33-f9ed3c05403d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=101893) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:55:34.656643 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 731/1448] 127.0.0.1 () {58 vars in 1013 bytes} [Wed May 25 14:55:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 14:55:34.695180 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa1a6654-66a5-4e9f-ace6-14ee86914073 None None] Authenticating user token {{(pid=101892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:55:34.706015 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa1a6654-66a5-4e9f-ace6-14ee86914073 None None] Validating token access rules against request {{(pid=101892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:55:34.709519 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0db7a4fc-ce6e-4e61-bee2-ea55da4d2f16 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ce28b25b907473588ccb87dc4acc06a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a000829c658c4a7cab67f7b6353ba3fa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:55:34.710152 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db7a4fc-ce6e-4e61-bee2-ea55da4d2f16 service neutron] REQUEST_METHOD: `GET` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:55:34.710439 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db7a4fc-ce6e-4e61-bee2-ea55da4d2f16 service neutron] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:55:34.710720 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db7a4fc-ce6e-4e61-bee2-ea55da4d2f16 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:55:34.719991 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0db7a4fc-ce6e-4e61-bee2-ea55da4d2f16 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:55:34.721426 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0db7a4fc-ce6e-4e61-bee2-ea55da4d2f16 service neutron] RBAC: Authorization granted {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:55:34.731522 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 718/1449] 10.222.0.84 () {60 vars in 1365 bytes} [Wed May 25 14:55:34 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 14:55:37.065909 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b4a014-9f55-45df-a140-e74a735c400a None None] REQUEST_METHOD: `GET` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:55:37.066518 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b4a014-9f55-45df-a140-e74a735c400a None None] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:55:37.066518 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b4a014-9f55-45df-a140-e74a735c400a None None] PATH_INFO: `/` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:55:37.067971 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 732/1450] 127.0.0.1 () {54 vars in 916 bytes} [Wed May 25 14:55:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 14:55:37.074540 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942e600f-bcb5-42df-b774-54a1fd1158a0 None None] REQUEST_METHOD: `POST` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:55:37.075062 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942e600f-bcb5-42df-b774-54a1fd1158a0 None None] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:55:37.075184 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942e600f-bcb5-42df-b774-54a1fd1158a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:55:37.093185 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.auth.core [None req-942e600f-bcb5-42df-b774-54a1fd1158a0 None None] MFA Rules not processed for user `05d87e87798e429aa1c10b24391f915e`. Rule list: `[]` (Enabled: `True`). {{(pid=101892) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:55:37.094379 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.fernet_utils [None req-942e600f-bcb5-42df-b774-54a1fd1158a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=101892) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:55:37.102455 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 719/1451] 127.0.0.1 () {58 vars in 1013 bytes} [Wed May 25 14:55:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 14:55:37.141059 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b4a014-9f55-45df-a140-e74a735c400a None None] Authenticating user token {{(pid=101893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:55:37.151617 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b4a014-9f55-45df-a140-e74a735c400a None None] Validating token access rules against request {{(pid=101893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:55:37.155011 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb5e9c3a-be28-4b28-884e-161689d417cf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ce28b25b907473588ccb87dc4acc06a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a000829c658c4a7cab67f7b6353ba3fa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:55:37.155681 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5e9c3a-be28-4b28-884e-161689d417cf service neutron] REQUEST_METHOD: `GET` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:55:37.155960 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5e9c3a-be28-4b28-884e-161689d417cf service neutron] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:55:37.156229 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5e9c3a-be28-4b28-884e-161689d417cf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:55:37.164918 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb5e9c3a-be28-4b28-884e-161689d417cf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:55:37.166344 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb5e9c3a-be28-4b28-884e-161689d417cf service neutron] RBAC: Authorization granted {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:55:37.175666 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 733/1452] 10.222.0.84 () {60 vars in 1365 bytes} [Wed May 25 14:55:37 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 14:55:39.474510 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184bdb9c-9833-4e4e-ae5b-e5ad325f80f8 None None] REQUEST_METHOD: `GET` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:55:39.475157 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184bdb9c-9833-4e4e-ae5b-e5ad325f80f8 None None] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:55:39.475157 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184bdb9c-9833-4e4e-ae5b-e5ad325f80f8 None None] PATH_INFO: `/` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:55:39.476540 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 720/1453] 127.0.0.1 () {54 vars in 916 bytes} [Wed May 25 14:55:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 14:55:39.482337 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dcd99ac-6b31-4853-a8b5-44d2586b1237 None None] REQUEST_METHOD: `POST` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:55:39.482771 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dcd99ac-6b31-4853-a8b5-44d2586b1237 None None] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:55:39.482902 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dcd99ac-6b31-4853-a8b5-44d2586b1237 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:55:39.500409 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.auth.core [None req-5dcd99ac-6b31-4853-a8b5-44d2586b1237 None None] MFA Rules not processed for user `05d87e87798e429aa1c10b24391f915e`. Rule list: `[]` (Enabled: `True`). {{(pid=101893) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:55:39.501607 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.fernet_utils [None req-5dcd99ac-6b31-4853-a8b5-44d2586b1237 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=101893) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:55:39.509893 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 734/1454] 127.0.0.1 () {58 vars in 1013 bytes} [Wed May 25 14:55:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 14:55:39.553306 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-184bdb9c-9833-4e4e-ae5b-e5ad325f80f8 None None] Authenticating user token {{(pid=101892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:55:39.564585 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-184bdb9c-9833-4e4e-ae5b-e5ad325f80f8 None None] Validating token access rules against request {{(pid=101892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:55:39.568298 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaa26db1-79aa-46d7-b94c-3468de20fe99 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ce28b25b907473588ccb87dc4acc06a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a000829c658c4a7cab67f7b6353ba3fa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:55:39.568941 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa26db1-79aa-46d7-b94c-3468de20fe99 service neutron] REQUEST_METHOD: `GET` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:55:39.569225 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa26db1-79aa-46d7-b94c-3468de20fe99 service neutron] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:55:39.569503 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa26db1-79aa-46d7-b94c-3468de20fe99 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:55:39.579190 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaa26db1-79aa-46d7-b94c-3468de20fe99 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:55:39.580654 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaa26db1-79aa-46d7-b94c-3468de20fe99 service neutron] RBAC: Authorization granted {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:55:39.590689 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 721/1455] 10.222.0.84 () {60 vars in 1365 bytes} [Wed May 25 14:55:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 14:55:41.862666 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e0bd34-03b9-404d-8668-d5e23fafa2e5 None None] REQUEST_METHOD: `GET` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:55:41.863214 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e0bd34-03b9-404d-8668-d5e23fafa2e5 None None] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:55:41.863214 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e0bd34-03b9-404d-8668-d5e23fafa2e5 None None] PATH_INFO: `/` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:55:41.864664 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 735/1456] 127.0.0.1 () {54 vars in 916 bytes} [Wed May 25 14:55:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 14:55:41.870652 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67d341a-af37-41ac-88fd-a2eac2d7a701 None None] REQUEST_METHOD: `POST` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:55:41.871094 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67d341a-af37-41ac-88fd-a2eac2d7a701 None None] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:55:41.871218 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67d341a-af37-41ac-88fd-a2eac2d7a701 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:55:41.889101 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.auth.core [None req-a67d341a-af37-41ac-88fd-a2eac2d7a701 None None] MFA Rules not processed for user `05d87e87798e429aa1c10b24391f915e`. Rule list: `[]` (Enabled: `True`). {{(pid=101892) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:55:41.890289 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.fernet_utils [None req-a67d341a-af37-41ac-88fd-a2eac2d7a701 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=101892) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:55:41.897910 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 722/1457] 127.0.0.1 () {58 vars in 1013 bytes} [Wed May 25 14:55:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 14:55:41.935793 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45e0bd34-03b9-404d-8668-d5e23fafa2e5 None None] Authenticating user token {{(pid=101893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:55:41.946412 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45e0bd34-03b9-404d-8668-d5e23fafa2e5 None None] Validating token access rules against request {{(pid=101893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:55:41.949938 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef4b3d62-3702-47cc-b947-ca453c5f00eb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ce28b25b907473588ccb87dc4acc06a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a000829c658c4a7cab67f7b6353ba3fa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:55:41.950572 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef4b3d62-3702-47cc-b947-ca453c5f00eb service neutron] REQUEST_METHOD: `GET` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:55:41.950852 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef4b3d62-3702-47cc-b947-ca453c5f00eb service neutron] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:55:41.951123 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef4b3d62-3702-47cc-b947-ca453c5f00eb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:55:41.959948 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef4b3d62-3702-47cc-b947-ca453c5f00eb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:55:41.961378 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef4b3d62-3702-47cc-b947-ca453c5f00eb service neutron] RBAC: Authorization granted {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:55:41.970598 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 736/1458] 10.222.0.84 () {60 vars in 1365 bytes} [Wed May 25 14:55:41 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 14:55:44.215802 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd18887a-189d-4bcf-96d9-3d10e03b8323 None None] REQUEST_METHOD: `GET` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:55:44.216372 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd18887a-189d-4bcf-96d9-3d10e03b8323 None None] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:55:44.216372 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd18887a-189d-4bcf-96d9-3d10e03b8323 None None] PATH_INFO: `/` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:55:44.217715 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 723/1459] 127.0.0.1 () {54 vars in 916 bytes} [Wed May 25 14:55:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 14:55:44.223435 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83aafb6e-2244-454b-b403-3b1e10e9d6bd None None] REQUEST_METHOD: `POST` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:55:44.223922 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83aafb6e-2244-454b-b403-3b1e10e9d6bd None None] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:55:44.224076 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83aafb6e-2244-454b-b403-3b1e10e9d6bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:55:44.230257 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG dbcounter [-] [101893] Writing DB stats keystone:SELECT=70 {{(pid=101893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:55:44.242767 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.auth.core [None req-83aafb6e-2244-454b-b403-3b1e10e9d6bd None None] MFA Rules not processed for user `05d87e87798e429aa1c10b24391f915e`. Rule list: `[]` (Enabled: `True`). {{(pid=101893) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:55:44.246743 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.fernet_utils [None req-83aafb6e-2244-454b-b403-3b1e10e9d6bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=101893) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:55:44.252255 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 737/1460] 127.0.0.1 () {58 vars in 1013 bytes} [Wed May 25 14:55:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 14:55:44.290662 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd18887a-189d-4bcf-96d9-3d10e03b8323 None None] Authenticating user token {{(pid=101892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:55:44.296188 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG dbcounter [-] [101892] Writing DB stats keystone:SELECT=73 {{(pid=101892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:55:44.301916 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd18887a-189d-4bcf-96d9-3d10e03b8323 None None] Validating token access rules against request {{(pid=101892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:55:44.305713 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da53dcc0-ddea-4a7b-b1ed-a238cb908846 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ce28b25b907473588ccb87dc4acc06a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a000829c658c4a7cab67f7b6353ba3fa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:55:44.306355 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da53dcc0-ddea-4a7b-b1ed-a238cb908846 service neutron] REQUEST_METHOD: `GET` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:55:44.306641 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da53dcc0-ddea-4a7b-b1ed-a238cb908846 service neutron] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:55:44.306972 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da53dcc0-ddea-4a7b-b1ed-a238cb908846 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:55:44.316240 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da53dcc0-ddea-4a7b-b1ed-a238cb908846 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:55:44.317681 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da53dcc0-ddea-4a7b-b1ed-a238cb908846 service neutron] RBAC: Authorization granted {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:55:44.328043 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 724/1461] 10.222.0.84 () {60 vars in 1365 bytes} [Wed May 25 14:55:44 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 25 14:55:46.583725 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de41fd05-af9b-4260-a8b8-ca885aa3472d None None] REQUEST_METHOD: `GET` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:55:46.584212 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de41fd05-af9b-4260-a8b8-ca885aa3472d None None] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:55:46.584322 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de41fd05-af9b-4260-a8b8-ca885aa3472d None None] PATH_INFO: `/` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:55:46.585686 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 738/1462] 127.0.0.1 () {54 vars in 916 bytes} [Wed May 25 14:55:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 14:55:46.592006 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d82a642-9061-45ec-8631-2c853ccca539 None None] REQUEST_METHOD: `POST` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:55:46.592417 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d82a642-9061-45ec-8631-2c853ccca539 None None] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:55:46.592585 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d82a642-9061-45ec-8631-2c853ccca539 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:55:46.610139 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.auth.core [None req-1d82a642-9061-45ec-8631-2c853ccca539 None None] MFA Rules not processed for user `05d87e87798e429aa1c10b24391f915e`. Rule list: `[]` (Enabled: `True`). {{(pid=101892) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:55:46.611325 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.fernet_utils [None req-1d82a642-9061-45ec-8631-2c853ccca539 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=101892) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:55:46.619430 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 725/1463] 127.0.0.1 () {58 vars in 1013 bytes} [Wed May 25 14:55:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 14:55:46.655977 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de41fd05-af9b-4260-a8b8-ca885aa3472d None None] Authenticating user token {{(pid=101893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:55:46.666721 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de41fd05-af9b-4260-a8b8-ca885aa3472d None None] Validating token access rules against request {{(pid=101893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:55:46.670373 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a21e02e-1dbc-46e7-af27-a5eeba0c8d40 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ce28b25b907473588ccb87dc4acc06a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a000829c658c4a7cab67f7b6353ba3fa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:55:46.671003 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a21e02e-1dbc-46e7-af27-a5eeba0c8d40 service neutron] REQUEST_METHOD: `GET` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:55:46.671285 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a21e02e-1dbc-46e7-af27-a5eeba0c8d40 service neutron] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:55:46.671578 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a21e02e-1dbc-46e7-af27-a5eeba0c8d40 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:55:46.680396 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a21e02e-1dbc-46e7-af27-a5eeba0c8d40 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:55:46.682331 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a21e02e-1dbc-46e7-af27-a5eeba0c8d40 service neutron] RBAC: Authorization granted {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:55:46.691583 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 739/1464] 10.222.0.84 () {60 vars in 1365 bytes} [Wed May 25 14:55:46 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 14:55:48.909252 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732780f5-5c82-4155-b562-250bf19ce5d3 None None] REQUEST_METHOD: `GET` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:55:48.909849 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732780f5-5c82-4155-b562-250bf19ce5d3 None None] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:55:48.909849 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732780f5-5c82-4155-b562-250bf19ce5d3 None None] PATH_INFO: `/` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:55:48.911169 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 726/1465] 127.0.0.1 () {54 vars in 916 bytes} [Wed May 25 14:55:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 14:55:48.917418 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d1cd1fb-7756-46ee-8444-889a610818fc None None] REQUEST_METHOD: `POST` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:55:48.917835 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d1cd1fb-7756-46ee-8444-889a610818fc None None] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:55:48.917974 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d1cd1fb-7756-46ee-8444-889a610818fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:55:48.935841 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.auth.core [None req-4d1cd1fb-7756-46ee-8444-889a610818fc None None] MFA Rules not processed for user `05d87e87798e429aa1c10b24391f915e`. Rule list: `[]` (Enabled: `True`). {{(pid=101893) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:55:48.937040 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.fernet_utils [None req-4d1cd1fb-7756-46ee-8444-889a610818fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=101893) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:55:48.944764 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 740/1466] 127.0.0.1 () {58 vars in 1013 bytes} [Wed May 25 14:55:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 14:55:48.981423 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-732780f5-5c82-4155-b562-250bf19ce5d3 None None] Authenticating user token {{(pid=101892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:55:48.992012 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-732780f5-5c82-4155-b562-250bf19ce5d3 None None] Validating token access rules against request {{(pid=101892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:55:48.996070 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1acefa37-5efd-4895-9595-3b4d507e4444 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ce28b25b907473588ccb87dc4acc06a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a000829c658c4a7cab67f7b6353ba3fa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:55:48.996710 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1acefa37-5efd-4895-9595-3b4d507e4444 service neutron] REQUEST_METHOD: `GET` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:55:48.996998 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1acefa37-5efd-4895-9595-3b4d507e4444 service neutron] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:55:48.997279 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1acefa37-5efd-4895-9595-3b4d507e4444 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:55:49.006287 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1acefa37-5efd-4895-9595-3b4d507e4444 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:55:49.007741 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1acefa37-5efd-4895-9595-3b4d507e4444 service neutron] RBAC: Authorization granted {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:55:49.017077 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 727/1467] 10.222.0.84 () {60 vars in 1365 bytes} [Wed May 25 14:55:48 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 14:55:51.241672 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304f0054-beac-4803-9c2b-4ac73e93e8d5 None None] REQUEST_METHOD: `GET` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:55:51.242216 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304f0054-beac-4803-9c2b-4ac73e93e8d5 None None] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:55:51.242216 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304f0054-beac-4803-9c2b-4ac73e93e8d5 None None] PATH_INFO: `/` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:55:51.243683 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 741/1468] 127.0.0.1 () {54 vars in 916 bytes} [Wed May 25 14:55:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 14:55:51.249892 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1d7952-60bf-46d8-9054-1ff255b11ae9 None None] REQUEST_METHOD: `POST` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:55:51.250347 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1d7952-60bf-46d8-9054-1ff255b11ae9 None None] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:55:51.250456 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1d7952-60bf-46d8-9054-1ff255b11ae9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:55:51.267740 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.auth.core [None req-9a1d7952-60bf-46d8-9054-1ff255b11ae9 None None] MFA Rules not processed for user `05d87e87798e429aa1c10b24391f915e`. Rule list: `[]` (Enabled: `True`). {{(pid=101892) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:55:51.268915 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.fernet_utils [None req-9a1d7952-60bf-46d8-9054-1ff255b11ae9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=101892) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:55:51.277142 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 728/1469] 127.0.0.1 () {58 vars in 1013 bytes} [Wed May 25 14:55:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 14:55:51.313290 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-304f0054-beac-4803-9c2b-4ac73e93e8d5 None None] Authenticating user token {{(pid=101893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:55:51.324147 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-304f0054-beac-4803-9c2b-4ac73e93e8d5 None None] Validating token access rules against request {{(pid=101893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:55:51.327689 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fee4fdf-89eb-4058-915c-b219b96042d5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ce28b25b907473588ccb87dc4acc06a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a000829c658c4a7cab67f7b6353ba3fa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:55:51.328322 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fee4fdf-89eb-4058-915c-b219b96042d5 service neutron] REQUEST_METHOD: `GET` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:55:51.328609 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fee4fdf-89eb-4058-915c-b219b96042d5 service neutron] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:55:51.328889 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fee4fdf-89eb-4058-915c-b219b96042d5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:55:51.338126 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fee4fdf-89eb-4058-915c-b219b96042d5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:55:51.339582 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fee4fdf-89eb-4058-915c-b219b96042d5 service neutron] RBAC: Authorization granted {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:55:51.348961 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 742/1470] 10.222.0.84 () {60 vars in 1365 bytes} [Wed May 25 14:55:51 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 14:56:01.262689 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG dbcounter [-] [101892] Writing DB stats keystone:SELECT=17 {{(pid=101892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:56:01.344659 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG dbcounter [-] [101893] Writing DB stats keystone:SELECT=17 {{(pid=101893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:56:25.196774 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd87a088-cf39-42d9-8706-93130e946e2e None None] REQUEST_METHOD: `GET` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:56:25.197338 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd87a088-cf39-42d9-8706-93130e946e2e None None] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:56:25.197338 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd87a088-cf39-42d9-8706-93130e946e2e None None] PATH_INFO: `/` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:56:25.198630 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 729/1471] 10.222.0.84 () {54 vars in 926 bytes} [Wed May 25 14:56:25 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 14:56:25.203985 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab1cb36-274c-42c4-a64a-dba56d7bad1c None None] REQUEST_METHOD: `POST` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:56:25.204419 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab1cb36-274c-42c4-a64a-dba56d7bad1c None None] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:56:25.204551 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab1cb36-274c-42c4-a64a-dba56d7bad1c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:56:25.222211 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.auth.core [None req-eab1cb36-274c-42c4-a64a-dba56d7bad1c None None] MFA Rules not processed for user `05d87e87798e429aa1c10b24391f915e`. Rule list: `[]` (Enabled: `True`). {{(pid=101893) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:56:25.223408 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.fernet_utils [None req-eab1cb36-274c-42c4-a64a-dba56d7bad1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=101893) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:56:25.231851 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 743/1472] 10.222.0.84 () {58 vars in 1023 bytes} [Wed May 25 14:56:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 14:56:25.277806 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc8be57-a5d1-4207-ad0d-6c500a8dd94a None None] REQUEST_METHOD: `GET` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:56:25.278095 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc8be57-a5d1-4207-ad0d-6c500a8dd94a None None] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:56:25.278375 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc8be57-a5d1-4207-ad0d-6c500a8dd94a None None] PATH_INFO: `/` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:56:25.279743 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 730/1473] 10.222.0.84 () {54 vars in 962 bytes} [Wed May 25 14:56:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 14:56:25.284396 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c019ca0-4d7e-4237-a18f-96ffeed2965d None None] REQUEST_METHOD: `POST` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:56:25.284694 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c019ca0-4d7e-4237-a18f-96ffeed2965d None None] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:56:25.284979 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c019ca0-4d7e-4237-a18f-96ffeed2965d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:56:25.303130 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.auth.core [None req-1c019ca0-4d7e-4237-a18f-96ffeed2965d None None] MFA Rules not processed for user `971542599734491aa112b815fc4cc5c2`. Rule list: `[]` (Enabled: `True`). {{(pid=101893) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:56:25.304355 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.fernet_utils [None req-1c019ca0-4d7e-4237-a18f-96ffeed2965d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=101893) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:56:25.311460 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 744/1474] 10.222.0.84 () {58 vars in 1059 bytes} [Wed May 25 14:56:25 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 14:56:25.318540 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fc8be57-a5d1-4207-ad0d-6c500a8dd94a None None] Authenticating user token {{(pid=101892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:56:25.329069 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fc8be57-a5d1-4207-ad0d-6c500a8dd94a None None] Validating token access rules against request {{(pid=101892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:56:25.332558 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af5ef9a7-4dae-443b-8787-ad5ec9faf849 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '971542599734491aa112b815fc4cc5c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a000829c658c4a7cab67f7b6353ba3fa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:56:25.333199 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5ef9a7-4dae-443b-8787-ad5ec9faf849 service glance] REQUEST_METHOD: `GET` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:56:25.333468 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5ef9a7-4dae-443b-8787-ad5ec9faf849 service glance] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:56:25.333749 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5ef9a7-4dae-443b-8787-ad5ec9faf849 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:56:25.342458 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af5ef9a7-4dae-443b-8787-ad5ec9faf849 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:56:25.343907 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af5ef9a7-4dae-443b-8787-ad5ec9faf849 service glance] RBAC: Authorization granted {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:56:25.353876 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 731/1475] 10.222.0.84 () {60 vars in 1365 bytes} [Wed May 25 14:56:25 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 25 14:56:27.657872 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46b775e-c4e9-4513-81a0-22ceee951680 None None] REQUEST_METHOD: `GET` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:56:27.658395 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46b775e-c4e9-4513-81a0-22ceee951680 None None] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:56:27.658395 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46b775e-c4e9-4513-81a0-22ceee951680 None None] PATH_INFO: `/` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:56:27.659756 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 745/1476] 10.222.0.84 () {54 vars in 926 bytes} [Wed May 25 14:56:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 14:56:27.665398 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2379cb-a6a4-4e14-a9eb-8c9df9cc133b None None] REQUEST_METHOD: `POST` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:56:27.665836 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2379cb-a6a4-4e14-a9eb-8c9df9cc133b None None] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:56:27.665973 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2379cb-a6a4-4e14-a9eb-8c9df9cc133b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:56:27.684570 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.auth.core [None req-6e2379cb-a6a4-4e14-a9eb-8c9df9cc133b None None] MFA Rules not processed for user `05d87e87798e429aa1c10b24391f915e`. Rule list: `[]` (Enabled: `True`). {{(pid=101892) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:56:27.685780 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.fernet_utils [None req-6e2379cb-a6a4-4e14-a9eb-8c9df9cc133b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=101892) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:56:27.694654 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 732/1477] 10.222.0.84 () {58 vars in 1023 bytes} [Wed May 25 14:56:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 14:56:27.716660 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e46b775e-c4e9-4513-81a0-22ceee951680 None None] Authenticating user token {{(pid=101893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:56:27.729722 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e46b775e-c4e9-4513-81a0-22ceee951680 None None] Validating token access rules against request {{(pid=101893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:56:27.734228 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-360b9510-d935-43fb-b419-4bd9bec50c4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cec56f74b2fa4826a506dc7b919465be', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:56:27.734866 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-360b9510-d935-43fb-b419-4bd9bec50c4a admin admin] REQUEST_METHOD: `GET` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:56:27.735149 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-360b9510-d935-43fb-b419-4bd9bec50c4a admin admin] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:56:27.735423 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-360b9510-d935-43fb-b419-4bd9bec50c4a admin admin] PATH_INFO: `/v3/projects` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:56:27.736189 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-360b9510-d935-43fb-b419-4bd9bec50c4a admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:56:27.737951 dv-cinder-803823-9-smb devstack@keystone.service[101893]: WARNING py.warnings [None req-360b9510-d935-43fb-b419-4bd9bec50c4a admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 25 14:56:27.737951 dv-cinder-803823-9-smb devstack@keystone.service[101893]: warnings.warn(msg) May 25 14:56:27.737951 dv-cinder-803823-9-smb devstack@keystone.service[101893]: May 25 14:56:27.739106 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-360b9510-d935-43fb-b419-4bd9bec50c4a admin admin] RBAC: Authorization granted {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:56:27.758558 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 746/1478] 10.222.0.84 () {56 vars in 1108 bytes} [Wed May 25 14:56:27 2022] GET /identity/v3/projects => generated 2553 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 14:56:29.976153 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2604f5b-9990-44d9-a527-cf81ea8595f1 None None] REQUEST_METHOD: `GET` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:56:29.977061 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2604f5b-9990-44d9-a527-cf81ea8595f1 None None] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:56:29.977061 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2604f5b-9990-44d9-a527-cf81ea8595f1 None None] PATH_INFO: `/` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:56:29.978100 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 733/1479] 10.222.0.84 () {54 vars in 926 bytes} [Wed May 25 14:56:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 14:56:29.983730 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f39da0d-a25c-4c20-87f8-d04461e50448 None None] REQUEST_METHOD: `POST` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:56:29.984135 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f39da0d-a25c-4c20-87f8-d04461e50448 None None] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:56:29.984289 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f39da0d-a25c-4c20-87f8-d04461e50448 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:56:30.002318 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.auth.core [None req-7f39da0d-a25c-4c20-87f8-d04461e50448 None None] MFA Rules not processed for user `05d87e87798e429aa1c10b24391f915e`. Rule list: `[]` (Enabled: `True`). {{(pid=101893) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:56:30.003526 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.fernet_utils [None req-7f39da0d-a25c-4c20-87f8-d04461e50448 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=101893) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:56:30.012195 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 747/1480] 10.222.0.84 () {58 vars in 1023 bytes} [Wed May 25 14:56:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 14:56:30.056195 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2604f5b-9990-44d9-a527-cf81ea8595f1 None None] Authenticating user token {{(pid=101892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:56:30.071033 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2604f5b-9990-44d9-a527-cf81ea8595f1 None None] Validating token access rules against request {{(pid=101892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:56:30.076409 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc5f287-c07f-4cfd-8f61-3b13f0c018ae service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2aeb182e6a5b43cfb0cc347ec847c848', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a000829c658c4a7cab67f7b6353ba3fa', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:56:30.077110 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc5f287-c07f-4cfd-8f61-3b13f0c018ae service nova] REQUEST_METHOD: `GET` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:56:30.077397 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc5f287-c07f-4cfd-8f61-3b13f0c018ae service nova] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:56:30.077673 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc5f287-c07f-4cfd-8f61-3b13f0c018ae service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:56:30.085863 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbc5f287-c07f-4cfd-8f61-3b13f0c018ae service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:56:30.088010 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbc5f287-c07f-4cfd-8f61-3b13f0c018ae service nova] RBAC: Authorization granted {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:56:30.097594 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 734/1481] 10.222.0.84 () {60 vars in 1365 bytes} [Wed May 25 14:56:30 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 14:56:32.472503 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c361da4d-432a-4d45-a6d3-fa57e80fbcd9 None None] REQUEST_METHOD: `GET` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:56:32.473075 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c361da4d-432a-4d45-a6d3-fa57e80fbcd9 None None] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:56:32.473075 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c361da4d-432a-4d45-a6d3-fa57e80fbcd9 None None] PATH_INFO: `/` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:56:32.474449 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 748/1482] 10.222.0.84 () {54 vars in 926 bytes} [Wed May 25 14:56:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 14:56:32.480296 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4307a054-6a90-4a80-ab9e-f49a8ac9b868 None None] REQUEST_METHOD: `POST` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:56:32.480735 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4307a054-6a90-4a80-ab9e-f49a8ac9b868 None None] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:56:32.480847 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4307a054-6a90-4a80-ab9e-f49a8ac9b868 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:56:32.498235 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.auth.core [None req-4307a054-6a90-4a80-ab9e-f49a8ac9b868 None None] MFA Rules not processed for user `05d87e87798e429aa1c10b24391f915e`. Rule list: `[]` (Enabled: `True`). {{(pid=101892) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:56:32.499420 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.fernet_utils [None req-4307a054-6a90-4a80-ab9e-f49a8ac9b868 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=101892) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:56:32.507074 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 735/1483] 10.222.0.84 () {58 vars in 1023 bytes} [Wed May 25 14:56:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 25 14:56:32.543223 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c361da4d-432a-4d45-a6d3-fa57e80fbcd9 None None] Authenticating user token {{(pid=101893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:56:32.554478 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c361da4d-432a-4d45-a6d3-fa57e80fbcd9 None None] Validating token access rules against request {{(pid=101893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:56:32.557997 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8d7ce73-580b-4f36-aaff-e4580e02c45b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ce28b25b907473588ccb87dc4acc06a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a000829c658c4a7cab67f7b6353ba3fa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:56:32.558644 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d7ce73-580b-4f36-aaff-e4580e02c45b service neutron] REQUEST_METHOD: `GET` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:56:32.558923 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d7ce73-580b-4f36-aaff-e4580e02c45b service neutron] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:56:32.559198 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d7ce73-580b-4f36-aaff-e4580e02c45b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:56:32.568345 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8d7ce73-580b-4f36-aaff-e4580e02c45b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:56:32.569777 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8d7ce73-580b-4f36-aaff-e4580e02c45b service neutron] RBAC: Authorization granted {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:56:32.579093 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 749/1484] 10.222.0.84 () {60 vars in 1365 bytes} [Wed May 25 14:56:32 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 14:56:34.861022 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a6bc712-5a50-46ff-9d7c-6a47d430cb24 None None] REQUEST_METHOD: `GET` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:56:34.861584 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a6bc712-5a50-46ff-9d7c-6a47d430cb24 None None] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:56:34.861584 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a6bc712-5a50-46ff-9d7c-6a47d430cb24 None None] PATH_INFO: `/` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:56:34.862920 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 736/1485] 10.222.0.84 () {54 vars in 926 bytes} [Wed May 25 14:56:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 14:56:34.868367 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13936ebc-edc4-47c6-bd84-67b4aed97e5a None None] REQUEST_METHOD: `POST` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:56:34.868831 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13936ebc-edc4-47c6-bd84-67b4aed97e5a None None] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:56:34.868967 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13936ebc-edc4-47c6-bd84-67b4aed97e5a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:56:34.886692 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.auth.core [None req-13936ebc-edc4-47c6-bd84-67b4aed97e5a None None] MFA Rules not processed for user `05d87e87798e429aa1c10b24391f915e`. Rule list: `[]` (Enabled: `True`). {{(pid=101893) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:56:34.887926 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.fernet_utils [None req-13936ebc-edc4-47c6-bd84-67b4aed97e5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=101893) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:56:34.895753 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 750/1486] 10.222.0.84 () {58 vars in 1023 bytes} [Wed May 25 14:56:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 25 14:56:34.945339 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a6bc712-5a50-46ff-9d7c-6a47d430cb24 None None] Authenticating user token {{(pid=101892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:56:34.956018 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a6bc712-5a50-46ff-9d7c-6a47d430cb24 None None] Validating token access rules against request {{(pid=101892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:56:34.959498 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-329d8b87-5ea4-4523-8ef1-264d4c609858 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ce28b25b907473588ccb87dc4acc06a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a000829c658c4a7cab67f7b6353ba3fa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:56:34.960167 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329d8b87-5ea4-4523-8ef1-264d4c609858 service neutron] REQUEST_METHOD: `GET` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:56:34.960461 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329d8b87-5ea4-4523-8ef1-264d4c609858 service neutron] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:56:34.961352 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329d8b87-5ea4-4523-8ef1-264d4c609858 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:56:34.970406 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-329d8b87-5ea4-4523-8ef1-264d4c609858 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:56:34.971876 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-329d8b87-5ea4-4523-8ef1-264d4c609858 service neutron] RBAC: Authorization granted {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:56:34.982913 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 737/1487] 10.222.0.84 () {60 vars in 1365 bytes} [Wed May 25 14:56:34 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 14:56:37.365514 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77255481-bb2e-4172-ba5e-73a6276ea1c2 None None] REQUEST_METHOD: `GET` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:56:37.366122 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77255481-bb2e-4172-ba5e-73a6276ea1c2 None None] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:56:37.366122 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77255481-bb2e-4172-ba5e-73a6276ea1c2 None None] PATH_INFO: `/` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:56:37.368141 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 751/1488] 10.222.0.84 () {54 vars in 926 bytes} [Wed May 25 14:56:37 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 14:56:37.373669 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f404b1-0002-409f-8ac6-67ea9de1cdf0 None None] REQUEST_METHOD: `POST` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:56:37.374105 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f404b1-0002-409f-8ac6-67ea9de1cdf0 None None] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:56:37.374212 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f404b1-0002-409f-8ac6-67ea9de1cdf0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:56:37.391612 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.auth.core [None req-a2f404b1-0002-409f-8ac6-67ea9de1cdf0 None None] MFA Rules not processed for user `05d87e87798e429aa1c10b24391f915e`. Rule list: `[]` (Enabled: `True`). {{(pid=101892) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:56:37.392797 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.fernet_utils [None req-a2f404b1-0002-409f-8ac6-67ea9de1cdf0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=101892) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:56:37.400536 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 738/1489] 10.222.0.84 () {58 vars in 1023 bytes} [Wed May 25 14:56:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 14:56:37.441045 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77255481-bb2e-4172-ba5e-73a6276ea1c2 None None] Authenticating user token {{(pid=101893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:56:37.451657 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77255481-bb2e-4172-ba5e-73a6276ea1c2 None None] Validating token access rules against request {{(pid=101893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:56:37.455176 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29994d99-2436-4801-af16-c8cf4ea815fa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ce28b25b907473588ccb87dc4acc06a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a000829c658c4a7cab67f7b6353ba3fa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:56:37.455845 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29994d99-2436-4801-af16-c8cf4ea815fa service neutron] REQUEST_METHOD: `GET` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:56:37.456130 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29994d99-2436-4801-af16-c8cf4ea815fa service neutron] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:56:37.456405 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29994d99-2436-4801-af16-c8cf4ea815fa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:56:37.465244 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29994d99-2436-4801-af16-c8cf4ea815fa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:56:37.466684 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29994d99-2436-4801-af16-c8cf4ea815fa service neutron] RBAC: Authorization granted {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:56:37.476665 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 752/1490] 10.222.0.84 () {60 vars in 1365 bytes} [Wed May 25 14:56:37 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 14:56:40.103634 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a27c39-0296-483e-afd3-9c273d91eb31 None None] REQUEST_METHOD: `GET` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:56:40.104211 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a27c39-0296-483e-afd3-9c273d91eb31 None None] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:56:40.104211 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a27c39-0296-483e-afd3-9c273d91eb31 None None] PATH_INFO: `/` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:56:40.105494 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 739/1491] 10.222.0.84 () {54 vars in 926 bytes} [Wed May 25 14:56:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 14:56:40.110617 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fed9262-96bd-41e6-a07f-de219b607261 None None] REQUEST_METHOD: `POST` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:56:40.111066 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fed9262-96bd-41e6-a07f-de219b607261 None None] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:56:40.111176 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fed9262-96bd-41e6-a07f-de219b607261 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:56:40.128848 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.auth.core [None req-5fed9262-96bd-41e6-a07f-de219b607261 None None] MFA Rules not processed for user `05d87e87798e429aa1c10b24391f915e`. Rule list: `[]` (Enabled: `True`). {{(pid=101893) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:56:40.130043 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.fernet_utils [None req-5fed9262-96bd-41e6-a07f-de219b607261 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=101893) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:56:40.137744 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 753/1492] 10.222.0.84 () {58 vars in 1023 bytes} [Wed May 25 14:56:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 14:56:40.176402 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a27c39-0296-483e-afd3-9c273d91eb31 None None] Authenticating user token {{(pid=101892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:56:40.186886 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a27c39-0296-483e-afd3-9c273d91eb31 None None] Validating token access rules against request {{(pid=101892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:56:40.190480 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c86ea772-2206-46e6-9f3c-aebcd9a8171b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ce28b25b907473588ccb87dc4acc06a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a000829c658c4a7cab67f7b6353ba3fa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:56:40.191108 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86ea772-2206-46e6-9f3c-aebcd9a8171b service neutron] REQUEST_METHOD: `GET` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:56:40.191391 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86ea772-2206-46e6-9f3c-aebcd9a8171b service neutron] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:56:40.191706 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86ea772-2206-46e6-9f3c-aebcd9a8171b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:56:40.200960 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c86ea772-2206-46e6-9f3c-aebcd9a8171b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:56:40.202387 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c86ea772-2206-46e6-9f3c-aebcd9a8171b service neutron] RBAC: Authorization granted {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:56:40.212204 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 740/1493] 10.222.0.84 () {60 vars in 1365 bytes} [Wed May 25 14:56:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 14:56:50.123622 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG dbcounter [-] [101893] Writing DB stats keystone:SELECT=33 {{(pid=101893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:56:50.207494 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG dbcounter [-] [101892] Writing DB stats keystone:SELECT=33 {{(pid=101892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:58:31.958465 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3b4ea0-ff72-40d7-8a0d-64b4b0167351 None None] REQUEST_METHOD: `POST` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:58:31.959104 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3b4ea0-ff72-40d7-8a0d-64b4b0167351 None None] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:58:31.959104 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3b4ea0-ff72-40d7-8a0d-64b4b0167351 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:58:31.977725 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.auth.core [None req-1a3b4ea0-ff72-40d7-8a0d-64b4b0167351 None None] MFA Rules not processed for user `05d87e87798e429aa1c10b24391f915e`. Rule list: `[]` (Enabled: `True`). {{(pid=101893) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:58:31.979044 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.fernet_utils [None req-1a3b4ea0-ff72-40d7-8a0d-64b4b0167351 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=101893) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:58:31.986985 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 754/1494] 10.222.0.84 () {58 vars in 957 bytes} [Wed May 25 14:58:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 14:58:31.996937 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b88fab-05cc-4e05-a944-32c3ee029971 None None] REQUEST_METHOD: `POST` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:58:31.997432 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b88fab-05cc-4e05-a944-32c3ee029971 None None] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:58:31.997546 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b88fab-05cc-4e05-a944-32c3ee029971 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:58:32.015076 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.auth.core [None req-b6b88fab-05cc-4e05-a944-32c3ee029971 None None] MFA Rules not processed for user `05d87e87798e429aa1c10b24391f915e`. Rule list: `[]` (Enabled: `True`). {{(pid=101892) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:58:32.016306 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.fernet_utils [None req-b6b88fab-05cc-4e05-a944-32c3ee029971 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=101892) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:58:32.024304 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 741/1495] 10.222.0.84 () {58 vars in 957 bytes} [Wed May 25 14:58:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 14:58:32.028736 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a3b4ea0-ff72-40d7-8a0d-64b4b0167351 None None] Authenticating user token {{(pid=101893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:58:32.038945 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a3b4ea0-ff72-40d7-8a0d-64b4b0167351 None None] Validating token access rules against request {{(pid=101893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:58:32.043441 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b74881e-9617-45e9-9c3e-62efd1a11933 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cec56f74b2fa4826a506dc7b919465be', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:58:32.044120 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b74881e-9617-45e9-9c3e-62efd1a11933 admin admin] REQUEST_METHOD: `GET` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:58:32.044407 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b74881e-9617-45e9-9c3e-62efd1a11933 admin admin] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:58:32.044681 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b74881e-9617-45e9-9c3e-62efd1a11933 admin admin] PATH_INFO: `/v3/domains` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:58:32.045404 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b74881e-9617-45e9-9c3e-62efd1a11933 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=101893) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:58:32.045712 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b74881e-9617-45e9-9c3e-62efd1a11933 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:58:32.046720 dv-cinder-803823-9-smb devstack@keystone.service[101893]: WARNING py.warnings [None req-9b74881e-9617-45e9-9c3e-62efd1a11933 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 25 14:58:32.046720 dv-cinder-803823-9-smb devstack@keystone.service[101893]: warnings.warn(msg) May 25 14:58:32.046720 dv-cinder-803823-9-smb devstack@keystone.service[101893]: May 25 14:58:32.047624 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b74881e-9617-45e9-9c3e-62efd1a11933 admin admin] RBAC: Authorization granted {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:58:32.060263 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 755/1496] 10.222.0.84 () {58 vars in 1152 bytes} [Wed May 25 14:58:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:58:32.068061 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6b88fab-05cc-4e05-a944-32c3ee029971 None None] Authenticating user token {{(pid=101892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:58:32.077238 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6b88fab-05cc-4e05-a944-32c3ee029971 None None] Validating token access rules against request {{(pid=101892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:58:32.081759 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbc9c48a-81e3-426e-85f1-390093815729 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cec56f74b2fa4826a506dc7b919465be', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:58:32.082406 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc9c48a-81e3-426e-85f1-390093815729 admin admin] REQUEST_METHOD: `POST` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:58:32.082694 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc9c48a-81e3-426e-85f1-390093815729 admin admin] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:58:32.082973 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc9c48a-81e3-426e-85f1-390093815729 admin admin] PATH_INFO: `/v3/projects` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:58:32.083703 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbc9c48a-81e3-426e-85f1-390093815729 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:58:32.085494 dv-cinder-803823-9-smb devstack@keystone.service[101892]: WARNING py.warnings [None req-bbc9c48a-81e3-426e-85f1-390093815729 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 25 14:58:32.085494 dv-cinder-803823-9-smb devstack@keystone.service[101892]: warnings.warn(msg) May 25 14:58:32.085494 dv-cinder-803823-9-smb devstack@keystone.service[101892]: May 25 14:58:32.086686 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbc9c48a-81e3-426e-85f1-390093815729 admin admin] RBAC: Authorization granted {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:58:32.181498 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 742/1497] 10.222.0.84 () {60 vars in 1152 bytes} [Wed May 25 14:58:32 2022] POST /identity/v3/projects => generated 379 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 14:58:32.185902 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b74881e-9617-45e9-9c3e-62efd1a11933 admin admin] Authenticating user token {{(pid=101893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:58:32.196302 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b74881e-9617-45e9-9c3e-62efd1a11933 admin admin] Validating token access rules against request {{(pid=101893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:58:32.252307 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c0cd7b8-a525-474e-beb7-443e8b6713f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cec56f74b2fa4826a506dc7b919465be', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:58:32.252897 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0cd7b8-a525-474e-beb7-443e8b6713f2 admin admin] REQUEST_METHOD: `POST` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:58:32.253183 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0cd7b8-a525-474e-beb7-443e8b6713f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:58:32.253461 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0cd7b8-a525-474e-beb7-443e8b6713f2 admin admin] PATH_INFO: `/v3/users` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:58:32.254150 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c0cd7b8-a525-474e-beb7-443e8b6713f2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:58:32.255170 dv-cinder-803823-9-smb devstack@keystone.service[101893]: WARNING py.warnings [None req-7c0cd7b8-a525-474e-beb7-443e8b6713f2 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 25 14:58:32.255170 dv-cinder-803823-9-smb devstack@keystone.service[101893]: warnings.warn(msg) May 25 14:58:32.255170 dv-cinder-803823-9-smb devstack@keystone.service[101893]: May 25 14:58:32.256430 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c0cd7b8-a525-474e-beb7-443e8b6713f2 admin admin] RBAC: Authorization granted {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:58:32.310882 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 756/1498] 10.222.0.84 () {60 vars in 1143 bytes} [Wed May 25 14:58:32 2022] POST /identity/v3/users => generated 290 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 25 14:58:32.315074 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbc9c48a-81e3-426e-85f1-390093815729 admin admin] Authenticating user token {{(pid=101892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:58:32.325338 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbc9c48a-81e3-426e-85f1-390093815729 admin admin] Validating token access rules against request {{(pid=101892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:58:32.329830 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31617093-a9d8-43c5-b24d-b23592ac7ddd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cec56f74b2fa4826a506dc7b919465be', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:58:32.330487 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31617093-a9d8-43c5-b24d-b23592ac7ddd admin admin] REQUEST_METHOD: `GET` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:58:32.330775 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31617093-a9d8-43c5-b24d-b23592ac7ddd admin admin] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:58:32.331056 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31617093-a9d8-43c5-b24d-b23592ac7ddd admin admin] PATH_INFO: `/v3/roles` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:58:32.331814 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31617093-a9d8-43c5-b24d-b23592ac7ddd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:58:32.332826 dv-cinder-803823-9-smb devstack@keystone.service[101892]: WARNING py.warnings [None req-31617093-a9d8-43c5-b24d-b23592ac7ddd admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 25 14:58:32.332826 dv-cinder-803823-9-smb devstack@keystone.service[101892]: warnings.warn(msg) May 25 14:58:32.332826 dv-cinder-803823-9-smb devstack@keystone.service[101892]: May 25 14:58:32.333721 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31617093-a9d8-43c5-b24d-b23592ac7ddd admin admin] RBAC: Authorization granted {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:58:32.347187 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 743/1499] 10.222.0.84 () {58 vars in 1121 bytes} [Wed May 25 14:58:32 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 14:58:32.350963 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c0cd7b8-a525-474e-beb7-443e8b6713f2 admin admin] Authenticating user token {{(pid=101893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:58:32.361565 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c0cd7b8-a525-474e-beb7-443e8b6713f2 admin admin] Validating token access rules against request {{(pid=101893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:58:32.366265 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97d56431-286b-4059-a22d-88fcc63f8911 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cec56f74b2fa4826a506dc7b919465be', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:58:32.366923 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d56431-286b-4059-a22d-88fcc63f8911 admin admin] REQUEST_METHOD: `GET` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:58:32.367209 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d56431-286b-4059-a22d-88fcc63f8911 admin admin] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:58:32.367485 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d56431-286b-4059-a22d-88fcc63f8911 admin admin] PATH_INFO: `/v3/roles` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:58:32.368271 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97d56431-286b-4059-a22d-88fcc63f8911 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:58:32.369291 dv-cinder-803823-9-smb devstack@keystone.service[101893]: WARNING py.warnings [None req-97d56431-286b-4059-a22d-88fcc63f8911 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 25 14:58:32.369291 dv-cinder-803823-9-smb devstack@keystone.service[101893]: warnings.warn(msg) May 25 14:58:32.369291 dv-cinder-803823-9-smb devstack@keystone.service[101893]: May 25 14:58:32.370193 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97d56431-286b-4059-a22d-88fcc63f8911 admin admin] RBAC: Authorization granted {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:58:32.384837 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 757/1500] 10.222.0.84 () {58 vars in 1121 bytes} [Wed May 25 14:58:32 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 25 14:58:32.389063 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31617093-a9d8-43c5-b24d-b23592ac7ddd admin admin] Authenticating user token {{(pid=101892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:58:32.399497 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31617093-a9d8-43c5-b24d-b23592ac7ddd admin admin] Validating token access rules against request {{(pid=101892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:58:32.404004 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db7b8f8-9197-4292-ab6b-2ee3457b9dfc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cec56f74b2fa4826a506dc7b919465be', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:58:32.404886 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db7b8f8-9197-4292-ab6b-2ee3457b9dfc admin admin] REQUEST_METHOD: `PUT` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:58:32.405167 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db7b8f8-9197-4292-ab6b-2ee3457b9dfc admin admin] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:58:32.405449 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db7b8f8-9197-4292-ab6b-2ee3457b9dfc admin admin] PATH_INFO: `/v3/projects/fadfad48c1844ae8a560d4e5f82da5d5/users/76ed0dd18f294b3ea53458e6c3486b84/roles/ff664fa0db7e4262a5accde96c3df4c3` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:58:32.421339 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4db7b8f8-9197-4292-ab6b-2ee3457b9dfc admin admin] RBAC: Authorizing `identity:create_grant(project_id=fadfad48c1844ae8a560d4e5f82da5d5, user_id=76ed0dd18f294b3ea53458e6c3486b84, role_id=ff664fa0db7e4262a5accde96c3df4c3)` {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:58:32.422365 dv-cinder-803823-9-smb devstack@keystone.service[101892]: WARNING py.warnings [None req-4db7b8f8-9197-4292-ab6b-2ee3457b9dfc admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 25 14:58:32.422365 dv-cinder-803823-9-smb devstack@keystone.service[101892]: warnings.warn(msg) May 25 14:58:32.422365 dv-cinder-803823-9-smb devstack@keystone.service[101892]: May 25 14:58:32.424438 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4db7b8f8-9197-4292-ab6b-2ee3457b9dfc admin admin] RBAC: Authorization granted {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:58:32.477305 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 744/1501] 10.222.0.84 () {60 vars in 1482 bytes} [Wed May 25 14:58:32 2022] PUT /identity/v3/projects/fadfad48c1844ae8a560d4e5f82da5d5/users/76ed0dd18f294b3ea53458e6c3486b84/roles/ff664fa0db7e4262a5accde96c3df4c3 => generated 0 bytes in 89 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 14:58:32.488446 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c18420f-3d50-40b8-af1d-00b82de40771 None None] REQUEST_METHOD: `POST` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:58:32.488768 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c18420f-3d50-40b8-af1d-00b82de40771 None None] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:58:32.489050 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c18420f-3d50-40b8-af1d-00b82de40771 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:58:32.514767 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.auth.core [None req-6c18420f-3d50-40b8-af1d-00b82de40771 None None] MFA Rules not processed for user `76ed0dd18f294b3ea53458e6c3486b84`. Rule list: `[]` (Enabled: `True`). {{(pid=101893) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:58:32.515986 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.fernet_utils [None req-6c18420f-3d50-40b8-af1d-00b82de40771 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=101893) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:58:32.579678 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 758/1502] 10.222.0.84 () {58 vars in 957 bytes} [Wed May 25 14:58:32 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 14:58:32.593716 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c824b0d-7d34-44e1-bcc4-d19360958dc2 None None] REQUEST_METHOD: `GET` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:58:32.594007 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c824b0d-7d34-44e1-bcc4-d19360958dc2 None None] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:58:32.594293 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c824b0d-7d34-44e1-bcc4-d19360958dc2 None None] PATH_INFO: `/` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:58:32.595697 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 745/1503] 10.222.0.84 () {54 vars in 963 bytes} [Wed May 25 14:58:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 14:58:32.600465 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580c9860-bd39-4752-8cb6-6eec89aac847 None None] REQUEST_METHOD: `POST` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:58:32.600758 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580c9860-bd39-4752-8cb6-6eec89aac847 None None] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:58:32.601072 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580c9860-bd39-4752-8cb6-6eec89aac847 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:58:32.618725 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.auth.core [None req-580c9860-bd39-4752-8cb6-6eec89aac847 None None] MFA Rules not processed for user `e079f89a5e524ab6ad4183e4f690de07`. Rule list: `[]` (Enabled: `True`). {{(pid=101893) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:58:32.619968 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.fernet_utils [None req-580c9860-bd39-4752-8cb6-6eec89aac847 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=101893) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:58:32.663084 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG dbcounter [-] [101893] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=101893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:58:32.670559 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 759/1504] 10.222.0.84 () {58 vars in 1060 bytes} [Wed May 25 14:58:32 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 71 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 14:58:32.687623 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c824b0d-7d34-44e1-bcc4-d19360958dc2 None None] Authenticating user token {{(pid=101892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:58:32.688403 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c824b0d-7d34-44e1-bcc4-d19360958dc2 None None] Validating token access rules against request {{(pid=101892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:58:32.691844 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31c25349-5b43-493e-947c-625cf5ce9b84 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e079f89a5e524ab6ad4183e4f690de07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a000829c658c4a7cab67f7b6353ba3fa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:58:32.692470 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c25349-5b43-493e-947c-625cf5ce9b84 service cinder] REQUEST_METHOD: `GET` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:58:32.692749 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c25349-5b43-493e-947c-625cf5ce9b84 service cinder] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:58:32.693023 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c25349-5b43-493e-947c-625cf5ce9b84 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:58:32.702223 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31c25349-5b43-493e-947c-625cf5ce9b84 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:58:32.703675 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31c25349-5b43-493e-947c-625cf5ce9b84 service cinder] RBAC: Authorization granted {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:58:32.713067 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 746/1505] 10.222.0.84 () {60 vars in 1365 bytes} [Wed May 25 14:58:32 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 14:58:32.753990 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0cd8809-30bb-4524-9599-12b0460e9485 None None] REQUEST_METHOD: `GET` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:58:32.754285 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0cd8809-30bb-4524-9599-12b0460e9485 None None] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:58:32.754595 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0cd8809-30bb-4524-9599-12b0460e9485 None None] PATH_INFO: `/` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:58:32.755943 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 760/1506] 10.222.0.84 () {52 vars in 829 bytes} [Wed May 25 14:58:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 25 14:58:32.759940 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31c25349-5b43-493e-947c-625cf5ce9b84 service cinder] Authenticating user token {{(pid=101892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:58:32.822502 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31c25349-5b43-493e-947c-625cf5ce9b84 service cinder] Validating token access rules against request {{(pid=101892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:58:32.826891 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cf64d33-cf9d-477b-b65d-507e1f3b5d52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cec56f74b2fa4826a506dc7b919465be', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:58:32.827792 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf64d33-cf9d-477b-b65d-507e1f3b5d52 admin admin] REQUEST_METHOD: `DELETE` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:58:32.828079 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf64d33-cf9d-477b-b65d-507e1f3b5d52 admin admin] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:58:32.828357 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf64d33-cf9d-477b-b65d-507e1f3b5d52 admin admin] PATH_INFO: `/v3/users/76ed0dd18f294b3ea53458e6c3486b84` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:58:32.829529 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cf64d33-cf9d-477b-b65d-507e1f3b5d52 admin admin] RBAC: Authorizing `identity:delete_user(user_id=76ed0dd18f294b3ea53458e6c3486b84)` {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:58:32.830530 dv-cinder-803823-9-smb devstack@keystone.service[101892]: WARNING py.warnings [None req-7cf64d33-cf9d-477b-b65d-507e1f3b5d52 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 25 14:58:32.830530 dv-cinder-803823-9-smb devstack@keystone.service[101892]: warnings.warn(msg) May 25 14:58:32.830530 dv-cinder-803823-9-smb devstack@keystone.service[101892]: May 25 14:58:32.831759 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cf64d33-cf9d-477b-b65d-507e1f3b5d52 admin admin] RBAC: Authorization granted {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:58:32.992099 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.notifications [None req-7cf64d33-cf9d-477b-b65d-507e1f3b5d52 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '76ed0dd18f294b3ea53458e6c3486b84'} {{(pid=101892) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:58:33.004584 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.notifications [None req-7cf64d33-cf9d-477b-b65d-507e1f3b5d52 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '76ed0dd18f294b3ea53458e6c3486b84'} {{(pid=101892) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:58:33.023435 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.notifications [None req-7cf64d33-cf9d-477b-b65d-507e1f3b5d52 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '76ed0dd18f294b3ea53458e6c3486b84'} {{(pid=101892) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:58:33.024333 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.notifications [None req-7cf64d33-cf9d-477b-b65d-507e1f3b5d52 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '76ed0dd18f294b3ea53458e6c3486b84'} {{(pid=101892) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:58:33.028277 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG dbcounter [-] [101892] Writing DB stats keystone:SELECT=88,keystone:INSERT=3,keystone:DELETE=9 {{(pid=101892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:58:33.105757 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.notifications [None req-7cf64d33-cf9d-477b-b65d-507e1f3b5d52 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '76ed0dd18f294b3ea53458e6c3486b84'} {{(pid=101892) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:58:33.112239 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 747/1507] 10.222.0.84 () {58 vars in 1223 bytes} [Wed May 25 14:58:32 2022] DELETE /identity/v3/users/76ed0dd18f294b3ea53458e6c3486b84 => generated 0 bytes in 353 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 14:58:33.117373 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4090d391-a50b-4357-9545-fb40ae815d0b None None] REQUEST_METHOD: `POST` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:58:33.117847 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4090d391-a50b-4357-9545-fb40ae815d0b None None] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:58:33.117954 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4090d391-a50b-4357-9545-fb40ae815d0b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:58:33.135777 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.auth.core [None req-4090d391-a50b-4357-9545-fb40ae815d0b None None] MFA Rules not processed for user `05d87e87798e429aa1c10b24391f915e`. Rule list: `[]` (Enabled: `True`). {{(pid=101893) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:58:33.136959 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.fernet_utils [None req-4090d391-a50b-4357-9545-fb40ae815d0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=101893) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:58:33.195825 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 761/1508] 10.222.0.84 () {58 vars in 957 bytes} [Wed May 25 14:58:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 14:58:33.205208 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cf64d33-cf9d-477b-b65d-507e1f3b5d52 admin admin] Authenticating user token {{(pid=101892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:58:33.206611 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.fernet_utils [None req-7cf64d33-cf9d-477b-b65d-507e1f3b5d52 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=101892) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:58:33.263309 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cf64d33-cf9d-477b-b65d-507e1f3b5d52 admin admin] Validating token access rules against request {{(pid=101892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:58:33.266893 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ab8d380-2433-43d0-a62f-e73440280900 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ce28b25b907473588ccb87dc4acc06a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a000829c658c4a7cab67f7b6353ba3fa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:58:33.267540 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab8d380-2433-43d0-a62f-e73440280900 service neutron] REQUEST_METHOD: `GET` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:58:33.267861 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab8d380-2433-43d0-a62f-e73440280900 service neutron] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:58:33.268143 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab8d380-2433-43d0-a62f-e73440280900 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:58:33.277075 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ab8d380-2433-43d0-a62f-e73440280900 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:58:33.278510 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ab8d380-2433-43d0-a62f-e73440280900 service neutron] RBAC: Authorization granted {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:58:33.287870 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 748/1509] 10.222.0.84 () {60 vars in 1365 bytes} [Wed May 25 14:58:33 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 14:58:33.747139 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4090d391-a50b-4357-9545-fb40ae815d0b None None] Authenticating user token {{(pid=101893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:58:33.748704 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.fernet_utils [None req-4090d391-a50b-4357-9545-fb40ae815d0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=101893) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:58:33.762079 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4090d391-a50b-4357-9545-fb40ae815d0b None None] Validating token access rules against request {{(pid=101893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:58:33.765181 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba6fcbb-e886-4f40-a783-655ff75d405f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cec56f74b2fa4826a506dc7b919465be', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:58:33.766064 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba6fcbb-e886-4f40-a783-655ff75d405f admin admin] REQUEST_METHOD: `DELETE` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:58:33.766348 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba6fcbb-e886-4f40-a783-655ff75d405f admin admin] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:58:33.766624 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba6fcbb-e886-4f40-a783-655ff75d405f admin admin] PATH_INFO: `/v3/projects/fadfad48c1844ae8a560d4e5f82da5d5` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:58:33.767932 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ba6fcbb-e886-4f40-a783-655ff75d405f admin admin] RBAC: Authorizing `identity:delete_project(project_id=fadfad48c1844ae8a560d4e5f82da5d5)` {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:58:33.769047 dv-cinder-803823-9-smb devstack@keystone.service[101893]: WARNING py.warnings [None req-8ba6fcbb-e886-4f40-a783-655ff75d405f admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 25 14:58:33.769047 dv-cinder-803823-9-smb devstack@keystone.service[101893]: warnings.warn(msg) May 25 14:58:33.769047 dv-cinder-803823-9-smb devstack@keystone.service[101893]: May 25 14:58:33.770232 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ba6fcbb-e886-4f40-a783-655ff75d405f admin admin] RBAC: Authorization granted {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:58:33.880994 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.notifications [None req-8ba6fcbb-e886-4f40-a783-655ff75d405f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fadfad48c1844ae8a560d4e5f82da5d5', 'request_id': 'req-8ba6fcbb-e886-4f40-a783-655ff75d405f'} {{(pid=101893) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:58:33.894007 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.notifications [None req-8ba6fcbb-e886-4f40-a783-655ff75d405f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fadfad48c1844ae8a560d4e5f82da5d5', 'request_id': 'req-8ba6fcbb-e886-4f40-a783-655ff75d405f'} {{(pid=101893) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:58:33.900707 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.notifications [None req-8ba6fcbb-e886-4f40-a783-655ff75d405f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fadfad48c1844ae8a560d4e5f82da5d5', 'request_id': 'req-8ba6fcbb-e886-4f40-a783-655ff75d405f'} {{(pid=101893) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:58:33.985422 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.notifications [None req-8ba6fcbb-e886-4f40-a783-655ff75d405f admin admin] The token cache is being invalidate because project fadfad48c1844ae8a560d4e5f82da5d5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=101893) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 25 14:58:33.985710 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.notifications [None req-8ba6fcbb-e886-4f40-a783-655ff75d405f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=101893) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:58:33.986357 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.notifications [None req-8ba6fcbb-e886-4f40-a783-655ff75d405f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=101893) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:58:33.988056 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 762/1510] 10.222.0.84 () {58 vars in 1232 bytes} [Wed May 25 14:58:33 2022] DELETE /identity/v3/projects/fadfad48c1844ae8a560d4e5f82da5d5 => generated 0 bytes in 241 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 14:58:43.283724 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG dbcounter [-] [101892] Writing DB stats keystone:DELETE=1,keystone:SELECT=28 {{(pid=101892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:58:43.981983 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG dbcounter [-] [101893] Writing DB stats keystone:SELECT=55,keystone:DELETE=7,keystone:INSERT=1 {{(pid=101893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:00:28.796364 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80fa8df8-e7fb-4e2f-84ea-a366f4c47c0e None None] REQUEST_METHOD: `GET` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:00:28.796957 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80fa8df8-e7fb-4e2f-84ea-a366f4c47c0e None None] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:00:28.796957 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80fa8df8-e7fb-4e2f-84ea-a366f4c47c0e None None] PATH_INFO: `/` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:00:28.798376 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 749/1511] 127.0.0.1 () {54 vars in 901 bytes} [Wed May 25 15:00:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 15:00:28.803322 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57a5124-c4e3-4dff-8c8b-eaea8fbb4626 None None] REQUEST_METHOD: `POST` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:00:28.813374 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57a5124-c4e3-4dff-8c8b-eaea8fbb4626 None None] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:00:28.813374 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57a5124-c4e3-4dff-8c8b-eaea8fbb4626 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:00:28.821771 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.auth.core [None req-b57a5124-c4e3-4dff-8c8b-eaea8fbb4626 None None] MFA Rules not processed for user `05d87e87798e429aa1c10b24391f915e`. Rule list: `[]` (Enabled: `True`). {{(pid=101893) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:00:28.822972 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.fernet_utils [None req-b57a5124-c4e3-4dff-8c8b-eaea8fbb4626 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=101893) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:00:28.883299 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 763/1512] 127.0.0.1 () {58 vars in 998 bytes} [Wed May 25 15:00:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 15:00:29.051141 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80fa8df8-e7fb-4e2f-84ea-a366f4c47c0e None None] Authenticating user token {{(pid=101892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:00:29.053031 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.fernet_utils [None req-80fa8df8-e7fb-4e2f-84ea-a366f4c47c0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=101892) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:00:29.130515 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80fa8df8-e7fb-4e2f-84ea-a366f4c47c0e None None] Validating token access rules against request {{(pid=101892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:00:29.137848 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8420f17-311e-4abd-8256-1158a333808b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2aeb182e6a5b43cfb0cc347ec847c848', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a000829c658c4a7cab67f7b6353ba3fa', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:00:29.138552 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8420f17-311e-4abd-8256-1158a333808b service nova] REQUEST_METHOD: `GET` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:00:29.138867 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8420f17-311e-4abd-8256-1158a333808b service nova] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:00:29.139126 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8420f17-311e-4abd-8256-1158a333808b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:00:29.147774 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8420f17-311e-4abd-8256-1158a333808b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:00:29.149502 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8420f17-311e-4abd-8256-1158a333808b service nova] RBAC: Authorization granted {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:00:29.159783 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 750/1513] 10.222.0.84 () {60 vars in 1365 bytes} [Wed May 25 15:00:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 15:00:29.210802 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ddd74b-120b-440c-bd22-1f2c14f5663b None None] REQUEST_METHOD: `GET` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:00:29.211115 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ddd74b-120b-440c-bd22-1f2c14f5663b None None] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:00:29.212031 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ddd74b-120b-440c-bd22-1f2c14f5663b None None] PATH_INFO: `/v3` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:00:29.213454 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 764/1514] 10.222.0.96 () {54 vars in 925 bytes} [Wed May 25 15:00:29 2022] GET /identity/v3 => generated 255 bytes in 4 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 15:00:29.220558 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a45a1c61-7ff5-4bcb-a552-1bd168dfd243 None None] REQUEST_METHOD: `POST` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:00:29.220857 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a45a1c61-7ff5-4bcb-a552-1bd168dfd243 None None] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:00:29.221139 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a45a1c61-7ff5-4bcb-a552-1bd168dfd243 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:00:29.240266 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.auth.core [None req-a45a1c61-7ff5-4bcb-a552-1bd168dfd243 None None] MFA Rules not processed for user `d18c4a1d92b94c0087a203db4fed22f2`. Rule list: `[]` (Enabled: `True`). {{(pid=101892) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:00:29.241508 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.fernet_utils [None req-a45a1c61-7ff5-4bcb-a552-1bd168dfd243 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=101892) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:00:29.304909 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 751/1515] 10.222.0.96 () {58 vars in 1015 bytes} [Wed May 25 15:00:29 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 15:00:30.036464 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a35c728-22f2-4d8f-9cda-589ad229c466 None None] REQUEST_METHOD: `GET` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:00:30.037034 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a35c728-22f2-4d8f-9cda-589ad229c466 None None] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:00:30.037034 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a35c728-22f2-4d8f-9cda-589ad229c466 None None] PATH_INFO: `/` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:00:30.038406 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 765/1516] 127.0.0.1 () {54 vars in 901 bytes} [Wed May 25 15:00:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 15:00:30.043248 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c007833a-81e8-4fe7-9dd1-ccde214b9f31 None None] REQUEST_METHOD: `POST` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:00:30.043749 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c007833a-81e8-4fe7-9dd1-ccde214b9f31 None None] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:00:30.043850 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c007833a-81e8-4fe7-9dd1-ccde214b9f31 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:00:30.061694 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.auth.core [None req-c007833a-81e8-4fe7-9dd1-ccde214b9f31 None None] MFA Rules not processed for user `05d87e87798e429aa1c10b24391f915e`. Rule list: `[]` (Enabled: `True`). {{(pid=101892) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:00:30.062885 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.fernet_utils [None req-c007833a-81e8-4fe7-9dd1-ccde214b9f31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=101892) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:00:30.071177 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 752/1517] 127.0.0.1 () {58 vars in 998 bytes} [Wed May 25 15:00:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 15:00:30.222030 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a35c728-22f2-4d8f-9cda-589ad229c466 None None] Authenticating user token {{(pid=101893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:00:30.236199 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a35c728-22f2-4d8f-9cda-589ad229c466 None None] Validating token access rules against request {{(pid=101893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:00:30.241583 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eb20f5c-fc79-45a1-803d-02e863bd276d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2aeb182e6a5b43cfb0cc347ec847c848', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a000829c658c4a7cab67f7b6353ba3fa', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:00:30.242220 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb20f5c-fc79-45a1-803d-02e863bd276d service nova] REQUEST_METHOD: `GET` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:00:30.243010 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb20f5c-fc79-45a1-803d-02e863bd276d service nova] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:00:30.243290 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb20f5c-fc79-45a1-803d-02e863bd276d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:00:30.251286 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eb20f5c-fc79-45a1-803d-02e863bd276d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:00:30.252932 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eb20f5c-fc79-45a1-803d-02e863bd276d service nova] RBAC: Authorization granted {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:00:30.262773 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 766/1518] 10.222.0.84 () {60 vars in 1365 bytes} [Wed May 25 15:00:30 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 15:00:38.418555 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0acff552-0a4d-424b-9040-86b89fe31b0f None None] REQUEST_METHOD: `GET` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:00:38.419095 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0acff552-0a4d-424b-9040-86b89fe31b0f None None] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:00:38.419095 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0acff552-0a4d-424b-9040-86b89fe31b0f None None] PATH_INFO: `/` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:00:38.420487 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 753/1519] 10.222.0.84 () {54 vars in 960 bytes} [Wed May 25 15:00:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 15:00:38.425274 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feada2d3-f849-435f-83c6-ccb9c20839d9 None None] REQUEST_METHOD: `POST` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:00:38.425679 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feada2d3-f849-435f-83c6-ccb9c20839d9 None None] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:00:38.425849 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feada2d3-f849-435f-83c6-ccb9c20839d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:00:38.445238 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.auth.core [None req-feada2d3-f849-435f-83c6-ccb9c20839d9 None None] MFA Rules not processed for user `d18c4a1d92b94c0087a203db4fed22f2`. Rule list: `[]` (Enabled: `True`). {{(pid=101893) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:00:38.446433 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.fernet_utils [None req-feada2d3-f849-435f-83c6-ccb9c20839d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=101893) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:00:38.454855 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 767/1520] 10.222.0.84 () {58 vars in 1057 bytes} [Wed May 25 15:00:38 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 15:00:38.462377 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0acff552-0a4d-424b-9040-86b89fe31b0f None None] Authenticating user token {{(pid=101892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:00:38.475931 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0acff552-0a4d-424b-9040-86b89fe31b0f None None] Validating token access rules against request {{(pid=101892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:00:38.481428 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc8e9b12-7227-47ec-a80c-ef753217e2ad service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd18c4a1d92b94c0087a203db4fed22f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a000829c658c4a7cab67f7b6353ba3fa', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:00:38.482181 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc8e9b12-7227-47ec-a80c-ef753217e2ad service placement] REQUEST_METHOD: `GET` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:00:38.482468 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc8e9b12-7227-47ec-a80c-ef753217e2ad service placement] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:00:38.482748 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc8e9b12-7227-47ec-a80c-ef753217e2ad service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:00:38.490736 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc8e9b12-7227-47ec-a80c-ef753217e2ad service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:00:38.492383 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc8e9b12-7227-47ec-a80c-ef753217e2ad service placement] RBAC: Authorization granted {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:00:38.501808 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 754/1521] 10.222.0.84 () {60 vars in 1365 bytes} [Wed May 25 15:00:38 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 15:00:41.523352 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2814657-db1c-4248-a90e-6a02f84aee3a None None] REQUEST_METHOD: `GET` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:00:41.523968 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2814657-db1c-4248-a90e-6a02f84aee3a None None] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:00:41.523968 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2814657-db1c-4248-a90e-6a02f84aee3a None None] PATH_INFO: `/` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:00:41.525379 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 768/1522] 127.0.0.1 () {54 vars in 901 bytes} [Wed May 25 15:00:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 15:00:41.530030 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8d2493-682d-4f07-b596-ad87276b1841 None None] REQUEST_METHOD: `POST` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:00:41.530461 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8d2493-682d-4f07-b596-ad87276b1841 None None] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:00:41.530607 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8d2493-682d-4f07-b596-ad87276b1841 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:00:41.550634 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.auth.core [None req-cc8d2493-682d-4f07-b596-ad87276b1841 None None] MFA Rules not processed for user `05d87e87798e429aa1c10b24391f915e`. Rule list: `[]` (Enabled: `True`). {{(pid=101892) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:00:41.551873 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.fernet_utils [None req-cc8d2493-682d-4f07-b596-ad87276b1841 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=101892) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:00:41.560355 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 755/1523] 127.0.0.1 () {58 vars in 998 bytes} [Wed May 25 15:00:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 15:00:41.709799 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2814657-db1c-4248-a90e-6a02f84aee3a None None] Authenticating user token {{(pid=101893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:00:41.724295 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2814657-db1c-4248-a90e-6a02f84aee3a None None] Validating token access rules against request {{(pid=101893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:00:41.731514 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94fea11e-d6ac-4548-b0bd-4d4c44685a9d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2aeb182e6a5b43cfb0cc347ec847c848', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a000829c658c4a7cab67f7b6353ba3fa', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:00:41.731514 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94fea11e-d6ac-4548-b0bd-4d4c44685a9d service nova] REQUEST_METHOD: `GET` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:00:41.731514 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94fea11e-d6ac-4548-b0bd-4d4c44685a9d service nova] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:00:41.731514 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94fea11e-d6ac-4548-b0bd-4d4c44685a9d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:00:41.739813 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94fea11e-d6ac-4548-b0bd-4d4c44685a9d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:00:41.741398 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94fea11e-d6ac-4548-b0bd-4d4c44685a9d service nova] RBAC: Authorization granted {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:00:41.750841 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 769/1524] 10.222.0.84 () {60 vars in 1365 bytes} [Wed May 25 15:00:41 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 15:00:42.621581 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2d8a8f-801b-493e-8a92-58e24e45aff9 None None] REQUEST_METHOD: `GET` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:00:42.622151 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2d8a8f-801b-493e-8a92-58e24e45aff9 None None] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:00:42.622151 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2d8a8f-801b-493e-8a92-58e24e45aff9 None None] PATH_INFO: `/` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:00:42.623539 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 756/1525] 127.0.0.1 () {54 vars in 901 bytes} [Wed May 25 15:00:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 15:00:42.628304 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56bacaad-52e8-4d53-b650-5fbc28877c9a None None] REQUEST_METHOD: `POST` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:00:42.628768 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56bacaad-52e8-4d53-b650-5fbc28877c9a None None] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:00:42.628887 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56bacaad-52e8-4d53-b650-5fbc28877c9a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:00:42.646195 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.auth.core [None req-56bacaad-52e8-4d53-b650-5fbc28877c9a None None] MFA Rules not processed for user `05d87e87798e429aa1c10b24391f915e`. Rule list: `[]` (Enabled: `True`). {{(pid=101893) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:00:42.647382 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.fernet_utils [None req-56bacaad-52e8-4d53-b650-5fbc28877c9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=101893) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:00:42.654993 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 770/1526] 127.0.0.1 () {58 vars in 998 bytes} [Wed May 25 15:00:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 15:00:42.809189 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc2d8a8f-801b-493e-8a92-58e24e45aff9 None None] Authenticating user token {{(pid=101892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:00:42.823130 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc2d8a8f-801b-493e-8a92-58e24e45aff9 None None] Validating token access rules against request {{(pid=101892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:00:42.832287 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad8335dc-7c4d-4b84-90b6-9dd975f1193e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2aeb182e6a5b43cfb0cc347ec847c848', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a000829c658c4a7cab67f7b6353ba3fa', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:00:42.834588 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8335dc-7c4d-4b84-90b6-9dd975f1193e service nova] REQUEST_METHOD: `GET` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:00:42.834588 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8335dc-7c4d-4b84-90b6-9dd975f1193e service nova] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:00:42.834588 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8335dc-7c4d-4b84-90b6-9dd975f1193e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:00:42.847305 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad8335dc-7c4d-4b84-90b6-9dd975f1193e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:00:42.848941 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad8335dc-7c4d-4b84-90b6-9dd975f1193e service nova] RBAC: Authorization granted {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:00:42.859219 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 757/1527] 10.222.0.84 () {60 vars in 1365 bytes} [Wed May 25 15:00:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 15:00:46.990453 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55548928-6f38-4cc6-980e-84d41e6e2afd None None] REQUEST_METHOD: `GET` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:00:46.991035 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55548928-6f38-4cc6-980e-84d41e6e2afd None None] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:00:46.991035 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55548928-6f38-4cc6-980e-84d41e6e2afd None None] PATH_INFO: `/` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:00:46.992536 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 771/1528] 127.0.0.1 () {54 vars in 916 bytes} [Wed May 25 15:00:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 15:00:46.998642 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab58df9-1c00-437c-8331-2048091a11f0 None None] REQUEST_METHOD: `POST` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:00:46.999103 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab58df9-1c00-437c-8331-2048091a11f0 None None] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:00:46.999223 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab58df9-1c00-437c-8331-2048091a11f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:00:47.016931 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.auth.core [None req-1ab58df9-1c00-437c-8331-2048091a11f0 None None] MFA Rules not processed for user `05d87e87798e429aa1c10b24391f915e`. Rule list: `[]` (Enabled: `True`). {{(pid=101892) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:00:47.018124 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.fernet_utils [None req-1ab58df9-1c00-437c-8331-2048091a11f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=101892) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:00:47.025784 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 758/1529] 127.0.0.1 () {58 vars in 1013 bytes} [Wed May 25 15:00:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 25 15:00:47.065901 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55548928-6f38-4cc6-980e-84d41e6e2afd None None] Authenticating user token {{(pid=101893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:00:47.067619 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.fernet_utils [None req-55548928-6f38-4cc6-980e-84d41e6e2afd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=101893) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:00:47.124550 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55548928-6f38-4cc6-980e-84d41e6e2afd None None] Validating token access rules against request {{(pid=101893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:00:47.128034 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ac5dc2-c008-4ce7-8191-fd561a540eb9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ce28b25b907473588ccb87dc4acc06a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a000829c658c4a7cab67f7b6353ba3fa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:00:47.128669 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ac5dc2-c008-4ce7-8191-fd561a540eb9 service neutron] REQUEST_METHOD: `GET` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:00:47.128948 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ac5dc2-c008-4ce7-8191-fd561a540eb9 service neutron] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:00:47.129222 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ac5dc2-c008-4ce7-8191-fd561a540eb9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:00:47.137843 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07ac5dc2-c008-4ce7-8191-fd561a540eb9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:00:47.139372 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07ac5dc2-c008-4ce7-8191-fd561a540eb9 service neutron] RBAC: Authorization granted {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:00:47.148481 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 772/1530] 10.222.0.84 () {60 vars in 1365 bytes} [Wed May 25 15:00:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 15:00:49.352044 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94070aea-d132-412d-9ce1-8b68a0aaafd3 None None] REQUEST_METHOD: `GET` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:00:49.355610 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94070aea-d132-412d-9ce1-8b68a0aaafd3 None None] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:00:49.355610 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94070aea-d132-412d-9ce1-8b68a0aaafd3 None None] PATH_INFO: `/` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:00:49.355610 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 759/1531] 127.0.0.1 () {54 vars in 916 bytes} [Wed May 25 15:00:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 15:00:49.359247 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53131264-7b08-41f1-9d7c-b713012b860d None None] REQUEST_METHOD: `POST` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:00:49.359687 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53131264-7b08-41f1-9d7c-b713012b860d None None] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:00:49.359894 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53131264-7b08-41f1-9d7c-b713012b860d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:00:49.377980 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.auth.core [None req-53131264-7b08-41f1-9d7c-b713012b860d None None] MFA Rules not processed for user `05d87e87798e429aa1c10b24391f915e`. Rule list: `[]` (Enabled: `True`). {{(pid=101893) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:00:49.379177 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.fernet_utils [None req-53131264-7b08-41f1-9d7c-b713012b860d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=101893) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:00:49.387633 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 773/1532] 127.0.0.1 () {58 vars in 1013 bytes} [Wed May 25 15:00:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 15:00:49.423147 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94070aea-d132-412d-9ce1-8b68a0aaafd3 None None] Authenticating user token {{(pid=101892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:00:49.434000 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94070aea-d132-412d-9ce1-8b68a0aaafd3 None None] Validating token access rules against request {{(pid=101892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:00:49.437460 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34320b2b-ca0d-4bf5-ba80-d004b3b0c06b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ce28b25b907473588ccb87dc4acc06a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a000829c658c4a7cab67f7b6353ba3fa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:00:49.441641 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34320b2b-ca0d-4bf5-ba80-d004b3b0c06b service neutron] REQUEST_METHOD: `GET` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:00:49.441641 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34320b2b-ca0d-4bf5-ba80-d004b3b0c06b service neutron] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:00:49.441641 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34320b2b-ca0d-4bf5-ba80-d004b3b0c06b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:00:49.447876 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34320b2b-ca0d-4bf5-ba80-d004b3b0c06b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:00:49.449287 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34320b2b-ca0d-4bf5-ba80-d004b3b0c06b service neutron] RBAC: Authorization granted {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:00:49.459072 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 760/1533] 10.222.0.84 () {60 vars in 1365 bytes} [Wed May 25 15:00:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 15:00:53.171673 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48be5b09-160a-4ffa-9878-0c84984cf5a1 None None] REQUEST_METHOD: `GET` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:00:53.172251 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48be5b09-160a-4ffa-9878-0c84984cf5a1 None None] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:00:53.172251 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48be5b09-160a-4ffa-9878-0c84984cf5a1 None None] PATH_INFO: `/` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:00:53.173588 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 774/1534] 127.0.0.1 () {54 vars in 916 bytes} [Wed May 25 15:00:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 15:00:53.178813 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20ffcfc-bf30-4664-8e23-df82f17b9ca1 None None] REQUEST_METHOD: `POST` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:00:53.179289 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20ffcfc-bf30-4664-8e23-df82f17b9ca1 None None] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:00:53.179392 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20ffcfc-bf30-4664-8e23-df82f17b9ca1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:00:53.197997 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.auth.core [None req-b20ffcfc-bf30-4664-8e23-df82f17b9ca1 None None] MFA Rules not processed for user `05d87e87798e429aa1c10b24391f915e`. Rule list: `[]` (Enabled: `True`). {{(pid=101892) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:00:53.199197 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.fernet_utils [None req-b20ffcfc-bf30-4664-8e23-df82f17b9ca1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=101892) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:00:53.206988 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 761/1535] 127.0.0.1 () {58 vars in 1013 bytes} [Wed May 25 15:00:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 15:00:53.484393 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48be5b09-160a-4ffa-9878-0c84984cf5a1 None None] Authenticating user token {{(pid=101893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:00:53.486074 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.fernet_utils [None req-48be5b09-160a-4ffa-9878-0c84984cf5a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=101893) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:00:53.542970 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48be5b09-160a-4ffa-9878-0c84984cf5a1 None None] Validating token access rules against request {{(pid=101893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:00:53.546517 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-274dc61e-5ee0-47de-ace0-56504203cb70 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e079f89a5e524ab6ad4183e4f690de07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a000829c658c4a7cab67f7b6353ba3fa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:00:53.547154 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274dc61e-5ee0-47de-ace0-56504203cb70 service cinder] REQUEST_METHOD: `GET` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:00:53.547437 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274dc61e-5ee0-47de-ace0-56504203cb70 service cinder] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:00:53.547746 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274dc61e-5ee0-47de-ace0-56504203cb70 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:00:53.557515 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-274dc61e-5ee0-47de-ace0-56504203cb70 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:00:53.558962 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-274dc61e-5ee0-47de-ace0-56504203cb70 service cinder] RBAC: Authorization granted {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:00:53.563923 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG dbcounter [-] [101893] Writing DB stats keystone:SELECT=100 {{(pid=101893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:00:53.568590 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 775/1536] 10.222.0.84 () {60 vars in 1365 bytes} [Wed May 25 15:00:53 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 15:00:55.766833 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4879a719-347e-4c33-bfab-edadb96d0d5f None None] REQUEST_METHOD: `GET` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:00:55.767349 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4879a719-347e-4c33-bfab-edadb96d0d5f None None] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:00:55.767349 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4879a719-347e-4c33-bfab-edadb96d0d5f None None] PATH_INFO: `/` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:00:55.768687 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 762/1537] 127.0.0.1 () {54 vars in 916 bytes} [Wed May 25 15:00:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 15:00:55.773948 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a8888b-06e5-4e4d-8593-87fa9d774fff None None] REQUEST_METHOD: `POST` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:00:55.774907 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a8888b-06e5-4e4d-8593-87fa9d774fff None None] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:00:55.775020 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a8888b-06e5-4e4d-8593-87fa9d774fff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:00:55.793402 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.auth.core [None req-c3a8888b-06e5-4e4d-8593-87fa9d774fff None None] MFA Rules not processed for user `05d87e87798e429aa1c10b24391f915e`. Rule list: `[]` (Enabled: `True`). {{(pid=101893) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:00:55.794611 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.fernet_utils [None req-c3a8888b-06e5-4e4d-8593-87fa9d774fff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=101893) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:00:55.802387 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 776/1538] 127.0.0.1 () {58 vars in 1013 bytes} [Wed May 25 15:00:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 15:00:56.076043 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4879a719-347e-4c33-bfab-edadb96d0d5f None None] Authenticating user token {{(pid=101892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:00:56.077736 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.fernet_utils [None req-4879a719-347e-4c33-bfab-edadb96d0d5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=101892) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:00:56.085416 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG dbcounter [-] [101892] Writing DB stats keystone:SELECT=94 {{(pid=101892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:00:56.091000 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4879a719-347e-4c33-bfab-edadb96d0d5f None None] Validating token access rules against request {{(pid=101892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:00:56.094455 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21fa2468-f694-43ed-96f6-fc2cf53b6a47 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e079f89a5e524ab6ad4183e4f690de07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a000829c658c4a7cab67f7b6353ba3fa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:00:56.096068 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21fa2468-f694-43ed-96f6-fc2cf53b6a47 service cinder] REQUEST_METHOD: `GET` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:00:56.096068 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21fa2468-f694-43ed-96f6-fc2cf53b6a47 service cinder] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:00:56.096068 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21fa2468-f694-43ed-96f6-fc2cf53b6a47 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:00:56.104794 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21fa2468-f694-43ed-96f6-fc2cf53b6a47 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:00:56.106196 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21fa2468-f694-43ed-96f6-fc2cf53b6a47 service cinder] RBAC: Authorization granted {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:00:56.115243 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 763/1539] 10.222.0.84 () {60 vars in 1365 bytes} [Wed May 25 15:00:56 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 15:01:05.787620 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG dbcounter [-] [101893] Writing DB stats keystone:SELECT=3 {{(pid=101893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:01:06.116819 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG dbcounter [-] [101892] Writing DB stats keystone:SELECT=5 {{(pid=101892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:02:41.290948 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3e9ae4-db51-40bc-99b8-985503a1581a None None] REQUEST_METHOD: `POST` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:02:41.292751 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3e9ae4-db51-40bc-99b8-985503a1581a None None] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:02:41.293238 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3e9ae4-db51-40bc-99b8-985503a1581a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:02:41.324359 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.auth.core [None req-7b3e9ae4-db51-40bc-99b8-985503a1581a None None] MFA Rules not processed for user `05d87e87798e429aa1c10b24391f915e`. Rule list: `[]` (Enabled: `True`). {{(pid=101893) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:02:41.325629 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.fernet_utils [None req-7b3e9ae4-db51-40bc-99b8-985503a1581a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=101893) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:02:41.339897 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 777/1540] 10.222.0.84 () {58 vars in 957 bytes} [Wed May 25 15:02:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 25 15:02:41.350714 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a6e513-ce2c-422c-abba-499905792922 None None] REQUEST_METHOD: `POST` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:02:41.351335 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a6e513-ce2c-422c-abba-499905792922 None None] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:02:41.351335 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a6e513-ce2c-422c-abba-499905792922 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:02:41.379920 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.auth.core [None req-46a6e513-ce2c-422c-abba-499905792922 None None] MFA Rules not processed for user `05d87e87798e429aa1c10b24391f915e`. Rule list: `[]` (Enabled: `True`). {{(pid=101892) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:02:41.381504 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.fernet_utils [None req-46a6e513-ce2c-422c-abba-499905792922 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=101892) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:02:41.389929 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 764/1541] 10.222.0.84 () {58 vars in 957 bytes} [Wed May 25 15:02:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 15:02:41.397918 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b3e9ae4-db51-40bc-99b8-985503a1581a None None] Authenticating user token {{(pid=101893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:02:41.413081 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b3e9ae4-db51-40bc-99b8-985503a1581a None None] Validating token access rules against request {{(pid=101893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:02:41.422296 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e86f50-7d07-4d59-9e77-20b03b0b6833 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cec56f74b2fa4826a506dc7b919465be', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:02:41.422975 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e86f50-7d07-4d59-9e77-20b03b0b6833 admin admin] REQUEST_METHOD: `GET` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:02:41.423261 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e86f50-7d07-4d59-9e77-20b03b0b6833 admin admin] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:02:41.423539 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e86f50-7d07-4d59-9e77-20b03b0b6833 admin admin] PATH_INFO: `/v3/domains` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:02:41.424295 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3e86f50-7d07-4d59-9e77-20b03b0b6833 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=101893) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 15:02:41.424610 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3e86f50-7d07-4d59-9e77-20b03b0b6833 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:02:41.426219 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3e86f50-7d07-4d59-9e77-20b03b0b6833 admin admin] RBAC: Authorization granted {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:02:41.445006 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 778/1542] 10.222.0.84 () {58 vars in 1152 bytes} [Wed May 25 15:02:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 15:02:41.461508 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46a6e513-ce2c-422c-abba-499905792922 None None] Authenticating user token {{(pid=101892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:02:41.477073 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46a6e513-ce2c-422c-abba-499905792922 None None] Validating token access rules against request {{(pid=101892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:02:41.482363 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee428488-b166-4f28-93f1-c602cf75ea39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cec56f74b2fa4826a506dc7b919465be', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:02:41.483030 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee428488-b166-4f28-93f1-c602cf75ea39 admin admin] REQUEST_METHOD: `POST` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:02:41.483315 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee428488-b166-4f28-93f1-c602cf75ea39 admin admin] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:02:41.483609 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee428488-b166-4f28-93f1-c602cf75ea39 admin admin] PATH_INFO: `/v3/projects` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:02:41.484300 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee428488-b166-4f28-93f1-c602cf75ea39 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:02:41.486192 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee428488-b166-4f28-93f1-c602cf75ea39 admin admin] RBAC: Authorization granted {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:02:41.491432 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f1941b-6bab-4c30-9641-25957ac345e5 None None] REQUEST_METHOD: `POST` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:02:41.492114 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f1941b-6bab-4c30-9641-25957ac345e5 None None] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:02:41.492804 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f1941b-6bab-4c30-9641-25957ac345e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:02:41.529373 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.auth.core [None req-a7f1941b-6bab-4c30-9641-25957ac345e5 None None] MFA Rules not processed for user `05d87e87798e429aa1c10b24391f915e`. Rule list: `[]` (Enabled: `True`). {{(pid=101893) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:02:41.530665 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.fernet_utils [None req-a7f1941b-6bab-4c30-9641-25957ac345e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=101893) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:02:41.546154 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 779/1543] 10.222.0.84 () {58 vars in 957 bytes} [Wed May 25 15:02:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 55 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 15:02:41.555795 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b5fe9c-248e-44f3-8f32-a4f21c914f9f None None] REQUEST_METHOD: `POST` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:02:41.561499 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b5fe9c-248e-44f3-8f32-a4f21c914f9f None None] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:02:41.561499 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b5fe9c-248e-44f3-8f32-a4f21c914f9f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:02:41.585723 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.auth.core [None req-64b5fe9c-248e-44f3-8f32-a4f21c914f9f None None] MFA Rules not processed for user `05d87e87798e429aa1c10b24391f915e`. Rule list: `[]` (Enabled: `True`). {{(pid=101893) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:02:41.587085 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.fernet_utils [None req-64b5fe9c-248e-44f3-8f32-a4f21c914f9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=101893) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:02:41.605150 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 765/1545] 10.222.0.84 () {60 vars in 1152 bytes} [Wed May 25 15:02:41 2022] POST /identity/v3/projects => generated 375 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 15:02:41.605564 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 780/1545] 10.222.0.84 () {58 vars in 957 bytes} [Wed May 25 15:02:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 25 15:02:41.606660 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a0448b-34c0-4c4f-8e17-2d71772dade7 None None] REQUEST_METHOD: `POST` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:02:41.606783 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d7f851-4102-4026-8a5f-bf3a93747c5c None None] REQUEST_METHOD: `POST` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:02:41.606889 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a0448b-34c0-4c4f-8e17-2d71772dade7 None None] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:02:41.607073 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d7f851-4102-4026-8a5f-bf3a93747c5c None None] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:02:41.607185 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a0448b-34c0-4c4f-8e17-2d71772dade7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:02:41.607277 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d7f851-4102-4026-8a5f-bf3a93747c5c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:02:41.640204 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.auth.core [None req-70d7f851-4102-4026-8a5f-bf3a93747c5c None None] MFA Rules not processed for user `05d87e87798e429aa1c10b24391f915e`. Rule list: `[]` (Enabled: `True`). {{(pid=101892) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:02:41.642205 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.fernet_utils [None req-70d7f851-4102-4026-8a5f-bf3a93747c5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=101892) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:02:41.647594 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.auth.core [None req-94a0448b-34c0-4c4f-8e17-2d71772dade7 None None] MFA Rules not processed for user `05d87e87798e429aa1c10b24391f915e`. Rule list: `[]` (Enabled: `True`). {{(pid=101893) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:02:41.647594 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.fernet_utils [None req-94a0448b-34c0-4c4f-8e17-2d71772dade7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=101893) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:02:41.722602 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 781/1546] 10.222.0.84 () {58 vars in 957 bytes} [Wed May 25 15:02:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 15:02:41.723771 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f866f267-041f-4575-9f2d-136f5e899921 None None] REQUEST_METHOD: `POST` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:02:41.724072 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f866f267-041f-4575-9f2d-136f5e899921 None None] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:02:41.724356 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f866f267-041f-4575-9f2d-136f5e899921 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:02:41.741844 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 766/1547] 10.222.0.84 () {58 vars in 957 bytes} [Wed May 25 15:02:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 15:02:41.743098 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d7f851-4102-4026-8a5f-bf3a93747c5c None None] Authenticating user token {{(pid=101892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:02:41.752891 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.auth.core [None req-f866f267-041f-4575-9f2d-136f5e899921 None None] MFA Rules not processed for user `05d87e87798e429aa1c10b24391f915e`. Rule list: `[]` (Enabled: `True`). {{(pid=101893) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:02:41.753102 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d7f851-4102-4026-8a5f-bf3a93747c5c None None] Validating token access rules against request {{(pid=101892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:02:41.754516 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.fernet_utils [None req-f866f267-041f-4575-9f2d-136f5e899921 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=101893) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:02:41.757565 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4616a4b-8a81-481b-89c3-a0a24a047dde admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cec56f74b2fa4826a506dc7b919465be', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:02:41.758228 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4616a4b-8a81-481b-89c3-a0a24a047dde admin admin] REQUEST_METHOD: `GET` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:02:41.758518 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4616a4b-8a81-481b-89c3-a0a24a047dde admin admin] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:02:41.758804 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4616a4b-8a81-481b-89c3-a0a24a047dde admin admin] PATH_INFO: `/v3/domains` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:02:41.759534 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4616a4b-8a81-481b-89c3-a0a24a047dde admin admin] RBAC: Adding query filter params (name=Default) {{(pid=101892) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 15:02:41.759881 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4616a4b-8a81-481b-89c3-a0a24a047dde admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:02:41.761507 dv-cinder-803823-9-smb devstack@keystone.service[101892]: WARNING py.warnings [None req-d4616a4b-8a81-481b-89c3-a0a24a047dde admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 25 15:02:41.761507 dv-cinder-803823-9-smb devstack@keystone.service[101892]: warnings.warn(msg) May 25 15:02:41.761507 dv-cinder-803823-9-smb devstack@keystone.service[101892]: May 25 15:02:41.762391 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4616a4b-8a81-481b-89c3-a0a24a047dde admin admin] RBAC: Authorization granted {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:02:41.771279 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 782/1548] 10.222.0.84 () {58 vars in 957 bytes} [Wed May 25 15:02:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 15:02:41.771279 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f866f267-041f-4575-9f2d-136f5e899921 None None] Authenticating user token {{(pid=101893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:02:41.774945 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 767/1549] 10.222.0.84 () {58 vars in 1152 bytes} [Wed May 25 15:02:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 15:02:41.776943 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c1458c-bbfe-42e6-95e3-659d6056ff6c None None] REQUEST_METHOD: `POST` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:02:41.777242 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c1458c-bbfe-42e6-95e3-659d6056ff6c None None] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:02:41.777522 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c1458c-bbfe-42e6-95e3-659d6056ff6c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:02:41.783253 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f866f267-041f-4575-9f2d-136f5e899921 None None] Validating token access rules against request {{(pid=101893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:02:41.788048 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece8f40f-086a-4c99-8fff-e20bc531b7bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cec56f74b2fa4826a506dc7b919465be', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:02:41.788771 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece8f40f-086a-4c99-8fff-e20bc531b7bd admin admin] REQUEST_METHOD: `POST` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:02:41.789062 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece8f40f-086a-4c99-8fff-e20bc531b7bd admin admin] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:02:41.789368 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece8f40f-086a-4c99-8fff-e20bc531b7bd admin admin] PATH_INFO: `/v3/users` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:02:41.790058 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ece8f40f-086a-4c99-8fff-e20bc531b7bd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:02:41.792085 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ece8f40f-086a-4c99-8fff-e20bc531b7bd admin admin] RBAC: Authorization granted {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:02:41.796012 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.auth.core [None req-b2c1458c-bbfe-42e6-95e3-659d6056ff6c None None] MFA Rules not processed for user `05d87e87798e429aa1c10b24391f915e`. Rule list: `[]` (Enabled: `True`). {{(pid=101892) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:02:41.797282 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.fernet_utils [None req-b2c1458c-bbfe-42e6-95e3-659d6056ff6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=101892) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:02:41.808511 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 768/1550] 10.222.0.84 () {58 vars in 957 bytes} [Wed May 25 15:02:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 15:02:41.810164 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a024fb-3b76-40de-898a-582850e5c15a None None] REQUEST_METHOD: `POST` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:02:41.810305 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a024fb-3b76-40de-898a-582850e5c15a None None] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:02:41.810487 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a024fb-3b76-40de-898a-582850e5c15a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:02:41.829074 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.auth.core [None req-54a024fb-3b76-40de-898a-582850e5c15a None None] MFA Rules not processed for user `05d87e87798e429aa1c10b24391f915e`. Rule list: `[]` (Enabled: `True`). {{(pid=101892) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:02:41.830324 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.fernet_utils [None req-54a024fb-3b76-40de-898a-582850e5c15a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=101892) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:02:41.838090 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 769/1551] 10.222.0.84 () {58 vars in 957 bytes} [Wed May 25 15:02:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 15:02:41.839899 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5d7c29-e8c4-4320-80c3-6c73f7af8553 None None] REQUEST_METHOD: `POST` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:02:41.840190 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5d7c29-e8c4-4320-80c3-6c73f7af8553 None None] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:02:41.840468 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5d7c29-e8c4-4320-80c3-6c73f7af8553 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:02:41.857826 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.auth.core [None req-ab5d7c29-e8c4-4320-80c3-6c73f7af8553 None None] MFA Rules not processed for user `05d87e87798e429aa1c10b24391f915e`. Rule list: `[]` (Enabled: `True`). {{(pid=101892) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:02:41.858991 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.fernet_utils [None req-ab5d7c29-e8c4-4320-80c3-6c73f7af8553 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=101892) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:02:41.866666 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 770/1552] 10.222.0.84 () {58 vars in 957 bytes} [Wed May 25 15:02:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 15:02:41.867907 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9c0a5e-9ff1-4d2c-aaab-cdb81c5213a7 None None] REQUEST_METHOD: `POST` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:02:41.868272 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9c0a5e-9ff1-4d2c-aaab-cdb81c5213a7 None None] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:02:41.868561 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9c0a5e-9ff1-4d2c-aaab-cdb81c5213a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:02:41.881053 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 783/1553] 10.222.0.84 () {60 vars in 1143 bytes} [Wed May 25 15:02:41 2022] POST /identity/v3/users => generated 288 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 15:02:41.882427 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be583ea1-11b8-46f2-8aae-1b03bcdc3e75 None None] REQUEST_METHOD: `POST` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:02:41.882729 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be583ea1-11b8-46f2-8aae-1b03bcdc3e75 None None] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:02:41.883013 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be583ea1-11b8-46f2-8aae-1b03bcdc3e75 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:02:41.886162 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.auth.core [None req-fe9c0a5e-9ff1-4d2c-aaab-cdb81c5213a7 None None] MFA Rules not processed for user `05d87e87798e429aa1c10b24391f915e`. Rule list: `[]` (Enabled: `True`). {{(pid=101892) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:02:41.890977 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.fernet_utils [None req-fe9c0a5e-9ff1-4d2c-aaab-cdb81c5213a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=101892) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:02:41.900007 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 771/1554] 10.222.0.84 () {58 vars in 957 bytes} [Wed May 25 15:02:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 15:02:41.900711 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe9c0a5e-9ff1-4d2c-aaab-cdb81c5213a7 None None] Authenticating user token {{(pid=101892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:02:41.904309 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.auth.core [None req-be583ea1-11b8-46f2-8aae-1b03bcdc3e75 None None] MFA Rules not processed for user `05d87e87798e429aa1c10b24391f915e`. Rule list: `[]` (Enabled: `True`). {{(pid=101893) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:02:41.905511 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.fernet_utils [None req-be583ea1-11b8-46f2-8aae-1b03bcdc3e75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=101893) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:02:41.911175 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe9c0a5e-9ff1-4d2c-aaab-cdb81c5213a7 None None] Validating token access rules against request {{(pid=101892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:02:41.914130 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 784/1555] 10.222.0.84 () {58 vars in 957 bytes} [Wed May 25 15:02:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 15:02:41.915401 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da184add-82df-4a68-b97e-90c9022f50aa None None] REQUEST_METHOD: `POST` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:02:41.915726 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da184add-82df-4a68-b97e-90c9022f50aa None None] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:02:41.915947 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7230ef35-5d29-4084-9a04-98f2f90626a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cec56f74b2fa4826a506dc7b919465be', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:02:41.916068 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da184add-82df-4a68-b97e-90c9022f50aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:02:41.916609 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7230ef35-5d29-4084-9a04-98f2f90626a3 admin admin] REQUEST_METHOD: `POST` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:02:41.916897 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7230ef35-5d29-4084-9a04-98f2f90626a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:02:41.917203 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7230ef35-5d29-4084-9a04-98f2f90626a3 admin admin] PATH_INFO: `/v3/projects` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:02:41.917852 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7230ef35-5d29-4084-9a04-98f2f90626a3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:02:41.919772 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7230ef35-5d29-4084-9a04-98f2f90626a3 admin admin] RBAC: Authorization granted {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:02:41.934372 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.auth.core [None req-da184add-82df-4a68-b97e-90c9022f50aa None None] MFA Rules not processed for user `05d87e87798e429aa1c10b24391f915e`. Rule list: `[]` (Enabled: `True`). {{(pid=101893) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:02:41.935751 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.fernet_utils [None req-da184add-82df-4a68-b97e-90c9022f50aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=101893) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:02:41.943711 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 785/1556] 10.222.0.84 () {58 vars in 957 bytes} [Wed May 25 15:02:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 15:02:41.944928 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4fd8b42-4ea3-4556-aaef-f482cf32d8dc None None] REQUEST_METHOD: `POST` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:02:41.945216 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4fd8b42-4ea3-4556-aaef-f482cf32d8dc None None] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:02:41.945493 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4fd8b42-4ea3-4556-aaef-f482cf32d8dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:02:41.966332 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.auth.core [None req-d4fd8b42-4ea3-4556-aaef-f482cf32d8dc None None] MFA Rules not processed for user `05d87e87798e429aa1c10b24391f915e`. Rule list: `[]` (Enabled: `True`). {{(pid=101893) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:02:41.967536 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.fernet_utils [None req-d4fd8b42-4ea3-4556-aaef-f482cf32d8dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=101893) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:02:41.975444 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 786/1557] 10.222.0.84 () {58 vars in 957 bytes} [Wed May 25 15:02:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 15:02:41.976684 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3843c7-6b05-4f18-9766-315a9ce5ed41 None None] REQUEST_METHOD: `POST` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:02:41.976979 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3843c7-6b05-4f18-9766-315a9ce5ed41 None None] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:02:41.977283 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3843c7-6b05-4f18-9766-315a9ce5ed41 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:02:41.995045 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.auth.core [None req-4b3843c7-6b05-4f18-9766-315a9ce5ed41 None None] MFA Rules not processed for user `05d87e87798e429aa1c10b24391f915e`. Rule list: `[]` (Enabled: `True`). {{(pid=101893) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:02:41.996438 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.fernet_utils [None req-4b3843c7-6b05-4f18-9766-315a9ce5ed41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=101893) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:02:42.006592 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 772/1558] 10.222.0.84 () {60 vars in 1152 bytes} [Wed May 25 15:02:41 2022] POST /identity/v3/projects => generated 375 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 15:02:42.006592 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7230ef35-5d29-4084-9a04-98f2f90626a3 admin admin] Authenticating user token {{(pid=101892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:02:42.006867 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 787/1559] 10.222.0.84 () {58 vars in 957 bytes} [Wed May 25 15:02:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 15:02:42.006867 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b3843c7-6b05-4f18-9766-315a9ce5ed41 None None] Authenticating user token {{(pid=101893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:02:42.016274 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b3843c7-6b05-4f18-9766-315a9ce5ed41 None None] Validating token access rules against request {{(pid=101893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:02:42.069276 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7230ef35-5d29-4084-9a04-98f2f90626a3 admin admin] Validating token access rules against request {{(pid=101892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:02:42.073472 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cfb2d52-c3d4-4526-9829-23f1f2710de2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cec56f74b2fa4826a506dc7b919465be', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:02:42.074151 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cfb2d52-c3d4-4526-9829-23f1f2710de2 admin admin] REQUEST_METHOD: `GET` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:02:42.074439 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cfb2d52-c3d4-4526-9829-23f1f2710de2 admin admin] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:02:42.076193 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cfb2d52-c3d4-4526-9829-23f1f2710de2 admin admin] PATH_INFO: `/v3/roles` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:02:42.076375 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74abe77a-a92d-4b93-88d4-211c619a5e5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cec56f74b2fa4826a506dc7b919465be', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:02:42.076498 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cfb2d52-c3d4-4526-9829-23f1f2710de2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:02:42.076598 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74abe77a-a92d-4b93-88d4-211c619a5e5c admin admin] REQUEST_METHOD: `GET` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:02:42.076598 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74abe77a-a92d-4b93-88d4-211c619a5e5c admin admin] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:02:42.076598 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74abe77a-a92d-4b93-88d4-211c619a5e5c admin admin] PATH_INFO: `/v3/domains` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:02:42.076901 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74abe77a-a92d-4b93-88d4-211c619a5e5c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=101892) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 15:02:42.077105 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cfb2d52-c3d4-4526-9829-23f1f2710de2 admin admin] RBAC: Authorization granted {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:02:42.077203 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74abe77a-a92d-4b93-88d4-211c619a5e5c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:02:42.079035 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74abe77a-a92d-4b93-88d4-211c619a5e5c admin admin] RBAC: Authorization granted {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:02:42.090351 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 788/1560] 10.222.0.84 () {58 vars in 1121 bytes} [Wed May 25 15:02:42 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 15:02:42.090351 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cfb2d52-c3d4-4526-9829-23f1f2710de2 admin admin] Authenticating user token {{(pid=101893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:02:42.103430 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 773/1561] 10.222.0.84 () {58 vars in 1152 bytes} [Wed May 25 15:02:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 15:02:42.103430 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74abe77a-a92d-4b93-88d4-211c619a5e5c admin admin] Authenticating user token {{(pid=101892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:02:42.103673 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cfb2d52-c3d4-4526-9829-23f1f2710de2 admin admin] Validating token access rules against request {{(pid=101893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:02:42.103781 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG dbcounter [-] [101892] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=101892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:02:42.103915 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4288313c-b92d-456c-8b0a-85e7b1b2a630 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cec56f74b2fa4826a506dc7b919465be', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:02:42.104151 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4288313c-b92d-456c-8b0a-85e7b1b2a630 admin admin] REQUEST_METHOD: `GET` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:02:42.104421 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4288313c-b92d-456c-8b0a-85e7b1b2a630 admin admin] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:02:42.104700 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4288313c-b92d-456c-8b0a-85e7b1b2a630 admin admin] PATH_INFO: `/v3/domains` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:02:42.105495 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4288313c-b92d-456c-8b0a-85e7b1b2a630 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=101893) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 15:02:42.105806 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4288313c-b92d-456c-8b0a-85e7b1b2a630 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:02:42.106291 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74abe77a-a92d-4b93-88d4-211c619a5e5c admin admin] Validating token access rules against request {{(pid=101892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:02:42.107407 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4288313c-b92d-456c-8b0a-85e7b1b2a630 admin admin] RBAC: Authorization granted {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:02:42.111832 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac711ca-f30f-42b0-bb70-89a8e11f0d18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cec56f74b2fa4826a506dc7b919465be', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:02:42.112488 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac711ca-f30f-42b0-bb70-89a8e11f0d18 admin admin] REQUEST_METHOD: `GET` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:02:42.112775 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac711ca-f30f-42b0-bb70-89a8e11f0d18 admin admin] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:02:42.113056 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac711ca-f30f-42b0-bb70-89a8e11f0d18 admin admin] PATH_INFO: `/v3/domains` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:02:42.113778 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eac711ca-f30f-42b0-bb70-89a8e11f0d18 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=101892) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 15:02:42.114089 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eac711ca-f30f-42b0-bb70-89a8e11f0d18 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:02:42.116455 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eac711ca-f30f-42b0-bb70-89a8e11f0d18 admin admin] RBAC: Authorization granted {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:02:42.116593 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG dbcounter [-] [101893] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=101893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:02:42.120751 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 789/1562] 10.222.0.84 () {58 vars in 1152 bytes} [Wed May 25 15:02:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 15:02:42.121974 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd1cf93-2f64-47f5-87f9-dd9a491d95a0 None None] REQUEST_METHOD: `POST` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:02:42.122258 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd1cf93-2f64-47f5-87f9-dd9a491d95a0 None None] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:02:42.122529 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd1cf93-2f64-47f5-87f9-dd9a491d95a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:02:42.128842 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 774/1563] 10.222.0.84 () {58 vars in 1152 bytes} [Wed May 25 15:02:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 15:02:42.132282 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac711ca-f30f-42b0-bb70-89a8e11f0d18 admin admin] Authenticating user token {{(pid=101892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:02:42.140012 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac711ca-f30f-42b0-bb70-89a8e11f0d18 admin admin] Validating token access rules against request {{(pid=101892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:02:42.141220 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.auth.core [None req-edd1cf93-2f64-47f5-87f9-dd9a491d95a0 None None] MFA Rules not processed for user `05d87e87798e429aa1c10b24391f915e`. Rule list: `[]` (Enabled: `True`). {{(pid=101893) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:02:42.142432 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.fernet_utils [None req-edd1cf93-2f64-47f5-87f9-dd9a491d95a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=101893) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:02:42.144815 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6836f15-7e89-4d5c-9b04-251d6ada02b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cec56f74b2fa4826a506dc7b919465be', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:02:42.145470 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6836f15-7e89-4d5c-9b04-251d6ada02b7 admin admin] REQUEST_METHOD: `GET` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:02:42.145748 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6836f15-7e89-4d5c-9b04-251d6ada02b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:02:42.146019 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6836f15-7e89-4d5c-9b04-251d6ada02b7 admin admin] PATH_INFO: `/v3/domains` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:02:42.146734 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6836f15-7e89-4d5c-9b04-251d6ada02b7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=101892) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 15:02:42.147085 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6836f15-7e89-4d5c-9b04-251d6ada02b7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:02:42.148817 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6836f15-7e89-4d5c-9b04-251d6ada02b7 admin admin] RBAC: Authorization granted {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:02:42.150383 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 790/1564] 10.222.0.84 () {58 vars in 957 bytes} [Wed May 25 15:02:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 15:02:42.151701 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd1cf93-2f64-47f5-87f9-dd9a491d95a0 None None] Authenticating user token {{(pid=101893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:02:42.160765 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd1cf93-2f64-47f5-87f9-dd9a491d95a0 None None] Validating token access rules against request {{(pid=101893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:02:42.165338 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-970691e1-7f9d-412a-b4f3-b07a36688d7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cec56f74b2fa4826a506dc7b919465be', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:02:42.165865 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 775/1565] 10.222.0.84 () {58 vars in 1152 bytes} [Wed May 25 15:02:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 15:02:42.166016 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970691e1-7f9d-412a-b4f3-b07a36688d7b admin admin] REQUEST_METHOD: `POST` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:02:42.166273 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970691e1-7f9d-412a-b4f3-b07a36688d7b admin admin] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:02:42.166550 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970691e1-7f9d-412a-b4f3-b07a36688d7b admin admin] PATH_INFO: `/v3/users` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:02:42.166699 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6836f15-7e89-4d5c-9b04-251d6ada02b7 admin admin] Authenticating user token {{(pid=101892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:02:42.167887 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-970691e1-7f9d-412a-b4f3-b07a36688d7b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:02:42.169814 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-970691e1-7f9d-412a-b4f3-b07a36688d7b admin admin] RBAC: Authorization granted {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:02:42.177721 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6836f15-7e89-4d5c-9b04-251d6ada02b7 admin admin] Validating token access rules against request {{(pid=101892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:02:42.182399 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7bbcea4-213b-4ec0-ab8d-7acec2e39fe0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cec56f74b2fa4826a506dc7b919465be', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:02:42.187222 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7bbcea4-213b-4ec0-ab8d-7acec2e39fe0 admin admin] REQUEST_METHOD: `GET` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:02:42.187222 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7bbcea4-213b-4ec0-ab8d-7acec2e39fe0 admin admin] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:02:42.187222 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7bbcea4-213b-4ec0-ab8d-7acec2e39fe0 admin admin] PATH_INFO: `/v3/domains` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:02:42.187222 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7bbcea4-213b-4ec0-ab8d-7acec2e39fe0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=101892) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 15:02:42.187222 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7bbcea4-213b-4ec0-ab8d-7acec2e39fe0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:02:42.187222 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7bbcea4-213b-4ec0-ab8d-7acec2e39fe0 admin admin] RBAC: Authorization granted {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:02:42.197422 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 776/1566] 10.222.0.84 () {58 vars in 1152 bytes} [Wed May 25 15:02:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 15:02:42.198235 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7bbcea4-213b-4ec0-ab8d-7acec2e39fe0 admin admin] Authenticating user token {{(pid=101892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:02:42.207652 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7bbcea4-213b-4ec0-ab8d-7acec2e39fe0 admin admin] Validating token access rules against request {{(pid=101892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:02:42.212199 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca6d1e42-30e0-40a5-89db-6a10e753616f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cec56f74b2fa4826a506dc7b919465be', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:02:42.212836 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6d1e42-30e0-40a5-89db-6a10e753616f admin admin] REQUEST_METHOD: `GET` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:02:42.213124 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6d1e42-30e0-40a5-89db-6a10e753616f admin admin] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:02:42.213936 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6d1e42-30e0-40a5-89db-6a10e753616f admin admin] PATH_INFO: `/v3/roles` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:02:42.214647 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca6d1e42-30e0-40a5-89db-6a10e753616f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:02:42.216316 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca6d1e42-30e0-40a5-89db-6a10e753616f admin admin] RBAC: Authorization granted {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:02:42.225866 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 777/1567] 10.222.0.84 () {58 vars in 1121 bytes} [Wed May 25 15:02:42 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 15:02:42.226609 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca6d1e42-30e0-40a5-89db-6a10e753616f admin admin] Authenticating user token {{(pid=101892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:02:42.236268 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca6d1e42-30e0-40a5-89db-6a10e753616f admin admin] Validating token access rules against request {{(pid=101892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:02:42.240747 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-931bd915-ec38-4d9e-9b6c-169a77f6c43f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cec56f74b2fa4826a506dc7b919465be', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:02:42.241354 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931bd915-ec38-4d9e-9b6c-169a77f6c43f admin admin] REQUEST_METHOD: `POST` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:02:42.241641 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931bd915-ec38-4d9e-9b6c-169a77f6c43f admin admin] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:02:42.241925 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931bd915-ec38-4d9e-9b6c-169a77f6c43f admin admin] PATH_INFO: `/v3/projects` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:02:42.242601 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-931bd915-ec38-4d9e-9b6c-169a77f6c43f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:02:42.244520 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-931bd915-ec38-4d9e-9b6c-169a77f6c43f admin admin] RBAC: Authorization granted {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:02:42.346091 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 791/1568] 10.222.0.84 () {60 vars in 1143 bytes} [Wed May 25 15:02:42 2022] POST /identity/v3/users => generated 288 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 15:02:42.346091 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-970691e1-7f9d-412a-b4f3-b07a36688d7b admin admin] Authenticating user token {{(pid=101893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:02:42.355243 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-970691e1-7f9d-412a-b4f3-b07a36688d7b admin admin] Validating token access rules against request {{(pid=101893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:02:42.359895 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c119d74-c742-40a7-9a9c-a25946d84d41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cec56f74b2fa4826a506dc7b919465be', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:02:42.360524 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c119d74-c742-40a7-9a9c-a25946d84d41 admin admin] REQUEST_METHOD: `POST` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:02:42.360806 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c119d74-c742-40a7-9a9c-a25946d84d41 admin admin] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:02:42.361082 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c119d74-c742-40a7-9a9c-a25946d84d41 admin admin] PATH_INFO: `/v3/projects` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:02:42.361747 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c119d74-c742-40a7-9a9c-a25946d84d41 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:02:42.362817 dv-cinder-803823-9-smb devstack@keystone.service[101893]: WARNING py.warnings [None req-6c119d74-c742-40a7-9a9c-a25946d84d41 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 25 15:02:42.362817 dv-cinder-803823-9-smb devstack@keystone.service[101893]: warnings.warn(msg) May 25 15:02:42.362817 dv-cinder-803823-9-smb devstack@keystone.service[101893]: May 25 15:02:42.364025 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c119d74-c742-40a7-9a9c-a25946d84d41 admin admin] RBAC: Authorization granted {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:02:42.373748 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 778/1569] 10.222.0.84 () {60 vars in 1152 bytes} [Wed May 25 15:02:42 2022] POST /identity/v3/projects => generated 387 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 15:02:42.374526 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-931bd915-ec38-4d9e-9b6c-169a77f6c43f admin admin] Authenticating user token {{(pid=101892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:02:42.437835 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-931bd915-ec38-4d9e-9b6c-169a77f6c43f admin admin] Validating token access rules against request {{(pid=101892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:02:42.442352 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e5b4b2d-df16-41c4-bb9c-ddd3f8372623 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cec56f74b2fa4826a506dc7b919465be', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:02:42.443007 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5b4b2d-df16-41c4-bb9c-ddd3f8372623 admin admin] REQUEST_METHOD: `POST` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:02:42.443295 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5b4b2d-df16-41c4-bb9c-ddd3f8372623 admin admin] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:02:42.443598 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5b4b2d-df16-41c4-bb9c-ddd3f8372623 admin admin] PATH_INFO: `/v3/projects` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:02:42.444291 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e5b4b2d-df16-41c4-bb9c-ddd3f8372623 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:02:42.446196 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e5b4b2d-df16-41c4-bb9c-ddd3f8372623 admin admin] RBAC: Authorization granted {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:02:42.470700 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 792/1570] 10.222.0.84 () {60 vars in 1152 bytes} [Wed May 25 15:02:42 2022] POST /identity/v3/projects => generated 377 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 15:02:42.471715 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c119d74-c742-40a7-9a9c-a25946d84d41 admin admin] Authenticating user token {{(pid=101893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:02:42.520374 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 779/1571] 10.222.0.84 () {60 vars in 1152 bytes} [Wed May 25 15:02:42 2022] POST /identity/v3/projects => generated 357 bytes in 146 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 15:02:42.521181 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e5b4b2d-df16-41c4-bb9c-ddd3f8372623 admin admin] Authenticating user token {{(pid=101892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:02:42.534206 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c119d74-c742-40a7-9a9c-a25946d84d41 admin admin] Validating token access rules against request {{(pid=101893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:02:42.594571 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e5b4b2d-df16-41c4-bb9c-ddd3f8372623 admin admin] Validating token access rules against request {{(pid=101892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:02:42.599335 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cad53585-3184-4455-96a7-37f53b69e0b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cec56f74b2fa4826a506dc7b919465be', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:02:42.599974 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad53585-3184-4455-96a7-37f53b69e0b6 admin admin] REQUEST_METHOD: `POST` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:02:42.600263 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad53585-3184-4455-96a7-37f53b69e0b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:02:42.600544 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad53585-3184-4455-96a7-37f53b69e0b6 admin admin] PATH_INFO: `/v3/projects` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:02:42.601273 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cad53585-3184-4455-96a7-37f53b69e0b6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:02:42.603191 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cad53585-3184-4455-96a7-37f53b69e0b6 admin admin] RBAC: Authorization granted {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:02:42.608280 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f4d1d9-c52c-4f1a-b199-4ebd75d102d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cec56f74b2fa4826a506dc7b919465be', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:02:42.608946 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f4d1d9-c52c-4f1a-b199-4ebd75d102d4 admin admin] REQUEST_METHOD: `GET` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:02:42.609229 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f4d1d9-c52c-4f1a-b199-4ebd75d102d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:02:42.609504 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f4d1d9-c52c-4f1a-b199-4ebd75d102d4 admin admin] PATH_INFO: `/v3/domains` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:02:42.610254 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54f4d1d9-c52c-4f1a-b199-4ebd75d102d4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=101893) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 15:02:42.610547 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54f4d1d9-c52c-4f1a-b199-4ebd75d102d4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:02:42.612188 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54f4d1d9-c52c-4f1a-b199-4ebd75d102d4 admin admin] RBAC: Authorization granted {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:02:42.623537 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 793/1572] 10.222.0.84 () {58 vars in 1152 bytes} [Wed May 25 15:02:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 15:02:42.624346 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f4d1d9-c52c-4f1a-b199-4ebd75d102d4 admin admin] Authenticating user token {{(pid=101893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:02:42.633790 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f4d1d9-c52c-4f1a-b199-4ebd75d102d4 admin admin] Validating token access rules against request {{(pid=101893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:02:42.638804 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c64fc19-c828-475e-9689-021354221ccd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cec56f74b2fa4826a506dc7b919465be', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:02:42.639427 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c64fc19-c828-475e-9689-021354221ccd admin admin] REQUEST_METHOD: `POST` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:02:42.639750 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c64fc19-c828-475e-9689-021354221ccd admin admin] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:02:42.642154 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c64fc19-c828-475e-9689-021354221ccd admin admin] PATH_INFO: `/v3/projects` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:02:42.642154 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c64fc19-c828-475e-9689-021354221ccd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:02:42.642567 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c64fc19-c828-475e-9689-021354221ccd admin admin] RBAC: Authorization granted {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:02:42.670322 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 780/1573] 10.222.0.84 () {60 vars in 1152 bytes} [Wed May 25 15:02:42 2022] POST /identity/v3/projects => generated 385 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 15:02:42.670322 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cad53585-3184-4455-96a7-37f53b69e0b6 admin admin] Authenticating user token {{(pid=101892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:02:42.673953 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG dbcounter [-] [101892] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=101892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:02:42.729294 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cad53585-3184-4455-96a7-37f53b69e0b6 admin admin] Validating token access rules against request {{(pid=101892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:02:42.733869 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5663d2e-12e6-4677-8312-fb1dceba0458 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cec56f74b2fa4826a506dc7b919465be', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:02:42.734738 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5663d2e-12e6-4677-8312-fb1dceba0458 admin admin] REQUEST_METHOD: `PUT` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:02:42.735026 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5663d2e-12e6-4677-8312-fb1dceba0458 admin admin] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:02:42.735305 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5663d2e-12e6-4677-8312-fb1dceba0458 admin admin] PATH_INFO: `/v3/projects/13283d741db04e3abd9f4a259e6ccb13/users/4e9f463e2bfc4c86a07d530ac112b893/roles/ff664fa0db7e4262a5accde96c3df4c3` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:02:42.749471 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5663d2e-12e6-4677-8312-fb1dceba0458 admin admin] RBAC: Authorizing `identity:create_grant(project_id=13283d741db04e3abd9f4a259e6ccb13, user_id=4e9f463e2bfc4c86a07d530ac112b893, role_id=ff664fa0db7e4262a5accde96c3df4c3)` {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:02:42.752225 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5663d2e-12e6-4677-8312-fb1dceba0458 admin admin] RBAC: Authorization granted {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:02:42.761123 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 794/1574] 10.222.0.84 () {60 vars in 1152 bytes} [Wed May 25 15:02:42 2022] POST /identity/v3/projects => generated 393 bytes in 137 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 15:02:42.761997 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c64fc19-c828-475e-9689-021354221ccd admin admin] Authenticating user token {{(pid=101893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:02:42.796221 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG dbcounter [-] [101893] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=101893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:02:42.822527 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c64fc19-c828-475e-9689-021354221ccd admin admin] Validating token access rules against request {{(pid=101893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:02:42.828139 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32105b46-2c4f-4f7e-864f-a0e627231c4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cec56f74b2fa4826a506dc7b919465be', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:02:42.828801 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32105b46-2c4f-4f7e-864f-a0e627231c4d admin admin] REQUEST_METHOD: `GET` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:02:42.829082 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32105b46-2c4f-4f7e-864f-a0e627231c4d admin admin] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:02:42.829356 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32105b46-2c4f-4f7e-864f-a0e627231c4d admin admin] PATH_INFO: `/v3/roles` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:02:42.830072 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32105b46-2c4f-4f7e-864f-a0e627231c4d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:02:42.831724 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32105b46-2c4f-4f7e-864f-a0e627231c4d admin admin] RBAC: Authorization granted {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:02:42.841457 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 795/1575] 10.222.0.84 () {58 vars in 1121 bytes} [Wed May 25 15:02:42 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 15:02:42.842222 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32105b46-2c4f-4f7e-864f-a0e627231c4d admin admin] Authenticating user token {{(pid=101893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:02:42.846838 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 781/1576] 10.222.0.84 () {60 vars in 1482 bytes} [Wed May 25 15:02:42 2022] PUT /identity/v3/projects/13283d741db04e3abd9f4a259e6ccb13/users/4e9f463e2bfc4c86a07d530ac112b893/roles/ff664fa0db7e4262a5accde96c3df4c3 => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 15:02:42.847476 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5663d2e-12e6-4677-8312-fb1dceba0458 admin admin] Authenticating user token {{(pid=101892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:02:42.855609 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32105b46-2c4f-4f7e-864f-a0e627231c4d admin admin] Validating token access rules against request {{(pid=101893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:02:42.908996 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5663d2e-12e6-4677-8312-fb1dceba0458 admin admin] Validating token access rules against request {{(pid=101892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:02:42.911778 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3e4b9be-8b57-4848-b7e0-9dead847b936 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cec56f74b2fa4826a506dc7b919465be', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:02:42.912473 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e4b9be-8b57-4848-b7e0-9dead847b936 admin admin] REQUEST_METHOD: `POST` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:02:42.912753 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e4b9be-8b57-4848-b7e0-9dead847b936 admin admin] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:02:42.913027 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e4b9be-8b57-4848-b7e0-9dead847b936 admin admin] PATH_INFO: `/v3/users` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:02:42.913587 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea60791f-d4ef-41d4-af0a-51015221bac7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cec56f74b2fa4826a506dc7b919465be', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:02:42.913728 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3e4b9be-8b57-4848-b7e0-9dead847b936 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:02:42.914256 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea60791f-d4ef-41d4-af0a-51015221bac7 admin admin] REQUEST_METHOD: `POST` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:02:42.914545 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea60791f-d4ef-41d4-af0a-51015221bac7 admin admin] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:02:42.914827 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea60791f-d4ef-41d4-af0a-51015221bac7 admin admin] PATH_INFO: `/v3/users` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:02:42.915523 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea60791f-d4ef-41d4-af0a-51015221bac7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:02:42.920596 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3e4b9be-8b57-4848-b7e0-9dead847b936 admin admin] RBAC: Authorization granted {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:02:42.920724 dv-cinder-803823-9-smb devstack@keystone.service[101892]: WARNING py.warnings [None req-ea60791f-d4ef-41d4-af0a-51015221bac7 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 25 15:02:42.920724 dv-cinder-803823-9-smb devstack@keystone.service[101892]: warnings.warn(msg) May 25 15:02:42.920724 dv-cinder-803823-9-smb devstack@keystone.service[101892]: May 25 15:02:42.920724 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea60791f-d4ef-41d4-af0a-51015221bac7 admin admin] RBAC: Authorization granted {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:02:43.051244 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 796/1577] 10.222.0.84 () {60 vars in 1143 bytes} [Wed May 25 15:02:42 2022] POST /identity/v3/users => generated 294 bytes in 209 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 15:02:43.052094 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3e4b9be-8b57-4848-b7e0-9dead847b936 admin admin] Authenticating user token {{(pid=101893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:02:43.062076 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3e4b9be-8b57-4848-b7e0-9dead847b936 admin admin] Validating token access rules against request {{(pid=101893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:02:43.066774 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a1d25ad-b76d-492c-b96d-ad9fe089e73f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cec56f74b2fa4826a506dc7b919465be', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:02:43.067414 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1d25ad-b76d-492c-b96d-ad9fe089e73f admin admin] REQUEST_METHOD: `POST` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:02:43.067741 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1d25ad-b76d-492c-b96d-ad9fe089e73f admin admin] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:02:43.068023 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1d25ad-b76d-492c-b96d-ad9fe089e73f admin admin] PATH_INFO: `/v3/users` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:02:43.068698 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a1d25ad-b76d-492c-b96d-ad9fe089e73f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:02:43.070630 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a1d25ad-b76d-492c-b96d-ad9fe089e73f admin admin] RBAC: Authorization granted {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:02:43.085097 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 782/1578] 10.222.0.84 () {60 vars in 1143 bytes} [Wed May 25 15:02:42 2022] POST /identity/v3/users => generated 289 bytes in 238 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 15:02:43.088417 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea60791f-d4ef-41d4-af0a-51015221bac7 admin admin] Authenticating user token {{(pid=101892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:02:43.095636 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea60791f-d4ef-41d4-af0a-51015221bac7 admin admin] Validating token access rules against request {{(pid=101892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:02:43.100219 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c357a3a-c3ea-4974-a7bf-3806b6245714 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cec56f74b2fa4826a506dc7b919465be', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:02:43.100854 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c357a3a-c3ea-4974-a7bf-3806b6245714 admin admin] REQUEST_METHOD: `POST` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:02:43.101141 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c357a3a-c3ea-4974-a7bf-3806b6245714 admin admin] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:02:43.101418 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c357a3a-c3ea-4974-a7bf-3806b6245714 admin admin] PATH_INFO: `/v3/projects` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:02:43.102099 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c357a3a-c3ea-4974-a7bf-3806b6245714 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:02:43.104571 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c357a3a-c3ea-4974-a7bf-3806b6245714 admin admin] RBAC: Authorization granted {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:02:43.174082 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 797/1579] 10.222.0.84 () {60 vars in 1143 bytes} [Wed May 25 15:02:43 2022] POST /identity/v3/users => generated 279 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 15:02:43.174082 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a1d25ad-b76d-492c-b96d-ad9fe089e73f admin admin] Authenticating user token {{(pid=101893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:02:43.181829 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a1d25ad-b76d-492c-b96d-ad9fe089e73f admin admin] Validating token access rules against request {{(pid=101893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:02:43.187133 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-826f45f4-60f1-4881-a681-e103bbc295e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cec56f74b2fa4826a506dc7b919465be', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:02:43.187816 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826f45f4-60f1-4881-a681-e103bbc295e6 admin admin] REQUEST_METHOD: `POST` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:02:43.191363 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826f45f4-60f1-4881-a681-e103bbc295e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:02:43.191363 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826f45f4-60f1-4881-a681-e103bbc295e6 admin admin] PATH_INFO: `/v3/users` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:02:43.191363 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-826f45f4-60f1-4881-a681-e103bbc295e6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:02:43.191363 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-826f45f4-60f1-4881-a681-e103bbc295e6 admin admin] RBAC: Authorization granted {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:02:43.194821 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 783/1580] 10.222.0.84 () {60 vars in 1152 bytes} [Wed May 25 15:02:43 2022] POST /identity/v3/projects => generated 367 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 15:02:43.195491 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c357a3a-c3ea-4974-a7bf-3806b6245714 admin admin] Authenticating user token {{(pid=101892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:02:43.248033 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG dbcounter [-] [101892] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=101892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:02:43.258098 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c357a3a-c3ea-4974-a7bf-3806b6245714 admin admin] Validating token access rules against request {{(pid=101892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:02:43.262952 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a86a609-bf1d-4a44-87a2-7cf1817bcf68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cec56f74b2fa4826a506dc7b919465be', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:02:43.263680 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a86a609-bf1d-4a44-87a2-7cf1817bcf68 admin admin] REQUEST_METHOD: `POST` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:02:43.263947 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 798/1581] 10.222.0.84 () {60 vars in 1143 bytes} [Wed May 25 15:02:43 2022] POST /identity/v3/users => generated 293 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 15:02:43.264063 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a86a609-bf1d-4a44-87a2-7cf1817bcf68 admin admin] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:02:43.264237 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a86a609-bf1d-4a44-87a2-7cf1817bcf68 admin admin] PATH_INFO: `/v3/users` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:02:43.264777 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-826f45f4-60f1-4881-a681-e103bbc295e6 admin admin] Authenticating user token {{(pid=101893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:02:43.265122 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a86a609-bf1d-4a44-87a2-7cf1817bcf68 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:02:43.267712 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a86a609-bf1d-4a44-87a2-7cf1817bcf68 admin admin] RBAC: Authorization granted {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:02:43.274420 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-826f45f4-60f1-4881-a681-e103bbc295e6 admin admin] Validating token access rules against request {{(pid=101893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:02:43.279428 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a744805e-814d-4fea-a356-02a43c2cb77f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cec56f74b2fa4826a506dc7b919465be', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:02:43.280113 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a744805e-814d-4fea-a356-02a43c2cb77f admin admin] REQUEST_METHOD: `GET` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:02:43.280391 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a744805e-814d-4fea-a356-02a43c2cb77f admin admin] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:02:43.280666 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a744805e-814d-4fea-a356-02a43c2cb77f admin admin] PATH_INFO: `/v3/roles` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:02:43.281381 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a744805e-814d-4fea-a356-02a43c2cb77f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:02:43.282972 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a744805e-814d-4fea-a356-02a43c2cb77f admin admin] RBAC: Authorization granted {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:02:43.293418 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 799/1582] 10.222.0.84 () {58 vars in 1121 bytes} [Wed May 25 15:02:43 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 15:02:43.294692 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20dd04c1-03a1-44f5-9e1b-1bcbdc9fbdfb None None] REQUEST_METHOD: `POST` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:02:43.295014 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20dd04c1-03a1-44f5-9e1b-1bcbdc9fbdfb None None] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:02:43.295295 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20dd04c1-03a1-44f5-9e1b-1bcbdc9fbdfb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:02:43.313128 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.auth.core [None req-20dd04c1-03a1-44f5-9e1b-1bcbdc9fbdfb None None] MFA Rules not processed for user `05d87e87798e429aa1c10b24391f915e`. Rule list: `[]` (Enabled: `True`). {{(pid=101893) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:02:43.314334 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.fernet_utils [None req-20dd04c1-03a1-44f5-9e1b-1bcbdc9fbdfb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=101893) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:02:43.322155 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 800/1583] 10.222.0.84 () {58 vars in 957 bytes} [Wed May 25 15:02:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 15:02:43.324205 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20dd04c1-03a1-44f5-9e1b-1bcbdc9fbdfb None None] Authenticating user token {{(pid=101893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:02:43.333646 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 784/1584] 10.222.0.84 () {60 vars in 1143 bytes} [Wed May 25 15:02:43 2022] POST /identity/v3/users => generated 297 bytes in 138 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 15:02:43.334550 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20dd04c1-03a1-44f5-9e1b-1bcbdc9fbdfb None None] Validating token access rules against request {{(pid=101893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:02:43.334689 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a86a609-bf1d-4a44-87a2-7cf1817bcf68 admin admin] Authenticating user token {{(pid=101892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:02:43.341103 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d26157d7-2c00-458f-92e5-d5d8bab385b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cec56f74b2fa4826a506dc7b919465be', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:02:43.341805 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26157d7-2c00-458f-92e5-d5d8bab385b8 admin admin] REQUEST_METHOD: `GET` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:02:43.342094 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26157d7-2c00-458f-92e5-d5d8bab385b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:02:43.342371 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26157d7-2c00-458f-92e5-d5d8bab385b8 admin admin] PATH_INFO: `/v3/roles` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:02:43.343109 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d26157d7-2c00-458f-92e5-d5d8bab385b8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:02:43.344803 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d26157d7-2c00-458f-92e5-d5d8bab385b8 admin admin] RBAC: Authorization granted {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:02:43.348357 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a86a609-bf1d-4a44-87a2-7cf1817bcf68 admin admin] Validating token access rules against request {{(pid=101892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:02:43.354828 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c035cb36-570a-447c-9e0c-b35418f5fd78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cec56f74b2fa4826a506dc7b919465be', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:02:43.355992 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c035cb36-570a-447c-9e0c-b35418f5fd78 admin admin] REQUEST_METHOD: `GET` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:02:43.356648 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c035cb36-570a-447c-9e0c-b35418f5fd78 admin admin] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:02:43.357139 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c035cb36-570a-447c-9e0c-b35418f5fd78 admin admin] PATH_INFO: `/v3/roles` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:02:43.357254 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 801/1585] 10.222.0.84 () {58 vars in 1121 bytes} [Wed May 25 15:02:43 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 15:02:43.358035 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d26157d7-2c00-458f-92e5-d5d8bab385b8 admin admin] Authenticating user token {{(pid=101893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:02:43.358897 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c035cb36-570a-447c-9e0c-b35418f5fd78 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:02:43.360803 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c035cb36-570a-447c-9e0c-b35418f5fd78 admin admin] RBAC: Authorization granted {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:02:43.370880 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d26157d7-2c00-458f-92e5-d5d8bab385b8 admin admin] Validating token access rules against request {{(pid=101893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:02:43.373264 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 785/1586] 10.222.0.84 () {58 vars in 1121 bytes} [Wed May 25 15:02:43 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 15:02:43.373889 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c035cb36-570a-447c-9e0c-b35418f5fd78 admin admin] Authenticating user token {{(pid=101892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:02:43.379429 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79271189-14f1-4ce5-9c57-1691b81f94f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cec56f74b2fa4826a506dc7b919465be', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:02:43.380267 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79271189-14f1-4ce5-9c57-1691b81f94f6 admin admin] REQUEST_METHOD: `GET` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:02:43.380774 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79271189-14f1-4ce5-9c57-1691b81f94f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:02:43.381171 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79271189-14f1-4ce5-9c57-1691b81f94f6 admin admin] PATH_INFO: `/v3/roles` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:02:43.382019 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79271189-14f1-4ce5-9c57-1691b81f94f6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:02:43.383883 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79271189-14f1-4ce5-9c57-1691b81f94f6 admin admin] RBAC: Authorization granted {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:02:43.384997 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c035cb36-570a-447c-9e0c-b35418f5fd78 admin admin] Validating token access rules against request {{(pid=101892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:02:43.390680 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acdbab6c-887c-4066-b6fc-1330c35fcd45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cec56f74b2fa4826a506dc7b919465be', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:02:43.392660 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acdbab6c-887c-4066-b6fc-1330c35fcd45 admin admin] REQUEST_METHOD: `POST` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:02:43.392660 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acdbab6c-887c-4066-b6fc-1330c35fcd45 admin admin] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:02:43.392660 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acdbab6c-887c-4066-b6fc-1330c35fcd45 admin admin] PATH_INFO: `/v3/users` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:02:43.392660 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acdbab6c-887c-4066-b6fc-1330c35fcd45 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:02:43.394231 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acdbab6c-887c-4066-b6fc-1330c35fcd45 admin admin] RBAC: Authorization granted {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:02:43.396568 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 802/1587] 10.222.0.84 () {58 vars in 1121 bytes} [Wed May 25 15:02:43 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 15:02:43.397463 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79271189-14f1-4ce5-9c57-1691b81f94f6 admin admin] Authenticating user token {{(pid=101893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:02:43.408984 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79271189-14f1-4ce5-9c57-1691b81f94f6 admin admin] Validating token access rules against request {{(pid=101893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:02:43.414092 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13eedaa8-9e03-4c92-8e6a-dc1bac404560 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cec56f74b2fa4826a506dc7b919465be', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:02:43.414775 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13eedaa8-9e03-4c92-8e6a-dc1bac404560 admin admin] REQUEST_METHOD: `GET` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:02:43.415294 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13eedaa8-9e03-4c92-8e6a-dc1bac404560 admin admin] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:02:43.415435 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13eedaa8-9e03-4c92-8e6a-dc1bac404560 admin admin] PATH_INFO: `/v3/roles` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:02:43.416093 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13eedaa8-9e03-4c92-8e6a-dc1bac404560 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:02:43.418345 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13eedaa8-9e03-4c92-8e6a-dc1bac404560 admin admin] RBAC: Authorization granted {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:02:43.429445 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 803/1588] 10.222.0.84 () {58 vars in 1121 bytes} [Wed May 25 15:02:43 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 15:02:43.430184 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13eedaa8-9e03-4c92-8e6a-dc1bac404560 admin admin] Authenticating user token {{(pid=101893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:02:43.440122 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13eedaa8-9e03-4c92-8e6a-dc1bac404560 admin admin] Validating token access rules against request {{(pid=101893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:02:43.444656 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c35122e-bc67-4fc6-9eb5-467f65843bab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cec56f74b2fa4826a506dc7b919465be', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:02:43.445520 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c35122e-bc67-4fc6-9eb5-467f65843bab admin admin] REQUEST_METHOD: `PUT` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:02:43.445808 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c35122e-bc67-4fc6-9eb5-467f65843bab admin admin] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:02:43.446089 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c35122e-bc67-4fc6-9eb5-467f65843bab admin admin] PATH_INFO: `/v3/projects/9526509cc549495496b925be926ab821/users/0a784aa3174d41e0908d21c798df2c9b/roles/ff664fa0db7e4262a5accde96c3df4c3` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:02:43.460626 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c35122e-bc67-4fc6-9eb5-467f65843bab admin admin] RBAC: Authorizing `identity:create_grant(project_id=9526509cc549495496b925be926ab821, user_id=0a784aa3174d41e0908d21c798df2c9b, role_id=ff664fa0db7e4262a5accde96c3df4c3)` {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:02:43.461681 dv-cinder-803823-9-smb devstack@keystone.service[101893]: WARNING py.warnings [None req-6c35122e-bc67-4fc6-9eb5-467f65843bab admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 25 15:02:43.461681 dv-cinder-803823-9-smb devstack@keystone.service[101893]: warnings.warn(msg) May 25 15:02:43.461681 dv-cinder-803823-9-smb devstack@keystone.service[101893]: May 25 15:02:43.464165 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c35122e-bc67-4fc6-9eb5-467f65843bab admin admin] RBAC: Authorization granted {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:02:43.469867 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 786/1589] 10.222.0.84 () {60 vars in 1143 bytes} [Wed May 25 15:02:43 2022] POST /identity/v3/users => generated 284 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 15:02:43.470712 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acdbab6c-887c-4066-b6fc-1330c35fcd45 admin admin] Authenticating user token {{(pid=101892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:02:43.480697 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acdbab6c-887c-4066-b6fc-1330c35fcd45 admin admin] Validating token access rules against request {{(pid=101892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:02:43.485188 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1186a665-21ff-4c2a-84a1-9fb03e6f8412 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cec56f74b2fa4826a506dc7b919465be', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:02:43.485825 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1186a665-21ff-4c2a-84a1-9fb03e6f8412 admin admin] REQUEST_METHOD: `GET` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:02:43.486111 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1186a665-21ff-4c2a-84a1-9fb03e6f8412 admin admin] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:02:43.486388 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1186a665-21ff-4c2a-84a1-9fb03e6f8412 admin admin] PATH_INFO: `/v3/roles` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:02:43.487135 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1186a665-21ff-4c2a-84a1-9fb03e6f8412 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:02:43.488761 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1186a665-21ff-4c2a-84a1-9fb03e6f8412 admin admin] RBAC: Authorization granted {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:02:43.498989 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 787/1590] 10.222.0.84 () {58 vars in 1121 bytes} [Wed May 25 15:02:43 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 15:02:43.499788 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1186a665-21ff-4c2a-84a1-9fb03e6f8412 admin admin] Authenticating user token {{(pid=101892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:02:43.508818 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1186a665-21ff-4c2a-84a1-9fb03e6f8412 admin admin] Validating token access rules against request {{(pid=101892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:02:43.513407 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-605f97ae-a904-4197-9143-1713fb6eb09f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cec56f74b2fa4826a506dc7b919465be', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:02:43.514025 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605f97ae-a904-4197-9143-1713fb6eb09f admin admin] REQUEST_METHOD: `GET` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:02:43.514314 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605f97ae-a904-4197-9143-1713fb6eb09f admin admin] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:02:43.514596 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605f97ae-a904-4197-9143-1713fb6eb09f admin admin] PATH_INFO: `/v3/roles` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:02:43.515297 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-605f97ae-a904-4197-9143-1713fb6eb09f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:02:43.516884 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-605f97ae-a904-4197-9143-1713fb6eb09f admin admin] RBAC: Authorization granted {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:02:43.526950 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 788/1591] 10.222.0.84 () {58 vars in 1121 bytes} [Wed May 25 15:02:43 2022] GET /identity/v3/roles => generated 1420 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 15:02:43.527815 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-605f97ae-a904-4197-9143-1713fb6eb09f admin admin] Authenticating user token {{(pid=101892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:02:43.537181 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-605f97ae-a904-4197-9143-1713fb6eb09f admin admin] Validating token access rules against request {{(pid=101892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:02:43.537866 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 804/1592] 10.222.0.84 () {60 vars in 1482 bytes} [Wed May 25 15:02:43 2022] PUT /identity/v3/projects/9526509cc549495496b925be926ab821/users/0a784aa3174d41e0908d21c798df2c9b/roles/ff664fa0db7e4262a5accde96c3df4c3 => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 15:02:43.538766 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c35122e-bc67-4fc6-9eb5-467f65843bab admin admin] Authenticating user token {{(pid=101893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:02:43.558224 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG dbcounter [-] [101893] Writing DB stats keystone:SELECT=90,keystone:INSERT=10 {{(pid=101893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:02:43.595994 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f870baba-054a-4712-8f4d-f11a1bd86adb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cec56f74b2fa4826a506dc7b919465be', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:02:43.596671 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f870baba-054a-4712-8f4d-f11a1bd86adb admin admin] REQUEST_METHOD: `GET` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:02:43.596956 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f870baba-054a-4712-8f4d-f11a1bd86adb admin admin] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:02:43.597238 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f870baba-054a-4712-8f4d-f11a1bd86adb admin admin] PATH_INFO: `/v3/roles` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:02:43.597985 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f870baba-054a-4712-8f4d-f11a1bd86adb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:02:43.599640 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f870baba-054a-4712-8f4d-f11a1bd86adb admin admin] RBAC: Authorization granted {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:02:43.609807 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c35122e-bc67-4fc6-9eb5-467f65843bab admin admin] Validating token access rules against request {{(pid=101893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:02:43.609978 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 789/1593] 10.222.0.84 () {58 vars in 1121 bytes} [Wed May 25 15:02:43 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 15:02:43.610787 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f870baba-054a-4712-8f4d-f11a1bd86adb admin admin] Authenticating user token {{(pid=101892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:02:43.615019 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9d469bf-98d5-465e-8df2-7d733544dedf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cec56f74b2fa4826a506dc7b919465be', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:02:43.615734 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d469bf-98d5-465e-8df2-7d733544dedf admin admin] REQUEST_METHOD: `GET` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:02:43.616018 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d469bf-98d5-465e-8df2-7d733544dedf admin admin] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:02:43.616296 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d469bf-98d5-465e-8df2-7d733544dedf admin admin] PATH_INFO: `/v3/roles` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:02:43.617027 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9d469bf-98d5-465e-8df2-7d733544dedf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:02:43.618632 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9d469bf-98d5-465e-8df2-7d733544dedf admin admin] RBAC: Authorization granted {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:02:43.628829 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 805/1594] 10.222.0.84 () {58 vars in 1121 bytes} [Wed May 25 15:02:43 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 15:02:43.629705 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9d469bf-98d5-465e-8df2-7d733544dedf admin admin] Authenticating user token {{(pid=101893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:02:43.640772 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9d469bf-98d5-465e-8df2-7d733544dedf admin admin] Validating token access rules against request {{(pid=101893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:02:43.645670 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-239d0a1c-f650-4b21-8307-0a6bb1540120 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cec56f74b2fa4826a506dc7b919465be', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:02:43.649170 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239d0a1c-f650-4b21-8307-0a6bb1540120 admin admin] REQUEST_METHOD: `GET` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:02:43.649170 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239d0a1c-f650-4b21-8307-0a6bb1540120 admin admin] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:02:43.649170 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239d0a1c-f650-4b21-8307-0a6bb1540120 admin admin] PATH_INFO: `/v3/roles` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:02:43.649170 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-239d0a1c-f650-4b21-8307-0a6bb1540120 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:02:43.649562 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-239d0a1c-f650-4b21-8307-0a6bb1540120 admin admin] RBAC: Authorization granted {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:02:43.660129 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 806/1595] 10.222.0.84 () {58 vars in 1121 bytes} [Wed May 25 15:02:43 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 15:02:43.661143 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-239d0a1c-f650-4b21-8307-0a6bb1540120 admin admin] Authenticating user token {{(pid=101893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:02:43.668204 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f870baba-054a-4712-8f4d-f11a1bd86adb admin admin] Validating token access rules against request {{(pid=101892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:02:43.672070 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac5da735-5942-4ffa-a0ac-e8122f3c41c9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ce28b25b907473588ccb87dc4acc06a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a000829c658c4a7cab67f7b6353ba3fa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:02:43.672213 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-239d0a1c-f650-4b21-8307-0a6bb1540120 admin admin] Validating token access rules against request {{(pid=101893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:02:43.672723 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5da735-5942-4ffa-a0ac-e8122f3c41c9 service neutron] REQUEST_METHOD: `GET` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:02:43.673008 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5da735-5942-4ffa-a0ac-e8122f3c41c9 service neutron] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:02:43.673285 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5da735-5942-4ffa-a0ac-e8122f3c41c9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:02:43.676796 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2b43aec-0790-4dca-9b0e-7f09cf443858 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cec56f74b2fa4826a506dc7b919465be', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:02:43.677428 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b43aec-0790-4dca-9b0e-7f09cf443858 admin admin] REQUEST_METHOD: `GET` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:02:43.677709 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b43aec-0790-4dca-9b0e-7f09cf443858 admin admin] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:02:43.677984 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b43aec-0790-4dca-9b0e-7f09cf443858 admin admin] PATH_INFO: `/v3/roles` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:02:43.678685 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2b43aec-0790-4dca-9b0e-7f09cf443858 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:02:43.680486 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2b43aec-0790-4dca-9b0e-7f09cf443858 admin admin] RBAC: Authorization granted {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:02:43.682532 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac5da735-5942-4ffa-a0ac-e8122f3c41c9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:02:43.684007 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac5da735-5942-4ffa-a0ac-e8122f3c41c9 service neutron] RBAC: Authorization granted {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:02:43.690300 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 807/1596] 10.222.0.84 () {58 vars in 1121 bytes} [Wed May 25 15:02:43 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 15:02:43.691080 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2b43aec-0790-4dca-9b0e-7f09cf443858 admin admin] Authenticating user token {{(pid=101893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:02:43.694268 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 790/1597] 10.222.0.84 () {60 vars in 1365 bytes} [Wed May 25 15:02:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 15:02:43.695123 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac5da735-5942-4ffa-a0ac-e8122f3c41c9 service neutron] Authenticating user token {{(pid=101892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:02:43.700455 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2b43aec-0790-4dca-9b0e-7f09cf443858 admin admin] Validating token access rules against request {{(pid=101893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:02:43.705170 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac5da735-5942-4ffa-a0ac-e8122f3c41c9 service neutron] Validating token access rules against request {{(pid=101892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:02:43.705414 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bff61fa-6089-489e-9f17-ecf2650de0f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cec56f74b2fa4826a506dc7b919465be', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:02:43.706068 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bff61fa-6089-489e-9f17-ecf2650de0f9 admin admin] REQUEST_METHOD: `GET` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:02:43.706349 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bff61fa-6089-489e-9f17-ecf2650de0f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:02:43.706685 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bff61fa-6089-489e-9f17-ecf2650de0f9 admin admin] PATH_INFO: `/v3/roles` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:02:43.707334 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bff61fa-6089-489e-9f17-ecf2650de0f9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:02:43.708988 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bff61fa-6089-489e-9f17-ecf2650de0f9 admin admin] RBAC: Authorization granted {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:02:43.710020 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9467941b-9b21-4640-a9d2-463fec94f54e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cec56f74b2fa4826a506dc7b919465be', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:02:43.711255 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9467941b-9b21-4640-a9d2-463fec94f54e admin admin] REQUEST_METHOD: `PUT` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:02:43.711734 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9467941b-9b21-4640-a9d2-463fec94f54e admin admin] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:02:43.712025 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9467941b-9b21-4640-a9d2-463fec94f54e admin admin] PATH_INFO: `/v3/projects/31414400f2114ed9abdf300fb08e1592/users/43dce6e81a7c43819d2041bd6c2ad783/roles/ff664fa0db7e4262a5accde96c3df4c3` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:02:43.722487 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 808/1598] 10.222.0.84 () {58 vars in 1121 bytes} [Wed May 25 15:02:43 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 15:02:43.729638 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd0901f-0598-4a0a-b3eb-56f518173f2b None None] REQUEST_METHOD: `POST` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:02:43.729638 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd0901f-0598-4a0a-b3eb-56f518173f2b None None] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:02:43.729638 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd0901f-0598-4a0a-b3eb-56f518173f2b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:02:43.729962 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9467941b-9b21-4640-a9d2-463fec94f54e admin admin] RBAC: Authorizing `identity:create_grant(project_id=31414400f2114ed9abdf300fb08e1592, user_id=43dce6e81a7c43819d2041bd6c2ad783, role_id=ff664fa0db7e4262a5accde96c3df4c3)` {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:02:43.733779 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9467941b-9b21-4640-a9d2-463fec94f54e admin admin] RBAC: Authorization granted {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:02:43.750467 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.auth.core [None req-dbd0901f-0598-4a0a-b3eb-56f518173f2b None None] MFA Rules not processed for user `0a784aa3174d41e0908d21c798df2c9b`. Rule list: `[]` (Enabled: `True`). {{(pid=101893) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:02:43.756749 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.fernet_utils [None req-dbd0901f-0598-4a0a-b3eb-56f518173f2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=101893) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:02:43.816443 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 809/1599] 10.222.0.84 () {58 vars in 957 bytes} [Wed May 25 15:02:43 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 15:02:43.817336 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbd0901f-0598-4a0a-b3eb-56f518173f2b None None] Authenticating user token {{(pid=101893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:02:43.818878 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 791/1600] 10.222.0.84 () {60 vars in 1482 bytes} [Wed May 25 15:02:43 2022] PUT /identity/v3/projects/31414400f2114ed9abdf300fb08e1592/users/43dce6e81a7c43819d2041bd6c2ad783/roles/ff664fa0db7e4262a5accde96c3df4c3 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 15:02:43.819900 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9467941b-9b21-4640-a9d2-463fec94f54e admin admin] Authenticating user token {{(pid=101892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:02:43.830504 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG dbcounter [-] [101892] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=101892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:02:43.838020 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbd0901f-0598-4a0a-b3eb-56f518173f2b None None] Validating token access rules against request {{(pid=101893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:02:43.886217 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9467941b-9b21-4640-a9d2-463fec94f54e admin admin] Validating token access rules against request {{(pid=101892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:02:43.891160 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f16a5a5c-7a5b-4cb5-ba24-25c3814c15f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cec56f74b2fa4826a506dc7b919465be', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:02:43.892083 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16a5a5c-7a5b-4cb5-ba24-25c3814c15f5 admin admin] REQUEST_METHOD: `PUT` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:02:43.892370 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16a5a5c-7a5b-4cb5-ba24-25c3814c15f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:02:43.892649 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16a5a5c-7a5b-4cb5-ba24-25c3814c15f5 admin admin] PATH_INFO: `/v3/projects/d51c7a2aacdb43f0a3e0dd06b11ae05d/users/68b047b9c7d243d3a5b5fefec6d79f35/roles/ff664fa0db7e4262a5accde96c3df4c3` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:02:43.906722 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aa47847-4be5-46ad-91dc-8d270bb17524 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cec56f74b2fa4826a506dc7b919465be', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:02:43.907651 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa47847-4be5-46ad-91dc-8d270bb17524 admin admin] REQUEST_METHOD: `PUT` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:02:43.908335 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa47847-4be5-46ad-91dc-8d270bb17524 admin admin] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:02:43.908445 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f16a5a5c-7a5b-4cb5-ba24-25c3814c15f5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d51c7a2aacdb43f0a3e0dd06b11ae05d, user_id=68b047b9c7d243d3a5b5fefec6d79f35, role_id=ff664fa0db7e4262a5accde96c3df4c3)` {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:02:43.908538 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa47847-4be5-46ad-91dc-8d270bb17524 admin admin] PATH_INFO: `/v3/projects/e16d2e514b824e0896c5272e2d0a5e29/users/487533f39e944ceaad952200101f021f/roles/ff664fa0db7e4262a5accde96c3df4c3` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:02:43.910820 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f16a5a5c-7a5b-4cb5-ba24-25c3814c15f5 admin admin] RBAC: Authorization granted {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:02:43.911295 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG dbcounter [-] [101893] Writing DB stats keystone:SELECT=100 {{(pid=101893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:02:43.923136 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aa47847-4be5-46ad-91dc-8d270bb17524 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e16d2e514b824e0896c5272e2d0a5e29, user_id=487533f39e944ceaad952200101f021f, role_id=ff664fa0db7e4262a5accde96c3df4c3)` {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:02:43.926176 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aa47847-4be5-46ad-91dc-8d270bb17524 admin admin] RBAC: Authorization granted {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:02:43.967754 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 792/1601] 10.222.0.84 () {60 vars in 1482 bytes} [Wed May 25 15:02:43 2022] PUT /identity/v3/projects/d51c7a2aacdb43f0a3e0dd06b11ae05d/users/68b047b9c7d243d3a5b5fefec6d79f35/roles/ff664fa0db7e4262a5accde96c3df4c3 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 15:02:43.977651 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f16a5a5c-7a5b-4cb5-ba24-25c3814c15f5 admin admin] Authenticating user token {{(pid=101892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:02:44.029424 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 810/1602] 10.222.0.84 () {60 vars in 1482 bytes} [Wed May 25 15:02:43 2022] PUT /identity/v3/projects/e16d2e514b824e0896c5272e2d0a5e29/users/487533f39e944ceaad952200101f021f/roles/ff664fa0db7e4262a5accde96c3df4c3 => generated 0 bytes in 208 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 15:02:44.029424 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aa47847-4be5-46ad-91dc-8d270bb17524 admin admin] Authenticating user token {{(pid=101893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:02:44.041847 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f16a5a5c-7a5b-4cb5-ba24-25c3814c15f5 admin admin] Validating token access rules against request {{(pid=101892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:02:44.099197 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aa47847-4be5-46ad-91dc-8d270bb17524 admin admin] Validating token access rules against request {{(pid=101893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:02:44.100895 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ec7580e-a684-4698-bfd0-a833bcf334b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cec56f74b2fa4826a506dc7b919465be', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:02:44.101836 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec7580e-a684-4698-bfd0-a833bcf334b7 admin admin] REQUEST_METHOD: `PUT` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:02:44.102324 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec7580e-a684-4698-bfd0-a833bcf334b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:02:44.102609 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec7580e-a684-4698-bfd0-a833bcf334b7 admin admin] PATH_INFO: `/v3/projects/94a53aea4e3e468bade273e5a1dea39e/users/7fa42494cb4549f295d23e08cf93d330/roles/ff664fa0db7e4262a5accde96c3df4c3` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:02:44.104309 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e29ba147-86c0-4241-bd9a-476d07791f69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cec56f74b2fa4826a506dc7b919465be', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:02:44.105155 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29ba147-86c0-4241-bd9a-476d07791f69 admin admin] REQUEST_METHOD: `GET` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:02:44.106199 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29ba147-86c0-4241-bd9a-476d07791f69 admin admin] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:02:44.106517 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29ba147-86c0-4241-bd9a-476d07791f69 admin admin] PATH_INFO: `/v3/roles` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:02:44.107268 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e29ba147-86c0-4241-bd9a-476d07791f69 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:02:44.109017 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e29ba147-86c0-4241-bd9a-476d07791f69 admin admin] RBAC: Authorization granted {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:02:44.117121 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ec7580e-a684-4698-bfd0-a833bcf334b7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=94a53aea4e3e468bade273e5a1dea39e, user_id=7fa42494cb4549f295d23e08cf93d330, role_id=ff664fa0db7e4262a5accde96c3df4c3)` {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:02:44.119586 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 811/1603] 10.222.0.84 () {58 vars in 1121 bytes} [Wed May 25 15:02:44 2022] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 15:02:44.125052 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ec7580e-a684-4698-bfd0-a833bcf334b7 admin admin] RBAC: Authorization granted {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:02:44.125193 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e29ba147-86c0-4241-bd9a-476d07791f69 admin admin] Authenticating user token {{(pid=101893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:02:44.132315 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e29ba147-86c0-4241-bd9a-476d07791f69 admin admin] Validating token access rules against request {{(pid=101893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:02:44.137397 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa5d5ed-0e8e-4ff6-b796-fbffcc4dff39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cec56f74b2fa4826a506dc7b919465be', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:02:44.138248 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa5d5ed-0e8e-4ff6-b796-fbffcc4dff39 admin admin] REQUEST_METHOD: `PUT` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:02:44.138528 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa5d5ed-0e8e-4ff6-b796-fbffcc4dff39 admin admin] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:02:44.138800 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa5d5ed-0e8e-4ff6-b796-fbffcc4dff39 admin admin] PATH_INFO: `/v3/projects/970ef0402e6f466084887abf4f428e09/users/81783c1018864448aaf753c7c2da4c84/roles/ff664fa0db7e4262a5accde96c3df4c3` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:02:44.154486 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afa5d5ed-0e8e-4ff6-b796-fbffcc4dff39 admin admin] RBAC: Authorizing `identity:create_grant(project_id=970ef0402e6f466084887abf4f428e09, user_id=81783c1018864448aaf753c7c2da4c84, role_id=ff664fa0db7e4262a5accde96c3df4c3)` {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:02:44.157185 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afa5d5ed-0e8e-4ff6-b796-fbffcc4dff39 admin admin] RBAC: Authorization granted {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:02:44.218419 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 793/1604] 10.222.0.84 () {60 vars in 1482 bytes} [Wed May 25 15:02:43 2022] PUT /identity/v3/projects/94a53aea4e3e468bade273e5a1dea39e/users/7fa42494cb4549f295d23e08cf93d330/roles/ff664fa0db7e4262a5accde96c3df4c3 => generated 0 bytes in 250 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 15:02:44.219253 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ec7580e-a684-4698-bfd0-a833bcf334b7 admin admin] Authenticating user token {{(pid=101892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:02:44.248389 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG dbcounter [-] [101892] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=101892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:02:44.260967 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 812/1605] 10.222.0.84 () {60 vars in 1482 bytes} [Wed May 25 15:02:44 2022] PUT /identity/v3/projects/970ef0402e6f466084887abf4f428e09/users/81783c1018864448aaf753c7c2da4c84/roles/ff664fa0db7e4262a5accde96c3df4c3 => generated 0 bytes in 140 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 15:02:44.262552 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d4fb2b-e2a8-4cb8-a3e4-b2f53fa7bc6a None None] REQUEST_METHOD: `POST` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:02:44.264492 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d4fb2b-e2a8-4cb8-a3e4-b2f53fa7bc6a None None] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:02:44.264766 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d4fb2b-e2a8-4cb8-a3e4-b2f53fa7bc6a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:02:44.291138 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.auth.core [None req-f6d4fb2b-e2a8-4cb8-a3e4-b2f53fa7bc6a None None] MFA Rules not processed for user `05d87e87798e429aa1c10b24391f915e`. Rule list: `[]` (Enabled: `True`). {{(pid=101893) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:02:44.292436 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.fernet_utils [None req-f6d4fb2b-e2a8-4cb8-a3e4-b2f53fa7bc6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=101893) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:02:44.300669 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ec7580e-a684-4698-bfd0-a833bcf334b7 admin admin] Validating token access rules against request {{(pid=101892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:02:44.354118 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 813/1606] 10.222.0.84 () {58 vars in 957 bytes} [Wed May 25 15:02:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 15:02:44.355531 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e606337a-ffbc-4b99-a5e3-22d6b488198c None None] REQUEST_METHOD: `POST` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:02:44.356050 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e606337a-ffbc-4b99-a5e3-22d6b488198c None None] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:02:44.356341 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e606337a-ffbc-4b99-a5e3-22d6b488198c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:02:44.361129 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a99fc86a-d479-4c8a-a216-ee88e0766364 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cec56f74b2fa4826a506dc7b919465be', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:02:44.361800 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99fc86a-d479-4c8a-a216-ee88e0766364 admin admin] REQUEST_METHOD: `POST` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:02:44.362080 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99fc86a-d479-4c8a-a216-ee88e0766364 admin admin] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:02:44.362361 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99fc86a-d479-4c8a-a216-ee88e0766364 admin admin] PATH_INFO: `/v3/projects` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:02:44.363046 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a99fc86a-d479-4c8a-a216-ee88e0766364 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:02:44.365117 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a99fc86a-d479-4c8a-a216-ee88e0766364 admin admin] RBAC: Authorization granted {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:02:44.387276 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.auth.core [None req-e606337a-ffbc-4b99-a5e3-22d6b488198c None None] MFA Rules not processed for user `68b047b9c7d243d3a5b5fefec6d79f35`. Rule list: `[]` (Enabled: `True`). {{(pid=101893) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:02:44.388583 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.fernet_utils [None req-e606337a-ffbc-4b99-a5e3-22d6b488198c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=101893) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:02:44.434397 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG dbcounter [-] [101893] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=101893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:02:44.441302 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 794/1607] 10.222.0.84 () {60 vars in 1152 bytes} [Wed May 25 15:02:44 2022] POST /identity/v3/projects => generated 375 bytes in 219 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 15:02:44.441302 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d22dfa-f8a9-468f-9af4-3a79d9e35aa2 None None] REQUEST_METHOD: `POST` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:02:44.441302 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d22dfa-f8a9-468f-9af4-3a79d9e35aa2 None None] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:02:44.441302 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d22dfa-f8a9-468f-9af4-3a79d9e35aa2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:02:44.460046 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 814/1608] 10.222.0.84 () {58 vars in 957 bytes} [Wed May 25 15:02:44 2022] POST /identity/v3/auth/tokens => generated 3224 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 15:02:44.460345 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.auth.core [None req-25d22dfa-f8a9-468f-9af4-3a79d9e35aa2 None None] MFA Rules not processed for user `05d87e87798e429aa1c10b24391f915e`. Rule list: `[]` (Enabled: `True`). {{(pid=101892) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:02:44.460781 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e606337a-ffbc-4b99-a5e3-22d6b488198c None None] Authenticating user token {{(pid=101893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:02:44.461777 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.fernet_utils [None req-25d22dfa-f8a9-468f-9af4-3a79d9e35aa2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=101892) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:02:44.474203 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e606337a-ffbc-4b99-a5e3-22d6b488198c None None] Validating token access rules against request {{(pid=101893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:02:44.535185 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 795/1609] 10.222.0.84 () {58 vars in 957 bytes} [Wed May 25 15:02:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 15:02:44.539770 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95dbb46-475c-463b-b3be-200311e84e82 None None] REQUEST_METHOD: `POST` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:02:44.539895 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30927982-bed4-40b2-a960-3c538cd0219e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cec56f74b2fa4826a506dc7b919465be', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:02:44.540080 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95dbb46-475c-463b-b3be-200311e84e82 None None] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:02:44.540507 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95dbb46-475c-463b-b3be-200311e84e82 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:02:44.540823 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30927982-bed4-40b2-a960-3c538cd0219e admin admin] REQUEST_METHOD: `PUT` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:02:44.541111 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30927982-bed4-40b2-a960-3c538cd0219e admin admin] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:02:44.541939 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30927982-bed4-40b2-a960-3c538cd0219e admin admin] PATH_INFO: `/v3/projects/8582875058ee4f21af85291718e6a7ed/users/9e62022fc5874ac49784ccd152a3b161/roles/ff664fa0db7e4262a5accde96c3df4c3` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:02:44.559335 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.auth.core [None req-a95dbb46-475c-463b-b3be-200311e84e82 None None] MFA Rules not processed for user `05d87e87798e429aa1c10b24391f915e`. Rule list: `[]` (Enabled: `True`). {{(pid=101892) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:02:44.560577 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.fernet_utils [None req-a95dbb46-475c-463b-b3be-200311e84e82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=101892) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:02:44.560694 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30927982-bed4-40b2-a960-3c538cd0219e admin admin] RBAC: Authorizing `identity:create_grant(project_id=8582875058ee4f21af85291718e6a7ed, user_id=9e62022fc5874ac49784ccd152a3b161, role_id=ff664fa0db7e4262a5accde96c3df4c3)` {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:02:44.563389 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30927982-bed4-40b2-a960-3c538cd0219e admin admin] RBAC: Authorization granted {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:02:44.568294 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 796/1610] 10.222.0.84 () {58 vars in 957 bytes} [Wed May 25 15:02:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 15:02:44.569507 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90811a32-9c63-4ded-a59b-0dd2edeedbda None None] REQUEST_METHOD: `POST` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:02:44.569799 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90811a32-9c63-4ded-a59b-0dd2edeedbda None None] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:02:44.570290 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90811a32-9c63-4ded-a59b-0dd2edeedbda None None] PATH_INFO: `/v3/auth/tokens` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:02:44.589007 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.auth.core [None req-90811a32-9c63-4ded-a59b-0dd2edeedbda None None] MFA Rules not processed for user `05d87e87798e429aa1c10b24391f915e`. Rule list: `[]` (Enabled: `True`). {{(pid=101892) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:02:44.590208 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.fernet_utils [None req-90811a32-9c63-4ded-a59b-0dd2edeedbda None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=101892) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:02:44.597813 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 797/1611] 10.222.0.84 () {58 vars in 957 bytes} [Wed May 25 15:02:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 15:02:44.599355 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90811a32-9c63-4ded-a59b-0dd2edeedbda None None] Authenticating user token {{(pid=101892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:02:44.645759 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 815/1612] 10.222.0.84 () {60 vars in 1482 bytes} [Wed May 25 15:02:44 2022] PUT /identity/v3/projects/8582875058ee4f21af85291718e6a7ed/users/9e62022fc5874ac49784ccd152a3b161/roles/ff664fa0db7e4262a5accde96c3df4c3 => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 15:02:44.645759 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30927982-bed4-40b2-a960-3c538cd0219e admin admin] Authenticating user token {{(pid=101893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:02:44.668038 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG dbcounter [-] [101892] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=101892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:02:44.682925 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90811a32-9c63-4ded-a59b-0dd2edeedbda None None] Validating token access rules against request {{(pid=101892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:02:44.721921 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30927982-bed4-40b2-a960-3c538cd0219e admin admin] Validating token access rules against request {{(pid=101893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:02:44.726529 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9311165e-39f4-40e7-8dea-7a988d16dd1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cec56f74b2fa4826a506dc7b919465be', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:02:44.727201 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9311165e-39f4-40e7-8dea-7a988d16dd1a admin admin] REQUEST_METHOD: `POST` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:02:44.727494 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9311165e-39f4-40e7-8dea-7a988d16dd1a admin admin] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:02:44.727812 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9311165e-39f4-40e7-8dea-7a988d16dd1a admin admin] PATH_INFO: `/v3/users` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:02:44.728536 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9311165e-39f4-40e7-8dea-7a988d16dd1a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:02:44.731016 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9311165e-39f4-40e7-8dea-7a988d16dd1a admin admin] RBAC: Authorization granted {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:02:44.740417 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-676d4b16-e1c8-4552-b846-b7f1c77ffe4a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ce28b25b907473588ccb87dc4acc06a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a000829c658c4a7cab67f7b6353ba3fa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:02:44.741073 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676d4b16-e1c8-4552-b846-b7f1c77ffe4a service neutron] REQUEST_METHOD: `GET` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:02:44.741355 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676d4b16-e1c8-4552-b846-b7f1c77ffe4a service neutron] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:02:44.741755 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676d4b16-e1c8-4552-b846-b7f1c77ffe4a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:02:44.751767 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-676d4b16-e1c8-4552-b846-b7f1c77ffe4a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:02:44.753255 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-676d4b16-e1c8-4552-b846-b7f1c77ffe4a service neutron] RBAC: Authorization granted {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:02:44.762731 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 798/1613] 10.222.0.84 () {60 vars in 1365 bytes} [Wed May 25 15:02:44 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 164 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 15:02:44.763717 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-676d4b16-e1c8-4552-b846-b7f1c77ffe4a service neutron] Authenticating user token {{(pid=101892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:02:44.774408 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-676d4b16-e1c8-4552-b846-b7f1c77ffe4a service neutron] Validating token access rules against request {{(pid=101892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:02:44.779028 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb2b5e44-a2c8-4c85-b808-de95015d7d1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cec56f74b2fa4826a506dc7b919465be', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:02:44.779715 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2b5e44-a2c8-4c85-b808-de95015d7d1c admin admin] REQUEST_METHOD: `POST` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:02:44.780006 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2b5e44-a2c8-4c85-b808-de95015d7d1c admin admin] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:02:44.780285 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2b5e44-a2c8-4c85-b808-de95015d7d1c admin admin] PATH_INFO: `/v3/projects` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:02:44.781054 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb2b5e44-a2c8-4c85-b808-de95015d7d1c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:02:44.782957 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb2b5e44-a2c8-4c85-b808-de95015d7d1c admin admin] RBAC: Authorization granted {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:02:44.794249 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 816/1614] 10.222.0.84 () {60 vars in 1143 bytes} [Wed May 25 15:02:44 2022] POST /identity/v3/users => generated 294 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 15:02:44.795088 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9311165e-39f4-40e7-8dea-7a988d16dd1a admin admin] Authenticating user token {{(pid=101893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:02:44.804498 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9311165e-39f4-40e7-8dea-7a988d16dd1a admin admin] Validating token access rules against request {{(pid=101893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:02:44.808773 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f25fbd22-d558-4839-911a-3d8a3e3dbe38 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ce28b25b907473588ccb87dc4acc06a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a000829c658c4a7cab67f7b6353ba3fa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:02:44.809477 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25fbd22-d558-4839-911a-3d8a3e3dbe38 service neutron] REQUEST_METHOD: `GET` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:02:44.809755 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25fbd22-d558-4839-911a-3d8a3e3dbe38 service neutron] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:02:44.810031 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25fbd22-d558-4839-911a-3d8a3e3dbe38 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:02:44.821390 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f25fbd22-d558-4839-911a-3d8a3e3dbe38 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:02:44.823066 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f25fbd22-d558-4839-911a-3d8a3e3dbe38 service neutron] RBAC: Authorization granted {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:02:44.833576 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 817/1615] 10.222.0.84 () {60 vars in 1365 bytes} [Wed May 25 15:02:44 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 15:02:44.834908 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f25fbd22-d558-4839-911a-3d8a3e3dbe38 service neutron] Authenticating user token {{(pid=101893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:02:44.844173 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f25fbd22-d558-4839-911a-3d8a3e3dbe38 service neutron] Validating token access rules against request {{(pid=101893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:02:44.846625 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99ffaf33-f387-4310-aa8d-a676deac4a7b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ce28b25b907473588ccb87dc4acc06a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a000829c658c4a7cab67f7b6353ba3fa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:02:44.847266 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ffaf33-f387-4310-aa8d-a676deac4a7b service neutron] REQUEST_METHOD: `GET` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:02:44.847547 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ffaf33-f387-4310-aa8d-a676deac4a7b service neutron] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:02:44.847852 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ffaf33-f387-4310-aa8d-a676deac4a7b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:02:44.858551 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99ffaf33-f387-4310-aa8d-a676deac4a7b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:02:44.860057 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99ffaf33-f387-4310-aa8d-a676deac4a7b service neutron] RBAC: Authorization granted {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:02:44.871726 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 818/1616] 10.222.0.84 () {60 vars in 1365 bytes} [Wed May 25 15:02:44 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 15:02:44.872982 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99ffaf33-f387-4310-aa8d-a676deac4a7b service neutron] Authenticating user token {{(pid=101893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:02:44.881034 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99ffaf33-f387-4310-aa8d-a676deac4a7b service neutron] Validating token access rules against request {{(pid=101893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:02:44.884633 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-777997e2-bb71-45ac-9309-9c3ab2da1488 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ce28b25b907473588ccb87dc4acc06a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a000829c658c4a7cab67f7b6353ba3fa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:02:44.885296 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777997e2-bb71-45ac-9309-9c3ab2da1488 service neutron] REQUEST_METHOD: `GET` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:02:44.885575 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777997e2-bb71-45ac-9309-9c3ab2da1488 service neutron] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:02:44.885867 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777997e2-bb71-45ac-9309-9c3ab2da1488 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:02:44.898373 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-777997e2-bb71-45ac-9309-9c3ab2da1488 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:02:44.900460 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-777997e2-bb71-45ac-9309-9c3ab2da1488 service neutron] RBAC: Authorization granted {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:02:44.907850 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 799/1617] 10.222.0.84 () {60 vars in 1152 bytes} [Wed May 25 15:02:44 2022] POST /identity/v3/projects => generated 357 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 15:02:44.914696 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f136411-4a03-47a2-9f83-a9812dbe2462 None None] REQUEST_METHOD: `POST` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:02:44.914986 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f136411-4a03-47a2-9f83-a9812dbe2462 None None] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:02:44.915267 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f136411-4a03-47a2-9f83-a9812dbe2462 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:02:44.925141 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 819/1618] 10.222.0.84 () {60 vars in 1365 bytes} [Wed May 25 15:02:44 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 15:02:44.928318 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-777997e2-bb71-45ac-9309-9c3ab2da1488 service neutron] Authenticating user token {{(pid=101893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:02:44.938570 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-777997e2-bb71-45ac-9309-9c3ab2da1488 service neutron] Validating token access rules against request {{(pid=101893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:02:44.972323 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.auth.core [None req-8f136411-4a03-47a2-9f83-a9812dbe2462 None None] MFA Rules not processed for user `9e62022fc5874ac49784ccd152a3b161`. Rule list: `[]` (Enabled: `True`). {{(pid=101892) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:02:44.973468 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.fernet_utils [None req-8f136411-4a03-47a2-9f83-a9812dbe2462 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=101892) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:02:44.975832 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG dbcounter [-] [101893] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=101893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:02:45.039681 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-648c4c78-3ef7-40f7-9503-009b59fb7c00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cec56f74b2fa4826a506dc7b919465be', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:02:45.041882 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648c4c78-3ef7-40f7-9503-009b59fb7c00 admin admin] REQUEST_METHOD: `GET` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:02:45.042292 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648c4c78-3ef7-40f7-9503-009b59fb7c00 admin admin] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:02:45.042670 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648c4c78-3ef7-40f7-9503-009b59fb7c00 admin admin] PATH_INFO: `/v3/roles` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:02:45.044286 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-648c4c78-3ef7-40f7-9503-009b59fb7c00 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:02:45.047408 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-648c4c78-3ef7-40f7-9503-009b59fb7c00 admin admin] RBAC: Authorization granted {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:02:45.058684 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 800/1619] 10.222.0.84 () {58 vars in 957 bytes} [Wed May 25 15:02:44 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 15:02:45.062404 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f136411-4a03-47a2-9f83-a9812dbe2462 None None] Authenticating user token {{(pid=101892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:02:45.071647 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 820/1620] 10.222.0.84 () {58 vars in 1121 bytes} [Wed May 25 15:02:44 2022] GET /identity/v3/roles => generated 1420 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 15:02:45.073181 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f136411-4a03-47a2-9f83-a9812dbe2462 None None] Validating token access rules against request {{(pid=101892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:02:45.076961 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-648c4c78-3ef7-40f7-9503-009b59fb7c00 admin admin] Authenticating user token {{(pid=101893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:02:45.089812 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-648c4c78-3ef7-40f7-9503-009b59fb7c00 admin admin] Validating token access rules against request {{(pid=101893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:02:45.091785 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b60ad7d-a9ae-4ace-b37f-9754608e30a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cec56f74b2fa4826a506dc7b919465be', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:02:45.093051 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b60ad7d-a9ae-4ace-b37f-9754608e30a3 admin admin] REQUEST_METHOD: `POST` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:02:45.093435 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b60ad7d-a9ae-4ace-b37f-9754608e30a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:02:45.093881 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b60ad7d-a9ae-4ace-b37f-9754608e30a3 admin admin] PATH_INFO: `/v3/users` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:02:45.094864 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b60ad7d-a9ae-4ace-b37f-9754608e30a3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:02:45.097254 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b1205d3-f8bd-4ba4-b71d-45d0abd585b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cec56f74b2fa4826a506dc7b919465be', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:02:45.097696 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b60ad7d-a9ae-4ace-b37f-9754608e30a3 admin admin] RBAC: Authorization granted {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:02:45.098227 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1205d3-f8bd-4ba4-b71d-45d0abd585b4 admin admin] REQUEST_METHOD: `PUT` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:02:45.098521 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1205d3-f8bd-4ba4-b71d-45d0abd585b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:02:45.098805 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1205d3-f8bd-4ba4-b71d-45d0abd585b4 admin admin] PATH_INFO: `/v3/projects/bdfbd2cbeee2412d938755b72e0e3299/users/a60f87407ba3444b9703cb85c5f252bf/roles/a3b78e7d547d4d2d998b4c99a4396bba` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:02:45.122048 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b1205d3-f8bd-4ba4-b71d-45d0abd585b4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bdfbd2cbeee2412d938755b72e0e3299, user_id=a60f87407ba3444b9703cb85c5f252bf, role_id=a3b78e7d547d4d2d998b4c99a4396bba)` {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:02:45.125225 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b1205d3-f8bd-4ba4-b71d-45d0abd585b4 admin admin] RBAC: Authorization granted {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:02:45.214292 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 801/1621] 10.222.0.84 () {60 vars in 1143 bytes} [Wed May 25 15:02:45 2022] POST /identity/v3/users => generated 285 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 15:02:45.215971 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b60ad7d-a9ae-4ace-b37f-9754608e30a3 admin admin] Authenticating user token {{(pid=101892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:02:45.249479 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 821/1622] 10.222.0.84 () {60 vars in 1482 bytes} [Wed May 25 15:02:45 2022] PUT /identity/v3/projects/bdfbd2cbeee2412d938755b72e0e3299/users/a60f87407ba3444b9703cb85c5f252bf/roles/a3b78e7d547d4d2d998b4c99a4396bba => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 25 15:02:45.249479 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b1205d3-f8bd-4ba4-b71d-45d0abd585b4 admin admin] Authenticating user token {{(pid=101893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:02:45.330739 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG dbcounter [-] [101892] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=101892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:02:45.341576 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b60ad7d-a9ae-4ace-b37f-9754608e30a3 admin admin] Validating token access rules against request {{(pid=101892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:02:45.357093 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b1205d3-f8bd-4ba4-b71d-45d0abd585b4 admin admin] Validating token access rules against request {{(pid=101893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:02:45.362258 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5164c922-c999-4bd4-9d54-6de5f41fa1f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cec56f74b2fa4826a506dc7b919465be', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:02:45.362945 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5164c922-c999-4bd4-9d54-6de5f41fa1f8 admin admin] REQUEST_METHOD: `GET` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:02:45.363228 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5164c922-c999-4bd4-9d54-6de5f41fa1f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:02:45.363697 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5164c922-c999-4bd4-9d54-6de5f41fa1f8 admin admin] PATH_INFO: `/v3/roles` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:02:45.364385 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5164c922-c999-4bd4-9d54-6de5f41fa1f8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:02:45.366151 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5164c922-c999-4bd4-9d54-6de5f41fa1f8 admin admin] RBAC: Authorization granted {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:02:45.377031 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 822/1623] 10.222.0.84 () {58 vars in 1121 bytes} [Wed May 25 15:02:45 2022] GET /identity/v3/roles => generated 1420 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 15:02:45.377951 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5164c922-c999-4bd4-9d54-6de5f41fa1f8 admin admin] Authenticating user token {{(pid=101893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:02:45.390216 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5164c922-c999-4bd4-9d54-6de5f41fa1f8 admin admin] Validating token access rules against request {{(pid=101893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:02:45.395282 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87ff9efe-2bb7-488d-8546-d5e7c2327eb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cec56f74b2fa4826a506dc7b919465be', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:02:45.396148 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ff9efe-2bb7-488d-8546-d5e7c2327eb8 admin admin] REQUEST_METHOD: `GET` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:02:45.396497 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ff9efe-2bb7-488d-8546-d5e7c2327eb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:02:45.396711 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ff9efe-2bb7-488d-8546-d5e7c2327eb8 admin admin] PATH_INFO: `/v3/roles` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:02:45.397463 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87ff9efe-2bb7-488d-8546-d5e7c2327eb8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:02:45.399102 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87ff9efe-2bb7-488d-8546-d5e7c2327eb8 admin admin] RBAC: Authorization granted {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:02:45.411873 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 823/1624] 10.222.0.84 () {58 vars in 1121 bytes} [Wed May 25 15:02:45 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 15:02:45.412155 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87ff9efe-2bb7-488d-8546-d5e7c2327eb8 admin admin] Authenticating user token {{(pid=101893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:02:45.414842 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4842c9c0-2c6c-4384-a35d-cc02d55e93c2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e079f89a5e524ab6ad4183e4f690de07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a000829c658c4a7cab67f7b6353ba3fa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:02:45.418332 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4842c9c0-2c6c-4384-a35d-cc02d55e93c2 service cinder] REQUEST_METHOD: `GET` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:02:45.418332 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4842c9c0-2c6c-4384-a35d-cc02d55e93c2 service cinder] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:02:45.418812 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4842c9c0-2c6c-4384-a35d-cc02d55e93c2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:02:45.423736 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87ff9efe-2bb7-488d-8546-d5e7c2327eb8 admin admin] Validating token access rules against request {{(pid=101893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:02:45.437079 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-607dc61c-0e45-4792-bbc9-fde700eb3f46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cec56f74b2fa4826a506dc7b919465be', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:02:45.438671 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607dc61c-0e45-4792-bbc9-fde700eb3f46 admin admin] REQUEST_METHOD: `PUT` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:02:45.439012 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607dc61c-0e45-4792-bbc9-fde700eb3f46 admin admin] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:02:45.439441 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607dc61c-0e45-4792-bbc9-fde700eb3f46 admin admin] PATH_INFO: `/v3/projects/d8746fde70bc4086838d19cf39207766/users/1d9dbd10b9a34540b8689b4a9afc10b7/roles/a3b78e7d547d4d2d998b4c99a4396bba` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:02:45.461151 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-607dc61c-0e45-4792-bbc9-fde700eb3f46 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d8746fde70bc4086838d19cf39207766, user_id=1d9dbd10b9a34540b8689b4a9afc10b7, role_id=a3b78e7d547d4d2d998b4c99a4396bba)` {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:02:45.464839 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-607dc61c-0e45-4792-bbc9-fde700eb3f46 admin admin] RBAC: Authorization granted {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:02:45.499371 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4842c9c0-2c6c-4384-a35d-cc02d55e93c2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:02:45.501041 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4842c9c0-2c6c-4384-a35d-cc02d55e93c2 service cinder] RBAC: Authorization granted {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:02:45.523198 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 802/1625] 10.222.0.84 () {60 vars in 1365 bytes} [Wed May 25 15:02:45 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 15:02:45.525242 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4842c9c0-2c6c-4384-a35d-cc02d55e93c2 service cinder] Authenticating user token {{(pid=101892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:02:45.564475 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4842c9c0-2c6c-4384-a35d-cc02d55e93c2 service cinder] Validating token access rules against request {{(pid=101892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:02:45.572128 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 824/1626] 10.222.0.84 () {60 vars in 1482 bytes} [Wed May 25 15:02:45 2022] PUT /identity/v3/projects/d8746fde70bc4086838d19cf39207766/users/1d9dbd10b9a34540b8689b4a9afc10b7/roles/a3b78e7d547d4d2d998b4c99a4396bba => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 15:02:45.573368 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-607dc61c-0e45-4792-bbc9-fde700eb3f46 admin admin] Authenticating user token {{(pid=101893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:02:45.654152 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG dbcounter [-] [101893] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=101893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:02:45.667953 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-607dc61c-0e45-4792-bbc9-fde700eb3f46 admin admin] Validating token access rules against request {{(pid=101893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:02:45.674603 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ee2b6cb-8f8b-4fc0-9acd-f786f89fdf15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cec56f74b2fa4826a506dc7b919465be', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:02:45.675903 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee2b6cb-8f8b-4fc0-9acd-f786f89fdf15 admin admin] REQUEST_METHOD: `GET` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:02:45.676351 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee2b6cb-8f8b-4fc0-9acd-f786f89fdf15 admin admin] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:02:45.676817 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee2b6cb-8f8b-4fc0-9acd-f786f89fdf15 admin admin] PATH_INFO: `/v3/roles` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:02:45.678051 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ee2b6cb-8f8b-4fc0-9acd-f786f89fdf15 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:02:45.680106 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ee2b6cb-8f8b-4fc0-9acd-f786f89fdf15 admin admin] RBAC: Authorization granted {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:02:45.681321 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-746ed2a7-0e8d-4c90-93db-0077d715c7f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cec56f74b2fa4826a506dc7b919465be', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:02:45.684757 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746ed2a7-0e8d-4c90-93db-0077d715c7f4 admin admin] REQUEST_METHOD: `PUT` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:02:45.685135 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746ed2a7-0e8d-4c90-93db-0077d715c7f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:02:45.685702 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746ed2a7-0e8d-4c90-93db-0077d715c7f4 admin admin] PATH_INFO: `/v3/projects/bdfbd2cbeee2412d938755b72e0e3299/users/a60f87407ba3444b9703cb85c5f252bf/roles/a3b78e7d547d4d2d998b4c99a4396bba` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:02:45.688228 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-746ed2a7-0e8d-4c90-93db-0077d715c7f4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bdfbd2cbeee2412d938755b72e0e3299, user_id=a60f87407ba3444b9703cb85c5f252bf, role_id=a3b78e7d547d4d2d998b4c99a4396bba)` {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:02:45.692485 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-746ed2a7-0e8d-4c90-93db-0077d715c7f4 admin admin] RBAC: Authorization granted {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:02:45.699379 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 825/1627] 10.222.0.84 () {58 vars in 1121 bytes} [Wed May 25 15:02:45 2022] GET /identity/v3/roles => generated 1420 bytes in 126 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 15:02:45.701188 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ee2b6cb-8f8b-4fc0-9acd-f786f89fdf15 admin admin] Authenticating user token {{(pid=101893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:02:45.714353 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ee2b6cb-8f8b-4fc0-9acd-f786f89fdf15 admin admin] Validating token access rules against request {{(pid=101893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:02:45.729478 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 803/1628] 10.222.0.84 () {60 vars in 1482 bytes} [Wed May 25 15:02:45 2022] PUT /identity/v3/projects/bdfbd2cbeee2412d938755b72e0e3299/users/a60f87407ba3444b9703cb85c5f252bf/roles/a3b78e7d547d4d2d998b4c99a4396bba => generated 0 bytes in 205 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 15:02:45.743932 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18483544-3f13-4ccc-8b39-5465c86d77d3 None None] REQUEST_METHOD: `POST` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:02:45.744354 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18483544-3f13-4ccc-8b39-5465c86d77d3 None None] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:02:45.744718 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18483544-3f13-4ccc-8b39-5465c86d77d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:02:45.794596 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.auth.core [None req-18483544-3f13-4ccc-8b39-5465c86d77d3 None None] MFA Rules not processed for user `a60f87407ba3444b9703cb85c5f252bf`. Rule list: `[]` (Enabled: `True`). {{(pid=101892) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:02:45.797180 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.fernet_utils [None req-18483544-3f13-4ccc-8b39-5465c86d77d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=101892) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:02:45.844207 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb44d0e-8af3-4b9c-913c-13ed839f5bb3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cec56f74b2fa4826a506dc7b919465be', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:02:45.845443 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb44d0e-8af3-4b9c-913c-13ed839f5bb3 admin admin] REQUEST_METHOD: `PUT` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:02:45.845937 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb44d0e-8af3-4b9c-913c-13ed839f5bb3 admin admin] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:02:45.846623 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb44d0e-8af3-4b9c-913c-13ed839f5bb3 admin admin] PATH_INFO: `/v3/projects/d8746fde70bc4086838d19cf39207766/users/1d9dbd10b9a34540b8689b4a9afc10b7/roles/a3b78e7d547d4d2d998b4c99a4396bba` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:02:45.849036 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbb44d0e-8af3-4b9c-913c-13ed839f5bb3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d8746fde70bc4086838d19cf39207766, user_id=1d9dbd10b9a34540b8689b4a9afc10b7, role_id=a3b78e7d547d4d2d998b4c99a4396bba)` {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:02:45.852906 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbb44d0e-8af3-4b9c-913c-13ed839f5bb3 admin admin] RBAC: Authorization granted {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:02:45.872345 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 826/1629] 10.222.0.84 () {60 vars in 1482 bytes} [Wed May 25 15:02:45 2022] PUT /identity/v3/projects/d8746fde70bc4086838d19cf39207766/users/1d9dbd10b9a34540b8689b4a9afc10b7/roles/a3b78e7d547d4d2d998b4c99a4396bba => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 15:02:45.885340 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b6c969-d1fe-4c64-94cc-e8c389ee25b6 None None] REQUEST_METHOD: `POST` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:02:45.885681 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b6c969-d1fe-4c64-94cc-e8c389ee25b6 None None] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:02:45.885956 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b6c969-d1fe-4c64-94cc-e8c389ee25b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:02:45.927004 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG dbcounter [-] [101892] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=101892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:02:45.961722 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 804/1630] 10.222.0.84 () {58 vars in 957 bytes} [Wed May 25 15:02:45 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 219 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 25 15:02:45.979252 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18483544-3f13-4ccc-8b39-5465c86d77d3 None None] Authenticating user token {{(pid=101892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:02:45.987404 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.auth.core [None req-c3b6c969-d1fe-4c64-94cc-e8c389ee25b6 None None] MFA Rules not processed for user `1d9dbd10b9a34540b8689b4a9afc10b7`. Rule list: `[]` (Enabled: `True`). {{(pid=101893) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:02:45.992156 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.fernet_utils [None req-c3b6c969-d1fe-4c64-94cc-e8c389ee25b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=101893) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:02:46.082866 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18483544-3f13-4ccc-8b39-5465c86d77d3 None None] Validating token access rules against request {{(pid=101892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:02:46.122611 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 827/1631] 10.222.0.84 () {58 vars in 957 bytes} [Wed May 25 15:02:45 2022] POST /identity/v3/auth/tokens => generated 3291 bytes in 238 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 15:02:46.170937 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93a3e909-b0d2-4765-b543-7b17bf3afb67 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e079f89a5e524ab6ad4183e4f690de07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a000829c658c4a7cab67f7b6353ba3fa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:02:46.171713 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a3e909-b0d2-4765-b543-7b17bf3afb67 service cinder] REQUEST_METHOD: `GET` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:02:46.172034 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a3e909-b0d2-4765-b543-7b17bf3afb67 service cinder] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:02:46.172407 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a3e909-b0d2-4765-b543-7b17bf3afb67 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:02:46.241386 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93a3e909-b0d2-4765-b543-7b17bf3afb67 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:02:46.242870 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93a3e909-b0d2-4765-b543-7b17bf3afb67 service cinder] RBAC: Authorization granted {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:02:46.253871 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 805/1632] 10.222.0.84 () {60 vars in 1365 bytes} [Wed May 25 15:02:45 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 275 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 15:02:46.878021 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3b6c969-d1fe-4c64-94cc-e8c389ee25b6 None None] Authenticating user token {{(pid=101893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:02:46.904190 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3b6c969-d1fe-4c64-94cc-e8c389ee25b6 None None] Validating token access rules against request {{(pid=101893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:02:46.912517 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e4934b-377c-4bee-952c-662ad293ae7c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e079f89a5e524ab6ad4183e4f690de07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a000829c658c4a7cab67f7b6353ba3fa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:02:46.913845 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e4934b-377c-4bee-952c-662ad293ae7c service cinder] REQUEST_METHOD: `GET` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:02:46.913845 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e4934b-377c-4bee-952c-662ad293ae7c service cinder] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:02:46.913845 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e4934b-377c-4bee-952c-662ad293ae7c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:02:46.930780 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9e4934b-377c-4bee-952c-662ad293ae7c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:02:46.933400 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9e4934b-377c-4bee-952c-662ad293ae7c service cinder] RBAC: Authorization granted {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:02:46.954874 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 828/1633] 10.222.0.84 () {60 vars in 1365 bytes} [Wed May 25 15:02:46 2022] GET /identity/v3/auth/tokens => generated 3291 bytes in 78 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 15:02:47.607091 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93a3e909-b0d2-4765-b543-7b17bf3afb67 service cinder] Authenticating user token {{(pid=101892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:02:47.607091 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93a3e909-b0d2-4765-b543-7b17bf3afb67 service cinder] Validating token access rules against request {{(pid=101892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:02:47.607091 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9b0352c-84b0-4590-a27a-b6e76e178dc5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e079f89a5e524ab6ad4183e4f690de07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a000829c658c4a7cab67f7b6353ba3fa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:02:47.607091 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b0352c-84b0-4590-a27a-b6e76e178dc5 service cinder] REQUEST_METHOD: `GET` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:02:47.612317 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b0352c-84b0-4590-a27a-b6e76e178dc5 service cinder] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:02:47.612317 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b0352c-84b0-4590-a27a-b6e76e178dc5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:02:47.612317 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG dbcounter [-] [101892] Writing DB stats keystone:SELECT=100 {{(pid=101892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:02:47.612317 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9b0352c-84b0-4590-a27a-b6e76e178dc5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:02:47.612317 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9b0352c-84b0-4590-a27a-b6e76e178dc5 service cinder] RBAC: Authorization granted {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:02:47.615887 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99d8a17-3022-4def-a640-b6633beffd1b None None] REQUEST_METHOD: `POST` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:02:47.615887 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99d8a17-3022-4def-a640-b6633beffd1b None None] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:02:47.615887 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99d8a17-3022-4def-a640-b6633beffd1b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:02:47.617200 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 806/1634] 10.222.0.84 () {60 vars in 1365 bytes} [Wed May 25 15:02:47 2022] GET /identity/v3/auth/tokens => generated 3224 bytes in 142 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 15:02:47.617516 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.auth.core [None req-d99d8a17-3022-4def-a640-b6633beffd1b None None] MFA Rules not processed for user `487533f39e944ceaad952200101f021f`. Rule list: `[]` (Enabled: `True`). {{(pid=101893) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:02:47.617516 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.fernet_utils [None req-d99d8a17-3022-4def-a640-b6633beffd1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=101893) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:02:47.617516 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG dbcounter [-] [101893] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=101893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:02:47.665199 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 829/1635] 10.222.0.84 () {58 vars in 957 bytes} [Wed May 25 15:02:47 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 25 15:02:47.679819 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dedacbe-ff88-4d89-836f-018654086353 None None] REQUEST_METHOD: `POST` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:02:47.679819 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dedacbe-ff88-4d89-836f-018654086353 None None] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:02:47.679819 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dedacbe-ff88-4d89-836f-018654086353 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:02:47.712286 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.auth.core [None req-6dedacbe-ff88-4d89-836f-018654086353 None None] MFA Rules not processed for user `487533f39e944ceaad952200101f021f`. Rule list: `[]` (Enabled: `True`). {{(pid=101892) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:02:47.714694 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.fernet_utils [None req-6dedacbe-ff88-4d89-836f-018654086353 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=101892) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:02:47.734453 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 807/1636] 10.222.0.84 () {58 vars in 957 bytes} [Wed May 25 15:02:47 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 57 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 15:02:47.779730 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f39b6c8-1153-48cc-94b9-3ca20144b4c7 None None] REQUEST_METHOD: `GET` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:02:47.780071 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f39b6c8-1153-48cc-94b9-3ca20144b4c7 None None] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:02:47.780382 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f39b6c8-1153-48cc-94b9-3ca20144b4c7 None None] PATH_INFO: `/` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:02:47.782085 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 830/1637] 10.222.0.84 () {54 vars in 961 bytes} [Wed May 25 15:02:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 15:02:47.796250 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745c7dd0-7097-47d7-ae82-66f0d6d7abe5 None None] REQUEST_METHOD: `POST` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:02:47.797765 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745c7dd0-7097-47d7-ae82-66f0d6d7abe5 None None] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:02:47.798143 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745c7dd0-7097-47d7-ae82-66f0d6d7abe5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:02:47.829098 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.auth.core [None req-745c7dd0-7097-47d7-ae82-66f0d6d7abe5 None None] MFA Rules not processed for user `2aeb182e6a5b43cfb0cc347ec847c848`. Rule list: `[]` (Enabled: `True`). {{(pid=101892) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:02:47.830426 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.fernet_utils [None req-745c7dd0-7097-47d7-ae82-66f0d6d7abe5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=101892) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:02:47.943400 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 808/1638] 10.222.0.84 () {58 vars in 1058 bytes} [Wed May 25 15:02:47 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 15:02:47.953675 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f39b6c8-1153-48cc-94b9-3ca20144b4c7 None None] Authenticating user token {{(pid=101893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:02:47.987207 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f39b6c8-1153-48cc-94b9-3ca20144b4c7 None None] Validating token access rules against request {{(pid=101893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:02:47.998277 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c2859d-21e0-40b9-ba8b-ac3710f66c7e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2aeb182e6a5b43cfb0cc347ec847c848', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a000829c658c4a7cab67f7b6353ba3fa', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:02:48.001265 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c2859d-21e0-40b9-ba8b-ac3710f66c7e service nova] REQUEST_METHOD: `GET` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:02:48.007471 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c2859d-21e0-40b9-ba8b-ac3710f66c7e service nova] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:02:48.007471 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c2859d-21e0-40b9-ba8b-ac3710f66c7e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:02:48.013334 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61c2859d-21e0-40b9-ba8b-ac3710f66c7e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:02:48.021296 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61c2859d-21e0-40b9-ba8b-ac3710f66c7e service nova] RBAC: Authorization granted {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:02:48.037178 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 831/1639] 10.222.0.84 () {60 vars in 1365 bytes} [Wed May 25 15:02:47 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 15:02:48.462401 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3a3fb8-103e-47cd-a36f-dbd5aac64ead None None] REQUEST_METHOD: `GET` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:02:48.462724 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3a3fb8-103e-47cd-a36f-dbd5aac64ead None None] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:02:48.463576 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3a3fb8-103e-47cd-a36f-dbd5aac64ead None None] PATH_INFO: `/` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:02:48.465586 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 809/1640] 10.222.0.84 () {54 vars in 912 bytes} [Wed May 25 15:02:48 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 15:02:48.479830 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05acbf2f-9b05-4357-a7d6-c727b974f62f None None] REQUEST_METHOD: `POST` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:02:48.480192 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05acbf2f-9b05-4357-a7d6-c727b974f62f None None] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:02:48.481115 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05acbf2f-9b05-4357-a7d6-c727b974f62f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:02:48.510451 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.auth.core [None req-05acbf2f-9b05-4357-a7d6-c727b974f62f None None] MFA Rules not processed for user `2aeb182e6a5b43cfb0cc347ec847c848`. Rule list: `[]` (Enabled: `True`). {{(pid=101893) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:02:48.511720 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.fernet_utils [None req-05acbf2f-9b05-4357-a7d6-c727b974f62f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=101893) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:02:48.531601 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 832/1641] 10.222.0.84 () {58 vars in 1009 bytes} [Wed May 25 15:02:48 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 15:02:48.540842 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d3a3fb8-103e-47cd-a36f-dbd5aac64ead None None] Authenticating user token {{(pid=101892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:02:48.542695 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.fernet_utils [None req-1d3a3fb8-103e-47cd-a36f-dbd5aac64ead None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=101892) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:02:48.685039 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d3a3fb8-103e-47cd-a36f-dbd5aac64ead None None] Validating token access rules against request {{(pid=101892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:02:48.692295 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc4a6892-d029-4379-900c-c5699477502c service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '971542599734491aa112b815fc4cc5c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a000829c658c4a7cab67f7b6353ba3fa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:02:48.693645 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4a6892-d029-4379-900c-c5699477502c service glance] REQUEST_METHOD: `GET` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:02:48.693864 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4a6892-d029-4379-900c-c5699477502c service glance] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:02:48.694034 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4a6892-d029-4379-900c-c5699477502c service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:02:48.723274 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc4a6892-d029-4379-900c-c5699477502c service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:02:48.726668 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc4a6892-d029-4379-900c-c5699477502c service glance] RBAC: Authorization granted {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:02:48.758903 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 810/1642] 10.222.0.84 () {60 vars in 1365 bytes} [Wed May 25 15:02:48 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 218 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 15:02:49.399963 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa30f4b-1a9b-4210-8340-c17fbbf69245 None None] REQUEST_METHOD: `GET` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:02:49.401068 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa30f4b-1a9b-4210-8340-c17fbbf69245 None None] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:02:49.401068 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa30f4b-1a9b-4210-8340-c17fbbf69245 None None] PATH_INFO: `/` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:02:49.403280 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 833/1643] 10.222.0.84 () {54 vars in 912 bytes} [Wed May 25 15:02:49 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 15:02:49.408930 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079f4b37-d94e-4b2f-ab5e-45eb4f8c572d None None] REQUEST_METHOD: `POST` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:02:49.409540 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079f4b37-d94e-4b2f-ab5e-45eb4f8c572d None None] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:02:49.410185 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079f4b37-d94e-4b2f-ab5e-45eb4f8c572d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:02:49.537274 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.auth.core [None req-079f4b37-d94e-4b2f-ab5e-45eb4f8c572d None None] MFA Rules not processed for user `9ce28b25b907473588ccb87dc4acc06a`. Rule list: `[]` (Enabled: `True`). {{(pid=101892) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:02:49.544041 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.fernet_utils [None req-079f4b37-d94e-4b2f-ab5e-45eb4f8c572d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=101892) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:02:49.667041 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 811/1644] 10.222.0.84 () {58 vars in 1009 bytes} [Wed May 25 15:02:49 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 260 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 25 15:02:49.696343 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa30f4b-1a9b-4210-8340-c17fbbf69245 None None] Authenticating user token {{(pid=101893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:02:49.699034 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.fernet_utils [None req-faa30f4b-1a9b-4210-8340-c17fbbf69245 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=101893) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:02:49.723061 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa30f4b-1a9b-4210-8340-c17fbbf69245 None None] Validating token access rules against request {{(pid=101893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:02:49.732675 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2edea00f-c830-48de-a7ce-997e66c2ee70 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ce28b25b907473588ccb87dc4acc06a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a000829c658c4a7cab67f7b6353ba3fa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:02:49.733595 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2edea00f-c830-48de-a7ce-997e66c2ee70 service neutron] REQUEST_METHOD: `GET` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:02:49.734028 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2edea00f-c830-48de-a7ce-997e66c2ee70 service neutron] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:02:49.742110 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2edea00f-c830-48de-a7ce-997e66c2ee70 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:02:49.747056 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2edea00f-c830-48de-a7ce-997e66c2ee70 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:02:49.750161 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2edea00f-c830-48de-a7ce-997e66c2ee70 service neutron] RBAC: Authorization granted {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:02:49.775742 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 834/1645] 10.222.0.84 () {60 vars in 1365 bytes} [Wed May 25 15:02:49 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 76 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 15:02:50.006943 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331bff2c-9ab0-4cfb-9793-b1333679bb82 None None] REQUEST_METHOD: `GET` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:02:50.007912 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331bff2c-9ab0-4cfb-9793-b1333679bb82 None None] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:02:50.008163 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331bff2c-9ab0-4cfb-9793-b1333679bb82 None None] PATH_INFO: `/` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:02:50.010322 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 812/1646] 10.222.0.84 () {54 vars in 961 bytes} [Wed May 25 15:02:50 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 15:02:50.036119 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa4c1a2-8ac4-40b5-baff-c80c8d94751a None None] REQUEST_METHOD: `POST` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:02:50.036775 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa4c1a2-8ac4-40b5-baff-c80c8d94751a None None] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:02:50.037189 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa4c1a2-8ac4-40b5-baff-c80c8d94751a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:02:50.085881 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.auth.core [None req-5fa4c1a2-8ac4-40b5-baff-c80c8d94751a None None] MFA Rules not processed for user `2aeb182e6a5b43cfb0cc347ec847c848`. Rule list: `[]` (Enabled: `True`). {{(pid=101893) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:02:50.087520 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.fernet_utils [None req-5fa4c1a2-8ac4-40b5-baff-c80c8d94751a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=101893) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:02:50.114038 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 835/1647] 10.222.0.84 () {58 vars in 1058 bytes} [Wed May 25 15:02:50 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 15:02:50.121013 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45369d24-8628-4706-8a21-ffb7b5691dba None None] REQUEST_METHOD: `GET` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:02:50.124649 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45369d24-8628-4706-8a21-ffb7b5691dba None None] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:02:50.124649 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45369d24-8628-4706-8a21-ffb7b5691dba None None] PATH_INFO: `/` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:02:50.124649 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 813/1648] 10.222.0.84 () {54 vars in 912 bytes} [Wed May 25 15:02:50 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 25 15:02:50.129989 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26506f7-9ebd-4b76-9368-d7c7a85130f2 None None] REQUEST_METHOD: `POST` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:02:50.130333 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26506f7-9ebd-4b76-9368-d7c7a85130f2 None None] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:02:50.130635 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26506f7-9ebd-4b76-9368-d7c7a85130f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:02:50.168015 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.auth.core [None req-b26506f7-9ebd-4b76-9368-d7c7a85130f2 None None] MFA Rules not processed for user `2aeb182e6a5b43cfb0cc347ec847c848`. Rule list: `[]` (Enabled: `True`). {{(pid=101893) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:02:50.171772 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.fernet_utils [None req-b26506f7-9ebd-4b76-9368-d7c7a85130f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=101893) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:02:50.194611 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 836/1649] 10.222.0.84 () {58 vars in 1009 bytes} [Wed May 25 15:02:50 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 65 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 15:02:50.209023 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45369d24-8628-4706-8a21-ffb7b5691dba None None] Authenticating user token {{(pid=101892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:02:50.228366 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45369d24-8628-4706-8a21-ffb7b5691dba None None] Validating token access rules against request {{(pid=101892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:02:50.238883 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ee5e95-ba4b-4e8a-88b6-ac65f22ba0b7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e079f89a5e524ab6ad4183e4f690de07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a000829c658c4a7cab67f7b6353ba3fa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:02:50.240434 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ee5e95-ba4b-4e8a-88b6-ac65f22ba0b7 service cinder] REQUEST_METHOD: `GET` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:02:50.243781 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ee5e95-ba4b-4e8a-88b6-ac65f22ba0b7 service cinder] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:02:50.243781 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ee5e95-ba4b-4e8a-88b6-ac65f22ba0b7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:02:50.269054 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09ee5e95-ba4b-4e8a-88b6-ac65f22ba0b7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:02:50.273290 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09ee5e95-ba4b-4e8a-88b6-ac65f22ba0b7 service cinder] RBAC: Authorization granted {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:02:50.287531 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG dbcounter [-] [101892] Writing DB stats keystone:SELECT=100 {{(pid=101892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:02:50.305090 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 814/1650] 10.222.0.84 () {60 vars in 1365 bytes} [Wed May 25 15:02:50 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 15:02:50.660622 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b26506f7-9ebd-4b76-9368-d7c7a85130f2 None None] Authenticating user token {{(pid=101893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:02:50.673812 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b26506f7-9ebd-4b76-9368-d7c7a85130f2 None None] Validating token access rules against request {{(pid=101893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:02:50.678222 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2dd9484-b094-41ec-a3fe-95c9bfe4b16e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e079f89a5e524ab6ad4183e4f690de07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a000829c658c4a7cab67f7b6353ba3fa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:02:50.679120 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2dd9484-b094-41ec-a3fe-95c9bfe4b16e service cinder] REQUEST_METHOD: `GET` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:02:50.679652 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2dd9484-b094-41ec-a3fe-95c9bfe4b16e service cinder] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:02:50.680124 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2dd9484-b094-41ec-a3fe-95c9bfe4b16e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:02:50.813053 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2dd9484-b094-41ec-a3fe-95c9bfe4b16e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:02:50.817182 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2dd9484-b094-41ec-a3fe-95c9bfe4b16e service cinder] RBAC: Authorization granted {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:02:50.837160 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 837/1651] 10.222.0.84 () {60 vars in 1365 bytes} [Wed May 25 15:02:50 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 177 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 15:02:51.160477 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed0fde4-f90a-434e-a950-be106ab2e927 None None] REQUEST_METHOD: `GET` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:02:51.160984 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed0fde4-f90a-434e-a950-be106ab2e927 None None] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:02:51.161106 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed0fde4-f90a-434e-a950-be106ab2e927 None None] PATH_INFO: `/` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:02:51.163170 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 815/1652] 10.222.0.84 () {54 vars in 960 bytes} [Wed May 25 15:02:51 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 15:02:51.177025 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0cd386-75be-42a6-9a6c-e8b4e7de7361 None None] REQUEST_METHOD: `POST` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:02:51.177025 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0cd386-75be-42a6-9a6c-e8b4e7de7361 None None] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:02:51.177025 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0cd386-75be-42a6-9a6c-e8b4e7de7361 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:02:51.223757 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.auth.core [None req-af0cd386-75be-42a6-9a6c-e8b4e7de7361 None None] MFA Rules not processed for user `d18c4a1d92b94c0087a203db4fed22f2`. Rule list: `[]` (Enabled: `True`). {{(pid=101893) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:02:51.228042 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.fernet_utils [None req-af0cd386-75be-42a6-9a6c-e8b4e7de7361 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=101893) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:02:51.416282 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 838/1653] 10.222.0.84 () {58 vars in 1057 bytes} [Wed May 25 15:02:51 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 248 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 15:02:51.420723 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eed0fde4-f90a-434e-a950-be106ab2e927 None None] Authenticating user token {{(pid=101892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:02:51.473296 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eed0fde4-f90a-434e-a950-be106ab2e927 None None] Validating token access rules against request {{(pid=101892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:02:51.494188 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de367786-8323-4e54-8ddb-bc50f4fa3f63 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd18c4a1d92b94c0087a203db4fed22f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a000829c658c4a7cab67f7b6353ba3fa', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:02:51.497476 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de367786-8323-4e54-8ddb-bc50f4fa3f63 service placement] REQUEST_METHOD: `GET` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:02:51.499406 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de367786-8323-4e54-8ddb-bc50f4fa3f63 service placement] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:02:51.502261 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de367786-8323-4e54-8ddb-bc50f4fa3f63 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:02:51.510820 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.fernet_utils [None req-de367786-8323-4e54-8ddb-bc50f4fa3f63 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=101892) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:02:51.547050 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de367786-8323-4e54-8ddb-bc50f4fa3f63 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:02:51.551378 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de367786-8323-4e54-8ddb-bc50f4fa3f63 service placement] RBAC: Authorization granted {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:02:51.572480 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 816/1654] 10.222.0.84 () {60 vars in 1365 bytes} [Wed May 25 15:02:51 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 152 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 15:02:55.699984 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50084d1c-402d-4308-b369-27189056f821 None None] REQUEST_METHOD: `POST` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:02:55.701607 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50084d1c-402d-4308-b369-27189056f821 None None] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:02:55.702587 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50084d1c-402d-4308-b369-27189056f821 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:02:55.765582 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.auth.core [None req-50084d1c-402d-4308-b369-27189056f821 None None] MFA Rules not processed for user `4e9f463e2bfc4c86a07d530ac112b893`. Rule list: `[]` (Enabled: `True`). {{(pid=101893) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:02:55.766949 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.fernet_utils [None req-50084d1c-402d-4308-b369-27189056f821 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=101893) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:02:55.789233 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG dbcounter [-] [101893] Writing DB stats keystone:SELECT=100 {{(pid=101893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:02:55.918981 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 839/1655] 10.222.0.84 () {58 vars in 957 bytes} [Wed May 25 15:02:55 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 216 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 15:02:55.929767 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de367786-8323-4e54-8ddb-bc50f4fa3f63 service placement] Authenticating user token {{(pid=101892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:02:55.971300 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de367786-8323-4e54-8ddb-bc50f4fa3f63 service placement] Validating token access rules against request {{(pid=101892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:02:55.997562 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa4dcd1b-4170-4e46-9c88-f33fff7f694e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2aeb182e6a5b43cfb0cc347ec847c848', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a000829c658c4a7cab67f7b6353ba3fa', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:02:55.998276 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4dcd1b-4170-4e46-9c88-f33fff7f694e service nova] REQUEST_METHOD: `GET` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:02:56.002528 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4dcd1b-4170-4e46-9c88-f33fff7f694e service nova] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:02:56.004748 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4dcd1b-4170-4e46-9c88-f33fff7f694e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:02:56.031388 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa4dcd1b-4170-4e46-9c88-f33fff7f694e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:02:56.034441 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa4dcd1b-4170-4e46-9c88-f33fff7f694e service nova] RBAC: Authorization granted {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:02:56.064087 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 817/1656] 10.222.0.84 () {60 vars in 1365 bytes} [Wed May 25 15:02:55 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 15:02:57.662844 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7da4506-a449-4347-9274-427171fd2f87 None None] REQUEST_METHOD: `POST` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:02:57.663909 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7da4506-a449-4347-9274-427171fd2f87 None None] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:02:57.664417 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7da4506-a449-4347-9274-427171fd2f87 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:02:57.722703 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.auth.core [None req-b7da4506-a449-4347-9274-427171fd2f87 None None] MFA Rules not processed for user `049a7ab3f95f460e908f79cc321176fd`. Rule list: `[]` (Enabled: `True`). {{(pid=101893) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:02:57.728874 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.fernet_utils [None req-b7da4506-a449-4347-9274-427171fd2f87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=101893) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:02:57.949602 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 840/1657] 10.222.0.84 () {58 vars in 1009 bytes} [Wed May 25 15:02:57 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 288 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 15:02:58.550057 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa4dcd1b-4170-4e46-9c88-f33fff7f694e service nova] Authenticating user token {{(pid=101892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:02:58.552639 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.fernet_utils [None req-aa4dcd1b-4170-4e46-9c88-f33fff7f694e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=101892) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:02:58.774199 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa4dcd1b-4170-4e46-9c88-f33fff7f694e service nova] Validating token access rules against request {{(pid=101892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:02:58.793795 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9802bf3-11ba-44e5-94fd-d66e81621ee0 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e196f0897b98455c9e164271d7d0070a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a000829c658c4a7cab67f7b6353ba3fa', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:02:58.795414 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9802bf3-11ba-44e5-94fd-d66e81621ee0 service swift] REQUEST_METHOD: `GET` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:02:58.797160 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9802bf3-11ba-44e5-94fd-d66e81621ee0 service swift] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:02:58.797746 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9802bf3-11ba-44e5-94fd-d66e81621ee0 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:02:58.833603 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9802bf3-11ba-44e5-94fd-d66e81621ee0 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:02:58.835605 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9802bf3-11ba-44e5-94fd-d66e81621ee0 service swift] RBAC: Authorization granted {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:02:58.872070 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 818/1658] 10.222.0.84 () {60 vars in 1384 bytes} [Wed May 25 15:02:58 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 325 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 25 15:02:59.009440 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bfd1909-4f25-47cb-ae1e-ec95b88413e5 None None] REQUEST_METHOD: `POST` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:02:59.010960 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bfd1909-4f25-47cb-ae1e-ec95b88413e5 None None] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:02:59.011615 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bfd1909-4f25-47cb-ae1e-ec95b88413e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:02:59.080476 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.auth.core [None req-6bfd1909-4f25-47cb-ae1e-ec95b88413e5 None None] MFA Rules not processed for user `81783c1018864448aaf753c7c2da4c84`. Rule list: `[]` (Enabled: `True`). {{(pid=101893) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:02:59.087997 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.fernet_utils [None req-6bfd1909-4f25-47cb-ae1e-ec95b88413e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=101893) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:02:59.387756 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 841/1659] 10.222.0.84 () {58 vars in 957 bytes} [Wed May 25 15:02:59 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 373 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 25 15:02:59.389353 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065deb1c-5b02-4db2-a109-817d19995dea None None] REQUEST_METHOD: `POST` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:02:59.394100 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065deb1c-5b02-4db2-a109-817d19995dea None None] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:02:59.394100 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065deb1c-5b02-4db2-a109-817d19995dea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:02:59.456663 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.auth.core [None req-065deb1c-5b02-4db2-a109-817d19995dea None None] MFA Rules not processed for user `81783c1018864448aaf753c7c2da4c84`. Rule list: `[]` (Enabled: `True`). {{(pid=101892) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:02:59.463120 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.fernet_utils [None req-065deb1c-5b02-4db2-a109-817d19995dea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=101892) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:02:59.501322 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 819/1660] 10.222.0.84 () {58 vars in 957 bytes} [Wed May 25 15:02:59 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 15:02:59.520370 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bfd1909-4f25-47cb-ae1e-ec95b88413e5 None None] Authenticating user token {{(pid=101893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:02:59.554671 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bfd1909-4f25-47cb-ae1e-ec95b88413e5 None None] Validating token access rules against request {{(pid=101893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:02:59.582509 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8db05437-76c5-4aa6-ae7d-841b35cf52b5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2aeb182e6a5b43cfb0cc347ec847c848', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a000829c658c4a7cab67f7b6353ba3fa', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:02:59.585698 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db05437-76c5-4aa6-ae7d-841b35cf52b5 service nova] REQUEST_METHOD: `GET` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:02:59.590378 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db05437-76c5-4aa6-ae7d-841b35cf52b5 service nova] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:02:59.590735 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db05437-76c5-4aa6-ae7d-841b35cf52b5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:02:59.628567 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8db05437-76c5-4aa6-ae7d-841b35cf52b5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:02:59.633992 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8db05437-76c5-4aa6-ae7d-841b35cf52b5 service nova] RBAC: Authorization granted {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:02:59.677505 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 842/1661] 10.222.0.84 () {60 vars in 1365 bytes} [Wed May 25 15:02:59 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 158 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 15:03:00.511260 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e57c51-33b3-41c7-8357-baf99307cb5b None None] REQUEST_METHOD: `POST` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:03:00.512291 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e57c51-33b3-41c7-8357-baf99307cb5b None None] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:03:00.512711 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e57c51-33b3-41c7-8357-baf99307cb5b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:03:00.588737 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.auth.core [None req-86e57c51-33b3-41c7-8357-baf99307cb5b None None] MFA Rules not processed for user `43dce6e81a7c43819d2041bd6c2ad783`. Rule list: `[]` (Enabled: `True`). {{(pid=101892) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:03:00.591458 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.fernet_utils [None req-86e57c51-33b3-41c7-8357-baf99307cb5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=101892) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:03:00.785558 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 820/1662] 10.222.0.84 () {58 vars in 957 bytes} [Wed May 25 15:03:00 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 275 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 15:03:00.815131 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8db05437-76c5-4aa6-ae7d-841b35cf52b5 service nova] Authenticating user token {{(pid=101893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:03:00.846911 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8db05437-76c5-4aa6-ae7d-841b35cf52b5 service nova] Validating token access rules against request {{(pid=101893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:03:00.894311 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa4a568e-dcf8-4451-9ca8-efe8909dbd0a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2aeb182e6a5b43cfb0cc347ec847c848', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a000829c658c4a7cab67f7b6353ba3fa', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:03:00.895179 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4a568e-dcf8-4451-9ca8-efe8909dbd0a service nova] REQUEST_METHOD: `GET` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:03:00.896311 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4a568e-dcf8-4451-9ca8-efe8909dbd0a service nova] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:03:00.896769 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4a568e-dcf8-4451-9ca8-efe8909dbd0a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:03:01.139227 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa4a568e-dcf8-4451-9ca8-efe8909dbd0a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:03:01.139227 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa4a568e-dcf8-4451-9ca8-efe8909dbd0a service nova] RBAC: Authorization granted {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:03:01.139227 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 843/1663] 10.222.0.84 () {60 vars in 1365 bytes} [Wed May 25 15:03:00 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 125 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 15:03:01.245296 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1663825-bacd-4642-845d-2130057733a7 None None] REQUEST_METHOD: `GET` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:03:01.246147 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1663825-bacd-4642-845d-2130057733a7 None None] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:03:01.246633 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1663825-bacd-4642-845d-2130057733a7 None None] PATH_INFO: `/` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:03:01.252803 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 821/1664] 10.222.0.84 () {54 vars in 912 bytes} [Wed May 25 15:03:01 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 15:03:01.258213 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6013f226-94a9-444a-af3c-560b09d18589 None None] REQUEST_METHOD: `POST` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:03:01.258504 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6013f226-94a9-444a-af3c-560b09d18589 None None] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:03:01.259986 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6013f226-94a9-444a-af3c-560b09d18589 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:03:01.294916 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.auth.core [None req-6013f226-94a9-444a-af3c-560b09d18589 None None] MFA Rules not processed for user `9ce28b25b907473588ccb87dc4acc06a`. Rule list: `[]` (Enabled: `True`). {{(pid=101893) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:03:01.298912 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.fernet_utils [None req-6013f226-94a9-444a-af3c-560b09d18589 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=101893) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:03:01.325776 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 844/1665] 10.222.0.84 () {58 vars in 1009 bytes} [Wed May 25 15:03:01 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 68 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 15:03:01.340376 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1663825-bacd-4642-845d-2130057733a7 None None] Authenticating user token {{(pid=101892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:03:01.364857 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1663825-bacd-4642-845d-2130057733a7 None None] Validating token access rules against request {{(pid=101892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:03:01.370592 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34ecd7d3-bdc6-4a7f-b468-a13d752dc5cd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ce28b25b907473588ccb87dc4acc06a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a000829c658c4a7cab67f7b6353ba3fa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:03:01.371719 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ecd7d3-bdc6-4a7f-b468-a13d752dc5cd service neutron] REQUEST_METHOD: `GET` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:03:01.375390 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ecd7d3-bdc6-4a7f-b468-a13d752dc5cd service neutron] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:03:01.375960 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ecd7d3-bdc6-4a7f-b468-a13d752dc5cd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:03:01.387816 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34ecd7d3-bdc6-4a7f-b468-a13d752dc5cd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:03:01.390063 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34ecd7d3-bdc6-4a7f-b468-a13d752dc5cd service neutron] RBAC: Authorization granted {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:03:01.410420 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 822/1666] 10.222.0.84 () {60 vars in 1365 bytes} [Wed May 25 15:03:01 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 70 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 15:03:02.991579 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f4fb9a-29c0-48e9-a00d-017a2cc2e773 None None] REQUEST_METHOD: `POST` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:03:02.992149 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f4fb9a-29c0-48e9-a00d-017a2cc2e773 None None] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:03:02.992474 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f4fb9a-29c0-48e9-a00d-017a2cc2e773 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:03:03.079548 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.auth.core [None req-b7f4fb9a-29c0-48e9-a00d-017a2cc2e773 None None] MFA Rules not processed for user `9ce28b25b907473588ccb87dc4acc06a`. Rule list: `[]` (Enabled: `True`). {{(pid=101893) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:03:03.081314 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.fernet_utils [None req-b7f4fb9a-29c0-48e9-a00d-017a2cc2e773 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=101893) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:03:03.115908 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 845/1667] 10.222.0.96 () {58 vars in 1015 bytes} [Wed May 25 15:03:02 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 15:03:03.227548 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34ecd7d3-bdc6-4a7f-b468-a13d752dc5cd service neutron] Authenticating user token {{(pid=101892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:03:03.252464 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34ecd7d3-bdc6-4a7f-b468-a13d752dc5cd service neutron] Validating token access rules against request {{(pid=101892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:03:03.257883 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfd05342-7964-4e0f-aa52-e4cfe13a9523 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ce28b25b907473588ccb87dc4acc06a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a000829c658c4a7cab67f7b6353ba3fa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:03:03.258796 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd05342-7964-4e0f-aa52-e4cfe13a9523 service neutron] REQUEST_METHOD: `GET` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:03:03.259280 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd05342-7964-4e0f-aa52-e4cfe13a9523 service neutron] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:03:03.259784 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd05342-7964-4e0f-aa52-e4cfe13a9523 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:03:03.278034 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfd05342-7964-4e0f-aa52-e4cfe13a9523 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:03:03.286272 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfd05342-7964-4e0f-aa52-e4cfe13a9523 service neutron] RBAC: Authorization granted {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:03:03.300038 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 823/1668] 10.222.0.84 () {60 vars in 1365 bytes} [Wed May 25 15:03:03 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 74 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 15:03:04.453370 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f4fb9a-29c0-48e9-a00d-017a2cc2e773 None None] Authenticating user token {{(pid=101893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:03:04.483890 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-710637c0-98f5-41e9-8e7b-2e702b0a74a4 None None] REQUEST_METHOD: `POST` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:03:04.489777 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-710637c0-98f5-41e9-8e7b-2e702b0a74a4 None None] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:03:04.489777 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-710637c0-98f5-41e9-8e7b-2e702b0a74a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:03:04.511040 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG dbcounter [-] [101893] Writing DB stats keystone:SELECT=100 {{(pid=101893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:03:04.555417 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.auth.core [None req-710637c0-98f5-41e9-8e7b-2e702b0a74a4 None None] MFA Rules not processed for user `81783c1018864448aaf753c7c2da4c84`. Rule list: `[]` (Enabled: `True`). {{(pid=101892) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:03:04.568841 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.fernet_utils [None req-710637c0-98f5-41e9-8e7b-2e702b0a74a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=101892) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:03:04.598784 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 824/1669] 10.222.0.84 () {58 vars in 957 bytes} [Wed May 25 15:03:04 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 15:03:04.777321 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f4fb9a-29c0-48e9-a00d-017a2cc2e773 None None] Validating token access rules against request {{(pid=101893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:03:04.794755 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5856e3b8-f824-4ec5-a259-337a10a0fb21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cec56f74b2fa4826a506dc7b919465be', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:03:04.798864 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5856e3b8-f824-4ec5-a259-337a10a0fb21 admin admin] REQUEST_METHOD: `DELETE` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:03:04.803501 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5856e3b8-f824-4ec5-a259-337a10a0fb21 admin admin] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:03:04.803501 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5856e3b8-f824-4ec5-a259-337a10a0fb21 admin admin] PATH_INFO: `/v3/users/9e62022fc5874ac49784ccd152a3b161` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:03:04.805765 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5856e3b8-f824-4ec5-a259-337a10a0fb21 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9e62022fc5874ac49784ccd152a3b161)` {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:03:04.809298 dv-cinder-803823-9-smb devstack@keystone.service[101893]: WARNING py.warnings [None req-5856e3b8-f824-4ec5-a259-337a10a0fb21 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 25 15:03:04.809298 dv-cinder-803823-9-smb devstack@keystone.service[101893]: warnings.warn(msg) May 25 15:03:04.809298 dv-cinder-803823-9-smb devstack@keystone.service[101893]: May 25 15:03:04.830643 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5856e3b8-f824-4ec5-a259-337a10a0fb21 admin admin] RBAC: Authorization granted {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:03:05.154036 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.notifications [None req-5856e3b8-f824-4ec5-a259-337a10a0fb21 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9e62022fc5874ac49784ccd152a3b161'} {{(pid=101893) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:03:05.209688 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.notifications [None req-5856e3b8-f824-4ec5-a259-337a10a0fb21 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9e62022fc5874ac49784ccd152a3b161'} {{(pid=101893) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:03:05.268276 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.notifications [None req-5856e3b8-f824-4ec5-a259-337a10a0fb21 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9e62022fc5874ac49784ccd152a3b161'} {{(pid=101893) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:03:05.269749 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.notifications [None req-5856e3b8-f824-4ec5-a259-337a10a0fb21 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9e62022fc5874ac49784ccd152a3b161'} {{(pid=101893) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:03:05.270593 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.notifications [None req-5856e3b8-f824-4ec5-a259-337a10a0fb21 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9e62022fc5874ac49784ccd152a3b161'} {{(pid=101893) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:03:05.378133 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb6a10d-c0b9-4af9-8163-45093c0a7b6c None None] REQUEST_METHOD: `POST` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:03:05.378659 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb6a10d-c0b9-4af9-8163-45093c0a7b6c None None] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:03:05.379781 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb6a10d-c0b9-4af9-8163-45093c0a7b6c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:03:05.381876 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 846/1670] 10.222.0.84 () {58 vars in 1223 bytes} [Wed May 25 15:03:04 2022] DELETE /identity/v3/users/9e62022fc5874ac49784ccd152a3b161 => generated 0 bytes in 920 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 15:03:05.421511 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.auth.core [None req-5cb6a10d-c0b9-4af9-8163-45093c0a7b6c None None] MFA Rules not processed for user `05d87e87798e429aa1c10b24391f915e`. Rule list: `[]` (Enabled: `True`). {{(pid=101892) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:03:05.425462 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.fernet_utils [None req-5cb6a10d-c0b9-4af9-8163-45093c0a7b6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=101892) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:03:05.448955 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG dbcounter [-] [101892] Writing DB stats keystone:SELECT=100 {{(pid=101892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:03:05.643905 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 825/1671] 10.222.0.84 () {58 vars in 957 bytes} [Wed May 25 15:03:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 267 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 15:03:05.915435 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5856e3b8-f824-4ec5-a259-337a10a0fb21 admin admin] Authenticating user token {{(pid=101893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:03:05.917960 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.fernet_utils [None req-5856e3b8-f824-4ec5-a259-337a10a0fb21 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=101893) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:03:06.063005 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f0bd8a-af1e-4cad-b9c1-800d8afd55ab None None] REQUEST_METHOD: `POST` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:03:06.063485 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f0bd8a-af1e-4cad-b9c1-800d8afd55ab None None] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:03:06.064027 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f0bd8a-af1e-4cad-b9c1-800d8afd55ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:03:06.097987 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.auth.core [None req-12f0bd8a-af1e-4cad-b9c1-800d8afd55ab None None] MFA Rules not processed for user `4e9f463e2bfc4c86a07d530ac112b893`. Rule list: `[]` (Enabled: `True`). {{(pid=101892) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:03:06.099235 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.fernet_utils [None req-12f0bd8a-af1e-4cad-b9c1-800d8afd55ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=101892) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:03:06.104927 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5856e3b8-f824-4ec5-a259-337a10a0fb21 admin admin] Validating token access rules against request {{(pid=101893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:03:06.119818 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e13fbc57-963c-4de6-906c-d67e3669d19f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ce28b25b907473588ccb87dc4acc06a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a000829c658c4a7cab67f7b6353ba3fa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:03:06.122990 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13fbc57-963c-4de6-906c-d67e3669d19f service neutron] REQUEST_METHOD: `GET` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:03:06.125039 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13fbc57-963c-4de6-906c-d67e3669d19f service neutron] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:03:06.126039 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13fbc57-963c-4de6-906c-d67e3669d19f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:03:06.172655 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e13fbc57-963c-4de6-906c-d67e3669d19f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:03:06.174173 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e13fbc57-963c-4de6-906c-d67e3669d19f service neutron] RBAC: Authorization granted {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:03:06.235711 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 847/1672] 10.222.0.84 () {60 vars in 1365 bytes} [Wed May 25 15:03:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 320 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 15:03:06.327721 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 826/1673] 10.222.0.84 () {58 vars in 957 bytes} [Wed May 25 15:03:06 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 267 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 25 15:03:08.351527 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dcf47ad-2c6b-47f9-b80b-b40c178a33fd None None] REQUEST_METHOD: `POST` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:03:08.352690 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dcf47ad-2c6b-47f9-b80b-b40c178a33fd None None] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:03:08.353168 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dcf47ad-2c6b-47f9-b80b-b40c178a33fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:03:08.390105 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.auth.core [None req-9dcf47ad-2c6b-47f9-b80b-b40c178a33fd None None] MFA Rules not processed for user `43dce6e81a7c43819d2041bd6c2ad783`. Rule list: `[]` (Enabled: `True`). {{(pid=101893) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:03:08.398277 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.fernet_utils [None req-9dcf47ad-2c6b-47f9-b80b-b40c178a33fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=101893) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:03:08.509246 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG dbcounter [-] [101893] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=101893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:03:08.579151 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 848/1674] 10.222.0.84 () {58 vars in 957 bytes} [Wed May 25 15:03:08 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 228 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 15:03:08.659335 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12f0bd8a-af1e-4cad-b9c1-800d8afd55ab None None] Authenticating user token {{(pid=101892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:03:08.661857 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.fernet_utils [None req-12f0bd8a-af1e-4cad-b9c1-800d8afd55ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=101892) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:03:08.728304 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12f0bd8a-af1e-4cad-b9c1-800d8afd55ab None None] Validating token access rules against request {{(pid=101892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:03:08.734506 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c8bdef-5952-4be7-9bb2-d3f06ea0d382 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cec56f74b2fa4826a506dc7b919465be', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:03:08.746704 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c8bdef-5952-4be7-9bb2-d3f06ea0d382 admin admin] REQUEST_METHOD: `DELETE` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:03:08.747176 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c8bdef-5952-4be7-9bb2-d3f06ea0d382 admin admin] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:03:08.747545 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c8bdef-5952-4be7-9bb2-d3f06ea0d382 admin admin] PATH_INFO: `/v3/projects/8582875058ee4f21af85291718e6a7ed` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:03:08.753523 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0c8bdef-5952-4be7-9bb2-d3f06ea0d382 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8582875058ee4f21af85291718e6a7ed)` {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:03:08.755154 dv-cinder-803823-9-smb devstack@keystone.service[101892]: WARNING py.warnings [None req-e0c8bdef-5952-4be7-9bb2-d3f06ea0d382 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 25 15:03:08.755154 dv-cinder-803823-9-smb devstack@keystone.service[101892]: warnings.warn(msg) May 25 15:03:08.755154 dv-cinder-803823-9-smb devstack@keystone.service[101892]: May 25 15:03:08.756888 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0c8bdef-5952-4be7-9bb2-d3f06ea0d382 admin admin] RBAC: Authorization granted {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:03:08.982411 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.notifications [None req-e0c8bdef-5952-4be7-9bb2-d3f06ea0d382 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8582875058ee4f21af85291718e6a7ed', 'request_id': 'req-e0c8bdef-5952-4be7-9bb2-d3f06ea0d382'} {{(pid=101892) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:03:09.015580 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.notifications [None req-e0c8bdef-5952-4be7-9bb2-d3f06ea0d382 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8582875058ee4f21af85291718e6a7ed', 'request_id': 'req-e0c8bdef-5952-4be7-9bb2-d3f06ea0d382'} {{(pid=101892) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:03:09.037344 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.notifications [None req-e0c8bdef-5952-4be7-9bb2-d3f06ea0d382 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8582875058ee4f21af85291718e6a7ed', 'request_id': 'req-e0c8bdef-5952-4be7-9bb2-d3f06ea0d382'} {{(pid=101892) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:03:09.192808 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.notifications [None req-e0c8bdef-5952-4be7-9bb2-d3f06ea0d382 admin admin] The token cache is being invalidate because project 8582875058ee4f21af85291718e6a7ed was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=101892) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 25 15:03:09.193183 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.notifications [None req-e0c8bdef-5952-4be7-9bb2-d3f06ea0d382 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=101892) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:03:09.194231 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.notifications [None req-e0c8bdef-5952-4be7-9bb2-d3f06ea0d382 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=101892) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:03:09.198706 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 827/1675] 10.222.0.84 () {58 vars in 1232 bytes} [Wed May 25 15:03:08 2022] DELETE /identity/v3/projects/8582875058ee4f21af85291718e6a7ed => generated 0 bytes in 541 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 25 15:03:09.205221 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723b96aa-44c5-40e8-aba8-60634bf4fbf2 None None] REQUEST_METHOD: `POST` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:03:09.205597 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723b96aa-44c5-40e8-aba8-60634bf4fbf2 None None] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:03:09.206146 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723b96aa-44c5-40e8-aba8-60634bf4fbf2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:03:09.331279 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599529e8-beae-4c7c-bf89-60d9ea00babd None None] REQUEST_METHOD: `POST` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:03:09.331588 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599529e8-beae-4c7c-bf89-60d9ea00babd None None] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:03:09.331879 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599529e8-beae-4c7c-bf89-60d9ea00babd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:03:09.454807 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.auth.core [None req-599529e8-beae-4c7c-bf89-60d9ea00babd None None] MFA Rules not processed for user `7fa42494cb4549f295d23e08cf93d330`. Rule list: `[]` (Enabled: `True`). {{(pid=101892) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:03:09.462695 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.fernet_utils [None req-599529e8-beae-4c7c-bf89-60d9ea00babd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=101892) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:03:09.592388 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG dbcounter [-] [101892] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=101892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:03:09.727050 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 828/1676] 10.222.0.84 () {58 vars in 957 bytes} [Wed May 25 15:03:09 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 397 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 15:03:09.851764 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.auth.core [None req-723b96aa-44c5-40e8-aba8-60634bf4fbf2 None None] MFA Rules not processed for user `05d87e87798e429aa1c10b24391f915e`. Rule list: `[]` (Enabled: `True`). {{(pid=101893) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:03:09.854831 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.fernet_utils [None req-723b96aa-44c5-40e8-aba8-60634bf4fbf2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=101893) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:03:10.032456 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16ecb9b-3f37-4846-beea-49c3b3535ffd None None] REQUEST_METHOD: `GET` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:03:10.032895 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16ecb9b-3f37-4846-beea-49c3b3535ffd None None] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:03:10.033274 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16ecb9b-3f37-4846-beea-49c3b3535ffd None None] PATH_INFO: `/` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:03:10.034916 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 829/1677] 10.222.0.84 () {54 vars in 921 bytes} [Wed May 25 15:03:10 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 25 15:03:10.125084 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad02f6ce-080f-4bb6-a8a1-b471f23adaaa None None] REQUEST_METHOD: `POST` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:03:10.125539 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad02f6ce-080f-4bb6-a8a1-b471f23adaaa None None] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:03:10.125940 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad02f6ce-080f-4bb6-a8a1-b471f23adaaa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:03:10.157805 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 849/1678] 10.222.0.84 () {58 vars in 957 bytes} [Wed May 25 15:03:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 947 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 15:03:10.161377 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233af476-65cc-445b-83a4-aa9d014e58bb None None] REQUEST_METHOD: `POST` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:03:10.161795 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233af476-65cc-445b-83a4-aa9d014e58bb None None] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:03:10.162136 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233af476-65cc-445b-83a4-aa9d014e58bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:03:10.193659 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.auth.core [None req-ad02f6ce-080f-4bb6-a8a1-b471f23adaaa None None] MFA Rules not processed for user `2aeb182e6a5b43cfb0cc347ec847c848`. Rule list: `[]` (Enabled: `True`). {{(pid=101892) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:03:10.209908 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.fernet_utils [None req-ad02f6ce-080f-4bb6-a8a1-b471f23adaaa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=101892) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:03:10.279004 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.auth.core [None req-233af476-65cc-445b-83a4-aa9d014e58bb None None] MFA Rules not processed for user `05d87e87798e429aa1c10b24391f915e`. Rule list: `[]` (Enabled: `True`). {{(pid=101893) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:03:10.279004 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.fernet_utils [None req-233af476-65cc-445b-83a4-aa9d014e58bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=101893) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:03:10.342241 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 850/1679] 10.222.0.84 () {58 vars in 957 bytes} [Wed May 25 15:03:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 15:03:10.343611 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-233af476-65cc-445b-83a4-aa9d014e58bb None None] Authenticating user token {{(pid=101893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:03:10.381929 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-233af476-65cc-445b-83a4-aa9d014e58bb None None] Validating token access rules against request {{(pid=101893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:03:10.418543 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac374c83-ec4b-48b2-b00b-546cc9a0b3cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cec56f74b2fa4826a506dc7b919465be', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:03:10.419396 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac374c83-ec4b-48b2-b00b-546cc9a0b3cf admin admin] REQUEST_METHOD: `GET` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:03:10.421340 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac374c83-ec4b-48b2-b00b-546cc9a0b3cf admin admin] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:03:10.424812 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac374c83-ec4b-48b2-b00b-546cc9a0b3cf admin admin] PATH_INFO: `/v3/domains` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:03:10.426186 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac374c83-ec4b-48b2-b00b-546cc9a0b3cf admin admin] RBAC: Adding query filter params (name=Default) {{(pid=101893) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 15:03:10.428909 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac374c83-ec4b-48b2-b00b-546cc9a0b3cf admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:03:10.433150 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac374c83-ec4b-48b2-b00b-546cc9a0b3cf admin admin] RBAC: Authorization granted {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:03:10.458501 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 830/1680] 10.222.0.84 () {58 vars in 1018 bytes} [Wed May 25 15:03:10 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 335 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 15:03:10.487551 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 851/1681] 10.222.0.84 () {58 vars in 1152 bytes} [Wed May 25 15:03:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 15:03:10.516582 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad02f6ce-080f-4bb6-a8a1-b471f23adaaa None None] Authenticating user token {{(pid=101892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:03:10.561534 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad02f6ce-080f-4bb6-a8a1-b471f23adaaa None None] Validating token access rules against request {{(pid=101892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:03:10.585693 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43e70e7d-1016-4123-be25-3b9793826ea8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cec56f74b2fa4826a506dc7b919465be', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:03:10.595049 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e70e7d-1016-4123-be25-3b9793826ea8 admin admin] REQUEST_METHOD: `POST` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:03:10.595049 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e70e7d-1016-4123-be25-3b9793826ea8 admin admin] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:03:10.595049 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e70e7d-1016-4123-be25-3b9793826ea8 admin admin] PATH_INFO: `/v3/projects` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:03:10.595049 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43e70e7d-1016-4123-be25-3b9793826ea8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:03:10.597448 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43e70e7d-1016-4123-be25-3b9793826ea8 admin admin] RBAC: Authorization granted {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:03:10.780052 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 831/1682] 10.222.0.84 () {60 vars in 1152 bytes} [Wed May 25 15:03:10 2022] POST /identity/v3/projects => generated 399 bytes in 261 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 15:03:10.783098 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac374c83-ec4b-48b2-b00b-546cc9a0b3cf admin admin] Authenticating user token {{(pid=101893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:03:10.798983 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac374c83-ec4b-48b2-b00b-546cc9a0b3cf admin admin] Validating token access rules against request {{(pid=101893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:03:10.966773 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe7fb7f-aaf2-484e-af15-0f70400c4822 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cec56f74b2fa4826a506dc7b919465be', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:03:10.967845 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe7fb7f-aaf2-484e-af15-0f70400c4822 admin admin] REQUEST_METHOD: `POST` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:03:10.968200 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe7fb7f-aaf2-484e-af15-0f70400c4822 admin admin] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:03:10.968387 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe7fb7f-aaf2-484e-af15-0f70400c4822 admin admin] PATH_INFO: `/v3/users` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:03:10.969235 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afe7fb7f-aaf2-484e-af15-0f70400c4822 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:03:10.994799 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afe7fb7f-aaf2-484e-af15-0f70400c4822 admin admin] RBAC: Authorization granted {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:03:11.123812 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 852/1683] 10.222.0.84 () {60 vars in 1143 bytes} [Wed May 25 15:03:10 2022] POST /identity/v3/users => generated 300 bytes in 341 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 15:03:11.140714 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43e70e7d-1016-4123-be25-3b9793826ea8 admin admin] Authenticating user token {{(pid=101892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:03:11.174293 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43e70e7d-1016-4123-be25-3b9793826ea8 admin admin] Validating token access rules against request {{(pid=101892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:03:11.200549 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-442512f4-c07b-4b8b-ac6b-4c0fc6003f25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cec56f74b2fa4826a506dc7b919465be', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:03:11.201988 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-442512f4-c07b-4b8b-ac6b-4c0fc6003f25 admin admin] REQUEST_METHOD: `GET` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:03:11.203239 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-442512f4-c07b-4b8b-ac6b-4c0fc6003f25 admin admin] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:03:11.205479 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-442512f4-c07b-4b8b-ac6b-4c0fc6003f25 admin admin] PATH_INFO: `/v3/roles` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:03:11.209247 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-442512f4-c07b-4b8b-ac6b-4c0fc6003f25 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:03:11.217320 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-442512f4-c07b-4b8b-ac6b-4c0fc6003f25 admin admin] RBAC: Authorization granted {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:03:11.569646 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe7fb7f-aaf2-484e-af15-0f70400c4822 admin admin] Authenticating user token {{(pid=101893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:03:11.571877 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.fernet_utils [None req-afe7fb7f-aaf2-484e-af15-0f70400c4822 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=101893) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:03:11.783332 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG dbcounter [-] [101893] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=101893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:03:11.817302 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 832/1684] 10.222.0.84 () {58 vars in 1121 bytes} [Wed May 25 15:03:11 2022] GET /identity/v3/roles => generated 1420 bytes in 680 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 15:03:11.821153 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-442512f4-c07b-4b8b-ac6b-4c0fc6003f25 admin admin] Authenticating user token {{(pid=101892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:03:11.857963 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-442512f4-c07b-4b8b-ac6b-4c0fc6003f25 admin admin] Validating token access rules against request {{(pid=101892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:03:11.890187 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe7fb7f-aaf2-484e-af15-0f70400c4822 admin admin] Validating token access rules against request {{(pid=101893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:03:11.893431 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6444e9e6-f94e-45d6-9505-79797a3ebe76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cec56f74b2fa4826a506dc7b919465be', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:03:11.895116 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6444e9e6-f94e-45d6-9505-79797a3ebe76 admin admin] REQUEST_METHOD: `GET` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:03:11.910443 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6444e9e6-f94e-45d6-9505-79797a3ebe76 admin admin] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:03:11.911192 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6444e9e6-f94e-45d6-9505-79797a3ebe76 admin admin] PATH_INFO: `/v3/roles` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:03:11.913696 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6444e9e6-f94e-45d6-9505-79797a3ebe76 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:03:11.916528 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6444e9e6-f94e-45d6-9505-79797a3ebe76 admin admin] RBAC: Authorization granted {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:03:11.921138 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f6a48a-dcc3-4f21-87b3-5276e8630b64 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2aeb182e6a5b43cfb0cc347ec847c848', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a000829c658c4a7cab67f7b6353ba3fa', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:03:11.925120 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f6a48a-dcc3-4f21-87b3-5276e8630b64 service nova] REQUEST_METHOD: `GET` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:03:11.925553 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f6a48a-dcc3-4f21-87b3-5276e8630b64 service nova] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:03:11.927486 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f6a48a-dcc3-4f21-87b3-5276e8630b64 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:03:11.969191 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 833/1685] 10.222.0.84 () {58 vars in 1121 bytes} [Wed May 25 15:03:11 2022] GET /identity/v3/roles => generated 1420 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 15:03:11.980638 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6444e9e6-f94e-45d6-9505-79797a3ebe76 admin admin] Authenticating user token {{(pid=101892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:03:12.018966 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6444e9e6-f94e-45d6-9505-79797a3ebe76 admin admin] Validating token access rules against request {{(pid=101892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:03:12.037366 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b709f2cd-c619-4cd5-a783-cbbc8d8c95af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cec56f74b2fa4826a506dc7b919465be', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:03:12.040482 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b709f2cd-c619-4cd5-a783-cbbc8d8c95af admin admin] REQUEST_METHOD: `PUT` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:03:12.060513 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b709f2cd-c619-4cd5-a783-cbbc8d8c95af admin admin] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:03:12.067747 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b709f2cd-c619-4cd5-a783-cbbc8d8c95af admin admin] PATH_INFO: `/v3/projects/9662cc7737a04a36a8d4a4405a605ec5/users/4595422d8a074fdfaec629e847bde399/roles/ff664fa0db7e4262a5accde96c3df4c3` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:03:12.095929 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38f6a48a-dcc3-4f21-87b3-5276e8630b64 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:03:12.097983 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38f6a48a-dcc3-4f21-87b3-5276e8630b64 service nova] RBAC: Authorization granted {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:03:12.155348 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 853/1686] 10.222.0.84 () {60 vars in 1365 bytes} [Wed May 25 15:03:11 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 586 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 25 15:03:12.158147 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b709f2cd-c619-4cd5-a783-cbbc8d8c95af admin admin] RBAC: Authorizing `identity:create_grant(project_id=9662cc7737a04a36a8d4a4405a605ec5, user_id=4595422d8a074fdfaec629e847bde399, role_id=ff664fa0db7e4262a5accde96c3df4c3)` {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:03:12.165964 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b709f2cd-c619-4cd5-a783-cbbc8d8c95af admin admin] RBAC: Authorization granted {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:03:12.257164 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 834/1687] 10.222.0.84 () {60 vars in 1482 bytes} [Wed May 25 15:03:11 2022] PUT /identity/v3/projects/9662cc7737a04a36a8d4a4405a605ec5/users/4595422d8a074fdfaec629e847bde399/roles/ff664fa0db7e4262a5accde96c3df4c3 => generated 0 bytes in 278 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 15:03:12.268311 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ffaf14-cafb-41ad-8c4a-b9cce2ac7e92 None None] REQUEST_METHOD: `POST` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:03:12.268792 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ffaf14-cafb-41ad-8c4a-b9cce2ac7e92 None None] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:03:12.269180 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ffaf14-cafb-41ad-8c4a-b9cce2ac7e92 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:03:12.370878 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.auth.core [None req-a3ffaf14-cafb-41ad-8c4a-b9cce2ac7e92 None None] MFA Rules not processed for user `4595422d8a074fdfaec629e847bde399`. Rule list: `[]` (Enabled: `True`). {{(pid=101893) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:03:12.381351 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.fernet_utils [None req-a3ffaf14-cafb-41ad-8c4a-b9cce2ac7e92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=101893) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:03:12.734190 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 854/1688] 10.222.0.84 () {58 vars in 957 bytes} [Wed May 25 15:03:12 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 467 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 15:03:12.738467 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b709f2cd-c619-4cd5-a783-cbbc8d8c95af admin admin] Authenticating user token {{(pid=101892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:03:13.001799 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG dbcounter [-] [101892] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=101892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:03:13.038665 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b709f2cd-c619-4cd5-a783-cbbc8d8c95af admin admin] Validating token access rules against request {{(pid=101892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:03:13.060822 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa91cdb2-94fa-4ab6-b20c-a1bec8db58b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cec56f74b2fa4826a506dc7b919465be', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:03:13.064645 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa91cdb2-94fa-4ab6-b20c-a1bec8db58b1 admin admin] REQUEST_METHOD: `POST` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:03:13.068701 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa91cdb2-94fa-4ab6-b20c-a1bec8db58b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:03:13.068701 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa91cdb2-94fa-4ab6-b20c-a1bec8db58b1 admin admin] PATH_INFO: `/v3/projects` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:03:13.068701 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa91cdb2-94fa-4ab6-b20c-a1bec8db58b1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:03:13.075982 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa91cdb2-94fa-4ab6-b20c-a1bec8db58b1 admin admin] RBAC: Authorization granted {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:03:13.181539 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 835/1689] 10.222.0.84 () {60 vars in 1152 bytes} [Wed May 25 15:03:12 2022] POST /identity/v3/projects => generated 397 bytes in 444 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 15:03:13.185408 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3ffaf14-cafb-41ad-8c4a-b9cce2ac7e92 None None] Authenticating user token {{(pid=101893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:03:13.207754 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3ffaf14-cafb-41ad-8c4a-b9cce2ac7e92 None None] Validating token access rules against request {{(pid=101893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:03:13.466845 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa43cf8-56b4-488d-888a-7af1bfac9c9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cec56f74b2fa4826a506dc7b919465be', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:03:13.468472 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa43cf8-56b4-488d-888a-7af1bfac9c9c admin admin] REQUEST_METHOD: `POST` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:03:13.470932 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa43cf8-56b4-488d-888a-7af1bfac9c9c admin admin] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:03:13.472192 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa43cf8-56b4-488d-888a-7af1bfac9c9c admin admin] PATH_INFO: `/v3/users` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:03:13.474800 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aa43cf8-56b4-488d-888a-7af1bfac9c9c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:03:13.485706 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aa43cf8-56b4-488d-888a-7af1bfac9c9c admin admin] RBAC: Authorization granted {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:03:13.591949 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 855/1690] 10.222.0.84 () {60 vars in 1143 bytes} [Wed May 25 15:03:13 2022] POST /identity/v3/users => generated 305 bytes in 407 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 15:03:13.596132 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa91cdb2-94fa-4ab6-b20c-a1bec8db58b1 admin admin] Authenticating user token {{(pid=101892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:03:13.614705 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa91cdb2-94fa-4ab6-b20c-a1bec8db58b1 admin admin] Validating token access rules against request {{(pid=101892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:03:13.633251 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8cbfce6-80d2-4303-ad9e-e7cc615ca7bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cec56f74b2fa4826a506dc7b919465be', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:03:13.634002 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8cbfce6-80d2-4303-ad9e-e7cc615ca7bd admin admin] REQUEST_METHOD: `GET` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:03:13.634334 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8cbfce6-80d2-4303-ad9e-e7cc615ca7bd admin admin] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:03:13.634714 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8cbfce6-80d2-4303-ad9e-e7cc615ca7bd admin admin] PATH_INFO: `/v3/roles` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:03:13.635475 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8cbfce6-80d2-4303-ad9e-e7cc615ca7bd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:03:13.637295 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8cbfce6-80d2-4303-ad9e-e7cc615ca7bd admin admin] RBAC: Authorization granted {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:03:13.665852 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 836/1691] 10.222.0.84 () {58 vars in 1121 bytes} [Wed May 25 15:03:13 2022] GET /identity/v3/roles => generated 1420 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 15:03:13.669038 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa43cf8-56b4-488d-888a-7af1bfac9c9c admin admin] Authenticating user token {{(pid=101893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:03:13.692293 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa43cf8-56b4-488d-888a-7af1bfac9c9c admin admin] Validating token access rules against request {{(pid=101893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:03:13.725275 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f639148c-cc2c-45ed-9878-7dea1bafcc1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cec56f74b2fa4826a506dc7b919465be', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:03:13.729697 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f639148c-cc2c-45ed-9878-7dea1bafcc1d admin admin] REQUEST_METHOD: `PUT` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:03:13.730448 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f639148c-cc2c-45ed-9878-7dea1bafcc1d admin admin] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:03:13.731724 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f639148c-cc2c-45ed-9878-7dea1bafcc1d admin admin] PATH_INFO: `/v3/projects/1691cfc6835c464fbf3fb823c6e7b437/users/3dd027952ae543c2930c39099a5efa42/roles/a3b78e7d547d4d2d998b4c99a4396bba` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:03:13.740204 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG dbcounter [-] [101893] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=101893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:03:13.806989 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f639148c-cc2c-45ed-9878-7dea1bafcc1d admin admin] RBAC: Authorizing `identity:create_grant(project_id=1691cfc6835c464fbf3fb823c6e7b437, user_id=3dd027952ae543c2930c39099a5efa42, role_id=a3b78e7d547d4d2d998b4c99a4396bba)` {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:03:13.813118 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f639148c-cc2c-45ed-9878-7dea1bafcc1d admin admin] RBAC: Authorization granted {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:03:13.986327 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 856/1692] 10.222.0.84 () {60 vars in 1482 bytes} [Wed May 25 15:03:13 2022] PUT /identity/v3/projects/1691cfc6835c464fbf3fb823c6e7b437/users/3dd027952ae543c2930c39099a5efa42/roles/a3b78e7d547d4d2d998b4c99a4396bba => generated 0 bytes in 318 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 15:03:13.990920 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8cbfce6-80d2-4303-ad9e-e7cc615ca7bd admin admin] Authenticating user token {{(pid=101892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:03:14.004861 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8cbfce6-80d2-4303-ad9e-e7cc615ca7bd admin admin] Validating token access rules against request {{(pid=101892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:03:14.028752 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f639148c-cc2c-45ed-9878-7dea1bafcc1d admin admin] Authenticating user token {{(pid=101893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:03:14.161930 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42b15dfd-95d2-4ff6-8ae3-364faa423783 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cec56f74b2fa4826a506dc7b919465be', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:03:14.162157 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b15dfd-95d2-4ff6-8ae3-364faa423783 admin admin] REQUEST_METHOD: `GET` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:03:14.162421 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b15dfd-95d2-4ff6-8ae3-364faa423783 admin admin] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:03:14.163192 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b15dfd-95d2-4ff6-8ae3-364faa423783 admin admin] PATH_INFO: `/v3/roles` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:03:14.163435 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42b15dfd-95d2-4ff6-8ae3-364faa423783 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:03:14.169248 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42b15dfd-95d2-4ff6-8ae3-364faa423783 admin admin] RBAC: Authorization granted {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:03:14.197127 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 837/1693] 10.222.0.84 () {58 vars in 1121 bytes} [Wed May 25 15:03:13 2022] GET /identity/v3/roles => generated 1420 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 15:03:14.203121 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42b15dfd-95d2-4ff6-8ae3-364faa423783 admin admin] Authenticating user token {{(pid=101892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:03:14.230287 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f639148c-cc2c-45ed-9878-7dea1bafcc1d admin admin] Validating token access rules against request {{(pid=101893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:03:14.238864 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42b15dfd-95d2-4ff6-8ae3-364faa423783 admin admin] Validating token access rules against request {{(pid=101892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:03:14.253407 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26f740a0-0c27-418b-b802-a62dad135c3b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2aeb182e6a5b43cfb0cc347ec847c848', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a000829c658c4a7cab67f7b6353ba3fa', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:03:14.255474 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f740a0-0c27-418b-b802-a62dad135c3b service nova] REQUEST_METHOD: `GET` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:03:14.256561 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f740a0-0c27-418b-b802-a62dad135c3b service nova] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:03:14.256902 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f740a0-0c27-418b-b802-a62dad135c3b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:03:14.271991 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11194394-b1ba-41df-b76f-70c985c86792 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cec56f74b2fa4826a506dc7b919465be', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:03:14.271991 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11194394-b1ba-41df-b76f-70c985c86792 admin admin] REQUEST_METHOD: `PUT` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:03:14.271991 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11194394-b1ba-41df-b76f-70c985c86792 admin admin] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:03:14.272361 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11194394-b1ba-41df-b76f-70c985c86792 admin admin] PATH_INFO: `/v3/projects/1691cfc6835c464fbf3fb823c6e7b437/users/3dd027952ae543c2930c39099a5efa42/roles/a3b78e7d547d4d2d998b4c99a4396bba` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:03:14.272674 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11194394-b1ba-41df-b76f-70c985c86792 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1691cfc6835c464fbf3fb823c6e7b437, user_id=3dd027952ae543c2930c39099a5efa42, role_id=a3b78e7d547d4d2d998b4c99a4396bba)` {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:03:14.284049 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11194394-b1ba-41df-b76f-70c985c86792 admin admin] RBAC: Authorization granted {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:03:14.284257 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26f740a0-0c27-418b-b802-a62dad135c3b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:03:14.285780 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26f740a0-0c27-418b-b802-a62dad135c3b service nova] RBAC: Authorization granted {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:03:14.339157 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 838/1694] 10.222.0.84 () {60 vars in 1482 bytes} [Wed May 25 15:03:14 2022] PUT /identity/v3/projects/1691cfc6835c464fbf3fb823c6e7b437/users/3dd027952ae543c2930c39099a5efa42/roles/a3b78e7d547d4d2d998b4c99a4396bba => generated 0 bytes in 137 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 15:03:14.353456 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9941a4d0-3c3e-416c-9807-3b4b8a5240e9 None None] REQUEST_METHOD: `POST` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:03:14.353778 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9941a4d0-3c3e-416c-9807-3b4b8a5240e9 None None] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:03:14.354062 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9941a4d0-3c3e-416c-9807-3b4b8a5240e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:03:14.364414 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 857/1695] 10.222.0.84 () {60 vars in 1365 bytes} [Wed May 25 15:03:14 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 331 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 15:03:14.394496 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26f740a0-0c27-418b-b802-a62dad135c3b service nova] Authenticating user token {{(pid=101893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:03:14.402394 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.fernet_utils [None req-26f740a0-0c27-418b-b802-a62dad135c3b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=101893) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:03:14.437610 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26f740a0-0c27-418b-b802-a62dad135c3b service nova] Validating token access rules against request {{(pid=101893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:03:14.458692 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.auth.core [None req-9941a4d0-3c3e-416c-9807-3b4b8a5240e9 None None] MFA Rules not processed for user `3dd027952ae543c2930c39099a5efa42`. Rule list: `[]` (Enabled: `True`). {{(pid=101892) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:03:14.464319 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.fernet_utils [None req-9941a4d0-3c3e-416c-9807-3b4b8a5240e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=101892) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:03:14.714702 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e867401-2a2b-45e8-923f-fbccfc9e5590 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cec56f74b2fa4826a506dc7b919465be', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:03:14.716236 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e867401-2a2b-45e8-923f-fbccfc9e5590 admin admin] REQUEST_METHOD: `DELETE` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:03:14.716724 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e867401-2a2b-45e8-923f-fbccfc9e5590 admin admin] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:03:14.718509 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e867401-2a2b-45e8-923f-fbccfc9e5590 admin admin] PATH_INFO: `/v3/users/0a784aa3174d41e0908d21c798df2c9b` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:03:14.721937 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e867401-2a2b-45e8-923f-fbccfc9e5590 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0a784aa3174d41e0908d21c798df2c9b)` {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:03:14.728908 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e867401-2a2b-45e8-923f-fbccfc9e5590 admin admin] RBAC: Authorization granted {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:03:14.807677 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 839/1696] 10.222.0.84 () {58 vars in 957 bytes} [Wed May 25 15:03:14 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 457 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 15:03:14.827475 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9941a4d0-3c3e-416c-9807-3b4b8a5240e9 None None] Authenticating user token {{(pid=101892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:03:14.829553 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.fernet_utils [None req-9941a4d0-3c3e-416c-9807-3b4b8a5240e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=101892) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:03:15.023247 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG dbcounter [-] [101892] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=101892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:03:15.046425 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.notifications [None req-8e867401-2a2b-45e8-923f-fbccfc9e5590 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0a784aa3174d41e0908d21c798df2c9b'} {{(pid=101893) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:03:15.075407 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.notifications [None req-8e867401-2a2b-45e8-923f-fbccfc9e5590 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0a784aa3174d41e0908d21c798df2c9b'} {{(pid=101893) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:03:15.106387 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9941a4d0-3c3e-416c-9807-3b4b8a5240e9 None None] Validating token access rules against request {{(pid=101892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:03:15.110526 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18db4c27-a0c9-4e9a-a440-fd8a45bd1067 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e079f89a5e524ab6ad4183e4f690de07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a000829c658c4a7cab67f7b6353ba3fa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:03:15.111201 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18db4c27-a0c9-4e9a-a440-fd8a45bd1067 service cinder] REQUEST_METHOD: `GET` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:03:15.111482 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18db4c27-a0c9-4e9a-a440-fd8a45bd1067 service cinder] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:03:15.113036 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18db4c27-a0c9-4e9a-a440-fd8a45bd1067 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:03:15.116864 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG dbcounter [-] [101893] Writing DB stats keystone:SELECT=91,keystone:INSERT=1,keystone:DELETE=8 {{(pid=101893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:03:15.122514 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.notifications [None req-8e867401-2a2b-45e8-923f-fbccfc9e5590 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0a784aa3174d41e0908d21c798df2c9b'} {{(pid=101893) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:03:15.124869 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.notifications [None req-8e867401-2a2b-45e8-923f-fbccfc9e5590 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0a784aa3174d41e0908d21c798df2c9b'} {{(pid=101893) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:03:15.126184 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.notifications [None req-8e867401-2a2b-45e8-923f-fbccfc9e5590 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0a784aa3174d41e0908d21c798df2c9b'} {{(pid=101893) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:03:15.182172 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18db4c27-a0c9-4e9a-a440-fd8a45bd1067 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:03:15.192851 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18db4c27-a0c9-4e9a-a440-fd8a45bd1067 service cinder] RBAC: Authorization granted {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:03:15.230172 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 840/1697] 10.222.0.84 () {60 vars in 1365 bytes} [Wed May 25 15:03:14 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 404 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 15:03:15.241569 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 858/1698] 10.222.0.84 () {58 vars in 1223 bytes} [Wed May 25 15:03:14 2022] DELETE /identity/v3/users/0a784aa3174d41e0908d21c798df2c9b => generated 0 bytes in 847 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 25 15:03:15.246682 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1226a8de-ceb5-44c7-b415-eda591e87784 None None] REQUEST_METHOD: `POST` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:03:15.247089 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1226a8de-ceb5-44c7-b415-eda591e87784 None None] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:03:15.247634 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1226a8de-ceb5-44c7-b415-eda591e87784 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:03:15.280651 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.auth.core [None req-1226a8de-ceb5-44c7-b415-eda591e87784 None None] MFA Rules not processed for user `05d87e87798e429aa1c10b24391f915e`. Rule list: `[]` (Enabled: `True`). {{(pid=101892) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:03:15.282378 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.fernet_utils [None req-1226a8de-ceb5-44c7-b415-eda591e87784 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=101892) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:03:15.399605 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 841/1699] 10.222.0.84 () {58 vars in 957 bytes} [Wed May 25 15:03:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 15:03:15.499312 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e867401-2a2b-45e8-923f-fbccfc9e5590 admin admin] Authenticating user token {{(pid=101893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:03:15.501697 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.fernet_utils [None req-8e867401-2a2b-45e8-923f-fbccfc9e5590 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=101893) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:03:15.608819 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1226a8de-ceb5-44c7-b415-eda591e87784 None None] Authenticating user token {{(pid=101892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:03:15.610188 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.fernet_utils [None req-1226a8de-ceb5-44c7-b415-eda591e87784 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=101892) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:03:15.653537 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e867401-2a2b-45e8-923f-fbccfc9e5590 admin admin] Validating token access rules against request {{(pid=101893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:03:15.660676 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecbb8509-6034-452c-a376-fb058b5c86f7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ce28b25b907473588ccb87dc4acc06a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a000829c658c4a7cab67f7b6353ba3fa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:03:15.661968 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecbb8509-6034-452c-a376-fb058b5c86f7 service neutron] REQUEST_METHOD: `GET` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:03:15.662505 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecbb8509-6034-452c-a376-fb058b5c86f7 service neutron] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:03:15.662980 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecbb8509-6034-452c-a376-fb058b5c86f7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:03:15.675852 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecbb8509-6034-452c-a376-fb058b5c86f7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:03:15.684197 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecbb8509-6034-452c-a376-fb058b5c86f7 service neutron] RBAC: Authorization granted {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:03:15.727149 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 859/1700] 10.222.0.84 () {60 vars in 1365 bytes} [Wed May 25 15:03:15 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 225 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 15:03:15.875780 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1226a8de-ceb5-44c7-b415-eda591e87784 None None] Validating token access rules against request {{(pid=101892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:03:15.875780 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67f32fe7-cd1c-4b83-97af-a7e84b6dfef6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e079f89a5e524ab6ad4183e4f690de07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a000829c658c4a7cab67f7b6353ba3fa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:03:15.875780 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f32fe7-cd1c-4b83-97af-a7e84b6dfef6 service cinder] REQUEST_METHOD: `GET` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:03:15.875780 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f32fe7-cd1c-4b83-97af-a7e84b6dfef6 service cinder] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:03:15.876083 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f32fe7-cd1c-4b83-97af-a7e84b6dfef6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:03:15.876083 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.fernet_utils [None req-67f32fe7-cd1c-4b83-97af-a7e84b6dfef6 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=101892) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:03:16.095932 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67f32fe7-cd1c-4b83-97af-a7e84b6dfef6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:03:16.097476 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67f32fe7-cd1c-4b83-97af-a7e84b6dfef6 service cinder] RBAC: Authorization granted {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:03:16.141020 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 842/1701] 10.222.0.84 () {60 vars in 1365 bytes} [Wed May 25 15:03:15 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 532 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 15:03:17.325613 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecbb8509-6034-452c-a376-fb058b5c86f7 service neutron] Authenticating user token {{(pid=101893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:03:17.327445 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.fernet_utils [None req-ecbb8509-6034-452c-a376-fb058b5c86f7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=101893) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:03:17.361367 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecbb8509-6034-452c-a376-fb058b5c86f7 service neutron] Validating token access rules against request {{(pid=101893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:03:17.382540 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31b55406-d28a-4174-ab11-fa3c8c08ea96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cec56f74b2fa4826a506dc7b919465be', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:03:17.383633 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b55406-d28a-4174-ab11-fa3c8c08ea96 admin admin] REQUEST_METHOD: `DELETE` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:03:17.383983 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b55406-d28a-4174-ab11-fa3c8c08ea96 admin admin] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:03:17.384308 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b55406-d28a-4174-ab11-fa3c8c08ea96 admin admin] PATH_INFO: `/v3/users/68b047b9c7d243d3a5b5fefec6d79f35` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:03:17.385772 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31b55406-d28a-4174-ab11-fa3c8c08ea96 admin admin] RBAC: Authorizing `identity:delete_user(user_id=68b047b9c7d243d3a5b5fefec6d79f35)` {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:03:17.390811 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31b55406-d28a-4174-ab11-fa3c8c08ea96 admin admin] RBAC: Authorization granted {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:03:17.680085 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.notifications [None req-31b55406-d28a-4174-ab11-fa3c8c08ea96 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '68b047b9c7d243d3a5b5fefec6d79f35'} {{(pid=101893) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:03:17.692465 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.notifications [None req-31b55406-d28a-4174-ab11-fa3c8c08ea96 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '68b047b9c7d243d3a5b5fefec6d79f35'} {{(pid=101893) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:03:17.701937 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67f32fe7-cd1c-4b83-97af-a7e84b6dfef6 service cinder] Authenticating user token {{(pid=101892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:03:17.703400 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.fernet_utils [None req-67f32fe7-cd1c-4b83-97af-a7e84b6dfef6 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=101892) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:03:17.712492 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.notifications [None req-31b55406-d28a-4174-ab11-fa3c8c08ea96 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '68b047b9c7d243d3a5b5fefec6d79f35'} {{(pid=101893) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:03:17.713586 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.notifications [None req-31b55406-d28a-4174-ab11-fa3c8c08ea96 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '68b047b9c7d243d3a5b5fefec6d79f35'} {{(pid=101893) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:03:17.714364 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.notifications [None req-31b55406-d28a-4174-ab11-fa3c8c08ea96 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '68b047b9c7d243d3a5b5fefec6d79f35'} {{(pid=101893) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:03:17.730846 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67f32fe7-cd1c-4b83-97af-a7e84b6dfef6 service cinder] Validating token access rules against request {{(pid=101892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:03:17.738850 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b21878c4-8663-44d2-822a-cc561c17d58c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cec56f74b2fa4826a506dc7b919465be', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:03:17.739821 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21878c4-8663-44d2-822a-cc561c17d58c admin admin] REQUEST_METHOD: `DELETE` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:03:17.740416 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21878c4-8663-44d2-822a-cc561c17d58c admin admin] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:03:17.740839 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21878c4-8663-44d2-822a-cc561c17d58c admin admin] PATH_INFO: `/v3/projects/9526509cc549495496b925be926ab821` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:03:17.744009 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b21878c4-8663-44d2-822a-cc561c17d58c admin admin] RBAC: Authorizing `identity:delete_project(project_id=9526509cc549495496b925be926ab821)` {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:03:17.746155 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b21878c4-8663-44d2-822a-cc561c17d58c admin admin] RBAC: Authorization granted {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:03:17.822552 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 860/1702] 10.222.0.84 () {58 vars in 1223 bytes} [Wed May 25 15:03:17 2022] DELETE /identity/v3/users/68b047b9c7d243d3a5b5fefec6d79f35 => generated 0 bytes in 498 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 15:03:17.827816 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612cf3f2-f936-4951-970b-34dce83ef610 None None] REQUEST_METHOD: `POST` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:03:17.828300 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612cf3f2-f936-4951-970b-34dce83ef610 None None] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:03:17.828956 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612cf3f2-f936-4951-970b-34dce83ef610 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:03:17.882360 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.auth.core [None req-612cf3f2-f936-4951-970b-34dce83ef610 None None] MFA Rules not processed for user `05d87e87798e429aa1c10b24391f915e`. Rule list: `[]` (Enabled: `True`). {{(pid=101893) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:03:17.886738 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.fernet_utils [None req-612cf3f2-f936-4951-970b-34dce83ef610 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=101893) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:03:17.961248 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG dbcounter [-] [101892] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=101892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:03:18.002964 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.notifications [None req-b21878c4-8663-44d2-822a-cc561c17d58c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9526509cc549495496b925be926ab821', 'request_id': 'req-b21878c4-8663-44d2-822a-cc561c17d58c'} {{(pid=101892) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:03:18.031214 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.notifications [None req-b21878c4-8663-44d2-822a-cc561c17d58c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9526509cc549495496b925be926ab821', 'request_id': 'req-b21878c4-8663-44d2-822a-cc561c17d58c'} {{(pid=101892) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:03:18.058005 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.notifications [None req-b21878c4-8663-44d2-822a-cc561c17d58c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9526509cc549495496b925be926ab821', 'request_id': 'req-b21878c4-8663-44d2-822a-cc561c17d58c'} {{(pid=101892) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:03:18.067839 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 861/1703] 10.222.0.84 () {58 vars in 957 bytes} [Wed May 25 15:03:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 241 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 15:03:18.143226 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-612cf3f2-f936-4951-970b-34dce83ef610 None None] Authenticating user token {{(pid=101893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:03:18.145635 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.fernet_utils [None req-612cf3f2-f936-4951-970b-34dce83ef610 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=101893) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:03:18.153088 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG dbcounter [-] [101893] Writing DB stats keystone:DELETE=12,keystone:SELECT=86,keystone:INSERT=2 {{(pid=101893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:03:18.188415 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.notifications [None req-b21878c4-8663-44d2-822a-cc561c17d58c admin admin] The token cache is being invalidate because project 9526509cc549495496b925be926ab821 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=101892) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 25 15:03:18.189413 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.notifications [None req-b21878c4-8663-44d2-822a-cc561c17d58c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=101892) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:03:18.189553 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.notifications [None req-b21878c4-8663-44d2-822a-cc561c17d58c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=101892) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:03:18.191470 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 843/1704] 10.222.0.84 () {58 vars in 1232 bytes} [Wed May 25 15:03:17 2022] DELETE /identity/v3/projects/9526509cc549495496b925be926ab821 => generated 0 bytes in 491 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 25 15:03:18.197540 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b21878c4-8663-44d2-822a-cc561c17d58c admin admin] Authenticating user token {{(pid=101892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:03:18.200204 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.fernet_utils [None req-b21878c4-8663-44d2-822a-cc561c17d58c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=101892) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:03:18.295329 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-612cf3f2-f936-4951-970b-34dce83ef610 None None] Validating token access rules against request {{(pid=101893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:03:18.368776 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b21878c4-8663-44d2-822a-cc561c17d58c admin admin] Validating token access rules against request {{(pid=101892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:03:18.380558 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b668bc0a-6201-4dbb-b0b2-c172126c16eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cec56f74b2fa4826a506dc7b919465be', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:03:18.381262 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b668bc0a-6201-4dbb-b0b2-c172126c16eb admin admin] REQUEST_METHOD: `DELETE` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:03:18.381943 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b668bc0a-6201-4dbb-b0b2-c172126c16eb admin admin] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:03:18.381943 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b668bc0a-6201-4dbb-b0b2-c172126c16eb admin admin] PATH_INFO: `/v3/users/a60f87407ba3444b9703cb85c5f252bf` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:03:18.384053 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b668bc0a-6201-4dbb-b0b2-c172126c16eb admin admin] RBAC: Authorizing `identity:delete_user(user_id=a60f87407ba3444b9703cb85c5f252bf)` {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:03:18.386092 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b668bc0a-6201-4dbb-b0b2-c172126c16eb admin admin] RBAC: Authorization granted {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:03:18.413998 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8f9d2f8-cd75-4f09-8c45-bb6a5e075946 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ce28b25b907473588ccb87dc4acc06a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a000829c658c4a7cab67f7b6353ba3fa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:03:18.416083 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f9d2f8-cd75-4f09-8c45-bb6a5e075946 service neutron] REQUEST_METHOD: `GET` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:03:18.421508 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f9d2f8-cd75-4f09-8c45-bb6a5e075946 service neutron] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:03:18.421508 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f9d2f8-cd75-4f09-8c45-bb6a5e075946 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:03:18.421508 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.fernet_utils [None req-b8f9d2f8-cd75-4f09-8c45-bb6a5e075946 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=101893) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:03:18.467006 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8f9d2f8-cd75-4f09-8c45-bb6a5e075946 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:03:18.476721 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8f9d2f8-cd75-4f09-8c45-bb6a5e075946 service neutron] RBAC: Authorization granted {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:03:18.497801 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 862/1705] 10.222.0.84 () {60 vars in 1365 bytes} [Wed May 25 15:03:18 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 356 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 25 15:03:18.706488 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.notifications [None req-b668bc0a-6201-4dbb-b0b2-c172126c16eb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a60f87407ba3444b9703cb85c5f252bf'} {{(pid=101892) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:03:18.726008 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf986a4-0ffc-4329-a5bb-f0e1cf9d5711 None None] REQUEST_METHOD: `GET` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:03:18.726295 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf986a4-0ffc-4329-a5bb-f0e1cf9d5711 None None] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:03:18.726792 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf986a4-0ffc-4329-a5bb-f0e1cf9d5711 None None] PATH_INFO: `/` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:03:18.729310 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 863/1706] 10.222.0.84 () {54 vars in 921 bytes} [Wed May 25 15:03:18 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 15:03:18.732852 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.notifications [None req-b668bc0a-6201-4dbb-b0b2-c172126c16eb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a60f87407ba3444b9703cb85c5f252bf'} {{(pid=101892) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:03:18.764775 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.notifications [None req-b668bc0a-6201-4dbb-b0b2-c172126c16eb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a60f87407ba3444b9703cb85c5f252bf'} {{(pid=101892) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:03:18.765587 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.notifications [None req-b668bc0a-6201-4dbb-b0b2-c172126c16eb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a60f87407ba3444b9703cb85c5f252bf'} {{(pid=101892) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:03:18.771982 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-411390c6-de33-498b-b7a5-8b40f589e8ed None None] REQUEST_METHOD: `POST` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:03:18.772523 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-411390c6-de33-498b-b7a5-8b40f589e8ed None None] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:03:18.772933 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-411390c6-de33-498b-b7a5-8b40f589e8ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:03:18.818010 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.auth.core [None req-411390c6-de33-498b-b7a5-8b40f589e8ed None None] MFA Rules not processed for user `2aeb182e6a5b43cfb0cc347ec847c848`. Rule list: `[]` (Enabled: `True`). {{(pid=101893) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:03:18.819251 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.fernet_utils [None req-411390c6-de33-498b-b7a5-8b40f589e8ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=101893) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:03:18.862920 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.notifications [None req-b668bc0a-6201-4dbb-b0b2-c172126c16eb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a60f87407ba3444b9703cb85c5f252bf'} {{(pid=101892) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:03:18.873128 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 844/1707] 10.222.0.84 () {58 vars in 1223 bytes} [Wed May 25 15:03:18 2022] DELETE /identity/v3/users/a60f87407ba3444b9703cb85c5f252bf => generated 0 bytes in 677 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 15:03:19.001156 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 864/1708] 10.222.0.84 () {58 vars in 1018 bytes} [Wed May 25 15:03:18 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 230 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 15:03:19.483879 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b668bc0a-6201-4dbb-b0b2-c172126c16eb admin admin] Authenticating user token {{(pid=101892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:03:19.483879 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.fernet_utils [None req-b668bc0a-6201-4dbb-b0b2-c172126c16eb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=101892) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:03:19.624818 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b668bc0a-6201-4dbb-b0b2-c172126c16eb admin admin] Validating token access rules against request {{(pid=101892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:03:19.631818 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93661884-fb08-4ae9-821f-88277244a3b9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2aeb182e6a5b43cfb0cc347ec847c848', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a000829c658c4a7cab67f7b6353ba3fa', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:03:19.632906 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93661884-fb08-4ae9-821f-88277244a3b9 service nova] REQUEST_METHOD: `GET` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:03:19.633224 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93661884-fb08-4ae9-821f-88277244a3b9 service nova] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:03:19.634311 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93661884-fb08-4ae9-821f-88277244a3b9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:03:19.646103 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93661884-fb08-4ae9-821f-88277244a3b9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:03:19.652078 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93661884-fb08-4ae9-821f-88277244a3b9 service nova] RBAC: Authorization granted {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:03:19.674106 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG dbcounter [-] [101892] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=101892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:03:19.697438 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 845/1709] 10.222.0.84 () {60 vars in 1365 bytes} [Wed May 25 15:03:19 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 216 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 15:03:19.918809 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-411390c6-de33-498b-b7a5-8b40f589e8ed None None] Authenticating user token {{(pid=101893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:03:19.920610 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.fernet_utils [None req-411390c6-de33-498b-b7a5-8b40f589e8ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=101893) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:03:19.934295 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-411390c6-de33-498b-b7a5-8b40f589e8ed None None] Validating token access rules against request {{(pid=101893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:03:20.008308 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc90c1e0-f6b8-4d78-929d-383f3606d0e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cec56f74b2fa4826a506dc7b919465be', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:03:20.010128 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc90c1e0-f6b8-4d78-929d-383f3606d0e8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:03:20.010587 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc90c1e0-f6b8-4d78-929d-383f3606d0e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:03:20.011019 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc90c1e0-f6b8-4d78-929d-383f3606d0e8 admin admin] PATH_INFO: `/v3/projects/bdfbd2cbeee2412d938755b72e0e3299` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:03:20.013129 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc90c1e0-f6b8-4d78-929d-383f3606d0e8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bdfbd2cbeee2412d938755b72e0e3299)` {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:03:20.015190 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc90c1e0-f6b8-4d78-929d-383f3606d0e8 admin admin] RBAC: Authorization granted {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:03:20.062549 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93661884-fb08-4ae9-821f-88277244a3b9 service nova] Authenticating user token {{(pid=101892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:03:20.064629 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.fernet_utils [None req-93661884-fb08-4ae9-821f-88277244a3b9 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=101892) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:03:20.080488 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93661884-fb08-4ae9-821f-88277244a3b9 service nova] Validating token access rules against request {{(pid=101892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:03:20.085045 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f959b7-5ad4-4aa6-af3e-87018d3aa014 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cec56f74b2fa4826a506dc7b919465be', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:03:20.085911 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f959b7-5ad4-4aa6-af3e-87018d3aa014 admin admin] REQUEST_METHOD: `DELETE` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:03:20.086198 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f959b7-5ad4-4aa6-af3e-87018d3aa014 admin admin] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:03:20.086477 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f959b7-5ad4-4aa6-af3e-87018d3aa014 admin admin] PATH_INFO: `/v3/projects/d51c7a2aacdb43f0a3e0dd06b11ae05d` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:03:20.087822 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41f959b7-5ad4-4aa6-af3e-87018d3aa014 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d51c7a2aacdb43f0a3e0dd06b11ae05d)` {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:03:20.089724 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41f959b7-5ad4-4aa6-af3e-87018d3aa014 admin admin] RBAC: Authorization granted {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:03:20.232416 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.notifications [None req-cc90c1e0-f6b8-4d78-929d-383f3606d0e8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bdfbd2cbeee2412d938755b72e0e3299', 'request_id': 'req-cc90c1e0-f6b8-4d78-929d-383f3606d0e8'} {{(pid=101893) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:03:20.237476 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.notifications [None req-41f959b7-5ad4-4aa6-af3e-87018d3aa014 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd51c7a2aacdb43f0a3e0dd06b11ae05d', 'request_id': 'req-41f959b7-5ad4-4aa6-af3e-87018d3aa014'} {{(pid=101892) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:03:20.241427 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.notifications [None req-41f959b7-5ad4-4aa6-af3e-87018d3aa014 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd51c7a2aacdb43f0a3e0dd06b11ae05d', 'request_id': 'req-41f959b7-5ad4-4aa6-af3e-87018d3aa014'} {{(pid=101892) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:03:20.241926 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.notifications [None req-cc90c1e0-f6b8-4d78-929d-383f3606d0e8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bdfbd2cbeee2412d938755b72e0e3299', 'request_id': 'req-cc90c1e0-f6b8-4d78-929d-383f3606d0e8'} {{(pid=101893) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:03:20.246562 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.notifications [None req-41f959b7-5ad4-4aa6-af3e-87018d3aa014 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd51c7a2aacdb43f0a3e0dd06b11ae05d', 'request_id': 'req-41f959b7-5ad4-4aa6-af3e-87018d3aa014'} {{(pid=101892) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:03:20.248659 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.notifications [None req-cc90c1e0-f6b8-4d78-929d-383f3606d0e8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bdfbd2cbeee2412d938755b72e0e3299', 'request_id': 'req-cc90c1e0-f6b8-4d78-929d-383f3606d0e8'} {{(pid=101893) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:03:20.364202 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.notifications [None req-41f959b7-5ad4-4aa6-af3e-87018d3aa014 admin admin] The token cache is being invalidate because project d51c7a2aacdb43f0a3e0dd06b11ae05d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=101892) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 25 15:03:20.364506 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.notifications [None req-41f959b7-5ad4-4aa6-af3e-87018d3aa014 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=101892) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:03:20.365129 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.notifications [None req-41f959b7-5ad4-4aa6-af3e-87018d3aa014 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=101892) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:03:20.366753 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 846/1710] 10.222.0.84 () {58 vars in 1232 bytes} [Wed May 25 15:03:20 2022] DELETE /identity/v3/projects/d51c7a2aacdb43f0a3e0dd06b11ae05d => generated 0 bytes in 305 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 25 15:03:20.368042 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d22c44-c09c-4895-a644-474ed83a128d None None] REQUEST_METHOD: `POST` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:03:20.372216 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d22c44-c09c-4895-a644-474ed83a128d None None] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:03:20.372216 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d22c44-c09c-4895-a644-474ed83a128d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:03:20.388098 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.auth.core [None req-b3d22c44-c09c-4895-a644-474ed83a128d None None] MFA Rules not processed for user `7fa42494cb4549f295d23e08cf93d330`. Rule list: `[]` (Enabled: `True`). {{(pid=101892) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:03:20.392110 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.fernet_utils [None req-b3d22c44-c09c-4895-a644-474ed83a128d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=101892) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:03:20.416601 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.notifications [None req-cc90c1e0-f6b8-4d78-929d-383f3606d0e8 admin admin] The token cache is being invalidate because project bdfbd2cbeee2412d938755b72e0e3299 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=101893) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 25 15:03:20.417131 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.notifications [None req-cc90c1e0-f6b8-4d78-929d-383f3606d0e8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=101893) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:03:20.425284 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.notifications [None req-cc90c1e0-f6b8-4d78-929d-383f3606d0e8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=101893) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:03:20.425284 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 865/1711] 10.222.0.84 () {58 vars in 1232 bytes} [Wed May 25 15:03:19 2022] DELETE /identity/v3/projects/bdfbd2cbeee2412d938755b72e0e3299 => generated 0 bytes in 501 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 15:03:20.425284 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc90c1e0-f6b8-4d78-929d-383f3606d0e8 admin admin] Authenticating user token {{(pid=101893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:03:20.427597 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.fernet_utils [None req-cc90c1e0-f6b8-4d78-929d-383f3606d0e8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=101893) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:03:20.440955 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG dbcounter [-] [101893] Writing DB stats keystone:SELECT=100 {{(pid=101893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:03:20.455376 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 847/1712] 10.222.0.84 () {58 vars in 957 bytes} [Wed May 25 15:03:20 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 15:03:20.456757 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14e06fc-ff5d-4fd2-bf3f-e857c331653a None None] REQUEST_METHOD: `POST` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:03:20.457048 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14e06fc-ff5d-4fd2-bf3f-e857c331653a None None] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:03:20.457345 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14e06fc-ff5d-4fd2-bf3f-e857c331653a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:03:20.478077 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.auth.core [None req-a14e06fc-ff5d-4fd2-bf3f-e857c331653a None None] MFA Rules not processed for user `05d87e87798e429aa1c10b24391f915e`. Rule list: `[]` (Enabled: `True`). {{(pid=101892) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:03:20.479251 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.fernet_utils [None req-a14e06fc-ff5d-4fd2-bf3f-e857c331653a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=101892) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:03:20.514462 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc90c1e0-f6b8-4d78-929d-383f3606d0e8 admin admin] Validating token access rules against request {{(pid=101893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:03:20.561845 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 848/1713] 10.222.0.84 () {58 vars in 957 bytes} [Wed May 25 15:03:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 15:03:20.569417 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5ef3fb-cb37-4b59-abdb-1c0c1f127880 None None] REQUEST_METHOD: `POST` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:03:20.569825 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5ef3fb-cb37-4b59-abdb-1c0c1f127880 None None] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:03:20.570185 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5ef3fb-cb37-4b59-abdb-1c0c1f127880 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:03:20.588777 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c9e1ecf-ac2d-48f6-9b19-a03a1ca4437d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cec56f74b2fa4826a506dc7b919465be', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:03:20.589759 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c9e1ecf-ac2d-48f6-9b19-a03a1ca4437d admin admin] REQUEST_METHOD: `DELETE` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:03:20.590133 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c9e1ecf-ac2d-48f6-9b19-a03a1ca4437d admin admin] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:03:20.590478 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c9e1ecf-ac2d-48f6-9b19-a03a1ca4437d admin admin] PATH_INFO: `/v3/users/1d9dbd10b9a34540b8689b4a9afc10b7` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:03:20.591061 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.auth.core [None req-1c5ef3fb-cb37-4b59-abdb-1c0c1f127880 None None] MFA Rules not processed for user `05d87e87798e429aa1c10b24391f915e`. Rule list: `[]` (Enabled: `True`). {{(pid=101892) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:03:20.591814 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c9e1ecf-ac2d-48f6-9b19-a03a1ca4437d admin admin] RBAC: Authorizing `identity:delete_user(user_id=1d9dbd10b9a34540b8689b4a9afc10b7)` {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:03:20.592965 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.fernet_utils [None req-1c5ef3fb-cb37-4b59-abdb-1c0c1f127880 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=101892) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:03:20.594125 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c9e1ecf-ac2d-48f6-9b19-a03a1ca4437d admin admin] RBAC: Authorization granted {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:03:20.603253 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 849/1714] 10.222.0.84 () {58 vars in 957 bytes} [Wed May 25 15:03:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 15:03:20.606927 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c5ef3fb-cb37-4b59-abdb-1c0c1f127880 None None] Authenticating user token {{(pid=101892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:03:20.616716 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c5ef3fb-cb37-4b59-abdb-1c0c1f127880 None None] Validating token access rules against request {{(pid=101892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:03:20.622431 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da42983b-260b-4abb-a34b-332be9604767 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cec56f74b2fa4826a506dc7b919465be', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:03:20.623647 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da42983b-260b-4abb-a34b-332be9604767 admin admin] REQUEST_METHOD: `GET` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:03:20.624039 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da42983b-260b-4abb-a34b-332be9604767 admin admin] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:03:20.624636 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da42983b-260b-4abb-a34b-332be9604767 admin admin] PATH_INFO: `/v3/domains` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:03:20.625652 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da42983b-260b-4abb-a34b-332be9604767 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=101892) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 15:03:20.626050 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da42983b-260b-4abb-a34b-332be9604767 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:03:20.627900 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da42983b-260b-4abb-a34b-332be9604767 admin admin] RBAC: Authorization granted {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:03:20.642272 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 850/1715] 10.222.0.84 () {58 vars in 1152 bytes} [Wed May 25 15:03:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 15:03:20.646857 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da42983b-260b-4abb-a34b-332be9604767 admin admin] Authenticating user token {{(pid=101892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:03:20.657811 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da42983b-260b-4abb-a34b-332be9604767 admin admin] Validating token access rules against request {{(pid=101892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:03:20.662176 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae8202a-a299-4ab9-b7fa-f4944da646bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cec56f74b2fa4826a506dc7b919465be', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:03:20.662843 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae8202a-a299-4ab9-b7fa-f4944da646bc admin admin] REQUEST_METHOD: `POST` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:03:20.663125 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae8202a-a299-4ab9-b7fa-f4944da646bc admin admin] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:03:20.664481 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae8202a-a299-4ab9-b7fa-f4944da646bc admin admin] PATH_INFO: `/v3/projects` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:03:20.664481 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ae8202a-a299-4ab9-b7fa-f4944da646bc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:03:20.666193 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ae8202a-a299-4ab9-b7fa-f4944da646bc admin admin] RBAC: Authorization granted {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:03:20.757506 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 851/1716] 10.222.0.84 () {60 vars in 1152 bytes} [Wed May 25 15:03:20 2022] POST /identity/v3/projects => generated 385 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 25 15:03:20.761780 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae8202a-a299-4ab9-b7fa-f4944da646bc admin admin] Authenticating user token {{(pid=101892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:03:20.819933 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.notifications [None req-7c9e1ecf-ac2d-48f6-9b19-a03a1ca4437d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1d9dbd10b9a34540b8689b4a9afc10b7'} {{(pid=101893) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:03:20.828219 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.notifications [None req-7c9e1ecf-ac2d-48f6-9b19-a03a1ca4437d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1d9dbd10b9a34540b8689b4a9afc10b7'} {{(pid=101893) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:03:20.836246 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG dbcounter [-] [101893] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=101893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:03:20.843869 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.notifications [None req-7c9e1ecf-ac2d-48f6-9b19-a03a1ca4437d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1d9dbd10b9a34540b8689b4a9afc10b7'} {{(pid=101893) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:03:20.844968 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.notifications [None req-7c9e1ecf-ac2d-48f6-9b19-a03a1ca4437d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1d9dbd10b9a34540b8689b4a9afc10b7'} {{(pid=101893) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:03:20.845871 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.notifications [None req-7c9e1ecf-ac2d-48f6-9b19-a03a1ca4437d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1d9dbd10b9a34540b8689b4a9afc10b7'} {{(pid=101893) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:03:20.849852 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae8202a-a299-4ab9-b7fa-f4944da646bc admin admin] Validating token access rules against request {{(pid=101892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:03:20.854675 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b71a3e01-5bd3-4c85-b9b9-bc6e16214bb3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cec56f74b2fa4826a506dc7b919465be', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:03:20.855293 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71a3e01-5bd3-4c85-b9b9-bc6e16214bb3 admin admin] REQUEST_METHOD: `POST` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:03:20.855610 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71a3e01-5bd3-4c85-b9b9-bc6e16214bb3 admin admin] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:03:20.855894 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71a3e01-5bd3-4c85-b9b9-bc6e16214bb3 admin admin] PATH_INFO: `/v3/users` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:03:20.856587 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b71a3e01-5bd3-4c85-b9b9-bc6e16214bb3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:03:20.858675 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b71a3e01-5bd3-4c85-b9b9-bc6e16214bb3 admin admin] RBAC: Authorization granted {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:03:20.960422 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 866/1717] 10.222.0.84 () {58 vars in 1223 bytes} [Wed May 25 15:03:20 2022] DELETE /identity/v3/users/1d9dbd10b9a34540b8689b4a9afc10b7 => generated 0 bytes in 539 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 15:03:20.982012 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 852/1718] 10.222.0.84 () {60 vars in 1143 bytes} [Wed May 25 15:03:20 2022] POST /identity/v3/users => generated 293 bytes in 221 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 25 15:03:20.988024 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c9e1ecf-ac2d-48f6-9b19-a03a1ca4437d admin admin] Authenticating user token {{(pid=101893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:03:20.989996 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.fernet_utils [None req-7c9e1ecf-ac2d-48f6-9b19-a03a1ca4437d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=101893) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:03:21.073832 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c9e1ecf-ac2d-48f6-9b19-a03a1ca4437d admin admin] Validating token access rules against request {{(pid=101893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:03:21.079073 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3231827d-2066-488b-9bbd-f0ccd4514442 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cec56f74b2fa4826a506dc7b919465be', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:03:21.079863 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3231827d-2066-488b-9bbd-f0ccd4514442 admin admin] REQUEST_METHOD: `GET` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:03:21.080223 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3231827d-2066-488b-9bbd-f0ccd4514442 admin admin] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:03:21.080572 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3231827d-2066-488b-9bbd-f0ccd4514442 admin admin] PATH_INFO: `/v3/roles` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:03:21.081384 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3231827d-2066-488b-9bbd-f0ccd4514442 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:03:21.083067 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3231827d-2066-488b-9bbd-f0ccd4514442 admin admin] RBAC: Authorization granted {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:03:21.095251 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 867/1719] 10.222.0.84 () {58 vars in 1121 bytes} [Wed May 25 15:03:20 2022] GET /identity/v3/roles => generated 1420 bytes in 107 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 15:03:21.098897 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b71a3e01-5bd3-4c85-b9b9-bc6e16214bb3 admin admin] Authenticating user token {{(pid=101892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:03:21.109699 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b71a3e01-5bd3-4c85-b9b9-bc6e16214bb3 admin admin] Validating token access rules against request {{(pid=101892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:03:21.114481 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b29355f6-cf19-42d3-98c0-3eb1252caf29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cec56f74b2fa4826a506dc7b919465be', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:03:21.115151 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29355f6-cf19-42d3-98c0-3eb1252caf29 admin admin] REQUEST_METHOD: `GET` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:03:21.115434 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29355f6-cf19-42d3-98c0-3eb1252caf29 admin admin] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:03:21.115749 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29355f6-cf19-42d3-98c0-3eb1252caf29 admin admin] PATH_INFO: `/v3/roles` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:03:21.116477 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b29355f6-cf19-42d3-98c0-3eb1252caf29 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:03:21.118644 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b29355f6-cf19-42d3-98c0-3eb1252caf29 admin admin] RBAC: Authorization granted {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:03:21.129550 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 853/1720] 10.222.0.84 () {58 vars in 1121 bytes} [Wed May 25 15:03:21 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 15:03:21.134340 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3231827d-2066-488b-9bbd-f0ccd4514442 admin admin] Authenticating user token {{(pid=101893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:03:21.155052 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3231827d-2066-488b-9bbd-f0ccd4514442 admin admin] Validating token access rules against request {{(pid=101893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:03:21.161407 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e15cac9-f15e-4869-86db-22c34e85d1ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cec56f74b2fa4826a506dc7b919465be', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:03:21.165339 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e15cac9-f15e-4869-86db-22c34e85d1ba admin admin] REQUEST_METHOD: `PUT` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:03:21.165339 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e15cac9-f15e-4869-86db-22c34e85d1ba admin admin] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:03:21.165339 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e15cac9-f15e-4869-86db-22c34e85d1ba admin admin] PATH_INFO: `/v3/projects/0fa23f732488467f8b542e4ae6cd803e/users/86ddc2505ca14d8d973ca6e6311c0caa/roles/ff664fa0db7e4262a5accde96c3df4c3` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:03:21.182397 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e15cac9-f15e-4869-86db-22c34e85d1ba admin admin] RBAC: Authorizing `identity:create_grant(project_id=0fa23f732488467f8b542e4ae6cd803e, user_id=86ddc2505ca14d8d973ca6e6311c0caa, role_id=ff664fa0db7e4262a5accde96c3df4c3)` {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:03:21.184970 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e15cac9-f15e-4869-86db-22c34e85d1ba admin admin] RBAC: Authorization granted {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:03:21.256666 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG dbcounter [-] [101892] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=101892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:03:21.319729 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 868/1721] 10.222.0.84 () {60 vars in 1482 bytes} [Wed May 25 15:03:21 2022] PUT /identity/v3/projects/0fa23f732488467f8b542e4ae6cd803e/users/86ddc2505ca14d8d973ca6e6311c0caa/roles/ff664fa0db7e4262a5accde96c3df4c3 => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 25 15:03:21.330943 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae88360-4a51-4dc7-8f78-4dec8939a164 None None] REQUEST_METHOD: `POST` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:03:21.331238 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae88360-4a51-4dc7-8f78-4dec8939a164 None None] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:03:21.331549 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae88360-4a51-4dc7-8f78-4dec8939a164 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:03:21.380678 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.auth.core [None req-9ae88360-4a51-4dc7-8f78-4dec8939a164 None None] MFA Rules not processed for user `86ddc2505ca14d8d973ca6e6311c0caa`. Rule list: `[]` (Enabled: `True`). {{(pid=101892) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:03:21.380678 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.fernet_utils [None req-9ae88360-4a51-4dc7-8f78-4dec8939a164 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=101892) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:03:21.531354 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 854/1722] 10.222.0.84 () {58 vars in 957 bytes} [Wed May 25 15:03:21 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 25 15:03:21.544961 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e15cac9-f15e-4869-86db-22c34e85d1ba admin admin] Authenticating user token {{(pid=101893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:03:21.568742 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.fernet_utils [None req-1e15cac9-f15e-4869-86db-22c34e85d1ba admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=101893) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:03:21.710560 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e15cac9-f15e-4869-86db-22c34e85d1ba admin admin] Validating token access rules against request {{(pid=101893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:03:21.722299 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8252f30-ddbe-44e6-a8d9-cb718fe8187e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e079f89a5e524ab6ad4183e4f690de07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a000829c658c4a7cab67f7b6353ba3fa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:03:21.723056 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8252f30-ddbe-44e6-a8d9-cb718fe8187e service cinder] REQUEST_METHOD: `GET` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:03:21.723277 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8252f30-ddbe-44e6-a8d9-cb718fe8187e service cinder] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:03:21.723552 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8252f30-ddbe-44e6-a8d9-cb718fe8187e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:03:21.748730 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8252f30-ddbe-44e6-a8d9-cb718fe8187e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:03:21.750712 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8252f30-ddbe-44e6-a8d9-cb718fe8187e service cinder] RBAC: Authorization granted {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:03:21.769510 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 869/1723] 10.222.0.84 () {60 vars in 1365 bytes} [Wed May 25 15:03:21 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 225 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 15:03:21.794388 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ae88360-4a51-4dc7-8f78-4dec8939a164 None None] Authenticating user token {{(pid=101892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:03:21.885395 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ae88360-4a51-4dc7-8f78-4dec8939a164 None None] Validating token access rules against request {{(pid=101892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:03:21.890206 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-164ea8c3-2e77-4f7a-b812-84c6560001ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cec56f74b2fa4826a506dc7b919465be', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:03:21.947704 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-164ea8c3-2e77-4f7a-b812-84c6560001ab admin admin] REQUEST_METHOD: `DELETE` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:03:21.947704 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-164ea8c3-2e77-4f7a-b812-84c6560001ab admin admin] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:03:21.947704 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-164ea8c3-2e77-4f7a-b812-84c6560001ab admin admin] PATH_INFO: `/v3/users/86ddc2505ca14d8d973ca6e6311c0caa` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:03:21.947704 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-164ea8c3-2e77-4f7a-b812-84c6560001ab admin admin] RBAC: Authorizing `identity:delete_user(user_id=86ddc2505ca14d8d973ca6e6311c0caa)` {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:03:21.947704 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-164ea8c3-2e77-4f7a-b812-84c6560001ab admin admin] RBAC: Authorization granted {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:03:22.421720 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8252f30-ddbe-44e6-a8d9-cb718fe8187e service cinder] Authenticating user token {{(pid=101893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:03:22.423120 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.fernet_utils [None req-b8252f30-ddbe-44e6-a8d9-cb718fe8187e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=101893) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:03:22.452350 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8252f30-ddbe-44e6-a8d9-cb718fe8187e service cinder] Validating token access rules against request {{(pid=101893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:03:22.459930 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef482c3d-26b0-4416-9a8a-3d9ca93c3dba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cec56f74b2fa4826a506dc7b919465be', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:03:22.461342 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef482c3d-26b0-4416-9a8a-3d9ca93c3dba admin admin] REQUEST_METHOD: `DELETE` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:03:22.461654 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef482c3d-26b0-4416-9a8a-3d9ca93c3dba admin admin] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:03:22.461928 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef482c3d-26b0-4416-9a8a-3d9ca93c3dba admin admin] PATH_INFO: `/v3/projects/d8746fde70bc4086838d19cf39207766` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:03:22.463154 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef482c3d-26b0-4416-9a8a-3d9ca93c3dba admin admin] RBAC: Authorizing `identity:delete_project(project_id=d8746fde70bc4086838d19cf39207766)` {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:03:22.470320 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef482c3d-26b0-4416-9a8a-3d9ca93c3dba admin admin] RBAC: Authorization granted {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:03:22.616615 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.notifications [None req-164ea8c3-2e77-4f7a-b812-84c6560001ab admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '86ddc2505ca14d8d973ca6e6311c0caa'} {{(pid=101892) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:03:22.628595 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.notifications [None req-164ea8c3-2e77-4f7a-b812-84c6560001ab admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '86ddc2505ca14d8d973ca6e6311c0caa'} {{(pid=101892) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:03:22.678861 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.notifications [None req-ef482c3d-26b0-4416-9a8a-3d9ca93c3dba admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd8746fde70bc4086838d19cf39207766', 'request_id': 'req-ef482c3d-26b0-4416-9a8a-3d9ca93c3dba'} {{(pid=101893) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:03:22.682218 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.notifications [None req-164ea8c3-2e77-4f7a-b812-84c6560001ab admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '86ddc2505ca14d8d973ca6e6311c0caa'} {{(pid=101892) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:03:22.683310 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.notifications [None req-164ea8c3-2e77-4f7a-b812-84c6560001ab admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '86ddc2505ca14d8d973ca6e6311c0caa'} {{(pid=101892) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:03:22.692086 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.notifications [None req-ef482c3d-26b0-4416-9a8a-3d9ca93c3dba admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd8746fde70bc4086838d19cf39207766', 'request_id': 'req-ef482c3d-26b0-4416-9a8a-3d9ca93c3dba'} {{(pid=101893) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:03:22.704917 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.notifications [None req-ef482c3d-26b0-4416-9a8a-3d9ca93c3dba admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd8746fde70bc4086838d19cf39207766', 'request_id': 'req-ef482c3d-26b0-4416-9a8a-3d9ca93c3dba'} {{(pid=101893) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:03:22.765479 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.notifications [None req-164ea8c3-2e77-4f7a-b812-84c6560001ab admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '86ddc2505ca14d8d973ca6e6311c0caa'} {{(pid=101892) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:03:22.773506 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 855/1724] 10.222.0.84 () {58 vars in 1223 bytes} [Wed May 25 15:03:21 2022] DELETE /identity/v3/users/86ddc2505ca14d8d973ca6e6311c0caa => generated 0 bytes in 979 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 15:03:22.780345 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d263bf97-aa27-4201-a78a-2d6b2d3ecdd6 None None] REQUEST_METHOD: `POST` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:03:22.780899 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d263bf97-aa27-4201-a78a-2d6b2d3ecdd6 None None] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:03:22.781420 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d263bf97-aa27-4201-a78a-2d6b2d3ecdd6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:03:22.821487 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.auth.core [None req-d263bf97-aa27-4201-a78a-2d6b2d3ecdd6 None None] MFA Rules not processed for user `05d87e87798e429aa1c10b24391f915e`. Rule list: `[]` (Enabled: `True`). {{(pid=101892) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:03:22.827131 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.fernet_utils [None req-d263bf97-aa27-4201-a78a-2d6b2d3ecdd6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=101892) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:03:22.913272 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.notifications [None req-ef482c3d-26b0-4416-9a8a-3d9ca93c3dba admin admin] The token cache is being invalidate because project d8746fde70bc4086838d19cf39207766 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=101893) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 25 15:03:22.915505 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.notifications [None req-ef482c3d-26b0-4416-9a8a-3d9ca93c3dba admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=101893) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:03:22.932080 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.notifications [None req-ef482c3d-26b0-4416-9a8a-3d9ca93c3dba admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=101893) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:03:22.936320 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 870/1725] 10.222.0.84 () {58 vars in 1232 bytes} [Wed May 25 15:03:22 2022] DELETE /identity/v3/projects/d8746fde70bc4086838d19cf39207766 => generated 0 bytes in 515 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 15:03:22.949196 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e278d877-f7b1-4568-b608-759d1fba9874 None None] REQUEST_METHOD: `POST` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:03:22.953194 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e278d877-f7b1-4568-b608-759d1fba9874 None None] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:03:22.953194 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e278d877-f7b1-4568-b608-759d1fba9874 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:03:22.995053 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.auth.core [None req-e278d877-f7b1-4568-b608-759d1fba9874 None None] MFA Rules not processed for user `05d87e87798e429aa1c10b24391f915e`. Rule list: `[]` (Enabled: `True`). {{(pid=101893) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:03:22.996868 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.fernet_utils [None req-e278d877-f7b1-4568-b608-759d1fba9874 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=101893) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:03:23.018200 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 856/1726] 10.222.0.84 () {58 vars in 957 bytes} [Wed May 25 15:03:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 239 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 25 15:03:23.066903 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d263bf97-aa27-4201-a78a-2d6b2d3ecdd6 None None] Authenticating user token {{(pid=101892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:03:23.070130 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.fernet_utils [None req-d263bf97-aa27-4201-a78a-2d6b2d3ecdd6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=101892) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:03:23.179023 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 871/1727] 10.222.0.84 () {58 vars in 957 bytes} [Wed May 25 15:03:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 228 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 15:03:23.181748 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19313ae4-c56d-46be-ab08-5eed1172192d None None] REQUEST_METHOD: `POST` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:03:23.182151 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19313ae4-c56d-46be-ab08-5eed1172192d None None] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:03:23.182500 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19313ae4-c56d-46be-ab08-5eed1172192d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:03:23.205105 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d263bf97-aa27-4201-a78a-2d6b2d3ecdd6 None None] Validating token access rules against request {{(pid=101892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:03:23.214879 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42e6db8f-51ed-40dd-957d-688164ae0479 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ce28b25b907473588ccb87dc4acc06a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a000829c658c4a7cab67f7b6353ba3fa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:03:23.215745 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e6db8f-51ed-40dd-957d-688164ae0479 service neutron] REQUEST_METHOD: `GET` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:03:23.215970 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e6db8f-51ed-40dd-957d-688164ae0479 service neutron] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:03:23.216756 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e6db8f-51ed-40dd-957d-688164ae0479 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:03:23.227950 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.auth.core [None req-19313ae4-c56d-46be-ab08-5eed1172192d None None] MFA Rules not processed for user `05d87e87798e429aa1c10b24391f915e`. Rule list: `[]` (Enabled: `True`). {{(pid=101893) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:03:23.244689 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.fernet_utils [None req-19313ae4-c56d-46be-ab08-5eed1172192d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=101893) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:03:23.252988 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42e6db8f-51ed-40dd-957d-688164ae0479 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:03:23.254941 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42e6db8f-51ed-40dd-957d-688164ae0479 service neutron] RBAC: Authorization granted {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:03:23.271687 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 872/1728] 10.222.0.84 () {58 vars in 957 bytes} [Wed May 25 15:03:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 15:03:23.275452 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 857/1729] 10.222.0.84 () {60 vars in 1365 bytes} [Wed May 25 15:03:23 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 209 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 25 15:03:23.276672 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19313ae4-c56d-46be-ab08-5eed1172192d None None] Authenticating user token {{(pid=101893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:03:23.292880 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19313ae4-c56d-46be-ab08-5eed1172192d None None] Validating token access rules against request {{(pid=101893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:03:23.312512 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80f85601-0345-4c4e-8930-3494fb150594 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cec56f74b2fa4826a506dc7b919465be', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:03:23.319714 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f85601-0345-4c4e-8930-3494fb150594 admin admin] REQUEST_METHOD: `GET` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:03:23.319714 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f85601-0345-4c4e-8930-3494fb150594 admin admin] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:03:23.319714 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f85601-0345-4c4e-8930-3494fb150594 admin admin] PATH_INFO: `/v3/domains` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:03:23.319714 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80f85601-0345-4c4e-8930-3494fb150594 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=101893) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 15:03:23.319714 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80f85601-0345-4c4e-8930-3494fb150594 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:03:23.319714 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80f85601-0345-4c4e-8930-3494fb150594 admin admin] RBAC: Authorization granted {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:03:23.347995 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 873/1730] 10.222.0.84 () {58 vars in 1152 bytes} [Wed May 25 15:03:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 15:03:23.354083 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42e6db8f-51ed-40dd-957d-688164ae0479 service neutron] Authenticating user token {{(pid=101892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:03:23.376048 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42e6db8f-51ed-40dd-957d-688164ae0479 service neutron] Validating token access rules against request {{(pid=101892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:03:23.392419 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-663ed249-c048-4ca4-b9d7-5c0b0fd4259b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cec56f74b2fa4826a506dc7b919465be', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:03:23.396130 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663ed249-c048-4ca4-b9d7-5c0b0fd4259b admin admin] REQUEST_METHOD: `POST` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:03:23.396397 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663ed249-c048-4ca4-b9d7-5c0b0fd4259b admin admin] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:03:23.396689 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663ed249-c048-4ca4-b9d7-5c0b0fd4259b admin admin] PATH_INFO: `/v3/projects` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:03:23.397540 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-663ed249-c048-4ca4-b9d7-5c0b0fd4259b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:03:23.401981 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-663ed249-c048-4ca4-b9d7-5c0b0fd4259b admin admin] RBAC: Authorization granted {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:03:23.576799 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 858/1731] 10.222.0.84 () {60 vars in 1152 bytes} [Wed May 25 15:03:23 2022] POST /identity/v3/projects => generated 369 bytes in 223 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 15:03:23.581112 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80f85601-0345-4c4e-8930-3494fb150594 admin admin] Authenticating user token {{(pid=101893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:03:23.597406 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80f85601-0345-4c4e-8930-3494fb150594 admin admin] Validating token access rules against request {{(pid=101893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:03:23.702991 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e78cc2-06f1-4601-b9ea-8d38ae03e7ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cec56f74b2fa4826a506dc7b919465be', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:03:23.704214 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e78cc2-06f1-4601-b9ea-8d38ae03e7ba admin admin] REQUEST_METHOD: `POST` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:03:23.704707 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e78cc2-06f1-4601-b9ea-8d38ae03e7ba admin admin] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:03:23.705187 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e78cc2-06f1-4601-b9ea-8d38ae03e7ba admin admin] PATH_INFO: `/v3/users` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:03:23.706661 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9e78cc2-06f1-4601-b9ea-8d38ae03e7ba admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:03:23.709172 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9e78cc2-06f1-4601-b9ea-8d38ae03e7ba admin admin] RBAC: Authorization granted {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:03:23.852510 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 874/1732] 10.222.0.84 () {60 vars in 1143 bytes} [Wed May 25 15:03:23 2022] POST /identity/v3/users => generated 285 bytes in 272 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 15:03:23.855906 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-663ed249-c048-4ca4-b9d7-5c0b0fd4259b admin admin] Authenticating user token {{(pid=101892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:03:23.867335 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-663ed249-c048-4ca4-b9d7-5c0b0fd4259b admin admin] Validating token access rules against request {{(pid=101892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:03:23.873377 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c1200c5-d785-4cf3-b589-c2549cd171d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cec56f74b2fa4826a506dc7b919465be', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:03:23.874333 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c1200c5-d785-4cf3-b589-c2549cd171d6 admin admin] REQUEST_METHOD: `GET` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:03:23.874823 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c1200c5-d785-4cf3-b589-c2549cd171d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:03:23.875321 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c1200c5-d785-4cf3-b589-c2549cd171d6 admin admin] PATH_INFO: `/v3/roles` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:03:23.876299 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c1200c5-d785-4cf3-b589-c2549cd171d6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:03:23.882315 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c1200c5-d785-4cf3-b589-c2549cd171d6 admin admin] RBAC: Authorization granted {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:03:23.892193 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 859/1733] 10.222.0.84 () {58 vars in 1121 bytes} [Wed May 25 15:03:23 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 25 15:03:23.895872 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e78cc2-06f1-4601-b9ea-8d38ae03e7ba admin admin] Authenticating user token {{(pid=101893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:03:23.910793 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e78cc2-06f1-4601-b9ea-8d38ae03e7ba admin admin] Validating token access rules against request {{(pid=101893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:03:23.921812 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d65fd180-ae06-4681-9594-34509ec18bf8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cec56f74b2fa4826a506dc7b919465be', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:03:23.925317 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65fd180-ae06-4681-9594-34509ec18bf8 admin admin] REQUEST_METHOD: `GET` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:03:23.925709 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65fd180-ae06-4681-9594-34509ec18bf8 admin admin] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:03:23.934040 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65fd180-ae06-4681-9594-34509ec18bf8 admin admin] PATH_INFO: `/v3/roles` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:03:23.934040 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d65fd180-ae06-4681-9594-34509ec18bf8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:03:23.934040 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d65fd180-ae06-4681-9594-34509ec18bf8 admin admin] RBAC: Authorization granted {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:03:23.950524 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 875/1734] 10.222.0.84 () {58 vars in 1121 bytes} [Wed May 25 15:03:23 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 25 15:03:23.954781 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c1200c5-d785-4cf3-b589-c2549cd171d6 admin admin] Authenticating user token {{(pid=101892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:03:23.968467 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c1200c5-d785-4cf3-b589-c2549cd171d6 admin admin] Validating token access rules against request {{(pid=101892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:03:23.974660 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f2dc07a-9a43-4a9a-9f7d-f47957e6face admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cec56f74b2fa4826a506dc7b919465be', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:03:23.975618 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2dc07a-9a43-4a9a-9f7d-f47957e6face admin admin] REQUEST_METHOD: `PUT` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:03:23.975913 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2dc07a-9a43-4a9a-9f7d-f47957e6face admin admin] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:03:23.976195 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2dc07a-9a43-4a9a-9f7d-f47957e6face admin admin] PATH_INFO: `/v3/projects/e9b9fbca9a1e4f6cbe234aaf2de33c1f/users/c1992d39a74d4049ad91967de0d135fc/roles/ff664fa0db7e4262a5accde96c3df4c3` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:03:24.001665 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f2dc07a-9a43-4a9a-9f7d-f47957e6face admin admin] RBAC: Authorizing `identity:create_grant(project_id=e9b9fbca9a1e4f6cbe234aaf2de33c1f, user_id=c1992d39a74d4049ad91967de0d135fc, role_id=ff664fa0db7e4262a5accde96c3df4c3)` {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:03:24.004693 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f2dc07a-9a43-4a9a-9f7d-f47957e6face admin admin] RBAC: Authorization granted {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:03:24.171474 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG dbcounter [-] [101893] Writing DB stats keystone:SELECT=93,keystone:DELETE=5,keystone:INSERT=2 {{(pid=101893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:03:24.186983 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219749f1-6529-43ab-92fd-7134ecaca1d4 None None] REQUEST_METHOD: `POST` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:03:24.187542 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219749f1-6529-43ab-92fd-7134ecaca1d4 None None] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:03:24.187929 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219749f1-6529-43ab-92fd-7134ecaca1d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:03:24.189917 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 860/1735] 10.222.0.84 () {60 vars in 1482 bytes} [Wed May 25 15:03:23 2022] PUT /identity/v3/projects/e9b9fbca9a1e4f6cbe234aaf2de33c1f/users/c1992d39a74d4049ad91967de0d135fc/roles/ff664fa0db7e4262a5accde96c3df4c3 => generated 0 bytes in 218 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 15:03:24.276173 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.auth.core [None req-219749f1-6529-43ab-92fd-7134ecaca1d4 None None] MFA Rules not processed for user `c1992d39a74d4049ad91967de0d135fc`. Rule list: `[]` (Enabled: `True`). {{(pid=101893) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:03:24.277422 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.fernet_utils [None req-219749f1-6529-43ab-92fd-7134ecaca1d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=101893) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:03:24.346861 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f2dc07a-9a43-4a9a-9f7d-f47957e6face admin admin] Authenticating user token {{(pid=101892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:03:24.350619 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.fernet_utils [None req-0f2dc07a-9a43-4a9a-9f7d-f47957e6face admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=101892) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:03:24.421138 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 876/1736] 10.222.0.84 () {58 vars in 957 bytes} [Wed May 25 15:03:24 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 232 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 15:03:24.422796 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-219749f1-6529-43ab-92fd-7134ecaca1d4 None None] Authenticating user token {{(pid=101893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:03:24.481022 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f2dc07a-9a43-4a9a-9f7d-f47957e6face admin admin] Validating token access rules against request {{(pid=101892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:03:24.486270 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a641a7d-7e0a-4a1f-bcf7-59e418cd6ffe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cec56f74b2fa4826a506dc7b919465be', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:03:24.487359 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a641a7d-7e0a-4a1f-bcf7-59e418cd6ffe admin admin] REQUEST_METHOD: `DELETE` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:03:24.487854 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a641a7d-7e0a-4a1f-bcf7-59e418cd6ffe admin admin] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:03:24.488369 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a641a7d-7e0a-4a1f-bcf7-59e418cd6ffe admin admin] PATH_INFO: `/v3/users/4595422d8a074fdfaec629e847bde399` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:03:24.489848 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a641a7d-7e0a-4a1f-bcf7-59e418cd6ffe admin admin] RBAC: Authorizing `identity:delete_user(user_id=4595422d8a074fdfaec629e847bde399)` {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:03:24.492132 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a641a7d-7e0a-4a1f-bcf7-59e418cd6ffe admin admin] RBAC: Authorization granted {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:03:24.526209 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG dbcounter [-] [101892] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=101892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:03:24.577138 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-219749f1-6529-43ab-92fd-7134ecaca1d4 None None] Validating token access rules against request {{(pid=101893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:03:24.581470 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd3b27a5-9452-4cbb-970c-957463175996 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cec56f74b2fa4826a506dc7b919465be', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:03:24.583023 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3b27a5-9452-4cbb-970c-957463175996 admin admin] REQUEST_METHOD: `POST` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:03:24.583312 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3b27a5-9452-4cbb-970c-957463175996 admin admin] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:03:24.583688 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3b27a5-9452-4cbb-970c-957463175996 admin admin] PATH_INFO: `/v3/projects` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:03:24.584795 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd3b27a5-9452-4cbb-970c-957463175996 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:03:24.587431 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd3b27a5-9452-4cbb-970c-957463175996 admin admin] RBAC: Authorization granted {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:03:24.666541 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.notifications [None req-4a641a7d-7e0a-4a1f-bcf7-59e418cd6ffe admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4595422d8a074fdfaec629e847bde399'} {{(pid=101892) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:03:24.680054 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.notifications [None req-4a641a7d-7e0a-4a1f-bcf7-59e418cd6ffe admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4595422d8a074fdfaec629e847bde399'} {{(pid=101892) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:03:24.687592 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 877/1737] 10.222.0.84 () {60 vars in 1152 bytes} [Wed May 25 15:03:24 2022] POST /identity/v3/projects => generated 369 bytes in 266 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 25 15:03:24.692893 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd3b27a5-9452-4cbb-970c-957463175996 admin admin] Authenticating user token {{(pid=101893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:03:24.705872 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.notifications [None req-4a641a7d-7e0a-4a1f-bcf7-59e418cd6ffe admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4595422d8a074fdfaec629e847bde399'} {{(pid=101892) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:03:24.706981 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.notifications [None req-4a641a7d-7e0a-4a1f-bcf7-59e418cd6ffe admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4595422d8a074fdfaec629e847bde399'} {{(pid=101892) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:03:24.773333 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd3b27a5-9452-4cbb-970c-957463175996 admin admin] Validating token access rules against request {{(pid=101893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:03:24.779270 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db527e5b-f781-4410-b028-072f341dd5ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cec56f74b2fa4826a506dc7b919465be', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:03:24.780215 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db527e5b-f781-4410-b028-072f341dd5ab admin admin] REQUEST_METHOD: `POST` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:03:24.780823 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db527e5b-f781-4410-b028-072f341dd5ab admin admin] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:03:24.781030 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db527e5b-f781-4410-b028-072f341dd5ab admin admin] PATH_INFO: `/v3/users` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:03:24.781747 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db527e5b-f781-4410-b028-072f341dd5ab admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:03:24.783204 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.notifications [None req-4a641a7d-7e0a-4a1f-bcf7-59e418cd6ffe admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4595422d8a074fdfaec629e847bde399'} {{(pid=101892) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:03:24.783896 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db527e5b-f781-4410-b028-072f341dd5ab admin admin] RBAC: Authorization granted {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:03:24.797239 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 861/1738] 10.222.0.84 () {58 vars in 1223 bytes} [Wed May 25 15:03:24 2022] DELETE /identity/v3/users/4595422d8a074fdfaec629e847bde399 => generated 0 bytes in 451 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 15:03:24.802270 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c87cf10-b66d-48d8-a026-4b7981bed7f9 None None] REQUEST_METHOD: `POST` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:03:24.802563 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c87cf10-b66d-48d8-a026-4b7981bed7f9 None None] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:03:24.802844 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c87cf10-b66d-48d8-a026-4b7981bed7f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:03:24.824501 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.auth.core [None req-3c87cf10-b66d-48d8-a026-4b7981bed7f9 None None] MFA Rules not processed for user `05d87e87798e429aa1c10b24391f915e`. Rule list: `[]` (Enabled: `True`). {{(pid=101892) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:03:24.825745 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.fernet_utils [None req-3c87cf10-b66d-48d8-a026-4b7981bed7f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=101892) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:03:24.884568 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 878/1739] 10.222.0.84 () {60 vars in 1143 bytes} [Wed May 25 15:03:24 2022] POST /identity/v3/users => generated 291 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 15:03:24.885941 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db527e5b-f781-4410-b028-072f341dd5ab admin admin] Authenticating user token {{(pid=101893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:03:24.887726 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.fernet_utils [None req-db527e5b-f781-4410-b028-072f341dd5ab admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=101893) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:03:24.893595 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 862/1740] 10.222.0.84 () {58 vars in 957 bytes} [Wed May 25 15:03:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 15:03:24.901511 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c87cf10-b66d-48d8-a026-4b7981bed7f9 None None] Authenticating user token {{(pid=101892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:03:24.903314 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.fernet_utils [None req-3c87cf10-b66d-48d8-a026-4b7981bed7f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=101892) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:03:24.907887 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db527e5b-f781-4410-b028-072f341dd5ab admin admin] Validating token access rules against request {{(pid=101893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:03:24.915333 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dce7dd4-4365-4f4b-ab9d-c89fdab7a3ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cec56f74b2fa4826a506dc7b919465be', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:03:24.916656 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dce7dd4-4365-4f4b-ab9d-c89fdab7a3ec admin admin] REQUEST_METHOD: `GET` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:03:24.916656 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dce7dd4-4365-4f4b-ab9d-c89fdab7a3ec admin admin] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:03:24.916993 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dce7dd4-4365-4f4b-ab9d-c89fdab7a3ec admin admin] PATH_INFO: `/v3/roles` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:03:24.917819 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dce7dd4-4365-4f4b-ab9d-c89fdab7a3ec admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:03:24.919906 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dce7dd4-4365-4f4b-ab9d-c89fdab7a3ec admin admin] RBAC: Authorization granted {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:03:24.944667 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 879/1741] 10.222.0.84 () {58 vars in 1121 bytes} [Wed May 25 15:03:24 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 25 15:03:24.947451 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dce7dd4-4365-4f4b-ab9d-c89fdab7a3ec admin admin] Authenticating user token {{(pid=101893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:03:24.966599 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dce7dd4-4365-4f4b-ab9d-c89fdab7a3ec admin admin] Validating token access rules against request {{(pid=101893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:03:24.973327 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63a8da06-828d-40c4-881a-a8c54eca66a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cec56f74b2fa4826a506dc7b919465be', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:03:24.974489 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a8da06-828d-40c4-881a-a8c54eca66a8 admin admin] REQUEST_METHOD: `PUT` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:03:24.974775 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a8da06-828d-40c4-881a-a8c54eca66a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:03:24.975954 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a8da06-828d-40c4-881a-a8c54eca66a8 admin admin] PATH_INFO: `/v3/projects/35cf69f845d340c5ac3a67745b7216f8/users/3b889d87e2fa4e3cbe9840bbd94ee120/roles/a3b78e7d547d4d2d998b4c99a4396bba` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:03:25.007540 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c87cf10-b66d-48d8-a026-4b7981bed7f9 None None] Validating token access rules against request {{(pid=101892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:03:25.013832 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63a8da06-828d-40c4-881a-a8c54eca66a8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=35cf69f845d340c5ac3a67745b7216f8, user_id=3b889d87e2fa4e3cbe9840bbd94ee120, role_id=a3b78e7d547d4d2d998b4c99a4396bba)` {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:03:25.019393 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-883a53d4-5965-4972-b0d3-151f090d9a7d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ce28b25b907473588ccb87dc4acc06a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a000829c658c4a7cab67f7b6353ba3fa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:03:25.020419 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883a53d4-5965-4972-b0d3-151f090d9a7d service neutron] REQUEST_METHOD: `GET` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:03:25.020752 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883a53d4-5965-4972-b0d3-151f090d9a7d service neutron] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:03:25.021574 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63a8da06-828d-40c4-881a-a8c54eca66a8 admin admin] RBAC: Authorization granted {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:03:25.022095 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883a53d4-5965-4972-b0d3-151f090d9a7d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:03:25.040372 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-883a53d4-5965-4972-b0d3-151f090d9a7d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:03:25.042741 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-883a53d4-5965-4972-b0d3-151f090d9a7d service neutron] RBAC: Authorization granted {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:03:25.054394 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 863/1742] 10.222.0.84 () {60 vars in 1365 bytes} [Wed May 25 15:03:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 154 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 15:03:25.140157 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-883a53d4-5965-4972-b0d3-151f090d9a7d service neutron] Authenticating user token {{(pid=101892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:03:25.142184 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 880/1743] 10.222.0.84 () {60 vars in 1482 bytes} [Wed May 25 15:03:24 2022] PUT /identity/v3/projects/35cf69f845d340c5ac3a67745b7216f8/users/3b889d87e2fa4e3cbe9840bbd94ee120/roles/a3b78e7d547d4d2d998b4c99a4396bba => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 15:03:25.142660 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.fernet_utils [None req-883a53d4-5965-4972-b0d3-151f090d9a7d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=101892) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:03:25.153798 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63a8da06-828d-40c4-881a-a8c54eca66a8 admin admin] Authenticating user token {{(pid=101893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:03:25.176110 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-883a53d4-5965-4972-b0d3-151f090d9a7d service neutron] Validating token access rules against request {{(pid=101892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:03:25.269489 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63a8da06-828d-40c4-881a-a8c54eca66a8 admin admin] Validating token access rules against request {{(pid=101893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:03:25.275335 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ee4cd9-b362-4045-b7d6-b963a78ffe82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cec56f74b2fa4826a506dc7b919465be', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:03:25.276239 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ee4cd9-b362-4045-b7d6-b963a78ffe82 admin admin] REQUEST_METHOD: `GET` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:03:25.276662 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ee4cd9-b362-4045-b7d6-b963a78ffe82 admin admin] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:03:25.277079 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ee4cd9-b362-4045-b7d6-b963a78ffe82 admin admin] PATH_INFO: `/v3/roles` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:03:25.278077 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54ee4cd9-b362-4045-b7d6-b963a78ffe82 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:03:25.280070 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54ee4cd9-b362-4045-b7d6-b963a78ffe82 admin admin] RBAC: Authorization granted {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:03:25.314697 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 881/1744] 10.222.0.84 () {58 vars in 1121 bytes} [Wed May 25 15:03:25 2022] GET /identity/v3/roles => generated 1420 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 15:03:25.314697 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ee4cd9-b362-4045-b7d6-b963a78ffe82 admin admin] Authenticating user token {{(pid=101893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:03:25.324628 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ee4cd9-b362-4045-b7d6-b963a78ffe82 admin admin] Validating token access rules against request {{(pid=101893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:03:25.327486 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df432cec-ede5-4920-bf84-06e1a8019aef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cec56f74b2fa4826a506dc7b919465be', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:03:25.328603 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df432cec-ede5-4920-bf84-06e1a8019aef admin admin] REQUEST_METHOD: `DELETE` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:03:25.328982 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df432cec-ede5-4920-bf84-06e1a8019aef admin admin] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:03:25.329648 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df432cec-ede5-4920-bf84-06e1a8019aef admin admin] PATH_INFO: `/v3/projects/0fa23f732488467f8b542e4ae6cd803e` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:03:25.330993 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df432cec-ede5-4920-bf84-06e1a8019aef admin admin] RBAC: Authorizing `identity:delete_project(project_id=0fa23f732488467f8b542e4ae6cd803e)` {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:03:25.333361 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29763e0b-1fc7-43ac-9247-cfe6cf75cba3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cec56f74b2fa4826a506dc7b919465be', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:03:25.334586 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29763e0b-1fc7-43ac-9247-cfe6cf75cba3 admin admin] REQUEST_METHOD: `PUT` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:03:25.335011 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29763e0b-1fc7-43ac-9247-cfe6cf75cba3 admin admin] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:03:25.335445 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29763e0b-1fc7-43ac-9247-cfe6cf75cba3 admin admin] PATH_INFO: `/v3/projects/35cf69f845d340c5ac3a67745b7216f8/users/3b889d87e2fa4e3cbe9840bbd94ee120/roles/a3b78e7d547d4d2d998b4c99a4396bba` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:03:25.342880 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29763e0b-1fc7-43ac-9247-cfe6cf75cba3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=35cf69f845d340c5ac3a67745b7216f8, user_id=3b889d87e2fa4e3cbe9840bbd94ee120, role_id=a3b78e7d547d4d2d998b4c99a4396bba)` {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:03:25.342880 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29763e0b-1fc7-43ac-9247-cfe6cf75cba3 admin admin] RBAC: Authorization granted {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:03:25.343152 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df432cec-ede5-4920-bf84-06e1a8019aef admin admin] RBAC: Authorization granted {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:03:25.356827 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 882/1745] 10.222.0.84 () {60 vars in 1482 bytes} [Wed May 25 15:03:25 2022] PUT /identity/v3/projects/35cf69f845d340c5ac3a67745b7216f8/users/3b889d87e2fa4e3cbe9840bbd94ee120/roles/a3b78e7d547d4d2d998b4c99a4396bba => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 15:03:25.368810 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89705a5f-5007-4e68-aa47-e8abb6af038a None None] REQUEST_METHOD: `POST` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:03:25.369133 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89705a5f-5007-4e68-aa47-e8abb6af038a None None] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:03:25.369405 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89705a5f-5007-4e68-aa47-e8abb6af038a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:03:25.406503 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.auth.core [None req-89705a5f-5007-4e68-aa47-e8abb6af038a None None] MFA Rules not processed for user `3b889d87e2fa4e3cbe9840bbd94ee120`. Rule list: `[]` (Enabled: `True`). {{(pid=101893) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:03:25.407789 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.fernet_utils [None req-89705a5f-5007-4e68-aa47-e8abb6af038a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=101893) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:03:25.483846 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.notifications [None req-df432cec-ede5-4920-bf84-06e1a8019aef admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0fa23f732488467f8b542e4ae6cd803e', 'request_id': 'req-df432cec-ede5-4920-bf84-06e1a8019aef'} {{(pid=101892) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:03:25.494509 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.notifications [None req-df432cec-ede5-4920-bf84-06e1a8019aef admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0fa23f732488467f8b542e4ae6cd803e', 'request_id': 'req-df432cec-ede5-4920-bf84-06e1a8019aef'} {{(pid=101892) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:03:25.504185 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.notifications [None req-df432cec-ede5-4920-bf84-06e1a8019aef admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0fa23f732488467f8b542e4ae6cd803e', 'request_id': 'req-df432cec-ede5-4920-bf84-06e1a8019aef'} {{(pid=101892) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:03:25.550000 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 883/1746] 10.222.0.84 () {58 vars in 957 bytes} [Wed May 25 15:03:25 2022] POST /identity/v3/auth/tokens => generated 3303 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 15:03:25.565804 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89705a5f-5007-4e68-aa47-e8abb6af038a None None] Authenticating user token {{(pid=101893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:03:25.569639 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.fernet_utils [None req-89705a5f-5007-4e68-aa47-e8abb6af038a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=101893) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:03:25.608264 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.notifications [None req-df432cec-ede5-4920-bf84-06e1a8019aef admin admin] The token cache is being invalidate because project 0fa23f732488467f8b542e4ae6cd803e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=101892) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 25 15:03:25.608917 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.notifications [None req-df432cec-ede5-4920-bf84-06e1a8019aef admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=101892) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:03:25.610022 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.notifications [None req-df432cec-ede5-4920-bf84-06e1a8019aef admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=101892) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:03:25.617474 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 864/1747] 10.222.0.84 () {58 vars in 1232 bytes} [Wed May 25 15:03:25 2022] DELETE /identity/v3/projects/0fa23f732488467f8b542e4ae6cd803e => generated 0 bytes in 474 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 15:03:25.632746 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71360659-3a3c-4db3-b610-6937f165bbbf None None] REQUEST_METHOD: `POST` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:03:25.637192 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71360659-3a3c-4db3-b610-6937f165bbbf None None] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:03:25.637192 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71360659-3a3c-4db3-b610-6937f165bbbf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:03:25.690336 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.auth.core [None req-71360659-3a3c-4db3-b610-6937f165bbbf None None] MFA Rules not processed for user `05d87e87798e429aa1c10b24391f915e`. Rule list: `[]` (Enabled: `True`). {{(pid=101892) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:03:25.693821 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.fernet_utils [None req-71360659-3a3c-4db3-b610-6937f165bbbf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=101892) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:03:25.725973 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89705a5f-5007-4e68-aa47-e8abb6af038a None None] Validating token access rules against request {{(pid=101893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:03:25.780221 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 865/1748] 10.222.0.84 () {58 vars in 957 bytes} [Wed May 25 15:03:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 15:03:25.781723 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede82232-0d1d-4c34-a152-c020dd726a1a None None] REQUEST_METHOD: `GET` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:03:25.782142 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede82232-0d1d-4c34-a152-c020dd726a1a None None] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:03:25.782330 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede82232-0d1d-4c34-a152-c020dd726a1a None None] PATH_INFO: `/` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:03:25.786896 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 866/1749] 10.222.0.84 () {54 vars in 921 bytes} [Wed May 25 15:03:25 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 15:03:25.788087 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b0e363e-3e98-4ff7-8617-a63961525c5c None None] REQUEST_METHOD: `POST` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:03:25.788372 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b0e363e-3e98-4ff7-8617-a63961525c5c None None] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:03:25.788653 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b0e363e-3e98-4ff7-8617-a63961525c5c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:03:25.795449 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6314d149-3c06-4c88-8fea-52498b072c5e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e079f89a5e524ab6ad4183e4f690de07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a000829c658c4a7cab67f7b6353ba3fa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:03:25.796313 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6314d149-3c06-4c88-8fea-52498b072c5e service cinder] REQUEST_METHOD: `GET` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:03:25.796932 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6314d149-3c06-4c88-8fea-52498b072c5e service cinder] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:03:25.797366 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6314d149-3c06-4c88-8fea-52498b072c5e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:03:25.800319 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.fernet_utils [None req-6314d149-3c06-4c88-8fea-52498b072c5e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=101893) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:03:25.802405 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG dbcounter [-] [101892] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=101892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:03:25.815878 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.auth.core [None req-0b0e363e-3e98-4ff7-8617-a63961525c5c None None] MFA Rules not processed for user `05d87e87798e429aa1c10b24391f915e`. Rule list: `[]` (Enabled: `True`). {{(pid=101892) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:03:25.816764 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.fernet_utils [None req-0b0e363e-3e98-4ff7-8617-a63961525c5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=101892) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:03:25.833896 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 867/1750] 10.222.0.84 () {58 vars in 957 bytes} [Wed May 25 15:03:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 15:03:25.833896 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba82108-c5cb-4e47-85c6-290869bc2e5c None None] REQUEST_METHOD: `POST` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:03:25.833896 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba82108-c5cb-4e47-85c6-290869bc2e5c None None] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:03:25.834201 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba82108-c5cb-4e47-85c6-290869bc2e5c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:03:25.877982 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.auth.core [None req-5ba82108-c5cb-4e47-85c6-290869bc2e5c None None] MFA Rules not processed for user `2aeb182e6a5b43cfb0cc347ec847c848`. Rule list: `[]` (Enabled: `True`). {{(pid=101892) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:03:25.879830 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.fernet_utils [None req-5ba82108-c5cb-4e47-85c6-290869bc2e5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=101892) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:03:25.918017 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6314d149-3c06-4c88-8fea-52498b072c5e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:03:25.919517 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6314d149-3c06-4c88-8fea-52498b072c5e service cinder] RBAC: Authorization granted {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:03:25.956240 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 884/1751] 10.222.0.84 () {60 vars in 1365 bytes} [Wed May 25 15:03:25 2022] GET /identity/v3/auth/tokens => generated 3303 bytes in 391 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 15:03:25.958553 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6314d149-3c06-4c88-8fea-52498b072c5e service cinder] Authenticating user token {{(pid=101893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:03:25.975428 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6314d149-3c06-4c88-8fea-52498b072c5e service cinder] Validating token access rules against request {{(pid=101893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:03:25.981477 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f9e8820-fcd3-4aab-99b1-3f2367fe8182 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cec56f74b2fa4826a506dc7b919465be', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:03:25.982500 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9e8820-fcd3-4aab-99b1-3f2367fe8182 admin admin] REQUEST_METHOD: `GET` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:03:25.982847 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9e8820-fcd3-4aab-99b1-3f2367fe8182 admin admin] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:03:25.983197 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9e8820-fcd3-4aab-99b1-3f2367fe8182 admin admin] PATH_INFO: `/v3/domains` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:03:25.984086 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f9e8820-fcd3-4aab-99b1-3f2367fe8182 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=101893) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 15:03:25.984463 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f9e8820-fcd3-4aab-99b1-3f2367fe8182 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:03:25.986768 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f9e8820-fcd3-4aab-99b1-3f2367fe8182 admin admin] RBAC: Authorization granted {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:03:25.996851 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 868/1752] 10.222.0.84 () {58 vars in 1018 bytes} [Wed May 25 15:03:25 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 15:03:25.997535 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ba82108-c5cb-4e47-85c6-290869bc2e5c None None] Authenticating user token {{(pid=101892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:03:25.998944 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.fernet_utils [None req-5ba82108-c5cb-4e47-85c6-290869bc2e5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=101892) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:03:26.003373 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 885/1753] 10.222.0.84 () {58 vars in 1152 bytes} [Wed May 25 15:03:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 15:03:26.004470 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f9e8820-fcd3-4aab-99b1-3f2367fe8182 admin admin] Authenticating user token {{(pid=101893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:03:26.018833 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ba82108-c5cb-4e47-85c6-290869bc2e5c None None] Validating token access rules against request {{(pid=101892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:03:26.022688 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f9e8820-fcd3-4aab-99b1-3f2367fe8182 admin admin] Validating token access rules against request {{(pid=101893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:03:26.027914 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d668239c-881b-4ba4-a0e8-c3de0ac816b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cec56f74b2fa4826a506dc7b919465be', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:03:26.028647 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d668239c-881b-4ba4-a0e8-c3de0ac816b1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:03:26.028909 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7ede1d0-8833-4d6b-9e08-4aeecafa1d8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cec56f74b2fa4826a506dc7b919465be', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:03:26.029027 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d668239c-881b-4ba4-a0e8-c3de0ac816b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:03:26.029266 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d668239c-881b-4ba4-a0e8-c3de0ac816b1 admin admin] PATH_INFO: `/v3/projects/9662cc7737a04a36a8d4a4405a605ec5` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:03:26.029839 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ede1d0-8833-4d6b-9e08-4aeecafa1d8e admin admin] REQUEST_METHOD: `POST` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:03:26.030162 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ede1d0-8833-4d6b-9e08-4aeecafa1d8e admin admin] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:03:26.030722 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d668239c-881b-4ba4-a0e8-c3de0ac816b1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9662cc7737a04a36a8d4a4405a605ec5)` {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:03:26.030899 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ede1d0-8833-4d6b-9e08-4aeecafa1d8e admin admin] PATH_INFO: `/v3/projects` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:03:26.031295 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7ede1d0-8833-4d6b-9e08-4aeecafa1d8e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:03:26.032487 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d668239c-881b-4ba4-a0e8-c3de0ac816b1 admin admin] RBAC: Authorization granted {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:03:26.033467 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7ede1d0-8833-4d6b-9e08-4aeecafa1d8e admin admin] RBAC: Authorization granted {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:03:26.120990 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 886/1754] 10.222.0.84 () {60 vars in 1152 bytes} [Wed May 25 15:03:26 2022] POST /identity/v3/projects => generated 377 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 15:03:26.121975 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7ede1d0-8833-4d6b-9e08-4aeecafa1d8e admin admin] Authenticating user token {{(pid=101893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:03:26.123715 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.fernet_utils [None req-f7ede1d0-8833-4d6b-9e08-4aeecafa1d8e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=101893) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:03:26.162655 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.notifications [None req-d668239c-881b-4ba4-a0e8-c3de0ac816b1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9662cc7737a04a36a8d4a4405a605ec5', 'request_id': 'req-d668239c-881b-4ba4-a0e8-c3de0ac816b1'} {{(pid=101892) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:03:26.169393 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.notifications [None req-d668239c-881b-4ba4-a0e8-c3de0ac816b1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9662cc7737a04a36a8d4a4405a605ec5', 'request_id': 'req-d668239c-881b-4ba4-a0e8-c3de0ac816b1'} {{(pid=101892) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:03:26.175372 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.notifications [None req-d668239c-881b-4ba4-a0e8-c3de0ac816b1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9662cc7737a04a36a8d4a4405a605ec5', 'request_id': 'req-d668239c-881b-4ba4-a0e8-c3de0ac816b1'} {{(pid=101892) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:03:26.198956 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7ede1d0-8833-4d6b-9e08-4aeecafa1d8e admin admin] Validating token access rules against request {{(pid=101893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:03:26.262956 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce6df585-6826-471c-b410-80689acf9c42 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2aeb182e6a5b43cfb0cc347ec847c848', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a000829c658c4a7cab67f7b6353ba3fa', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:03:26.263641 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6df585-6826-471c-b410-80689acf9c42 service nova] REQUEST_METHOD: `GET` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:03:26.263930 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6df585-6826-471c-b410-80689acf9c42 service nova] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:03:26.264205 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6df585-6826-471c-b410-80689acf9c42 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:03:26.273078 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce6df585-6826-471c-b410-80689acf9c42 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:03:26.274692 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce6df585-6826-471c-b410-80689acf9c42 service nova] RBAC: Authorization granted {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:03:26.285067 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 887/1755] 10.222.0.84 () {60 vars in 1365 bytes} [Wed May 25 15:03:26 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 164 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 15:03:26.285914 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce6df585-6826-471c-b410-80689acf9c42 service nova] Authenticating user token {{(pid=101893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:03:26.309542 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.notifications [None req-d668239c-881b-4ba4-a0e8-c3de0ac816b1 admin admin] The token cache is being invalidate because project 9662cc7737a04a36a8d4a4405a605ec5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=101892) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 25 15:03:26.311950 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.notifications [None req-d668239c-881b-4ba4-a0e8-c3de0ac816b1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=101892) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:03:26.312658 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.notifications [None req-d668239c-881b-4ba4-a0e8-c3de0ac816b1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=101892) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:03:26.314598 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 869/1756] 10.222.0.84 () {58 vars in 1232 bytes} [Wed May 25 15:03:25 2022] DELETE /identity/v3/projects/9662cc7737a04a36a8d4a4405a605ec5 => generated 0 bytes in 317 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 15:03:26.318499 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d668239c-881b-4ba4-a0e8-c3de0ac816b1 admin admin] Authenticating user token {{(pid=101892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:03:26.320698 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.fernet_utils [None req-d668239c-881b-4ba4-a0e8-c3de0ac816b1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=101892) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:03:26.364197 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce6df585-6826-471c-b410-80689acf9c42 service nova] Validating token access rules against request {{(pid=101893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:03:26.369490 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a51f96a9-c0c6-4a0c-8cc4-2e47ef88f2c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cec56f74b2fa4826a506dc7b919465be', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:03:26.370661 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51f96a9-c0c6-4a0c-8cc4-2e47ef88f2c4 admin admin] REQUEST_METHOD: `POST` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:03:26.370661 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51f96a9-c0c6-4a0c-8cc4-2e47ef88f2c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:03:26.370862 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51f96a9-c0c6-4a0c-8cc4-2e47ef88f2c4 admin admin] PATH_INFO: `/v3/users` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:03:26.371404 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a51f96a9-c0c6-4a0c-8cc4-2e47ef88f2c4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:03:26.373417 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a51f96a9-c0c6-4a0c-8cc4-2e47ef88f2c4 admin admin] RBAC: Authorization granted {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:03:26.401193 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d668239c-881b-4ba4-a0e8-c3de0ac816b1 admin admin] Validating token access rules against request {{(pid=101892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:03:26.405943 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1928ff64-e35c-438b-8590-eb399b89ec66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cec56f74b2fa4826a506dc7b919465be', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:03:26.406820 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1928ff64-e35c-438b-8590-eb399b89ec66 admin admin] REQUEST_METHOD: `DELETE` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:03:26.407107 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1928ff64-e35c-438b-8590-eb399b89ec66 admin admin] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:03:26.407389 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1928ff64-e35c-438b-8590-eb399b89ec66 admin admin] PATH_INFO: `/v3/users/3dd027952ae543c2930c39099a5efa42` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:03:26.408614 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1928ff64-e35c-438b-8590-eb399b89ec66 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3dd027952ae543c2930c39099a5efa42)` {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:03:26.410541 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1928ff64-e35c-438b-8590-eb399b89ec66 admin admin] RBAC: Authorization granted {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:03:26.470100 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG dbcounter [-] [101893] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=101893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:03:26.476699 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 888/1757] 10.222.0.84 () {60 vars in 1143 bytes} [Wed May 25 15:03:26 2022] POST /identity/v3/users => generated 289 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 15:03:26.480715 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a51f96a9-c0c6-4a0c-8cc4-2e47ef88f2c4 admin admin] Authenticating user token {{(pid=101893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:03:26.482533 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.fernet_utils [None req-a51f96a9-c0c6-4a0c-8cc4-2e47ef88f2c4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=101893) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:03:26.495516 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a51f96a9-c0c6-4a0c-8cc4-2e47ef88f2c4 admin admin] Validating token access rules against request {{(pid=101893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:03:26.505776 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adf1c8a9-29e0-4cd6-bc3b-7dcfd736bde5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cec56f74b2fa4826a506dc7b919465be', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:03:26.506454 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf1c8a9-29e0-4cd6-bc3b-7dcfd736bde5 admin admin] REQUEST_METHOD: `GET` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:03:26.506796 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf1c8a9-29e0-4cd6-bc3b-7dcfd736bde5 admin admin] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:03:26.507165 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf1c8a9-29e0-4cd6-bc3b-7dcfd736bde5 admin admin] PATH_INFO: `/v3/roles` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:03:26.507934 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adf1c8a9-29e0-4cd6-bc3b-7dcfd736bde5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:03:26.510292 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adf1c8a9-29e0-4cd6-bc3b-7dcfd736bde5 admin admin] RBAC: Authorization granted {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:03:26.520560 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 889/1758] 10.222.0.84 () {58 vars in 1121 bytes} [Wed May 25 15:03:26 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 25 15:03:26.527729 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adf1c8a9-29e0-4cd6-bc3b-7dcfd736bde5 admin admin] Authenticating user token {{(pid=101893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:03:26.538175 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adf1c8a9-29e0-4cd6-bc3b-7dcfd736bde5 admin admin] Validating token access rules against request {{(pid=101893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:03:26.546383 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a3beda-f60d-4f0a-8144-0dd01c90b978 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cec56f74b2fa4826a506dc7b919465be', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:03:26.547069 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a3beda-f60d-4f0a-8144-0dd01c90b978 admin admin] REQUEST_METHOD: `GET` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:03:26.547357 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a3beda-f60d-4f0a-8144-0dd01c90b978 admin admin] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:03:26.548109 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a3beda-f60d-4f0a-8144-0dd01c90b978 admin admin] PATH_INFO: `/v3/roles` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:03:26.548852 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30a3beda-f60d-4f0a-8144-0dd01c90b978 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:03:26.550527 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30a3beda-f60d-4f0a-8144-0dd01c90b978 admin admin] RBAC: Authorization granted {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:03:26.567803 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 890/1759] 10.222.0.84 () {58 vars in 1121 bytes} [Wed May 25 15:03:26 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 15:03:26.572153 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a3beda-f60d-4f0a-8144-0dd01c90b978 admin admin] Authenticating user token {{(pid=101893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:03:26.582604 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a3beda-f60d-4f0a-8144-0dd01c90b978 admin admin] Validating token access rules against request {{(pid=101893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:03:26.587582 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-110faf58-65e9-430a-ad5e-d3f0595d1c1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cec56f74b2fa4826a506dc7b919465be', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:03:26.588542 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-110faf58-65e9-430a-ad5e-d3f0595d1c1b admin admin] REQUEST_METHOD: `PUT` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:03:26.588883 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-110faf58-65e9-430a-ad5e-d3f0595d1c1b admin admin] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:03:26.589238 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-110faf58-65e9-430a-ad5e-d3f0595d1c1b admin admin] PATH_INFO: `/v3/projects/8c7a02523aef47f7afa4d8f152db8ea9/users/298a40038f254b4db8ce9f2bed476ebb/roles/ff664fa0db7e4262a5accde96c3df4c3` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:03:26.605906 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-110faf58-65e9-430a-ad5e-d3f0595d1c1b admin admin] RBAC: Authorizing `identity:create_grant(project_id=8c7a02523aef47f7afa4d8f152db8ea9, user_id=298a40038f254b4db8ce9f2bed476ebb, role_id=ff664fa0db7e4262a5accde96c3df4c3)` {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:03:26.608668 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-110faf58-65e9-430a-ad5e-d3f0595d1c1b admin admin] RBAC: Authorization granted {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:03:26.659980 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.notifications [None req-1928ff64-e35c-438b-8590-eb399b89ec66 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3dd027952ae543c2930c39099a5efa42'} {{(pid=101892) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:03:26.673627 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.notifications [None req-1928ff64-e35c-438b-8590-eb399b89ec66 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3dd027952ae543c2930c39099a5efa42'} {{(pid=101892) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:03:26.681038 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 891/1760] 10.222.0.84 () {60 vars in 1482 bytes} [Wed May 25 15:03:26 2022] PUT /identity/v3/projects/8c7a02523aef47f7afa4d8f152db8ea9/users/298a40038f254b4db8ce9f2bed476ebb/roles/ff664fa0db7e4262a5accde96c3df4c3 => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 15:03:26.691614 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99959433-b0de-4948-9c41-a3298c682db4 None None] REQUEST_METHOD: `POST` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:03:26.691997 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99959433-b0de-4948-9c41-a3298c682db4 None None] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:03:26.692342 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99959433-b0de-4948-9c41-a3298c682db4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:03:26.708520 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.notifications [None req-1928ff64-e35c-438b-8590-eb399b89ec66 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3dd027952ae543c2930c39099a5efa42'} {{(pid=101892) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:03:26.709333 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.notifications [None req-1928ff64-e35c-438b-8590-eb399b89ec66 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3dd027952ae543c2930c39099a5efa42'} {{(pid=101892) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:03:26.726505 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.auth.core [None req-99959433-b0de-4948-9c41-a3298c682db4 None None] MFA Rules not processed for user `298a40038f254b4db8ce9f2bed476ebb`. Rule list: `[]` (Enabled: `True`). {{(pid=101893) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:03:26.728297 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.fernet_utils [None req-99959433-b0de-4948-9c41-a3298c682db4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=101893) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:03:26.799075 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 892/1761] 10.222.0.84 () {58 vars in 957 bytes} [Wed May 25 15:03:26 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 25 15:03:26.799871 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.notifications [None req-1928ff64-e35c-438b-8590-eb399b89ec66 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3dd027952ae543c2930c39099a5efa42'} {{(pid=101892) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:03:26.811831 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 870/1762] 10.222.0.84 () {58 vars in 1223 bytes} [Wed May 25 15:03:26 2022] DELETE /identity/v3/users/3dd027952ae543c2930c39099a5efa42 => generated 0 bytes in 490 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 25 15:03:26.816167 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99959433-b0de-4948-9c41-a3298c682db4 None None] Authenticating user token {{(pid=101893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:03:26.817720 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.fernet_utils [None req-99959433-b0de-4948-9c41-a3298c682db4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=101893) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:03:26.900249 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99959433-b0de-4948-9c41-a3298c682db4 None None] Validating token access rules against request {{(pid=101893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:03:26.969554 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9be2724b-29e9-417d-b494-24cafda607ce service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '971542599734491aa112b815fc4cc5c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a000829c658c4a7cab67f7b6353ba3fa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:03:26.970216 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be2724b-29e9-417d-b494-24cafda607ce service glance] REQUEST_METHOD: `GET` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:03:26.970531 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be2724b-29e9-417d-b494-24cafda607ce service glance] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:03:26.970809 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be2724b-29e9-417d-b494-24cafda607ce service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:03:26.972733 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.fernet_utils [None req-9be2724b-29e9-417d-b494-24cafda607ce service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=101893) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:03:27.052802 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9be2724b-29e9-417d-b494-24cafda607ce service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:03:27.054257 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9be2724b-29e9-417d-b494-24cafda607ce service glance] RBAC: Authorization granted {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:03:27.065992 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 893/1763] 10.222.0.84 () {60 vars in 1365 bytes} [Wed May 25 15:03:26 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 255 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 15:03:27.401240 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1928ff64-e35c-438b-8590-eb399b89ec66 admin admin] Authenticating user token {{(pid=101892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:03:27.402903 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.fernet_utils [None req-1928ff64-e35c-438b-8590-eb399b89ec66 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=101892) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:03:27.481434 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1928ff64-e35c-438b-8590-eb399b89ec66 admin admin] Validating token access rules against request {{(pid=101892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:03:27.485914 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7da62342-a50d-472d-9590-528d1bffc0d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cec56f74b2fa4826a506dc7b919465be', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:03:27.486774 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da62342-a50d-472d-9590-528d1bffc0d3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:03:27.487060 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da62342-a50d-472d-9590-528d1bffc0d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:03:27.487337 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da62342-a50d-472d-9590-528d1bffc0d3 admin admin] PATH_INFO: `/v3/projects/1691cfc6835c464fbf3fb823c6e7b437` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:03:27.488550 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7da62342-a50d-472d-9590-528d1bffc0d3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1691cfc6835c464fbf3fb823c6e7b437)` {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:03:27.490467 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7da62342-a50d-472d-9590-528d1bffc0d3 admin admin] RBAC: Authorization granted {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:03:27.611458 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.notifications [None req-7da62342-a50d-472d-9590-528d1bffc0d3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1691cfc6835c464fbf3fb823c6e7b437', 'request_id': 'req-7da62342-a50d-472d-9590-528d1bffc0d3'} {{(pid=101892) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:03:27.617762 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.notifications [None req-7da62342-a50d-472d-9590-528d1bffc0d3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1691cfc6835c464fbf3fb823c6e7b437', 'request_id': 'req-7da62342-a50d-472d-9590-528d1bffc0d3'} {{(pid=101892) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:03:27.623129 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.notifications [None req-7da62342-a50d-472d-9590-528d1bffc0d3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1691cfc6835c464fbf3fb823c6e7b437', 'request_id': 'req-7da62342-a50d-472d-9590-528d1bffc0d3'} {{(pid=101892) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:03:27.765153 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.notifications [None req-7da62342-a50d-472d-9590-528d1bffc0d3 admin admin] The token cache is being invalidate because project 1691cfc6835c464fbf3fb823c6e7b437 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=101892) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 25 15:03:27.765682 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.notifications [None req-7da62342-a50d-472d-9590-528d1bffc0d3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=101892) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:03:27.766102 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.notifications [None req-7da62342-a50d-472d-9590-528d1bffc0d3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=101892) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:03:27.771416 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 871/1764] 10.222.0.84 () {58 vars in 1232 bytes} [Wed May 25 15:03:27 2022] DELETE /identity/v3/projects/1691cfc6835c464fbf3fb823c6e7b437 => generated 0 bytes in 367 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 15:03:27.774208 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af0b12f-a709-4daf-9cf3-b61330d85cca None None] REQUEST_METHOD: `POST` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:03:27.774631 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af0b12f-a709-4daf-9cf3-b61330d85cca None None] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:03:27.774819 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af0b12f-a709-4daf-9cf3-b61330d85cca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:03:27.796042 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.auth.core [None req-7af0b12f-a709-4daf-9cf3-b61330d85cca None None] MFA Rules not processed for user `05d87e87798e429aa1c10b24391f915e`. Rule list: `[]` (Enabled: `True`). {{(pid=101893) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:03:27.797196 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.fernet_utils [None req-7af0b12f-a709-4daf-9cf3-b61330d85cca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=101893) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:03:27.855731 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 894/1765] 10.222.0.84 () {58 vars in 957 bytes} [Wed May 25 15:03:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 15:03:27.864450 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3e8bb4-0d29-4ecc-b87e-a2a4bb8c012f None None] REQUEST_METHOD: `POST` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:03:27.864743 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3e8bb4-0d29-4ecc-b87e-a2a4bb8c012f None None] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:03:27.865027 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3e8bb4-0d29-4ecc-b87e-a2a4bb8c012f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:03:27.885029 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.auth.core [None req-0f3e8bb4-0d29-4ecc-b87e-a2a4bb8c012f None None] MFA Rules not processed for user `05d87e87798e429aa1c10b24391f915e`. Rule list: `[]` (Enabled: `True`). {{(pid=101892) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:03:27.886275 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.fernet_utils [None req-0f3e8bb4-0d29-4ecc-b87e-a2a4bb8c012f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=101892) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:03:27.894562 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 872/1766] 10.222.0.84 () {58 vars in 957 bytes} [Wed May 25 15:03:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 15:03:27.904152 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7af0b12f-a709-4daf-9cf3-b61330d85cca None None] Authenticating user token {{(pid=101893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:03:27.920231 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7af0b12f-a709-4daf-9cf3-b61330d85cca None None] Validating token access rules against request {{(pid=101893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:03:27.935428 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f56382-43b1-47b6-9e9f-3896494e2fa2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cec56f74b2fa4826a506dc7b919465be', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:03:27.937701 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f56382-43b1-47b6-9e9f-3896494e2fa2 admin admin] REQUEST_METHOD: `GET` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:03:27.938154 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f56382-43b1-47b6-9e9f-3896494e2fa2 admin admin] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:03:27.939668 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f56382-43b1-47b6-9e9f-3896494e2fa2 admin admin] PATH_INFO: `/v3/domains` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:03:27.941769 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37f56382-43b1-47b6-9e9f-3896494e2fa2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=101893) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 15:03:27.951481 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37f56382-43b1-47b6-9e9f-3896494e2fa2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:03:27.951481 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37f56382-43b1-47b6-9e9f-3896494e2fa2 admin admin] RBAC: Authorization granted {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:03:27.965324 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 895/1767] 10.222.0.84 () {58 vars in 1152 bytes} [Wed May 25 15:03:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 15:03:27.966436 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f3e8bb4-0d29-4ecc-b87e-a2a4bb8c012f None None] Authenticating user token {{(pid=101892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:03:27.979028 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f3e8bb4-0d29-4ecc-b87e-a2a4bb8c012f None None] Validating token access rules against request {{(pid=101892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:03:27.989970 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-259c7c08-d7d3-4f30-8ec1-aeac544fb229 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cec56f74b2fa4826a506dc7b919465be', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:03:27.990762 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259c7c08-d7d3-4f30-8ec1-aeac544fb229 admin admin] REQUEST_METHOD: `POST` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:03:27.991052 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259c7c08-d7d3-4f30-8ec1-aeac544fb229 admin admin] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:03:27.991335 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259c7c08-d7d3-4f30-8ec1-aeac544fb229 admin admin] PATH_INFO: `/v3/projects` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:03:27.992107 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-259c7c08-d7d3-4f30-8ec1-aeac544fb229 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:03:27.994790 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-259c7c08-d7d3-4f30-8ec1-aeac544fb229 admin admin] RBAC: Authorization granted {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:03:28.039411 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG dbcounter [-] [101892] Writing DB stats keystone:SELECT=87,keystone:INSERT=3,keystone:DELETE=10 {{(pid=101892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:03:28.122623 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 873/1768] 10.222.0.84 () {60 vars in 1152 bytes} [Wed May 25 15:03:27 2022] POST /identity/v3/projects => generated 381 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 15:03:28.128996 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f56382-43b1-47b6-9e9f-3896494e2fa2 admin admin] Authenticating user token {{(pid=101893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:03:28.141859 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f56382-43b1-47b6-9e9f-3896494e2fa2 admin admin] Validating token access rules against request {{(pid=101893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:03:28.245685 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c627367-620e-4e5f-854b-22df3f8a78bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cec56f74b2fa4826a506dc7b919465be', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:03:28.250222 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c627367-620e-4e5f-854b-22df3f8a78bb admin admin] REQUEST_METHOD: `POST` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:03:28.250222 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c627367-620e-4e5f-854b-22df3f8a78bb admin admin] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:03:28.250222 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c627367-620e-4e5f-854b-22df3f8a78bb admin admin] PATH_INFO: `/v3/users` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:03:28.250222 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c627367-620e-4e5f-854b-22df3f8a78bb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:03:28.250222 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c627367-620e-4e5f-854b-22df3f8a78bb admin admin] RBAC: Authorization granted {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:03:28.354306 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 896/1769] 10.222.0.84 () {60 vars in 1143 bytes} [Wed May 25 15:03:28 2022] POST /identity/v3/users => generated 291 bytes in 228 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 15:03:28.361204 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-259c7c08-d7d3-4f30-8ec1-aeac544fb229 admin admin] Authenticating user token {{(pid=101892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:03:28.382063 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-259c7c08-d7d3-4f30-8ec1-aeac544fb229 admin admin] Validating token access rules against request {{(pid=101892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:03:28.384221 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5413a42-765b-4302-a753-8d697555b9f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cec56f74b2fa4826a506dc7b919465be', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:03:28.384923 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5413a42-765b-4302-a753-8d697555b9f7 admin admin] REQUEST_METHOD: `GET` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:03:28.385256 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5413a42-765b-4302-a753-8d697555b9f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:03:28.385493 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5413a42-765b-4302-a753-8d697555b9f7 admin admin] PATH_INFO: `/v3/roles` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:03:28.386239 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5413a42-765b-4302-a753-8d697555b9f7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:03:28.394584 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5413a42-765b-4302-a753-8d697555b9f7 admin admin] RBAC: Authorization granted {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:03:28.407851 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 874/1770] 10.222.0.84 () {58 vars in 1121 bytes} [Wed May 25 15:03:28 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 15:03:28.411926 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c627367-620e-4e5f-854b-22df3f8a78bb admin admin] Authenticating user token {{(pid=101893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:03:28.424242 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c627367-620e-4e5f-854b-22df3f8a78bb admin admin] Validating token access rules against request {{(pid=101893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:03:28.430948 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa988894-77c3-4f89-8107-0d8084992933 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cec56f74b2fa4826a506dc7b919465be', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:03:28.431713 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa988894-77c3-4f89-8107-0d8084992933 admin admin] REQUEST_METHOD: `GET` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:03:28.432002 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa988894-77c3-4f89-8107-0d8084992933 admin admin] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:03:28.432316 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa988894-77c3-4f89-8107-0d8084992933 admin admin] PATH_INFO: `/v3/roles` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:03:28.433015 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa988894-77c3-4f89-8107-0d8084992933 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:03:28.434707 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa988894-77c3-4f89-8107-0d8084992933 admin admin] RBAC: Authorization granted {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:03:28.445562 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 897/1771] 10.222.0.84 () {58 vars in 1121 bytes} [Wed May 25 15:03:28 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 15:03:28.450499 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5413a42-765b-4302-a753-8d697555b9f7 admin admin] Authenticating user token {{(pid=101892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:03:28.462181 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG dbcounter [-] [101893] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=101893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:03:28.462373 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5413a42-765b-4302-a753-8d697555b9f7 admin admin] Validating token access rules against request {{(pid=101892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:03:28.467222 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97e5b8be-d055-42dd-8f19-c5c8fb7a1282 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cec56f74b2fa4826a506dc7b919465be', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:03:28.473167 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e5b8be-d055-42dd-8f19-c5c8fb7a1282 admin admin] REQUEST_METHOD: `PUT` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:03:28.473167 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e5b8be-d055-42dd-8f19-c5c8fb7a1282 admin admin] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:03:28.473167 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e5b8be-d055-42dd-8f19-c5c8fb7a1282 admin admin] PATH_INFO: `/v3/projects/2bdea6bbee624e55b20e831a3a54d18c/users/029c87e6f4124a8ea0e8b1585740e358/roles/ff664fa0db7e4262a5accde96c3df4c3` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:03:28.492729 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97e5b8be-d055-42dd-8f19-c5c8fb7a1282 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2bdea6bbee624e55b20e831a3a54d18c, user_id=029c87e6f4124a8ea0e8b1585740e358, role_id=ff664fa0db7e4262a5accde96c3df4c3)` {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:03:28.496796 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97e5b8be-d055-42dd-8f19-c5c8fb7a1282 admin admin] RBAC: Authorization granted {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:03:28.586342 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 875/1772] 10.222.0.84 () {60 vars in 1482 bytes} [Wed May 25 15:03:28 2022] PUT /identity/v3/projects/2bdea6bbee624e55b20e831a3a54d18c/users/029c87e6f4124a8ea0e8b1585740e358/roles/ff664fa0db7e4262a5accde96c3df4c3 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 25 15:03:28.588048 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0093d30f-0fb3-4377-94bb-659d9e0623b5 None None] REQUEST_METHOD: `POST` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:03:28.588434 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0093d30f-0fb3-4377-94bb-659d9e0623b5 None None] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:03:28.588981 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0093d30f-0fb3-4377-94bb-659d9e0623b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:03:28.628935 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.auth.core [None req-0093d30f-0fb3-4377-94bb-659d9e0623b5 None None] MFA Rules not processed for user `029c87e6f4124a8ea0e8b1585740e358`. Rule list: `[]` (Enabled: `True`). {{(pid=101893) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:03:28.630688 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.fernet_utils [None req-0093d30f-0fb3-4377-94bb-659d9e0623b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=101893) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:03:28.740722 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 898/1773] 10.222.0.84 () {58 vars in 957 bytes} [Wed May 25 15:03:28 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 25 15:03:28.750171 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97e5b8be-d055-42dd-8f19-c5c8fb7a1282 admin admin] Authenticating user token {{(pid=101892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:03:28.832741 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97e5b8be-d055-42dd-8f19-c5c8fb7a1282 admin admin] Validating token access rules against request {{(pid=101892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:03:28.841192 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0451f381-5adb-48c6-93ba-a20db039a7c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cec56f74b2fa4826a506dc7b919465be', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:03:28.841940 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0451f381-5adb-48c6-93ba-a20db039a7c3 admin admin] REQUEST_METHOD: `POST` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:03:28.842228 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0451f381-5adb-48c6-93ba-a20db039a7c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:03:28.842513 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0451f381-5adb-48c6-93ba-a20db039a7c3 admin admin] PATH_INFO: `/v3/projects` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:03:28.843266 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0451f381-5adb-48c6-93ba-a20db039a7c3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:03:28.845398 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0451f381-5adb-48c6-93ba-a20db039a7c3 admin admin] RBAC: Authorization granted {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:03:28.958461 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 876/1774] 10.222.0.84 () {60 vars in 1152 bytes} [Wed May 25 15:03:28 2022] POST /identity/v3/projects => generated 377 bytes in 209 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 15:03:28.963487 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0093d30f-0fb3-4377-94bb-659d9e0623b5 None None] Authenticating user token {{(pid=101893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:03:28.981133 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0093d30f-0fb3-4377-94bb-659d9e0623b5 None None] Validating token access rules against request {{(pid=101893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:03:29.132759 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c61bd744-f0e5-43f0-ad86-1f0109428578 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cec56f74b2fa4826a506dc7b919465be', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:03:29.134087 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61bd744-f0e5-43f0-ad86-1f0109428578 admin admin] REQUEST_METHOD: `POST` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:03:29.134425 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61bd744-f0e5-43f0-ad86-1f0109428578 admin admin] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:03:29.134707 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61bd744-f0e5-43f0-ad86-1f0109428578 admin admin] PATH_INFO: `/v3/users` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:03:29.135533 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c61bd744-f0e5-43f0-ad86-1f0109428578 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:03:29.137863 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c61bd744-f0e5-43f0-ad86-1f0109428578 admin admin] RBAC: Authorization granted {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:03:29.276830 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 899/1775] 10.222.0.84 () {60 vars in 1143 bytes} [Wed May 25 15:03:28 2022] POST /identity/v3/users => generated 295 bytes in 313 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 15:03:29.284606 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0451f381-5adb-48c6-93ba-a20db039a7c3 admin admin] Authenticating user token {{(pid=101892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:03:29.303638 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0451f381-5adb-48c6-93ba-a20db039a7c3 admin admin] Validating token access rules against request {{(pid=101892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:03:29.332334 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41583fbe-fab9-4b4d-8287-b03701082562 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cec56f74b2fa4826a506dc7b919465be', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:03:29.333373 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41583fbe-fab9-4b4d-8287-b03701082562 admin admin] REQUEST_METHOD: `GET` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:03:29.335547 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41583fbe-fab9-4b4d-8287-b03701082562 admin admin] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:03:29.339794 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41583fbe-fab9-4b4d-8287-b03701082562 admin admin] PATH_INFO: `/v3/roles` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:03:29.340770 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41583fbe-fab9-4b4d-8287-b03701082562 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:03:29.342438 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41583fbe-fab9-4b4d-8287-b03701082562 admin admin] RBAC: Authorization granted {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:03:29.376720 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 877/1776] 10.222.0.84 () {58 vars in 1121 bytes} [Wed May 25 15:03:29 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 15:03:29.379174 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c61bd744-f0e5-43f0-ad86-1f0109428578 admin admin] Authenticating user token {{(pid=101893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:03:29.400316 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c61bd744-f0e5-43f0-ad86-1f0109428578 admin admin] Validating token access rules against request {{(pid=101893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:03:29.405739 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-208c5d6d-8a3f-4363-8f53-cd5e4ffefd5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cec56f74b2fa4826a506dc7b919465be', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:03:29.406781 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208c5d6d-8a3f-4363-8f53-cd5e4ffefd5a admin admin] REQUEST_METHOD: `PUT` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:03:29.406983 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208c5d6d-8a3f-4363-8f53-cd5e4ffefd5a admin admin] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:03:29.407268 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208c5d6d-8a3f-4363-8f53-cd5e4ffefd5a admin admin] PATH_INFO: `/v3/projects/d1c2334aaa16452c953dfb8d7a6fab43/users/adccb9335d824286a73ba60a48fb4ce4/roles/a3b78e7d547d4d2d998b4c99a4396bba` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:03:29.441991 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-208c5d6d-8a3f-4363-8f53-cd5e4ffefd5a admin admin] RBAC: Authorizing `identity:create_grant(project_id=d1c2334aaa16452c953dfb8d7a6fab43, user_id=adccb9335d824286a73ba60a48fb4ce4, role_id=a3b78e7d547d4d2d998b4c99a4396bba)` {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:03:29.450108 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-208c5d6d-8a3f-4363-8f53-cd5e4ffefd5a admin admin] RBAC: Authorization granted {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:03:29.509077 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41583fbe-fab9-4b4d-8287-b03701082562 admin admin] Authenticating user token {{(pid=101892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:03:29.511098 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.fernet_utils [None req-41583fbe-fab9-4b4d-8287-b03701082562 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=101892) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:03:29.530110 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41583fbe-fab9-4b4d-8287-b03701082562 admin admin] Validating token access rules against request {{(pid=101892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:03:29.535429 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0308065c-eeee-4cc7-94a1-06ef0859593e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cec56f74b2fa4826a506dc7b919465be', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:03:29.536383 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0308065c-eeee-4cc7-94a1-06ef0859593e admin admin] REQUEST_METHOD: `DELETE` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:03:29.536674 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0308065c-eeee-4cc7-94a1-06ef0859593e admin admin] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:03:29.536954 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0308065c-eeee-4cc7-94a1-06ef0859593e admin admin] PATH_INFO: `/v3/users/c1992d39a74d4049ad91967de0d135fc` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:03:29.538764 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0308065c-eeee-4cc7-94a1-06ef0859593e admin admin] RBAC: Authorizing `identity:delete_user(user_id=c1992d39a74d4049ad91967de0d135fc)` {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:03:29.541118 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0308065c-eeee-4cc7-94a1-06ef0859593e admin admin] RBAC: Authorization granted {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:03:29.559832 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG dbcounter [-] [101893] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=101893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:03:29.602922 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 900/1777] 10.222.0.84 () {60 vars in 1482 bytes} [Wed May 25 15:03:29 2022] PUT /identity/v3/projects/d1c2334aaa16452c953dfb8d7a6fab43/users/adccb9335d824286a73ba60a48fb4ce4/roles/a3b78e7d547d4d2d998b4c99a4396bba => generated 0 bytes in 222 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 15:03:29.604410 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-208c5d6d-8a3f-4363-8f53-cd5e4ffefd5a admin admin] Authenticating user token {{(pid=101893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:03:29.691764 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG dbcounter [-] [101892] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=101892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:03:29.725783 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-208c5d6d-8a3f-4363-8f53-cd5e4ffefd5a admin admin] Validating token access rules against request {{(pid=101893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:03:29.732651 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3788adf-a0a4-4ba1-8420-6f528e97063e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cec56f74b2fa4826a506dc7b919465be', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:03:29.733579 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3788adf-a0a4-4ba1-8420-6f528e97063e admin admin] REQUEST_METHOD: `GET` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:03:29.734160 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3788adf-a0a4-4ba1-8420-6f528e97063e admin admin] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:03:29.734937 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3788adf-a0a4-4ba1-8420-6f528e97063e admin admin] PATH_INFO: `/v3/roles` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:03:29.735959 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3788adf-a0a4-4ba1-8420-6f528e97063e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:03:29.738124 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3788adf-a0a4-4ba1-8420-6f528e97063e admin admin] RBAC: Authorization granted {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:03:29.753980 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 901/1778] 10.222.0.84 () {58 vars in 1121 bytes} [Wed May 25 15:03:29 2022] GET /identity/v3/roles => generated 1420 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 15:03:29.758147 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3788adf-a0a4-4ba1-8420-6f528e97063e admin admin] Authenticating user token {{(pid=101893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:03:29.764198 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.notifications [None req-0308065c-eeee-4cc7-94a1-06ef0859593e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c1992d39a74d4049ad91967de0d135fc'} {{(pid=101892) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:03:29.781511 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.notifications [None req-0308065c-eeee-4cc7-94a1-06ef0859593e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c1992d39a74d4049ad91967de0d135fc'} {{(pid=101892) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:03:29.787192 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3788adf-a0a4-4ba1-8420-6f528e97063e admin admin] Validating token access rules against request {{(pid=101893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:03:29.793023 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9fc88d6-e31b-46d8-852e-13f9d27a64b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cec56f74b2fa4826a506dc7b919465be', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:03:29.794302 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9fc88d6-e31b-46d8-852e-13f9d27a64b1 admin admin] REQUEST_METHOD: `PUT` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:03:29.794661 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9fc88d6-e31b-46d8-852e-13f9d27a64b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:03:29.795080 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9fc88d6-e31b-46d8-852e-13f9d27a64b1 admin admin] PATH_INFO: `/v3/projects/d1c2334aaa16452c953dfb8d7a6fab43/users/adccb9335d824286a73ba60a48fb4ce4/roles/a3b78e7d547d4d2d998b4c99a4396bba` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:03:29.798567 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9fc88d6-e31b-46d8-852e-13f9d27a64b1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d1c2334aaa16452c953dfb8d7a6fab43, user_id=adccb9335d824286a73ba60a48fb4ce4, role_id=a3b78e7d547d4d2d998b4c99a4396bba)` {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:03:29.803689 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9fc88d6-e31b-46d8-852e-13f9d27a64b1 admin admin] RBAC: Authorization granted {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:03:29.804247 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.notifications [None req-0308065c-eeee-4cc7-94a1-06ef0859593e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c1992d39a74d4049ad91967de0d135fc'} {{(pid=101892) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:03:29.804247 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.notifications [None req-0308065c-eeee-4cc7-94a1-06ef0859593e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c1992d39a74d4049ad91967de0d135fc'} {{(pid=101892) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:03:29.818138 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 902/1779] 10.222.0.84 () {60 vars in 1482 bytes} [Wed May 25 15:03:29 2022] PUT /identity/v3/projects/d1c2334aaa16452c953dfb8d7a6fab43/users/adccb9335d824286a73ba60a48fb4ce4/roles/a3b78e7d547d4d2d998b4c99a4396bba => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 15:03:29.833462 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a717077-ab12-4253-890e-92a149feea0a None None] REQUEST_METHOD: `POST` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:03:29.833946 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a717077-ab12-4253-890e-92a149feea0a None None] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:03:29.834240 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a717077-ab12-4253-890e-92a149feea0a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:03:29.881023 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.auth.core [None req-5a717077-ab12-4253-890e-92a149feea0a None None] MFA Rules not processed for user `adccb9335d824286a73ba60a48fb4ce4`. Rule list: `[]` (Enabled: `True`). {{(pid=101893) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:03:29.881915 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.fernet_utils [None req-5a717077-ab12-4253-890e-92a149feea0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=101893) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:03:29.891206 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.notifications [None req-0308065c-eeee-4cc7-94a1-06ef0859593e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c1992d39a74d4049ad91967de0d135fc'} {{(pid=101892) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:03:29.901230 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 878/1780] 10.222.0.84 () {58 vars in 1223 bytes} [Wed May 25 15:03:29 2022] DELETE /identity/v3/users/c1992d39a74d4049ad91967de0d135fc => generated 0 bytes in 393 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 25 15:03:29.906180 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63c615d-d487-4366-9855-eaf70532d288 None None] REQUEST_METHOD: `POST` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:03:29.906655 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63c615d-d487-4366-9855-eaf70532d288 None None] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:03:29.907086 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63c615d-d487-4366-9855-eaf70532d288 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:03:29.957601 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.auth.core [None req-d63c615d-d487-4366-9855-eaf70532d288 None None] MFA Rules not processed for user `05d87e87798e429aa1c10b24391f915e`. Rule list: `[]` (Enabled: `True`). {{(pid=101892) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:03:29.962877 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.fernet_utils [None req-d63c615d-d487-4366-9855-eaf70532d288 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=101892) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:03:30.021755 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 903/1781] 10.222.0.84 () {58 vars in 957 bytes} [Wed May 25 15:03:29 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 25 15:03:30.039157 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a717077-ab12-4253-890e-92a149feea0a None None] Authenticating user token {{(pid=101893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:03:30.042159 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.fernet_utils [None req-5a717077-ab12-4253-890e-92a149feea0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=101893) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:03:30.096843 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 879/1782] 10.222.0.84 () {58 vars in 957 bytes} [Wed May 25 15:03:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 15:03:30.106201 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d63c615d-d487-4366-9855-eaf70532d288 None None] Authenticating user token {{(pid=101892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:03:30.108985 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.fernet_utils [None req-d63c615d-d487-4366-9855-eaf70532d288 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=101892) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:03:30.198051 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a717077-ab12-4253-890e-92a149feea0a None None] Validating token access rules against request {{(pid=101893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:03:30.204796 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d63c615d-d487-4366-9855-eaf70532d288 None None] Validating token access rules against request {{(pid=101892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:03:30.211221 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03289ab0-002e-4ba6-bd63-3eadfd648407 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ce28b25b907473588ccb87dc4acc06a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a000829c658c4a7cab67f7b6353ba3fa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:03:30.211960 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03289ab0-002e-4ba6-bd63-3eadfd648407 service neutron] REQUEST_METHOD: `GET` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:03:30.212241 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03289ab0-002e-4ba6-bd63-3eadfd648407 service neutron] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:03:30.212888 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03289ab0-002e-4ba6-bd63-3eadfd648407 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:03:30.230856 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03289ab0-002e-4ba6-bd63-3eadfd648407 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:03:30.232410 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03289ab0-002e-4ba6-bd63-3eadfd648407 service neutron] RBAC: Authorization granted {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:03:30.245353 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 880/1783] 10.222.0.84 () {60 vars in 1365 bytes} [Wed May 25 15:03:30 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 139 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 15:03:30.300594 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d65f47f0-5ce1-428a-9b5a-9a1932414ee3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e079f89a5e524ab6ad4183e4f690de07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a000829c658c4a7cab67f7b6353ba3fa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:03:30.301257 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65f47f0-5ce1-428a-9b5a-9a1932414ee3 service cinder] REQUEST_METHOD: `GET` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:03:30.304304 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65f47f0-5ce1-428a-9b5a-9a1932414ee3 service cinder] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:03:30.304304 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65f47f0-5ce1-428a-9b5a-9a1932414ee3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:03:30.361378 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG dbcounter [-] [101893] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=101893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:03:30.383593 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d65f47f0-5ce1-428a-9b5a-9a1932414ee3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:03:30.385071 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d65f47f0-5ce1-428a-9b5a-9a1932414ee3 service cinder] RBAC: Authorization granted {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:03:30.401141 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 904/1784] 10.222.0.84 () {60 vars in 1365 bytes} [Wed May 25 15:03:30 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 365 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 25 15:03:30.456786 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG dbcounter [-] [101892] Writing DB stats keystone:DELETE=8,keystone:SELECT=91,keystone:INSERT=1 {{(pid=101892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:03:30.704420 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03289ab0-002e-4ba6-bd63-3eadfd648407 service neutron] Authenticating user token {{(pid=101892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:03:30.705975 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.fernet_utils [None req-03289ab0-002e-4ba6-bd63-3eadfd648407 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=101892) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:03:30.719487 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03289ab0-002e-4ba6-bd63-3eadfd648407 service neutron] Validating token access rules against request {{(pid=101892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:03:30.724072 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e582567-b1c5-497a-8f2e-e89f593318a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cec56f74b2fa4826a506dc7b919465be', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:03:30.730078 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e582567-b1c5-497a-8f2e-e89f593318a0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:03:30.730078 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e582567-b1c5-497a-8f2e-e89f593318a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:03:30.730078 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e582567-b1c5-497a-8f2e-e89f593318a0 admin admin] PATH_INFO: `/v3/projects/e9b9fbca9a1e4f6cbe234aaf2de33c1f` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:03:30.730078 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e582567-b1c5-497a-8f2e-e89f593318a0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e9b9fbca9a1e4f6cbe234aaf2de33c1f)` {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:03:30.730078 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e582567-b1c5-497a-8f2e-e89f593318a0 admin admin] RBAC: Authorization granted {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:03:30.823458 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.notifications [None req-8e582567-b1c5-497a-8f2e-e89f593318a0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e9b9fbca9a1e4f6cbe234aaf2de33c1f', 'request_id': 'req-8e582567-b1c5-497a-8f2e-e89f593318a0'} {{(pid=101892) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:03:30.830785 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.notifications [None req-8e582567-b1c5-497a-8f2e-e89f593318a0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e9b9fbca9a1e4f6cbe234aaf2de33c1f', 'request_id': 'req-8e582567-b1c5-497a-8f2e-e89f593318a0'} {{(pid=101892) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:03:30.846850 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.notifications [None req-8e582567-b1c5-497a-8f2e-e89f593318a0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e9b9fbca9a1e4f6cbe234aaf2de33c1f', 'request_id': 'req-8e582567-b1c5-497a-8f2e-e89f593318a0'} {{(pid=101892) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:03:30.907101 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.notifications [None req-8e582567-b1c5-497a-8f2e-e89f593318a0 admin admin] The token cache is being invalidate because project e9b9fbca9a1e4f6cbe234aaf2de33c1f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=101892) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 25 15:03:30.907395 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.notifications [None req-8e582567-b1c5-497a-8f2e-e89f593318a0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=101892) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:03:30.908063 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.notifications [None req-8e582567-b1c5-497a-8f2e-e89f593318a0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=101892) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:03:30.909637 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 881/1785] 10.222.0.84 () {58 vars in 1232 bytes} [Wed May 25 15:03:30 2022] DELETE /identity/v3/projects/e9b9fbca9a1e4f6cbe234aaf2de33c1f => generated 0 bytes in 206 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 25 15:03:30.913792 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d65f47f0-5ce1-428a-9b5a-9a1932414ee3 service cinder] Authenticating user token {{(pid=101893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:03:30.932983 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d65f47f0-5ce1-428a-9b5a-9a1932414ee3 service cinder] Validating token access rules against request {{(pid=101893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:03:30.972990 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e582567-b1c5-497a-8f2e-e89f593318a0 admin admin] Authenticating user token {{(pid=101892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:03:30.973189 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG dbcounter [-] [101893] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=101893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:03:30.978640 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.fernet_utils [None req-8e582567-b1c5-497a-8f2e-e89f593318a0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=101892) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:03:31.036392 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bffb226-cc75-4ddb-92ab-cf081d4fb9e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cec56f74b2fa4826a506dc7b919465be', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:03:31.037968 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bffb226-cc75-4ddb-92ab-cf081d4fb9e7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:03:31.038393 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bffb226-cc75-4ddb-92ab-cf081d4fb9e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:03:31.038850 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bffb226-cc75-4ddb-92ab-cf081d4fb9e7 admin admin] PATH_INFO: `/v3/users/3b889d87e2fa4e3cbe9840bbd94ee120` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:03:31.041347 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bffb226-cc75-4ddb-92ab-cf081d4fb9e7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3b889d87e2fa4e3cbe9840bbd94ee120)` {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:03:31.044095 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bffb226-cc75-4ddb-92ab-cf081d4fb9e7 admin admin] RBAC: Authorization granted {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:03:31.062137 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e582567-b1c5-497a-8f2e-e89f593318a0 admin admin] Validating token access rules against request {{(pid=101892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:03:31.070704 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32acedc1-a6d2-4de8-b8d9-0527bed2beaf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cec56f74b2fa4826a506dc7b919465be', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:03:31.075668 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32acedc1-a6d2-4de8-b8d9-0527bed2beaf admin admin] REQUEST_METHOD: `DELETE` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:03:31.075980 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32acedc1-a6d2-4de8-b8d9-0527bed2beaf admin admin] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:03:31.076543 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32acedc1-a6d2-4de8-b8d9-0527bed2beaf admin admin] PATH_INFO: `/v3/users/029c87e6f4124a8ea0e8b1585740e358` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:03:31.077924 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32acedc1-a6d2-4de8-b8d9-0527bed2beaf admin admin] RBAC: Authorizing `identity:delete_user(user_id=029c87e6f4124a8ea0e8b1585740e358)` {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:03:31.079952 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32acedc1-a6d2-4de8-b8d9-0527bed2beaf admin admin] RBAC: Authorization granted {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:03:31.280992 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.notifications [None req-8bffb226-cc75-4ddb-92ab-cf081d4fb9e7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3b889d87e2fa4e3cbe9840bbd94ee120'} {{(pid=101893) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:03:31.288433 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.notifications [None req-8bffb226-cc75-4ddb-92ab-cf081d4fb9e7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3b889d87e2fa4e3cbe9840bbd94ee120'} {{(pid=101893) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:03:31.301206 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.notifications [None req-8bffb226-cc75-4ddb-92ab-cf081d4fb9e7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3b889d87e2fa4e3cbe9840bbd94ee120'} {{(pid=101893) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:03:31.301954 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.notifications [None req-8bffb226-cc75-4ddb-92ab-cf081d4fb9e7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3b889d87e2fa4e3cbe9840bbd94ee120'} {{(pid=101893) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:03:31.302631 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.notifications [None req-8bffb226-cc75-4ddb-92ab-cf081d4fb9e7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3b889d87e2fa4e3cbe9840bbd94ee120'} {{(pid=101893) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:03:31.357325 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.notifications [None req-32acedc1-a6d2-4de8-b8d9-0527bed2beaf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '029c87e6f4124a8ea0e8b1585740e358'} {{(pid=101892) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:03:31.365039 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.notifications [None req-32acedc1-a6d2-4de8-b8d9-0527bed2beaf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '029c87e6f4124a8ea0e8b1585740e358'} {{(pid=101892) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:03:31.383962 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.notifications [None req-32acedc1-a6d2-4de8-b8d9-0527bed2beaf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '029c87e6f4124a8ea0e8b1585740e358'} {{(pid=101892) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:03:31.385347 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.notifications [None req-32acedc1-a6d2-4de8-b8d9-0527bed2beaf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '029c87e6f4124a8ea0e8b1585740e358'} {{(pid=101892) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:03:31.386266 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 905/1786] 10.222.0.84 () {58 vars in 1223 bytes} [Wed May 25 15:03:30 2022] DELETE /identity/v3/users/3b889d87e2fa4e3cbe9840bbd94ee120 => generated 0 bytes in 473 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 15:03:31.462670 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.notifications [None req-32acedc1-a6d2-4de8-b8d9-0527bed2beaf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '029c87e6f4124a8ea0e8b1585740e358'} {{(pid=101892) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:03:31.470177 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 882/1787] 10.222.0.84 () {58 vars in 1223 bytes} [Wed May 25 15:03:30 2022] DELETE /identity/v3/users/029c87e6f4124a8ea0e8b1585740e358 => generated 0 bytes in 498 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 25 15:03:31.475389 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9fd86e-261c-496a-b0e3-9b516b405599 None None] REQUEST_METHOD: `POST` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:03:31.476254 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9fd86e-261c-496a-b0e3-9b516b405599 None None] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:03:31.476935 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9fd86e-261c-496a-b0e3-9b516b405599 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:03:31.486590 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG dbcounter [-] [101892] Writing DB stats keystone:DELETE=13,keystone:SELECT=85,keystone:INSERT=2 {{(pid=101892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:03:31.506470 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.auth.core [None req-ee9fd86e-261c-496a-b0e3-9b516b405599 None None] MFA Rules not processed for user `05d87e87798e429aa1c10b24391f915e`. Rule list: `[]` (Enabled: `True`). {{(pid=101893) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:03:31.509300 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.fernet_utils [None req-ee9fd86e-261c-496a-b0e3-9b516b405599 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=101893) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:03:31.592255 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 906/1788] 10.222.0.84 () {58 vars in 957 bytes} [Wed May 25 15:03:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 25 15:03:31.603370 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32acedc1-a6d2-4de8-b8d9-0527bed2beaf admin admin] Authenticating user token {{(pid=101892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:03:31.604785 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.fernet_utils [None req-32acedc1-a6d2-4de8-b8d9-0527bed2beaf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=101892) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:03:31.678425 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32acedc1-a6d2-4de8-b8d9-0527bed2beaf admin admin] Validating token access rules against request {{(pid=101892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:03:31.682737 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f389b365-ba64-4398-bb91-0760411ffe25 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ce28b25b907473588ccb87dc4acc06a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a000829c658c4a7cab67f7b6353ba3fa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:03:31.683555 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f389b365-ba64-4398-bb91-0760411ffe25 service neutron] REQUEST_METHOD: `GET` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:03:31.683790 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f389b365-ba64-4398-bb91-0760411ffe25 service neutron] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:03:31.690389 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f389b365-ba64-4398-bb91-0760411ffe25 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:03:31.701443 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f389b365-ba64-4398-bb91-0760411ffe25 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:03:31.703607 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f389b365-ba64-4398-bb91-0760411ffe25 service neutron] RBAC: Authorization granted {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:03:31.713953 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 883/1789] 10.222.0.84 () {60 vars in 1365 bytes} [Wed May 25 15:03:31 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 15:03:31.930988 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG dbcounter [-] [101893] Writing DB stats keystone:SELECT=100 {{(pid=101893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:03:31.956924 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee9fd86e-261c-496a-b0e3-9b516b405599 None None] Authenticating user token {{(pid=101893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:03:31.963286 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.fernet_utils [None req-ee9fd86e-261c-496a-b0e3-9b516b405599 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=101893) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:03:31.985813 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee9fd86e-261c-496a-b0e3-9b516b405599 None None] Validating token access rules against request {{(pid=101893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:03:31.992939 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-330359bb-214a-48f9-8595-aba7f3fd776c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cec56f74b2fa4826a506dc7b919465be', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:03:31.994725 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330359bb-214a-48f9-8595-aba7f3fd776c admin admin] REQUEST_METHOD: `DELETE` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:03:31.994725 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330359bb-214a-48f9-8595-aba7f3fd776c admin admin] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:03:31.994992 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330359bb-214a-48f9-8595-aba7f3fd776c admin admin] PATH_INFO: `/v3/projects/35cf69f845d340c5ac3a67745b7216f8` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:03:31.996429 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-330359bb-214a-48f9-8595-aba7f3fd776c admin admin] RBAC: Authorizing `identity:delete_project(project_id=35cf69f845d340c5ac3a67745b7216f8)` {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:03:31.999027 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-330359bb-214a-48f9-8595-aba7f3fd776c admin admin] RBAC: Authorization granted {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:03:32.118800 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.notifications [None req-330359bb-214a-48f9-8595-aba7f3fd776c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '35cf69f845d340c5ac3a67745b7216f8', 'request_id': 'req-330359bb-214a-48f9-8595-aba7f3fd776c'} {{(pid=101893) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:03:32.127623 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.notifications [None req-330359bb-214a-48f9-8595-aba7f3fd776c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '35cf69f845d340c5ac3a67745b7216f8', 'request_id': 'req-330359bb-214a-48f9-8595-aba7f3fd776c'} {{(pid=101893) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:03:32.135900 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.notifications [None req-330359bb-214a-48f9-8595-aba7f3fd776c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '35cf69f845d340c5ac3a67745b7216f8', 'request_id': 'req-330359bb-214a-48f9-8595-aba7f3fd776c'} {{(pid=101893) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:03:32.172945 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f389b365-ba64-4398-bb91-0760411ffe25 service neutron] Authenticating user token {{(pid=101892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:03:32.174854 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.fernet_utils [None req-f389b365-ba64-4398-bb91-0760411ffe25 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=101892) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:03:32.203352 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f389b365-ba64-4398-bb91-0760411ffe25 service neutron] Validating token access rules against request {{(pid=101892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:03:32.227312 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.notifications [None req-330359bb-214a-48f9-8595-aba7f3fd776c admin admin] The token cache is being invalidate because project 35cf69f845d340c5ac3a67745b7216f8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=101893) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 25 15:03:32.227312 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.notifications [None req-330359bb-214a-48f9-8595-aba7f3fd776c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=101893) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:03:32.227312 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.notifications [None req-330359bb-214a-48f9-8595-aba7f3fd776c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=101893) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:03:32.228760 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 907/1790] 10.222.0.84 () {58 vars in 1232 bytes} [Wed May 25 15:03:31 2022] DELETE /identity/v3/projects/35cf69f845d340c5ac3a67745b7216f8 => generated 0 bytes in 272 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 15:03:32.234018 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61db6cca-9506-47fb-a40d-a9b0e473bc1f None None] REQUEST_METHOD: `POST` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:03:32.235123 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61db6cca-9506-47fb-a40d-a9b0e473bc1f None None] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:03:32.235852 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61db6cca-9506-47fb-a40d-a9b0e473bc1f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:03:32.263552 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.auth.core [None req-61db6cca-9506-47fb-a40d-a9b0e473bc1f None None] MFA Rules not processed for user `05d87e87798e429aa1c10b24391f915e`. Rule list: `[]` (Enabled: `True`). {{(pid=101893) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:03:32.265766 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.fernet_utils [None req-61db6cca-9506-47fb-a40d-a9b0e473bc1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=101893) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:03:32.318447 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb959af8-c598-457c-b7fd-0cdbd8eb6b11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cec56f74b2fa4826a506dc7b919465be', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:03:32.319383 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb959af8-c598-457c-b7fd-0cdbd8eb6b11 admin admin] REQUEST_METHOD: `DELETE` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:03:32.319686 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb959af8-c598-457c-b7fd-0cdbd8eb6b11 admin admin] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:03:32.319975 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb959af8-c598-457c-b7fd-0cdbd8eb6b11 admin admin] PATH_INFO: `/v3/projects/2bdea6bbee624e55b20e831a3a54d18c` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:03:32.321774 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb959af8-c598-457c-b7fd-0cdbd8eb6b11 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2bdea6bbee624e55b20e831a3a54d18c)` {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:03:32.324122 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb959af8-c598-457c-b7fd-0cdbd8eb6b11 admin admin] RBAC: Authorization granted {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:03:32.349329 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG dbcounter [-] [101893] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=101893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:03:32.368262 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 908/1791] 10.222.0.84 () {58 vars in 957 bytes} [Wed May 25 15:03:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 15:03:32.376125 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce93763-176c-4678-a2d9-5f064cc73a4e None None] REQUEST_METHOD: `POST` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:03:32.376460 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce93763-176c-4678-a2d9-5f064cc73a4e None None] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:03:32.376745 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce93763-176c-4678-a2d9-5f064cc73a4e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:03:32.395376 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.auth.core [None req-1ce93763-176c-4678-a2d9-5f064cc73a4e None None] MFA Rules not processed for user `05d87e87798e429aa1c10b24391f915e`. Rule list: `[]` (Enabled: `True`). {{(pid=101893) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:03:32.396664 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.fernet_utils [None req-1ce93763-176c-4678-a2d9-5f064cc73a4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=101893) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:03:32.412124 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 909/1792] 10.222.0.84 () {58 vars in 957 bytes} [Wed May 25 15:03:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 15:03:32.416356 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce93763-176c-4678-a2d9-5f064cc73a4e None None] Authenticating user token {{(pid=101893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:03:32.427474 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce93763-176c-4678-a2d9-5f064cc73a4e None None] Validating token access rules against request {{(pid=101893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:03:32.431820 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.notifications [None req-bb959af8-c598-457c-b7fd-0cdbd8eb6b11 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2bdea6bbee624e55b20e831a3a54d18c', 'request_id': 'req-bb959af8-c598-457c-b7fd-0cdbd8eb6b11'} {{(pid=101892) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:03:32.438112 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.notifications [None req-bb959af8-c598-457c-b7fd-0cdbd8eb6b11 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2bdea6bbee624e55b20e831a3a54d18c', 'request_id': 'req-bb959af8-c598-457c-b7fd-0cdbd8eb6b11'} {{(pid=101892) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:03:32.444145 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.notifications [None req-bb959af8-c598-457c-b7fd-0cdbd8eb6b11 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2bdea6bbee624e55b20e831a3a54d18c', 'request_id': 'req-bb959af8-c598-457c-b7fd-0cdbd8eb6b11'} {{(pid=101892) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:03:32.484640 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc041988-bfcd-452c-9805-2c6fbc215e0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cec56f74b2fa4826a506dc7b919465be', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:03:32.485315 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc041988-bfcd-452c-9805-2c6fbc215e0f admin admin] REQUEST_METHOD: `GET` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:03:32.485602 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc041988-bfcd-452c-9805-2c6fbc215e0f admin admin] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:03:32.485882 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc041988-bfcd-452c-9805-2c6fbc215e0f admin admin] PATH_INFO: `/v3/domains` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:03:32.486611 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc041988-bfcd-452c-9805-2c6fbc215e0f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=101893) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 15:03:32.486924 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc041988-bfcd-452c-9805-2c6fbc215e0f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:03:32.488678 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc041988-bfcd-452c-9805-2c6fbc215e0f admin admin] RBAC: Authorization granted {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:03:32.496413 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.notifications [None req-bb959af8-c598-457c-b7fd-0cdbd8eb6b11 admin admin] The token cache is being invalidate because project 2bdea6bbee624e55b20e831a3a54d18c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=101892) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 25 15:03:32.496709 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.notifications [None req-bb959af8-c598-457c-b7fd-0cdbd8eb6b11 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=101892) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:03:32.497349 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.notifications [None req-bb959af8-c598-457c-b7fd-0cdbd8eb6b11 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=101892) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:03:32.498922 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 884/1793] 10.222.0.84 () {58 vars in 1232 bytes} [Wed May 25 15:03:32 2022] DELETE /identity/v3/projects/2bdea6bbee624e55b20e831a3a54d18c => generated 0 bytes in 327 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 15:03:32.503023 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb959af8-c598-457c-b7fd-0cdbd8eb6b11 admin admin] Authenticating user token {{(pid=101892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:03:32.504225 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 910/1794] 10.222.0.84 () {58 vars in 1152 bytes} [Wed May 25 15:03:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 15:03:32.507689 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.fernet_utils [None req-bb959af8-c598-457c-b7fd-0cdbd8eb6b11 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=101892) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:03:32.508336 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc041988-bfcd-452c-9805-2c6fbc215e0f admin admin] Authenticating user token {{(pid=101893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:03:32.510619 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.fernet_utils [None req-dc041988-bfcd-452c-9805-2c6fbc215e0f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=101893) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:03:32.521047 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb959af8-c598-457c-b7fd-0cdbd8eb6b11 admin admin] Validating token access rules against request {{(pid=101892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:03:32.523005 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc041988-bfcd-452c-9805-2c6fbc215e0f admin admin] Validating token access rules against request {{(pid=101893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:03:32.526019 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8195cce-2d30-4359-8656-46b06571bae1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cec56f74b2fa4826a506dc7b919465be', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:03:32.526934 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8195cce-2d30-4359-8656-46b06571bae1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:03:32.527233 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8195cce-2d30-4359-8656-46b06571bae1 admin admin] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:03:32.532399 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8195cce-2d30-4359-8656-46b06571bae1 admin admin] PATH_INFO: `/v3/users/adccb9335d824286a73ba60a48fb4ce4` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:03:32.532577 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db060fc9-9daf-409c-9703-c46383c2fccb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cec56f74b2fa4826a506dc7b919465be', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:03:32.532577 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db060fc9-9daf-409c-9703-c46383c2fccb admin admin] REQUEST_METHOD: `POST` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:03:32.532739 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8195cce-2d30-4359-8656-46b06571bae1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=adccb9335d824286a73ba60a48fb4ce4)` {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:03:32.532825 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db060fc9-9daf-409c-9703-c46383c2fccb admin admin] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:03:32.532825 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db060fc9-9daf-409c-9703-c46383c2fccb admin admin] PATH_INFO: `/v3/projects` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:03:32.532825 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db060fc9-9daf-409c-9703-c46383c2fccb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:03:32.533020 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8195cce-2d30-4359-8656-46b06571bae1 admin admin] RBAC: Authorization granted {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:03:32.533107 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db060fc9-9daf-409c-9703-c46383c2fccb admin admin] RBAC: Authorization granted {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:03:32.618806 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 911/1795] 10.222.0.84 () {60 vars in 1152 bytes} [Wed May 25 15:03:32 2022] POST /identity/v3/projects => generated 367 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 25 15:03:32.622846 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db060fc9-9daf-409c-9703-c46383c2fccb admin admin] Authenticating user token {{(pid=101893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:03:32.685295 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db060fc9-9daf-409c-9703-c46383c2fccb admin admin] Validating token access rules against request {{(pid=101893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:03:32.689901 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-218f953e-f7ef-47df-9688-da59e3a54f21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cec56f74b2fa4826a506dc7b919465be', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:03:32.690564 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218f953e-f7ef-47df-9688-da59e3a54f21 admin admin] REQUEST_METHOD: `POST` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:03:32.690852 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218f953e-f7ef-47df-9688-da59e3a54f21 admin admin] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:03:32.691139 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218f953e-f7ef-47df-9688-da59e3a54f21 admin admin] PATH_INFO: `/v3/users` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:03:32.691861 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-218f953e-f7ef-47df-9688-da59e3a54f21 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:03:32.693790 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-218f953e-f7ef-47df-9688-da59e3a54f21 admin admin] RBAC: Authorization granted {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:03:32.726810 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG dbcounter [-] [101892] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=101892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:03:32.751970 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.notifications [None req-e8195cce-2d30-4359-8656-46b06571bae1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'adccb9335d824286a73ba60a48fb4ce4'} {{(pid=101892) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:03:32.759951 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.notifications [None req-e8195cce-2d30-4359-8656-46b06571bae1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'adccb9335d824286a73ba60a48fb4ce4'} {{(pid=101892) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:03:32.772779 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.notifications [None req-e8195cce-2d30-4359-8656-46b06571bae1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'adccb9335d824286a73ba60a48fb4ce4'} {{(pid=101892) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:03:32.773505 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.notifications [None req-e8195cce-2d30-4359-8656-46b06571bae1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'adccb9335d824286a73ba60a48fb4ce4'} {{(pid=101892) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:03:32.791801 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 912/1796] 10.222.0.84 () {60 vars in 1143 bytes} [Wed May 25 15:03:32 2022] POST /identity/v3/users => generated 284 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 25 15:03:32.793012 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-218f953e-f7ef-47df-9688-da59e3a54f21 admin admin] Authenticating user token {{(pid=101893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:03:32.803794 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-218f953e-f7ef-47df-9688-da59e3a54f21 admin admin] Validating token access rules against request {{(pid=101893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:03:32.809350 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db7387fb-ab72-47ae-8a21-b25c925fbdca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cec56f74b2fa4826a506dc7b919465be', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:03:32.810035 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7387fb-ab72-47ae-8a21-b25c925fbdca admin admin] REQUEST_METHOD: `GET` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:03:32.810367 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7387fb-ab72-47ae-8a21-b25c925fbdca admin admin] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:03:32.810812 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7387fb-ab72-47ae-8a21-b25c925fbdca admin admin] PATH_INFO: `/v3/roles` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:03:32.811550 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db7387fb-ab72-47ae-8a21-b25c925fbdca admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:03:32.813619 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db7387fb-ab72-47ae-8a21-b25c925fbdca admin admin] RBAC: Authorization granted {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:03:32.821687 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.notifications [None req-e8195cce-2d30-4359-8656-46b06571bae1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'adccb9335d824286a73ba60a48fb4ce4'} {{(pid=101892) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:03:32.827445 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 913/1797] 10.222.0.84 () {58 vars in 1121 bytes} [Wed May 25 15:03:32 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 15:03:32.831376 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 885/1798] 10.222.0.84 () {58 vars in 1223 bytes} [Wed May 25 15:03:32 2022] DELETE /identity/v3/users/adccb9335d824286a73ba60a48fb4ce4 => generated 0 bytes in 328 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 25 15:03:32.832716 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db7387fb-ab72-47ae-8a21-b25c925fbdca admin admin] Authenticating user token {{(pid=101893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:03:32.836368 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.fernet_utils [None req-db7387fb-ab72-47ae-8a21-b25c925fbdca admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=101893) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:03:32.859397 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db7387fb-ab72-47ae-8a21-b25c925fbdca admin admin] Validating token access rules against request {{(pid=101893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:03:32.945452 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56149b20-f6e5-406f-a21c-f0b55886ba27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cec56f74b2fa4826a506dc7b919465be', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:03:32.945452 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56149b20-f6e5-406f-a21c-f0b55886ba27 admin admin] REQUEST_METHOD: `GET` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:03:32.945452 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56149b20-f6e5-406f-a21c-f0b55886ba27 admin admin] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:03:32.945452 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56149b20-f6e5-406f-a21c-f0b55886ba27 admin admin] PATH_INFO: `/v3/roles` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:03:32.945830 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56149b20-f6e5-406f-a21c-f0b55886ba27 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:03:32.945830 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56149b20-f6e5-406f-a21c-f0b55886ba27 admin admin] RBAC: Authorization granted {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:03:32.952591 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 914/1799] 10.222.0.84 () {58 vars in 1121 bytes} [Wed May 25 15:03:32 2022] GET /identity/v3/roles => generated 1420 bytes in 120 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 15:03:32.956876 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8195cce-2d30-4359-8656-46b06571bae1 admin admin] Authenticating user token {{(pid=101892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:03:32.968050 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8195cce-2d30-4359-8656-46b06571bae1 admin admin] Validating token access rules against request {{(pid=101892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:03:32.972941 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a4c7fb5-fd8f-4f1f-831e-4b36f0cc8cc8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cec56f74b2fa4826a506dc7b919465be', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:03:32.973838 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a4c7fb5-fd8f-4f1f-831e-4b36f0cc8cc8 admin admin] REQUEST_METHOD: `PUT` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:03:32.974116 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a4c7fb5-fd8f-4f1f-831e-4b36f0cc8cc8 admin admin] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:03:32.974390 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a4c7fb5-fd8f-4f1f-831e-4b36f0cc8cc8 admin admin] PATH_INFO: `/v3/projects/dde15e88328f4868b8fba4e11c3230e8/users/a76b15b81d4747df87e0f1aa2307e7c1/roles/ff664fa0db7e4262a5accde96c3df4c3` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:03:32.990974 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a4c7fb5-fd8f-4f1f-831e-4b36f0cc8cc8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dde15e88328f4868b8fba4e11c3230e8, user_id=a76b15b81d4747df87e0f1aa2307e7c1, role_id=ff664fa0db7e4262a5accde96c3df4c3)` {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:03:32.993767 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a4c7fb5-fd8f-4f1f-831e-4b36f0cc8cc8 admin admin] RBAC: Authorization granted {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:03:33.005366 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG dbcounter [-] [101893] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=101893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:03:33.057017 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 886/1800] 10.222.0.84 () {60 vars in 1482 bytes} [Wed May 25 15:03:32 2022] PUT /identity/v3/projects/dde15e88328f4868b8fba4e11c3230e8/users/a76b15b81d4747df87e0f1aa2307e7c1/roles/ff664fa0db7e4262a5accde96c3df4c3 => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 15:03:33.069081 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c190474-4bca-4086-9e3b-438ae387efa2 None None] REQUEST_METHOD: `POST` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:03:33.069410 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c190474-4bca-4086-9e3b-438ae387efa2 None None] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:03:33.069734 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c190474-4bca-4086-9e3b-438ae387efa2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:03:33.106882 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.auth.core [None req-4c190474-4bca-4086-9e3b-438ae387efa2 None None] MFA Rules not processed for user `a76b15b81d4747df87e0f1aa2307e7c1`. Rule list: `[]` (Enabled: `True`). {{(pid=101893) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:03:33.108260 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.fernet_utils [None req-4c190474-4bca-4086-9e3b-438ae387efa2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=101893) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:03:33.177611 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 915/1801] 10.222.0.84 () {58 vars in 957 bytes} [Wed May 25 15:03:33 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 15:03:33.184278 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a4c7fb5-fd8f-4f1f-831e-4b36f0cc8cc8 admin admin] Authenticating user token {{(pid=101892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:03:33.281247 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a4c7fb5-fd8f-4f1f-831e-4b36f0cc8cc8 admin admin] Validating token access rules against request {{(pid=101892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:03:33.291451 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c190474-4bca-4086-9e3b-438ae387efa2 None None] Authenticating user token {{(pid=101893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:03:33.293405 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.fernet_utils [None req-4c190474-4bca-4086-9e3b-438ae387efa2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=101893) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:03:33.311352 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c190474-4bca-4086-9e3b-438ae387efa2 None None] Validating token access rules against request {{(pid=101893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:03:33.330251 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b05ff9f-ad96-4b8f-98e5-ea2640cae1ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cec56f74b2fa4826a506dc7b919465be', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:03:33.332635 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b05ff9f-ad96-4b8f-98e5-ea2640cae1ab admin admin] REQUEST_METHOD: `POST` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:03:33.332635 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b05ff9f-ad96-4b8f-98e5-ea2640cae1ab admin admin] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:03:33.332869 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b05ff9f-ad96-4b8f-98e5-ea2640cae1ab admin admin] PATH_INFO: `/v3/projects` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:03:33.334557 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b05ff9f-ad96-4b8f-98e5-ea2640cae1ab admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:03:33.341020 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b05ff9f-ad96-4b8f-98e5-ea2640cae1ab admin admin] RBAC: Authorization granted {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:03:33.345577 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1d702b7-5033-426c-aa58-27150562bbd6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cec56f74b2fa4826a506dc7b919465be', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:03:33.346528 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d702b7-5033-426c-aa58-27150562bbd6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:03:33.348250 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d702b7-5033-426c-aa58-27150562bbd6 admin admin] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:03:33.348535 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d702b7-5033-426c-aa58-27150562bbd6 admin admin] PATH_INFO: `/v3/projects/d1c2334aaa16452c953dfb8d7a6fab43` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:03:33.353359 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1d702b7-5033-426c-aa58-27150562bbd6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d1c2334aaa16452c953dfb8d7a6fab43)` {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:03:33.356036 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1d702b7-5033-426c-aa58-27150562bbd6 admin admin] RBAC: Authorization granted {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:03:33.482301 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 887/1802] 10.222.0.84 () {60 vars in 1152 bytes} [Wed May 25 15:03:33 2022] POST /identity/v3/projects => generated 365 bytes in 299 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 25 15:03:33.486255 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b05ff9f-ad96-4b8f-98e5-ea2640cae1ab admin admin] Authenticating user token {{(pid=101892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:03:33.543878 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.notifications [None req-b1d702b7-5033-426c-aa58-27150562bbd6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd1c2334aaa16452c953dfb8d7a6fab43', 'request_id': 'req-b1d702b7-5033-426c-aa58-27150562bbd6'} {{(pid=101893) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:03:33.563674 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.notifications [None req-b1d702b7-5033-426c-aa58-27150562bbd6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd1c2334aaa16452c953dfb8d7a6fab43', 'request_id': 'req-b1d702b7-5033-426c-aa58-27150562bbd6'} {{(pid=101893) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:03:33.566065 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG dbcounter [-] [101893] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=101893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:03:33.572471 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.notifications [None req-b1d702b7-5033-426c-aa58-27150562bbd6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd1c2334aaa16452c953dfb8d7a6fab43', 'request_id': 'req-b1d702b7-5033-426c-aa58-27150562bbd6'} {{(pid=101893) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:03:33.576491 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b05ff9f-ad96-4b8f-98e5-ea2640cae1ab admin admin] Validating token access rules against request {{(pid=101892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:03:33.624302 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG dbcounter [-] [101892] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=101892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:03:33.642444 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62d2f973-530d-4533-b8fe-1026372d1e45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cec56f74b2fa4826a506dc7b919465be', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:03:33.643179 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d2f973-530d-4533-b8fe-1026372d1e45 admin admin] REQUEST_METHOD: `POST` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:03:33.643470 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d2f973-530d-4533-b8fe-1026372d1e45 admin admin] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:03:33.644287 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d2f973-530d-4533-b8fe-1026372d1e45 admin admin] PATH_INFO: `/v3/users` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:03:33.644562 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62d2f973-530d-4533-b8fe-1026372d1e45 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:03:33.646520 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62d2f973-530d-4533-b8fe-1026372d1e45 admin admin] RBAC: Authorization granted {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:03:33.656734 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.notifications [None req-b1d702b7-5033-426c-aa58-27150562bbd6 admin admin] The token cache is being invalidate because project d1c2334aaa16452c953dfb8d7a6fab43 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=101893) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 25 15:03:33.657036 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.notifications [None req-b1d702b7-5033-426c-aa58-27150562bbd6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=101893) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:03:33.660012 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.notifications [None req-b1d702b7-5033-426c-aa58-27150562bbd6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=101893) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:03:33.667170 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 916/1803] 10.222.0.84 () {58 vars in 1232 bytes} [Wed May 25 15:03:33 2022] DELETE /identity/v3/projects/d1c2334aaa16452c953dfb8d7a6fab43 => generated 0 bytes in 374 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 15:03:33.669106 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0c15cb-aba0-487c-b043-4e7565796ade None None] REQUEST_METHOD: `POST` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:03:33.669475 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0c15cb-aba0-487c-b043-4e7565796ade None None] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:03:33.669850 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0c15cb-aba0-487c-b043-4e7565796ade None None] PATH_INFO: `/v3/auth/tokens` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:03:33.693482 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.auth.core [None req-5a0c15cb-aba0-487c-b043-4e7565796ade None None] MFA Rules not processed for user `05d87e87798e429aa1c10b24391f915e`. Rule list: `[]` (Enabled: `True`). {{(pid=101893) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:03:33.694857 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.fernet_utils [None req-5a0c15cb-aba0-487c-b043-4e7565796ade None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=101893) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:03:33.705889 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 917/1804] 10.222.0.84 () {58 vars in 957 bytes} [Wed May 25 15:03:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 15:03:33.713314 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d98f84-d00b-4e92-9991-bf70e38d1aa0 None None] REQUEST_METHOD: `POST` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:03:33.713660 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d98f84-d00b-4e92-9991-bf70e38d1aa0 None None] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:03:33.715710 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d98f84-d00b-4e92-9991-bf70e38d1aa0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:03:33.732450 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.auth.core [None req-d5d98f84-d00b-4e92-9991-bf70e38d1aa0 None None] MFA Rules not processed for user `05d87e87798e429aa1c10b24391f915e`. Rule list: `[]` (Enabled: `True`). {{(pid=101893) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:03:33.733910 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.fernet_utils [None req-d5d98f84-d00b-4e92-9991-bf70e38d1aa0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=101893) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:03:33.747598 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 888/1805] 10.222.0.84 () {60 vars in 1143 bytes} [Wed May 25 15:03:33 2022] POST /identity/v3/users => generated 289 bytes in 262 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 25 15:03:33.751400 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62d2f973-530d-4533-b8fe-1026372d1e45 admin admin] Authenticating user token {{(pid=101892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:03:33.753301 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.fernet_utils [None req-62d2f973-530d-4533-b8fe-1026372d1e45 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=101892) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:03:33.754838 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 918/1806] 10.222.0.84 () {58 vars in 957 bytes} [Wed May 25 15:03:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 25 15:03:33.761512 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d98f84-d00b-4e92-9991-bf70e38d1aa0 None None] Authenticating user token {{(pid=101893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:03:33.766780 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62d2f973-530d-4533-b8fe-1026372d1e45 admin admin] Validating token access rules against request {{(pid=101892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:03:33.771843 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d98f84-d00b-4e92-9991-bf70e38d1aa0 None None] Validating token access rules against request {{(pid=101893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:03:33.772229 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f8293a6-533f-476b-b5b5-91dec7790e61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cec56f74b2fa4826a506dc7b919465be', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:03:33.773131 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8293a6-533f-476b-b5b5-91dec7790e61 admin admin] REQUEST_METHOD: `GET` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:03:33.773380 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8293a6-533f-476b-b5b5-91dec7790e61 admin admin] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:03:33.773612 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8293a6-533f-476b-b5b5-91dec7790e61 admin admin] PATH_INFO: `/v3/roles` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:03:33.777792 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c4a2bb4-ae0f-4600-8861-2243b40e2fa5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cec56f74b2fa4826a506dc7b919465be', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:03:33.778187 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c4a2bb4-ae0f-4600-8861-2243b40e2fa5 admin admin] REQUEST_METHOD: `GET` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:03:33.778574 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c4a2bb4-ae0f-4600-8861-2243b40e2fa5 admin admin] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:03:33.778854 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c4a2bb4-ae0f-4600-8861-2243b40e2fa5 admin admin] PATH_INFO: `/v3/domains` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:03:33.779603 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c4a2bb4-ae0f-4600-8861-2243b40e2fa5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=101893) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 15:03:33.779921 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c4a2bb4-ae0f-4600-8861-2243b40e2fa5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:03:33.780948 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f8293a6-533f-476b-b5b5-91dec7790e61 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:03:33.782522 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c4a2bb4-ae0f-4600-8861-2243b40e2fa5 admin admin] RBAC: Authorization granted {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:03:33.782665 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f8293a6-533f-476b-b5b5-91dec7790e61 admin admin] RBAC: Authorization granted {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:03:33.809439 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 889/1807] 10.222.0.84 () {58 vars in 1121 bytes} [Wed May 25 15:03:33 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 15:03:33.813358 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f8293a6-533f-476b-b5b5-91dec7790e61 admin admin] Authenticating user token {{(pid=101892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:03:33.824936 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f8293a6-533f-476b-b5b5-91dec7790e61 admin admin] Validating token access rules against request {{(pid=101892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:03:33.826900 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 919/1808] 10.222.0.84 () {58 vars in 1152 bytes} [Wed May 25 15:03:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 15:03:33.830466 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c4a2bb4-ae0f-4600-8861-2243b40e2fa5 admin admin] Authenticating user token {{(pid=101893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:03:33.840595 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f41780c8-34a4-488a-b077-230adb740cf3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cec56f74b2fa4826a506dc7b919465be', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:03:33.841648 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41780c8-34a4-488a-b077-230adb740cf3 admin admin] REQUEST_METHOD: `PUT` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:03:33.842010 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41780c8-34a4-488a-b077-230adb740cf3 admin admin] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:03:33.842395 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41780c8-34a4-488a-b077-230adb740cf3 admin admin] PATH_INFO: `/v3/projects/bcf76d1b454346e4a68b1be5acae9390/users/d9ce2e1055f64138bfac138857dceb1d/roles/a3b78e7d547d4d2d998b4c99a4396bba` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:03:33.842504 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c4a2bb4-ae0f-4600-8861-2243b40e2fa5 admin admin] Validating token access rules against request {{(pid=101893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:03:33.848306 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15c973eb-405d-431a-a9c2-5ef43ddf4403 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cec56f74b2fa4826a506dc7b919465be', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:03:33.849002 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c973eb-405d-431a-a9c2-5ef43ddf4403 admin admin] REQUEST_METHOD: `POST` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:03:33.849294 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c973eb-405d-431a-a9c2-5ef43ddf4403 admin admin] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:03:33.849580 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c973eb-405d-431a-a9c2-5ef43ddf4403 admin admin] PATH_INFO: `/v3/projects` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:03:33.850285 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15c973eb-405d-431a-a9c2-5ef43ddf4403 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:03:33.852390 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15c973eb-405d-431a-a9c2-5ef43ddf4403 admin admin] RBAC: Authorization granted {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:03:33.876305 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f41780c8-34a4-488a-b077-230adb740cf3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bcf76d1b454346e4a68b1be5acae9390, user_id=d9ce2e1055f64138bfac138857dceb1d, role_id=a3b78e7d547d4d2d998b4c99a4396bba)` {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:03:33.879718 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f41780c8-34a4-488a-b077-230adb740cf3 admin admin] RBAC: Authorization granted {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:03:33.991496 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 920/1809] 10.222.0.84 () {60 vars in 1152 bytes} [Wed May 25 15:03:33 2022] POST /identity/v3/projects => generated 383 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 25 15:03:33.996384 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15c973eb-405d-431a-a9c2-5ef43ddf4403 admin admin] Authenticating user token {{(pid=101893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:03:33.998114 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 890/1810] 10.222.0.84 () {60 vars in 1482 bytes} [Wed May 25 15:03:33 2022] PUT /identity/v3/projects/bcf76d1b454346e4a68b1be5acae9390/users/d9ce2e1055f64138bfac138857dceb1d/roles/a3b78e7d547d4d2d998b4c99a4396bba => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 15:03:34.001850 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f41780c8-34a4-488a-b077-230adb740cf3 admin admin] Authenticating user token {{(pid=101892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:03:34.102914 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15c973eb-405d-431a-a9c2-5ef43ddf4403 admin admin] Validating token access rules against request {{(pid=101893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:03:34.108338 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0d4279c-5489-4090-8ca4-8ad341ef559e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cec56f74b2fa4826a506dc7b919465be', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:03:34.109369 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d4279c-5489-4090-8ca4-8ad341ef559e admin admin] REQUEST_METHOD: `POST` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:03:34.109866 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d4279c-5489-4090-8ca4-8ad341ef559e admin admin] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:03:34.110354 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d4279c-5489-4090-8ca4-8ad341ef559e admin admin] PATH_INFO: `/v3/users` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:03:34.111644 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0d4279c-5489-4090-8ca4-8ad341ef559e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:03:34.113991 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0d4279c-5489-4090-8ca4-8ad341ef559e admin admin] RBAC: Authorization granted {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:03:34.131548 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f41780c8-34a4-488a-b077-230adb740cf3 admin admin] Validating token access rules against request {{(pid=101892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:03:34.142521 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99645c7d-0438-4e3e-a203-f125d71c3438 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cec56f74b2fa4826a506dc7b919465be', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:03:34.143242 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99645c7d-0438-4e3e-a203-f125d71c3438 admin admin] REQUEST_METHOD: `GET` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:03:34.143533 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99645c7d-0438-4e3e-a203-f125d71c3438 admin admin] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:03:34.143884 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99645c7d-0438-4e3e-a203-f125d71c3438 admin admin] PATH_INFO: `/v3/roles` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:03:34.144634 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99645c7d-0438-4e3e-a203-f125d71c3438 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:03:34.146339 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99645c7d-0438-4e3e-a203-f125d71c3438 admin admin] RBAC: Authorization granted {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:03:34.158101 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 891/1811] 10.222.0.84 () {58 vars in 1121 bytes} [Wed May 25 15:03:34 2022] GET /identity/v3/roles => generated 1420 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 15:03:34.162245 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99645c7d-0438-4e3e-a203-f125d71c3438 admin admin] Authenticating user token {{(pid=101892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:03:34.172691 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99645c7d-0438-4e3e-a203-f125d71c3438 admin admin] Validating token access rules against request {{(pid=101892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:03:34.178684 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0afd835e-118b-4792-b055-ce73df217500 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cec56f74b2fa4826a506dc7b919465be', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:03:34.179644 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0afd835e-118b-4792-b055-ce73df217500 admin admin] REQUEST_METHOD: `PUT` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:03:34.179957 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0afd835e-118b-4792-b055-ce73df217500 admin admin] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:03:34.181166 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0afd835e-118b-4792-b055-ce73df217500 admin admin] PATH_INFO: `/v3/projects/bcf76d1b454346e4a68b1be5acae9390/users/d9ce2e1055f64138bfac138857dceb1d/roles/a3b78e7d547d4d2d998b4c99a4396bba` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:03:34.184321 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0afd835e-118b-4792-b055-ce73df217500 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bcf76d1b454346e4a68b1be5acae9390, user_id=d9ce2e1055f64138bfac138857dceb1d, role_id=a3b78e7d547d4d2d998b4c99a4396bba)` {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:03:34.187263 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0afd835e-118b-4792-b055-ce73df217500 admin admin] RBAC: Authorization granted {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:03:34.198698 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 892/1812] 10.222.0.84 () {60 vars in 1482 bytes} [Wed May 25 15:03:34 2022] PUT /identity/v3/projects/bcf76d1b454346e4a68b1be5acae9390/users/d9ce2e1055f64138bfac138857dceb1d/roles/a3b78e7d547d4d2d998b4c99a4396bba => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 25 15:03:34.209869 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7aeedc-e216-4794-bfd9-4d9906b570ca None None] REQUEST_METHOD: `POST` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:03:34.210179 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7aeedc-e216-4794-bfd9-4d9906b570ca None None] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:03:34.210539 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7aeedc-e216-4794-bfd9-4d9906b570ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:03:34.241246 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 921/1813] 10.222.0.84 () {60 vars in 1143 bytes} [Wed May 25 15:03:33 2022] POST /identity/v3/users => generated 292 bytes in 246 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 15:03:34.246034 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0d4279c-5489-4090-8ca4-8ad341ef559e admin admin] Authenticating user token {{(pid=101893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:03:34.258562 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.auth.core [None req-ab7aeedc-e216-4794-bfd9-4d9906b570ca None None] MFA Rules not processed for user `d9ce2e1055f64138bfac138857dceb1d`. Rule list: `[]` (Enabled: `True`). {{(pid=101892) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:03:34.259839 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.fernet_utils [None req-ab7aeedc-e216-4794-bfd9-4d9906b570ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=101892) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:03:34.264316 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0d4279c-5489-4090-8ca4-8ad341ef559e admin admin] Validating token access rules against request {{(pid=101893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:03:34.384558 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6178e859-28f1-4098-9859-4e3a5a15922c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cec56f74b2fa4826a506dc7b919465be', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:03:34.387798 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6178e859-28f1-4098-9859-4e3a5a15922c admin admin] REQUEST_METHOD: `GET` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:03:34.387908 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 893/1814] 10.222.0.84 () {58 vars in 957 bytes} [Wed May 25 15:03:34 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 25 15:03:34.388015 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6178e859-28f1-4098-9859-4e3a5a15922c admin admin] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:03:34.388015 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6178e859-28f1-4098-9859-4e3a5a15922c admin admin] PATH_INFO: `/v3/roles` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:03:34.388015 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6178e859-28f1-4098-9859-4e3a5a15922c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:03:34.388987 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6178e859-28f1-4098-9859-4e3a5a15922c admin admin] RBAC: Authorization granted {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:03:34.400218 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab7aeedc-e216-4794-bfd9-4d9906b570ca None None] Authenticating user token {{(pid=101892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:03:34.401969 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.fernet_utils [None req-ab7aeedc-e216-4794-bfd9-4d9906b570ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=101892) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:03:34.402416 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 922/1815] 10.222.0.84 () {58 vars in 1121 bytes} [Wed May 25 15:03:34 2022] GET /identity/v3/roles => generated 1420 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 15:03:34.406335 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6178e859-28f1-4098-9859-4e3a5a15922c admin admin] Authenticating user token {{(pid=101893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:03:34.418328 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6178e859-28f1-4098-9859-4e3a5a15922c admin admin] Validating token access rules against request {{(pid=101893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:03:34.423768 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-255912d6-d3e0-45f2-93b9-b29575d5b1c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cec56f74b2fa4826a506dc7b919465be', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:03:34.424797 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255912d6-d3e0-45f2-93b9-b29575d5b1c9 admin admin] REQUEST_METHOD: `GET` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:03:34.427733 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255912d6-d3e0-45f2-93b9-b29575d5b1c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:03:34.432360 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255912d6-d3e0-45f2-93b9-b29575d5b1c9 admin admin] PATH_INFO: `/v3/roles` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:03:34.432360 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-255912d6-d3e0-45f2-93b9-b29575d5b1c9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:03:34.432360 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-255912d6-d3e0-45f2-93b9-b29575d5b1c9 admin admin] RBAC: Authorization granted {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:03:34.444984 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 923/1816] 10.222.0.84 () {58 vars in 1121 bytes} [Wed May 25 15:03:34 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 25 15:03:34.448963 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-255912d6-d3e0-45f2-93b9-b29575d5b1c9 admin admin] Authenticating user token {{(pid=101893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:03:34.464728 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-255912d6-d3e0-45f2-93b9-b29575d5b1c9 admin admin] Validating token access rules against request {{(pid=101893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:03:34.467014 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f003369a-35b6-477d-82fd-dbf3ce715d2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cec56f74b2fa4826a506dc7b919465be', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:03:34.467897 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f003369a-35b6-477d-82fd-dbf3ce715d2d admin admin] REQUEST_METHOD: `PUT` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:03:34.468179 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f003369a-35b6-477d-82fd-dbf3ce715d2d admin admin] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:03:34.468459 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f003369a-35b6-477d-82fd-dbf3ce715d2d admin admin] PATH_INFO: `/v3/projects/233c152aa08d4c5389e8dcf45960f9a9/users/904b086715004a529d70b872c4586484/roles/ff664fa0db7e4262a5accde96c3df4c3` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:03:34.490307 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab7aeedc-e216-4794-bfd9-4d9906b570ca None None] Validating token access rules against request {{(pid=101892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:03:34.496820 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ae86571-43bb-4536-8621-858f899afa07 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e079f89a5e524ab6ad4183e4f690de07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a000829c658c4a7cab67f7b6353ba3fa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:03:34.497578 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae86571-43bb-4536-8621-858f899afa07 service cinder] REQUEST_METHOD: `GET` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:03:34.497861 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae86571-43bb-4536-8621-858f899afa07 service cinder] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:03:34.498166 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae86571-43bb-4536-8621-858f899afa07 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:03:34.498769 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f003369a-35b6-477d-82fd-dbf3ce715d2d admin admin] RBAC: Authorizing `identity:create_grant(project_id=233c152aa08d4c5389e8dcf45960f9a9, user_id=904b086715004a529d70b872c4586484, role_id=ff664fa0db7e4262a5accde96c3df4c3)` {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:03:34.501849 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f003369a-35b6-477d-82fd-dbf3ce715d2d admin admin] RBAC: Authorization granted {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:03:34.512517 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ae86571-43bb-4536-8621-858f899afa07 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:03:34.514123 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ae86571-43bb-4536-8621-858f899afa07 service cinder] RBAC: Authorization granted {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:03:34.527328 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 894/1817] 10.222.0.84 () {60 vars in 1365 bytes} [Wed May 25 15:03:34 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 128 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 15:03:34.606121 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 924/1818] 10.222.0.84 () {60 vars in 1482 bytes} [Wed May 25 15:03:34 2022] PUT /identity/v3/projects/233c152aa08d4c5389e8dcf45960f9a9/users/904b086715004a529d70b872c4586484/roles/ff664fa0db7e4262a5accde96c3df4c3 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 15:03:34.618519 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd3c722-92d5-4ecc-90f4-fa13503fc76b None None] REQUEST_METHOD: `POST` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:03:34.618891 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd3c722-92d5-4ecc-90f4-fa13503fc76b None None] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:03:34.619284 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd3c722-92d5-4ecc-90f4-fa13503fc76b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:03:34.656684 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f003369a-35b6-477d-82fd-dbf3ce715d2d admin admin] Authenticating user token {{(pid=101893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:03:34.657914 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.auth.core [None req-4dd3c722-92d5-4ecc-90f4-fa13503fc76b None None] MFA Rules not processed for user `904b086715004a529d70b872c4586484`. Rule list: `[]` (Enabled: `True`). {{(pid=101892) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:03:34.659250 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.fernet_utils [None req-4dd3c722-92d5-4ecc-90f4-fa13503fc76b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=101892) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:03:34.659388 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.fernet_utils [None req-f003369a-35b6-477d-82fd-dbf3ce715d2d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=101893) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:03:34.738529 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f003369a-35b6-477d-82fd-dbf3ce715d2d admin admin] Validating token access rules against request {{(pid=101893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:03:34.742907 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a16b85e-7e65-45c1-87d2-81068b3f5590 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e079f89a5e524ab6ad4183e4f690de07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a000829c658c4a7cab67f7b6353ba3fa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:03:34.743774 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a16b85e-7e65-45c1-87d2-81068b3f5590 service cinder] REQUEST_METHOD: `GET` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:03:34.744236 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a16b85e-7e65-45c1-87d2-81068b3f5590 service cinder] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:03:34.744467 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a16b85e-7e65-45c1-87d2-81068b3f5590 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:03:34.748079 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.fernet_utils [None req-2a16b85e-7e65-45c1-87d2-81068b3f5590 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=101893) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:03:34.748595 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 895/1819] 10.222.0.84 () {58 vars in 957 bytes} [Wed May 25 15:03:34 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 15:03:34.753611 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dd3c722-92d5-4ecc-90f4-fa13503fc76b None None] Authenticating user token {{(pid=101892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:03:34.785338 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG dbcounter [-] [101893] Writing DB stats keystone:DELETE=15,keystone:SELECT=83,keystone:INSERT=2 {{(pid=101893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:03:34.830252 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dd3c722-92d5-4ecc-90f4-fa13503fc76b None None] Validating token access rules against request {{(pid=101892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:03:34.833869 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a16b85e-7e65-45c1-87d2-81068b3f5590 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:03:34.835313 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a16b85e-7e65-45c1-87d2-81068b3f5590 service cinder] RBAC: Authorization granted {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:03:34.839628 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aefdca5-b66a-4aff-a1f1-130516377ba5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cec56f74b2fa4826a506dc7b919465be', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:03:34.840484 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aefdca5-b66a-4aff-a1f1-130516377ba5 admin admin] REQUEST_METHOD: `POST` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:03:34.840839 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aefdca5-b66a-4aff-a1f1-130516377ba5 admin admin] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:03:34.841192 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aefdca5-b66a-4aff-a1f1-130516377ba5 admin admin] PATH_INFO: `/v3/projects` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:03:34.841976 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aefdca5-b66a-4aff-a1f1-130516377ba5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:03:34.844875 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aefdca5-b66a-4aff-a1f1-130516377ba5 admin admin] RBAC: Authorization granted {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:03:34.848696 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 925/1820] 10.222.0.84 () {60 vars in 1365 bytes} [Wed May 25 15:03:34 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 193 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 15:03:34.926946 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 896/1821] 10.222.0.84 () {60 vars in 1152 bytes} [Wed May 25 15:03:34 2022] POST /identity/v3/projects => generated 383 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 25 15:03:34.931175 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a16b85e-7e65-45c1-87d2-81068b3f5590 service cinder] Authenticating user token {{(pid=101893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:03:34.942103 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a16b85e-7e65-45c1-87d2-81068b3f5590 service cinder] Validating token access rules against request {{(pid=101893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:03:35.006702 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffd72630-cf90-4e61-b41c-0a5e83b85d38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cec56f74b2fa4826a506dc7b919465be', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:03:35.007308 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd72630-cf90-4e61-b41c-0a5e83b85d38 admin admin] REQUEST_METHOD: `POST` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:03:35.007652 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd72630-cf90-4e61-b41c-0a5e83b85d38 admin admin] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:03:35.007941 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd72630-cf90-4e61-b41c-0a5e83b85d38 admin admin] PATH_INFO: `/v3/users` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:03:35.009170 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffd72630-cf90-4e61-b41c-0a5e83b85d38 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:03:35.011147 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffd72630-cf90-4e61-b41c-0a5e83b85d38 admin admin] RBAC: Authorization granted {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:03:35.130822 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 926/1822] 10.222.0.84 () {60 vars in 1143 bytes} [Wed May 25 15:03:34 2022] POST /identity/v3/users => generated 298 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 15:03:35.134819 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aefdca5-b66a-4aff-a1f1-130516377ba5 admin admin] Authenticating user token {{(pid=101892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:03:35.145015 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aefdca5-b66a-4aff-a1f1-130516377ba5 admin admin] Validating token access rules against request {{(pid=101892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:03:35.149967 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d785e5-d9c4-49a1-80ca-01e82591d8df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cec56f74b2fa4826a506dc7b919465be', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:03:35.150655 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d785e5-d9c4-49a1-80ca-01e82591d8df admin admin] REQUEST_METHOD: `GET` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:03:35.150938 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d785e5-d9c4-49a1-80ca-01e82591d8df admin admin] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:03:35.151215 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d785e5-d9c4-49a1-80ca-01e82591d8df admin admin] PATH_INFO: `/v3/roles` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:03:35.151997 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8d785e5-d9c4-49a1-80ca-01e82591d8df admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:03:35.153594 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8d785e5-d9c4-49a1-80ca-01e82591d8df admin admin] RBAC: Authorization granted {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:03:35.163830 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 897/1823] 10.222.0.84 () {58 vars in 1121 bytes} [Wed May 25 15:03:35 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 15:03:35.168397 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffd72630-cf90-4e61-b41c-0a5e83b85d38 admin admin] Authenticating user token {{(pid=101893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:03:35.178767 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffd72630-cf90-4e61-b41c-0a5e83b85d38 admin admin] Validating token access rules against request {{(pid=101893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:03:35.183704 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-241b88fe-fde3-4ff5-8683-b01da4cd0ddf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cec56f74b2fa4826a506dc7b919465be', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:03:35.184613 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241b88fe-fde3-4ff5-8683-b01da4cd0ddf admin admin] REQUEST_METHOD: `PUT` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:03:35.184893 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241b88fe-fde3-4ff5-8683-b01da4cd0ddf admin admin] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:03:35.185204 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241b88fe-fde3-4ff5-8683-b01da4cd0ddf admin admin] PATH_INFO: `/v3/projects/49beaead4d5b47cca7c00c4c93eecb02/users/94e6387b28ad4bba910cbbf937296065/roles/a3b78e7d547d4d2d998b4c99a4396bba` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:03:35.200031 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-241b88fe-fde3-4ff5-8683-b01da4cd0ddf admin admin] RBAC: Authorizing `identity:create_grant(project_id=49beaead4d5b47cca7c00c4c93eecb02, user_id=94e6387b28ad4bba910cbbf937296065, role_id=a3b78e7d547d4d2d998b4c99a4396bba)` {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:03:35.202990 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-241b88fe-fde3-4ff5-8683-b01da4cd0ddf admin admin] RBAC: Authorization granted {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:03:35.302091 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 927/1824] 10.222.0.84 () {60 vars in 1482 bytes} [Wed May 25 15:03:35 2022] PUT /identity/v3/projects/49beaead4d5b47cca7c00c4c93eecb02/users/94e6387b28ad4bba910cbbf937296065/roles/a3b78e7d547d4d2d998b4c99a4396bba => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 15:03:35.306459 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d785e5-d9c4-49a1-80ca-01e82591d8df admin admin] Authenticating user token {{(pid=101892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:03:35.317683 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d785e5-d9c4-49a1-80ca-01e82591d8df admin admin] Validating token access rules against request {{(pid=101892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:03:35.387280 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d34953c-b2a7-4b34-b808-87b21b580992 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cec56f74b2fa4826a506dc7b919465be', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:03:35.388085 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d34953c-b2a7-4b34-b808-87b21b580992 admin admin] REQUEST_METHOD: `GET` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:03:35.388449 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d34953c-b2a7-4b34-b808-87b21b580992 admin admin] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:03:35.388730 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d34953c-b2a7-4b34-b808-87b21b580992 admin admin] PATH_INFO: `/v3/roles` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:03:35.389519 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d34953c-b2a7-4b34-b808-87b21b580992 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:03:35.391313 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d34953c-b2a7-4b34-b808-87b21b580992 admin admin] RBAC: Authorization granted {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:03:35.404768 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 898/1825] 10.222.0.84 () {58 vars in 1121 bytes} [Wed May 25 15:03:35 2022] GET /identity/v3/roles => generated 1420 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 15:03:35.412157 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-241b88fe-fde3-4ff5-8683-b01da4cd0ddf admin admin] Authenticating user token {{(pid=101893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:03:35.424762 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-241b88fe-fde3-4ff5-8683-b01da4cd0ddf admin admin] Validating token access rules against request {{(pid=101893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:03:35.440613 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13bfd0c6-3bc3-41b4-b2dc-8eafc9e0e62f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cec56f74b2fa4826a506dc7b919465be', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:03:35.441631 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13bfd0c6-3bc3-41b4-b2dc-8eafc9e0e62f admin admin] REQUEST_METHOD: `PUT` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:03:35.441985 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13bfd0c6-3bc3-41b4-b2dc-8eafc9e0e62f admin admin] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:03:35.443518 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13bfd0c6-3bc3-41b4-b2dc-8eafc9e0e62f admin admin] PATH_INFO: `/v3/projects/49beaead4d5b47cca7c00c4c93eecb02/users/94e6387b28ad4bba910cbbf937296065/roles/a3b78e7d547d4d2d998b4c99a4396bba` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:03:35.445372 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13bfd0c6-3bc3-41b4-b2dc-8eafc9e0e62f admin admin] RBAC: Authorizing `identity:create_grant(project_id=49beaead4d5b47cca7c00c4c93eecb02, user_id=94e6387b28ad4bba910cbbf937296065, role_id=a3b78e7d547d4d2d998b4c99a4396bba)` {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:03:35.448406 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13bfd0c6-3bc3-41b4-b2dc-8eafc9e0e62f admin admin] RBAC: Authorization granted {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:03:35.461120 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 928/1826] 10.222.0.84 () {60 vars in 1482 bytes} [Wed May 25 15:03:35 2022] PUT /identity/v3/projects/49beaead4d5b47cca7c00c4c93eecb02/users/94e6387b28ad4bba910cbbf937296065/roles/a3b78e7d547d4d2d998b4c99a4396bba => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 25 15:03:35.473483 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96982ae-b6ed-44f2-983e-c15bdb533625 None None] REQUEST_METHOD: `POST` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:03:35.473870 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96982ae-b6ed-44f2-983e-c15bdb533625 None None] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:03:35.474155 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96982ae-b6ed-44f2-983e-c15bdb533625 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:03:35.512997 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.auth.core [None req-d96982ae-b6ed-44f2-983e-c15bdb533625 None None] MFA Rules not processed for user `94e6387b28ad4bba910cbbf937296065`. Rule list: `[]` (Enabled: `True`). {{(pid=101892) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:03:35.530256 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.fernet_utils [None req-d96982ae-b6ed-44f2-983e-c15bdb533625 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=101892) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:03:35.677950 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 899/1827] 10.222.0.84 () {58 vars in 957 bytes} [Wed May 25 15:03:35 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 25 15:03:35.692863 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13bfd0c6-3bc3-41b4-b2dc-8eafc9e0e62f admin admin] Authenticating user token {{(pid=101893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:03:35.750253 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13bfd0c6-3bc3-41b4-b2dc-8eafc9e0e62f admin admin] Validating token access rules against request {{(pid=101893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:03:35.753979 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd44471d-f549-4c7b-9208-1ff7c2b4af56 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e079f89a5e524ab6ad4183e4f690de07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a000829c658c4a7cab67f7b6353ba3fa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:03:35.754622 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd44471d-f549-4c7b-9208-1ff7c2b4af56 service cinder] REQUEST_METHOD: `GET` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:03:35.754906 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd44471d-f549-4c7b-9208-1ff7c2b4af56 service cinder] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:03:35.755186 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd44471d-f549-4c7b-9208-1ff7c2b4af56 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:03:35.764881 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd44471d-f549-4c7b-9208-1ff7c2b4af56 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:03:35.766315 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd44471d-f549-4c7b-9208-1ff7c2b4af56 service cinder] RBAC: Authorization granted {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:03:35.776585 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 929/1828] 10.222.0.84 () {60 vars in 1365 bytes} [Wed May 25 15:03:35 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 15:03:35.902227 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG dbcounter [-] [101892] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=101892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:03:35.958320 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d96982ae-b6ed-44f2-983e-c15bdb533625 None None] Authenticating user token {{(pid=101892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:03:35.968729 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d96982ae-b6ed-44f2-983e-c15bdb533625 None None] Validating token access rules against request {{(pid=101892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:03:35.973224 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-209b2595-6291-4f0b-95ce-d36d0f10d98d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e079f89a5e524ab6ad4183e4f690de07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a000829c658c4a7cab67f7b6353ba3fa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:03:35.974090 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209b2595-6291-4f0b-95ce-d36d0f10d98d service cinder] REQUEST_METHOD: `GET` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:03:35.974441 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209b2595-6291-4f0b-95ce-d36d0f10d98d service cinder] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:03:35.974830 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209b2595-6291-4f0b-95ce-d36d0f10d98d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:03:36.037629 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-209b2595-6291-4f0b-95ce-d36d0f10d98d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:03:36.039041 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-209b2595-6291-4f0b-95ce-d36d0f10d98d service cinder] RBAC: Authorization granted {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:03:36.048943 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 900/1829] 10.222.0.84 () {60 vars in 1365 bytes} [Wed May 25 15:03:35 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 15:03:36.515504 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd44471d-f549-4c7b-9208-1ff7c2b4af56 service cinder] Authenticating user token {{(pid=101893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:03:36.584781 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd44471d-f549-4c7b-9208-1ff7c2b4af56 service cinder] Validating token access rules against request {{(pid=101893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:03:36.589630 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2c369c5-7643-4d03-8025-8427191933cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cec56f74b2fa4826a506dc7b919465be', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:03:36.590503 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c369c5-7643-4d03-8025-8427191933cf admin admin] REQUEST_METHOD: `DELETE` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:03:36.590786 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c369c5-7643-4d03-8025-8427191933cf admin admin] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:03:36.591066 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c369c5-7643-4d03-8025-8427191933cf admin admin] PATH_INFO: `/v3/users/904b086715004a529d70b872c4586484` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:03:36.592406 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2c369c5-7643-4d03-8025-8427191933cf admin admin] RBAC: Authorizing `identity:delete_user(user_id=904b086715004a529d70b872c4586484)` {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:03:36.594315 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2c369c5-7643-4d03-8025-8427191933cf admin admin] RBAC: Authorization granted {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:03:36.787372 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.notifications [None req-c2c369c5-7643-4d03-8025-8427191933cf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '904b086715004a529d70b872c4586484'} {{(pid=101893) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:03:36.795955 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.notifications [None req-c2c369c5-7643-4d03-8025-8427191933cf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '904b086715004a529d70b872c4586484'} {{(pid=101893) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:03:36.807851 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.notifications [None req-c2c369c5-7643-4d03-8025-8427191933cf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '904b086715004a529d70b872c4586484'} {{(pid=101893) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:03:36.808611 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.notifications [None req-c2c369c5-7643-4d03-8025-8427191933cf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '904b086715004a529d70b872c4586484'} {{(pid=101893) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:03:36.809232 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.notifications [None req-c2c369c5-7643-4d03-8025-8427191933cf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '904b086715004a529d70b872c4586484'} {{(pid=101893) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:03:36.879485 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 930/1830] 10.222.0.84 () {58 vars in 1223 bytes} [Wed May 25 15:03:36 2022] DELETE /identity/v3/users/904b086715004a529d70b872c4586484 => generated 0 bytes in 364 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 25 15:03:36.884221 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb6f110-f59e-44b2-aef7-88e2cbd1632e None None] REQUEST_METHOD: `POST` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:03:36.884520 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb6f110-f59e-44b2-aef7-88e2cbd1632e None None] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:03:36.884807 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb6f110-f59e-44b2-aef7-88e2cbd1632e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:03:36.903424 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.auth.core [None req-feb6f110-f59e-44b2-aef7-88e2cbd1632e None None] MFA Rules not processed for user `05d87e87798e429aa1c10b24391f915e`. Rule list: `[]` (Enabled: `True`). {{(pid=101892) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:03:36.905314 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.fernet_utils [None req-feb6f110-f59e-44b2-aef7-88e2cbd1632e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=101892) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:03:36.919116 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG dbcounter [-] [101893] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=101893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:03:36.965166 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 901/1831] 10.222.0.84 () {58 vars in 957 bytes} [Wed May 25 15:03:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 25 15:03:36.974954 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2c369c5-7643-4d03-8025-8427191933cf admin admin] Authenticating user token {{(pid=101893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:03:36.977155 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.fernet_utils [None req-c2c369c5-7643-4d03-8025-8427191933cf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=101893) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:03:37.036461 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2c369c5-7643-4d03-8025-8427191933cf admin admin] Validating token access rules against request {{(pid=101893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:03:37.041064 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0d16adc-1cc9-4fb9-96c3-c9d8a87feefc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ce28b25b907473588ccb87dc4acc06a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a000829c658c4a7cab67f7b6353ba3fa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:03:37.041825 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d16adc-1cc9-4fb9-96c3-c9d8a87feefc service neutron] REQUEST_METHOD: `GET` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:03:37.042023 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d16adc-1cc9-4fb9-96c3-c9d8a87feefc service neutron] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:03:37.042306 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d16adc-1cc9-4fb9-96c3-c9d8a87feefc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:03:37.057361 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0d16adc-1cc9-4fb9-96c3-c9d8a87feefc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:03:37.058860 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0d16adc-1cc9-4fb9-96c3-c9d8a87feefc service neutron] RBAC: Authorization granted {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:03:37.071813 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 931/1832] 10.222.0.84 () {60 vars in 1365 bytes} [Wed May 25 15:03:36 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 25 15:03:37.594358 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feb6f110-f59e-44b2-aef7-88e2cbd1632e None None] Authenticating user token {{(pid=101892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:03:37.596210 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.fernet_utils [None req-feb6f110-f59e-44b2-aef7-88e2cbd1632e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=101892) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:03:37.652153 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feb6f110-f59e-44b2-aef7-88e2cbd1632e None None] Validating token access rules against request {{(pid=101892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:03:37.668183 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba98deb-11ad-4fdf-bed6-bbd1357b6bf1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cec56f74b2fa4826a506dc7b919465be', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:03:37.672936 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba98deb-11ad-4fdf-bed6-bbd1357b6bf1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:03:37.674509 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba98deb-11ad-4fdf-bed6-bbd1357b6bf1 admin admin] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:03:37.676407 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba98deb-11ad-4fdf-bed6-bbd1357b6bf1 admin admin] PATH_INFO: `/v3/projects/233c152aa08d4c5389e8dcf45960f9a9` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:03:37.684326 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bba98deb-11ad-4fdf-bed6-bbd1357b6bf1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=233c152aa08d4c5389e8dcf45960f9a9)` {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:03:37.688056 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bba98deb-11ad-4fdf-bed6-bbd1357b6bf1 admin admin] RBAC: Authorization granted {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:03:37.802594 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.notifications [None req-bba98deb-11ad-4fdf-bed6-bbd1357b6bf1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '233c152aa08d4c5389e8dcf45960f9a9', 'request_id': 'req-bba98deb-11ad-4fdf-bed6-bbd1357b6bf1'} {{(pid=101892) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:03:37.811421 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.notifications [None req-bba98deb-11ad-4fdf-bed6-bbd1357b6bf1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '233c152aa08d4c5389e8dcf45960f9a9', 'request_id': 'req-bba98deb-11ad-4fdf-bed6-bbd1357b6bf1'} {{(pid=101892) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:03:37.818146 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.notifications [None req-bba98deb-11ad-4fdf-bed6-bbd1357b6bf1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '233c152aa08d4c5389e8dcf45960f9a9', 'request_id': 'req-bba98deb-11ad-4fdf-bed6-bbd1357b6bf1'} {{(pid=101892) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:03:37.837185 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG dbcounter [-] [101892] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=101892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:03:37.921613 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.notifications [None req-bba98deb-11ad-4fdf-bed6-bbd1357b6bf1 admin admin] The token cache is being invalidate because project 233c152aa08d4c5389e8dcf45960f9a9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=101892) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 25 15:03:37.921613 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.notifications [None req-bba98deb-11ad-4fdf-bed6-bbd1357b6bf1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=101892) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:03:37.922691 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.notifications [None req-bba98deb-11ad-4fdf-bed6-bbd1357b6bf1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=101892) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:03:37.925019 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 902/1833] 10.222.0.84 () {58 vars in 1232 bytes} [Wed May 25 15:03:37 2022] DELETE /identity/v3/projects/233c152aa08d4c5389e8dcf45960f9a9 => generated 0 bytes in 331 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 15:03:37.928876 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0d16adc-1cc9-4fb9-96c3-c9d8a87feefc service neutron] Authenticating user token {{(pid=101893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:03:37.943176 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0d16adc-1cc9-4fb9-96c3-c9d8a87feefc service neutron] Validating token access rules against request {{(pid=101893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:03:38.017814 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc6a1d1a-6add-43dc-8748-1fb873c5ba47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cec56f74b2fa4826a506dc7b919465be', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:03:38.019138 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6a1d1a-6add-43dc-8748-1fb873c5ba47 admin admin] REQUEST_METHOD: `DELETE` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:03:38.019430 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6a1d1a-6add-43dc-8748-1fb873c5ba47 admin admin] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:03:38.019745 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6a1d1a-6add-43dc-8748-1fb873c5ba47 admin admin] PATH_INFO: `/v3/users/94e6387b28ad4bba910cbbf937296065` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:03:38.021182 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc6a1d1a-6add-43dc-8748-1fb873c5ba47 admin admin] RBAC: Authorizing `identity:delete_user(user_id=94e6387b28ad4bba910cbbf937296065)` {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:03:38.023146 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc6a1d1a-6add-43dc-8748-1fb873c5ba47 admin admin] RBAC: Authorization granted {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:03:38.027904 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG dbcounter [-] [101893] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=101893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:03:38.179697 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.notifications [None req-fc6a1d1a-6add-43dc-8748-1fb873c5ba47 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '94e6387b28ad4bba910cbbf937296065'} {{(pid=101893) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:03:38.187321 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.notifications [None req-fc6a1d1a-6add-43dc-8748-1fb873c5ba47 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '94e6387b28ad4bba910cbbf937296065'} {{(pid=101893) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:03:38.200853 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.notifications [None req-fc6a1d1a-6add-43dc-8748-1fb873c5ba47 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '94e6387b28ad4bba910cbbf937296065'} {{(pid=101893) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:03:38.201830 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.notifications [None req-fc6a1d1a-6add-43dc-8748-1fb873c5ba47 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '94e6387b28ad4bba910cbbf937296065'} {{(pid=101893) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:03:38.202527 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.notifications [None req-fc6a1d1a-6add-43dc-8748-1fb873c5ba47 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '94e6387b28ad4bba910cbbf937296065'} {{(pid=101893) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:03:38.275080 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 932/1834] 10.222.0.84 () {58 vars in 1223 bytes} [Wed May 25 15:03:37 2022] DELETE /identity/v3/users/94e6387b28ad4bba910cbbf937296065 => generated 0 bytes in 342 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 15:03:38.707877 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG dbcounter [-] [101892] Writing DB stats keystone:SELECT=94,keystone:DELETE=3,keystone:INSERT=3 {{(pid=101892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:03:38.808344 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG dbcounter [-] [101893] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=101893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:03:39.025330 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba98deb-11ad-4fdf-bed6-bbd1357b6bf1 admin admin] Authenticating user token {{(pid=101892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:03:39.027330 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.fernet_utils [None req-bba98deb-11ad-4fdf-bed6-bbd1357b6bf1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=101892) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:03:39.042288 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba98deb-11ad-4fdf-bed6-bbd1357b6bf1 admin admin] Validating token access rules against request {{(pid=101892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:03:39.132136 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7653f6d7-b3b1-4b56-8d48-29b34a180ff5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cec56f74b2fa4826a506dc7b919465be', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:03:39.133185 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7653f6d7-b3b1-4b56-8d48-29b34a180ff5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:03:39.133563 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7653f6d7-b3b1-4b56-8d48-29b34a180ff5 admin admin] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:03:39.133917 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7653f6d7-b3b1-4b56-8d48-29b34a180ff5 admin admin] PATH_INFO: `/v3/projects/49beaead4d5b47cca7c00c4c93eecb02` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:03:39.137611 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7653f6d7-b3b1-4b56-8d48-29b34a180ff5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=49beaead4d5b47cca7c00c4c93eecb02)` {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:03:39.142954 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7653f6d7-b3b1-4b56-8d48-29b34a180ff5 admin admin] RBAC: Authorization granted {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:03:39.272130 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.notifications [None req-7653f6d7-b3b1-4b56-8d48-29b34a180ff5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '49beaead4d5b47cca7c00c4c93eecb02', 'request_id': 'req-7653f6d7-b3b1-4b56-8d48-29b34a180ff5'} {{(pid=101892) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:03:39.279754 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.notifications [None req-7653f6d7-b3b1-4b56-8d48-29b34a180ff5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '49beaead4d5b47cca7c00c4c93eecb02', 'request_id': 'req-7653f6d7-b3b1-4b56-8d48-29b34a180ff5'} {{(pid=101892) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:03:39.286098 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.notifications [None req-7653f6d7-b3b1-4b56-8d48-29b34a180ff5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '49beaead4d5b47cca7c00c4c93eecb02', 'request_id': 'req-7653f6d7-b3b1-4b56-8d48-29b34a180ff5'} {{(pid=101892) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:03:39.416975 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.notifications [None req-7653f6d7-b3b1-4b56-8d48-29b34a180ff5 admin admin] The token cache is being invalidate because project 49beaead4d5b47cca7c00c4c93eecb02 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=101892) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 25 15:03:39.417288 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.notifications [None req-7653f6d7-b3b1-4b56-8d48-29b34a180ff5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=101892) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:03:39.418130 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.notifications [None req-7653f6d7-b3b1-4b56-8d48-29b34a180ff5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=101892) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:03:39.420522 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 903/1835] 10.222.0.84 () {58 vars in 1232 bytes} [Wed May 25 15:03:39 2022] DELETE /identity/v3/projects/49beaead4d5b47cca7c00c4c93eecb02 => generated 0 bytes in 397 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 25 15:03:39.425554 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57dd969a-dd6a-44ab-b57c-112476b4895b None None] REQUEST_METHOD: `POST` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:03:39.426013 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57dd969a-dd6a-44ab-b57c-112476b4895b None None] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:03:39.426322 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57dd969a-dd6a-44ab-b57c-112476b4895b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:03:39.450633 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.auth.core [None req-57dd969a-dd6a-44ab-b57c-112476b4895b None None] MFA Rules not processed for user `05d87e87798e429aa1c10b24391f915e`. Rule list: `[]` (Enabled: `True`). {{(pid=101893) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:03:39.452469 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.fernet_utils [None req-57dd969a-dd6a-44ab-b57c-112476b4895b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=101893) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:03:39.552629 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 933/1836] 10.222.0.84 () {58 vars in 957 bytes} [Wed May 25 15:03:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 15:03:39.567231 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f102f4-dbc1-423e-871b-af5def442541 None None] REQUEST_METHOD: `POST` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:03:39.567709 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f102f4-dbc1-423e-871b-af5def442541 None None] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:03:39.568397 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f102f4-dbc1-423e-871b-af5def442541 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:03:39.594001 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.auth.core [None req-71f102f4-dbc1-423e-871b-af5def442541 None None] MFA Rules not processed for user `05d87e87798e429aa1c10b24391f915e`. Rule list: `[]` (Enabled: `True`). {{(pid=101892) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:03:39.595399 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.fernet_utils [None req-71f102f4-dbc1-423e-871b-af5def442541 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=101892) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:03:39.604951 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 904/1837] 10.222.0.84 () {58 vars in 957 bytes} [Wed May 25 15:03:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 15:03:39.609522 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57dd969a-dd6a-44ab-b57c-112476b4895b None None] Authenticating user token {{(pid=101893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:03:39.622024 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57dd969a-dd6a-44ab-b57c-112476b4895b None None] Validating token access rules against request {{(pid=101893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:03:39.632230 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-865e2de1-35e0-4742-ad8e-5495e786dec9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cec56f74b2fa4826a506dc7b919465be', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:03:39.632930 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865e2de1-35e0-4742-ad8e-5495e786dec9 admin admin] REQUEST_METHOD: `GET` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:03:39.638058 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865e2de1-35e0-4742-ad8e-5495e786dec9 admin admin] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:03:39.638515 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865e2de1-35e0-4742-ad8e-5495e786dec9 admin admin] PATH_INFO: `/v3/domains` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:03:39.639440 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-865e2de1-35e0-4742-ad8e-5495e786dec9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=101893) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 15:03:39.639951 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-865e2de1-35e0-4742-ad8e-5495e786dec9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:03:39.642249 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-865e2de1-35e0-4742-ad8e-5495e786dec9 admin admin] RBAC: Authorization granted {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:03:39.657649 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 934/1838] 10.222.0.84 () {58 vars in 1152 bytes} [Wed May 25 15:03:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 15:03:39.661931 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f102f4-dbc1-423e-871b-af5def442541 None None] Authenticating user token {{(pid=101892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:03:39.668944 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG dbcounter [-] [101893] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=101893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:03:39.676586 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f102f4-dbc1-423e-871b-af5def442541 None None] Validating token access rules against request {{(pid=101892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:03:39.686416 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5bdaadd-44d1-40d3-b981-74ed28109fcf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cec56f74b2fa4826a506dc7b919465be', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:03:39.687460 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5bdaadd-44d1-40d3-b981-74ed28109fcf admin admin] REQUEST_METHOD: `POST` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:03:39.687865 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5bdaadd-44d1-40d3-b981-74ed28109fcf admin admin] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:03:39.688339 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5bdaadd-44d1-40d3-b981-74ed28109fcf admin admin] PATH_INFO: `/v3/projects` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:03:39.691076 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5bdaadd-44d1-40d3-b981-74ed28109fcf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:03:39.693349 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5bdaadd-44d1-40d3-b981-74ed28109fcf admin admin] RBAC: Authorization granted {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:03:39.802686 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 905/1839] 10.222.0.84 () {60 vars in 1152 bytes} [Wed May 25 15:03:39 2022] POST /identity/v3/projects => generated 369 bytes in 141 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 15:03:39.807490 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-865e2de1-35e0-4742-ad8e-5495e786dec9 admin admin] Authenticating user token {{(pid=101893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:03:39.826661 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-865e2de1-35e0-4742-ad8e-5495e786dec9 admin admin] Validating token access rules against request {{(pid=101893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:03:39.865348 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG dbcounter [-] [101892] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=101892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:03:39.925226 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7edb1ae-e0a0-4aee-b820-4b4d8c371450 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cec56f74b2fa4826a506dc7b919465be', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:03:39.926399 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7edb1ae-e0a0-4aee-b820-4b4d8c371450 admin admin] REQUEST_METHOD: `POST` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:03:39.926931 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7edb1ae-e0a0-4aee-b820-4b4d8c371450 admin admin] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:03:39.927380 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7edb1ae-e0a0-4aee-b820-4b4d8c371450 admin admin] PATH_INFO: `/v3/users` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:03:39.928562 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7edb1ae-e0a0-4aee-b820-4b4d8c371450 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:03:39.932361 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7edb1ae-e0a0-4aee-b820-4b4d8c371450 admin admin] RBAC: Authorization granted {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:03:40.016015 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 935/1840] 10.222.0.84 () {60 vars in 1143 bytes} [Wed May 25 15:03:39 2022] POST /identity/v3/users => generated 285 bytes in 208 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 15:03:40.019333 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5bdaadd-44d1-40d3-b981-74ed28109fcf admin admin] Authenticating user token {{(pid=101892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:03:40.031295 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5bdaadd-44d1-40d3-b981-74ed28109fcf admin admin] Validating token access rules against request {{(pid=101892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:03:40.037144 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba66f64c-7288-429a-8ae6-c44cfde15d46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cec56f74b2fa4826a506dc7b919465be', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:03:40.037980 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba66f64c-7288-429a-8ae6-c44cfde15d46 admin admin] REQUEST_METHOD: `GET` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:03:40.038395 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba66f64c-7288-429a-8ae6-c44cfde15d46 admin admin] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:03:40.038991 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba66f64c-7288-429a-8ae6-c44cfde15d46 admin admin] PATH_INFO: `/v3/roles` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:03:40.040266 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba66f64c-7288-429a-8ae6-c44cfde15d46 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:03:40.041910 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba66f64c-7288-429a-8ae6-c44cfde15d46 admin admin] RBAC: Authorization granted {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:03:40.057220 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 906/1841] 10.222.0.84 () {58 vars in 1121 bytes} [Wed May 25 15:03:40 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 15:03:40.061202 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7edb1ae-e0a0-4aee-b820-4b4d8c371450 admin admin] Authenticating user token {{(pid=101893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:03:40.071304 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7edb1ae-e0a0-4aee-b820-4b4d8c371450 admin admin] Validating token access rules against request {{(pid=101893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:03:40.076939 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a10b508c-e989-4665-bec5-a18e2f05b559 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cec56f74b2fa4826a506dc7b919465be', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:03:40.077811 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10b508c-e989-4665-bec5-a18e2f05b559 admin admin] REQUEST_METHOD: `GET` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:03:40.078346 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10b508c-e989-4665-bec5-a18e2f05b559 admin admin] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:03:40.078830 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10b508c-e989-4665-bec5-a18e2f05b559 admin admin] PATH_INFO: `/v3/roles` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:03:40.080902 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a10b508c-e989-4665-bec5-a18e2f05b559 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:03:40.081956 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a10b508c-e989-4665-bec5-a18e2f05b559 admin admin] RBAC: Authorization granted {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:03:40.092435 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 936/1842] 10.222.0.84 () {58 vars in 1121 bytes} [Wed May 25 15:03:40 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 25 15:03:40.096600 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba66f64c-7288-429a-8ae6-c44cfde15d46 admin admin] Authenticating user token {{(pid=101892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:03:40.107636 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba66f64c-7288-429a-8ae6-c44cfde15d46 admin admin] Validating token access rules against request {{(pid=101892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:03:40.114013 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e0bc5ef-f72d-4ee0-b2d6-f2fb856a156a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cec56f74b2fa4826a506dc7b919465be', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:03:40.114970 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0bc5ef-f72d-4ee0-b2d6-f2fb856a156a admin admin] REQUEST_METHOD: `PUT` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:03:40.115322 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0bc5ef-f72d-4ee0-b2d6-f2fb856a156a admin admin] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:03:40.115711 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0bc5ef-f72d-4ee0-b2d6-f2fb856a156a admin admin] PATH_INFO: `/v3/projects/2fad216b9ab04ff3b56880b0f689b748/users/cda62ae16d144dc3a3a866a061994568/roles/ff664fa0db7e4262a5accde96c3df4c3` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:03:40.131310 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e0bc5ef-f72d-4ee0-b2d6-f2fb856a156a admin admin] RBAC: Authorizing `identity:create_grant(project_id=2fad216b9ab04ff3b56880b0f689b748, user_id=cda62ae16d144dc3a3a866a061994568, role_id=ff664fa0db7e4262a5accde96c3df4c3)` {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:03:40.134118 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e0bc5ef-f72d-4ee0-b2d6-f2fb856a156a admin admin] RBAC: Authorization granted {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:03:40.173593 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a10b508c-e989-4665-bec5-a18e2f05b559 admin admin] Authenticating user token {{(pid=101893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:03:40.176068 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.fernet_utils [None req-a10b508c-e989-4665-bec5-a18e2f05b559 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=101893) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:03:40.189551 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a10b508c-e989-4665-bec5-a18e2f05b559 admin admin] Validating token access rules against request {{(pid=101893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:03:40.194508 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96e0c2cd-604e-4c02-a0b1-46bb3c5b879b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cec56f74b2fa4826a506dc7b919465be', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:03:40.195498 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e0c2cd-604e-4c02-a0b1-46bb3c5b879b admin admin] REQUEST_METHOD: `DELETE` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:03:40.195968 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e0c2cd-604e-4c02-a0b1-46bb3c5b879b admin admin] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:03:40.196355 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e0c2cd-604e-4c02-a0b1-46bb3c5b879b admin admin] PATH_INFO: `/v3/users/a76b15b81d4747df87e0f1aa2307e7c1` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:03:40.197667 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96e0c2cd-604e-4c02-a0b1-46bb3c5b879b admin admin] RBAC: Authorizing `identity:delete_user(user_id=a76b15b81d4747df87e0f1aa2307e7c1)` {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:03:40.199706 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96e0c2cd-604e-4c02-a0b1-46bb3c5b879b admin admin] RBAC: Authorization granted {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:03:40.207072 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 907/1843] 10.222.0.84 () {60 vars in 1482 bytes} [Wed May 25 15:03:40 2022] PUT /identity/v3/projects/2fad216b9ab04ff3b56880b0f689b748/users/cda62ae16d144dc3a3a866a061994568/roles/ff664fa0db7e4262a5accde96c3df4c3 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 15:03:40.217076 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56592816-e761-43ce-a8a0-87231e00f416 None None] REQUEST_METHOD: `POST` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:03:40.217366 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56592816-e761-43ce-a8a0-87231e00f416 None None] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:03:40.217915 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56592816-e761-43ce-a8a0-87231e00f416 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:03:40.247646 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.auth.core [None req-56592816-e761-43ce-a8a0-87231e00f416 None None] MFA Rules not processed for user `cda62ae16d144dc3a3a866a061994568`. Rule list: `[]` (Enabled: `True`). {{(pid=101892) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:03:40.249003 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.fernet_utils [None req-56592816-e761-43ce-a8a0-87231e00f416 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=101892) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:03:40.318028 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 908/1844] 10.222.0.84 () {58 vars in 957 bytes} [Wed May 25 15:03:40 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 25 15:03:40.329923 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56592816-e761-43ce-a8a0-87231e00f416 None None] Authenticating user token {{(pid=101892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:03:40.331349 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.fernet_utils [None req-56592816-e761-43ce-a8a0-87231e00f416 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=101892) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:03:40.343036 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.notifications [None req-96e0c2cd-604e-4c02-a0b1-46bb3c5b879b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a76b15b81d4747df87e0f1aa2307e7c1'} {{(pid=101893) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:03:40.354663 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.notifications [None req-96e0c2cd-604e-4c02-a0b1-46bb3c5b879b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a76b15b81d4747df87e0f1aa2307e7c1'} {{(pid=101893) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:03:40.366026 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG dbcounter [-] [101893] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=101893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:03:40.370580 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.notifications [None req-96e0c2cd-604e-4c02-a0b1-46bb3c5b879b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a76b15b81d4747df87e0f1aa2307e7c1'} {{(pid=101893) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:03:40.371592 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.notifications [None req-96e0c2cd-604e-4c02-a0b1-46bb3c5b879b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a76b15b81d4747df87e0f1aa2307e7c1'} {{(pid=101893) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:03:40.372490 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.notifications [None req-96e0c2cd-604e-4c02-a0b1-46bb3c5b879b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a76b15b81d4747df87e0f1aa2307e7c1'} {{(pid=101893) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:03:40.396878 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56592816-e761-43ce-a8a0-87231e00f416 None None] Validating token access rules against request {{(pid=101892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:03:40.401870 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba615b53-8d1b-487f-85a5-fa3dbc56d4d7 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '971542599734491aa112b815fc4cc5c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a000829c658c4a7cab67f7b6353ba3fa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:03:40.402980 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba615b53-8d1b-487f-85a5-fa3dbc56d4d7 service glance] REQUEST_METHOD: `GET` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:03:40.403474 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba615b53-8d1b-487f-85a5-fa3dbc56d4d7 service glance] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:03:40.403935 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba615b53-8d1b-487f-85a5-fa3dbc56d4d7 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:03:40.406321 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.fernet_utils [None req-ba615b53-8d1b-487f-85a5-fa3dbc56d4d7 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=101892) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:03:40.419749 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 937/1845] 10.222.0.84 () {58 vars in 1223 bytes} [Wed May 25 15:03:40 2022] DELETE /identity/v3/users/a76b15b81d4747df87e0f1aa2307e7c1 => generated 0 bytes in 246 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 25 15:03:40.424056 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba615b53-8d1b-487f-85a5-fa3dbc56d4d7 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:03:40.426440 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f45933-d3eb-419b-b685-e538624ebf99 None None] REQUEST_METHOD: `POST` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:03:40.426901 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba615b53-8d1b-487f-85a5-fa3dbc56d4d7 service glance] RBAC: Authorization granted {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:03:40.427010 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f45933-d3eb-419b-b685-e538624ebf99 None None] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:03:40.427457 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f45933-d3eb-419b-b685-e538624ebf99 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:03:40.442789 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG dbcounter [-] [101892] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=101892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:03:40.445559 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 909/1846] 10.222.0.84 () {60 vars in 1365 bytes} [Wed May 25 15:03:40 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 25 15:03:40.455507 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.auth.core [None req-a9f45933-d3eb-419b-b685-e538624ebf99 None None] MFA Rules not processed for user `05d87e87798e429aa1c10b24391f915e`. Rule list: `[]` (Enabled: `True`). {{(pid=101893) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:03:40.456791 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.fernet_utils [None req-a9f45933-d3eb-419b-b685-e538624ebf99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=101893) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:03:40.524856 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 938/1847] 10.222.0.84 () {58 vars in 957 bytes} [Wed May 25 15:03:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 15:03:40.535549 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba615b53-8d1b-487f-85a5-fa3dbc56d4d7 service glance] Authenticating user token {{(pid=101892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:03:40.537002 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.fernet_utils [None req-ba615b53-8d1b-487f-85a5-fa3dbc56d4d7 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=101892) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:03:40.594319 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG dbcounter [-] [101892] Writing DB stats keystone:SELECT=100 {{(pid=101892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:03:40.633360 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba615b53-8d1b-487f-85a5-fa3dbc56d4d7 service glance] Validating token access rules against request {{(pid=101892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:03:40.658286 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG dbcounter [-] [101893] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=101893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:03:40.687683 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG dbcounter [-] [101892] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=101892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:03:40.701689 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f2dc327-b27d-4c99-a6e9-ccfdc7ecc54a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ce28b25b907473588ccb87dc4acc06a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a000829c658c4a7cab67f7b6353ba3fa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:03:40.702373 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2dc327-b27d-4c99-a6e9-ccfdc7ecc54a service neutron] REQUEST_METHOD: `GET` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:03:40.702722 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2dc327-b27d-4c99-a6e9-ccfdc7ecc54a service neutron] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:03:40.703692 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2dc327-b27d-4c99-a6e9-ccfdc7ecc54a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:03:40.717528 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f2dc327-b27d-4c99-a6e9-ccfdc7ecc54a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:03:40.719628 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f2dc327-b27d-4c99-a6e9-ccfdc7ecc54a service neutron] RBAC: Authorization granted {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:03:40.731974 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 910/1848] 10.222.0.84 () {60 vars in 1365 bytes} [Wed May 25 15:03:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 197 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 25 15:03:41.090719 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG dbcounter [-] [101893] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=101893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:03:41.147618 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG dbcounter [-] [101892] Writing DB stats keystone:SELECT=94,keystone:DELETE=3,keystone:INSERT=3 {{(pid=101892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:03:41.195492 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9f45933-d3eb-419b-b685-e538624ebf99 None None] Authenticating user token {{(pid=101893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:03:41.197734 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.fernet_utils [None req-a9f45933-d3eb-419b-b685-e538624ebf99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=101893) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:03:41.211344 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9f45933-d3eb-419b-b685-e538624ebf99 None None] Validating token access rules against request {{(pid=101893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:03:41.228021 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1bc1760-9aa4-412b-b3c1-7ef058d92265 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cec56f74b2fa4826a506dc7b919465be', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:03:41.229018 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1bc1760-9aa4-412b-b3c1-7ef058d92265 admin admin] REQUEST_METHOD: `DELETE` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:03:41.229262 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1bc1760-9aa4-412b-b3c1-7ef058d92265 admin admin] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:03:41.229553 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1bc1760-9aa4-412b-b3c1-7ef058d92265 admin admin] PATH_INFO: `/v3/projects/dde15e88328f4868b8fba4e11c3230e8` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:03:41.230758 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1bc1760-9aa4-412b-b3c1-7ef058d92265 admin admin] RBAC: Authorizing `identity:delete_project(project_id=dde15e88328f4868b8fba4e11c3230e8)` {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:03:41.232888 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1bc1760-9aa4-412b-b3c1-7ef058d92265 admin admin] RBAC: Authorization granted {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:03:41.333680 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.notifications [None req-e1bc1760-9aa4-412b-b3c1-7ef058d92265 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dde15e88328f4868b8fba4e11c3230e8', 'request_id': 'req-e1bc1760-9aa4-412b-b3c1-7ef058d92265'} {{(pid=101893) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:03:41.340999 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.notifications [None req-e1bc1760-9aa4-412b-b3c1-7ef058d92265 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dde15e88328f4868b8fba4e11c3230e8', 'request_id': 'req-e1bc1760-9aa4-412b-b3c1-7ef058d92265'} {{(pid=101893) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:03:41.347662 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.notifications [None req-e1bc1760-9aa4-412b-b3c1-7ef058d92265 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dde15e88328f4868b8fba4e11c3230e8', 'request_id': 'req-e1bc1760-9aa4-412b-b3c1-7ef058d92265'} {{(pid=101893) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:03:41.434484 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.notifications [None req-e1bc1760-9aa4-412b-b3c1-7ef058d92265 admin admin] The token cache is being invalidate because project dde15e88328f4868b8fba4e11c3230e8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=101893) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 25 15:03:41.435089 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.notifications [None req-e1bc1760-9aa4-412b-b3c1-7ef058d92265 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=101893) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:03:41.435787 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.notifications [None req-e1bc1760-9aa4-412b-b3c1-7ef058d92265 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=101893) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:03:41.437471 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 939/1849] 10.222.0.84 () {58 vars in 1232 bytes} [Wed May 25 15:03:41 2022] DELETE /identity/v3/projects/dde15e88328f4868b8fba4e11c3230e8 => generated 0 bytes in 242 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 15:03:41.441516 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f2dc327-b27d-4c99-a6e9-ccfdc7ecc54a service neutron] Authenticating user token {{(pid=101892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:03:41.453464 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f2dc327-b27d-4c99-a6e9-ccfdc7ecc54a service neutron] Validating token access rules against request {{(pid=101892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:03:41.514287 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2afd4a7-153c-4282-8dd8-38cc4742d73d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cec56f74b2fa4826a506dc7b919465be', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:03:41.515083 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2afd4a7-153c-4282-8dd8-38cc4742d73d admin admin] REQUEST_METHOD: `DELETE` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:03:41.515368 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2afd4a7-153c-4282-8dd8-38cc4742d73d admin admin] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:03:41.515687 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2afd4a7-153c-4282-8dd8-38cc4742d73d admin admin] PATH_INFO: `/v3/users/d9ce2e1055f64138bfac138857dceb1d` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:03:41.516863 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2afd4a7-153c-4282-8dd8-38cc4742d73d admin admin] RBAC: Authorizing `identity:delete_user(user_id=d9ce2e1055f64138bfac138857dceb1d)` {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:03:41.518855 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2afd4a7-153c-4282-8dd8-38cc4742d73d admin admin] RBAC: Authorization granted {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:03:41.723115 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.notifications [None req-b2afd4a7-153c-4282-8dd8-38cc4742d73d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd9ce2e1055f64138bfac138857dceb1d'} {{(pid=101892) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:03:41.731646 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.notifications [None req-b2afd4a7-153c-4282-8dd8-38cc4742d73d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd9ce2e1055f64138bfac138857dceb1d'} {{(pid=101892) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:03:41.739119 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG dbcounter [-] [101892] Writing DB stats keystone:SELECT=92,keystone:DELETE=8 {{(pid=101892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:03:41.746135 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.notifications [None req-b2afd4a7-153c-4282-8dd8-38cc4742d73d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd9ce2e1055f64138bfac138857dceb1d'} {{(pid=101892) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:03:41.746945 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.notifications [None req-b2afd4a7-153c-4282-8dd8-38cc4742d73d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd9ce2e1055f64138bfac138857dceb1d'} {{(pid=101892) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:03:41.881179 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.notifications [None req-b2afd4a7-153c-4282-8dd8-38cc4742d73d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd9ce2e1055f64138bfac138857dceb1d'} {{(pid=101892) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:03:41.892718 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 911/1850] 10.222.0.84 () {58 vars in 1223 bytes} [Wed May 25 15:03:41 2022] DELETE /identity/v3/users/d9ce2e1055f64138bfac138857dceb1d => generated 0 bytes in 452 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 25 15:03:42.580226 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1bc1760-9aa4-412b-b3c1-7ef058d92265 admin admin] Authenticating user token {{(pid=101893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:03:42.582250 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.fernet_utils [None req-e1bc1760-9aa4-412b-b3c1-7ef058d92265 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=101893) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:03:42.596841 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1bc1760-9aa4-412b-b3c1-7ef058d92265 admin admin] Validating token access rules against request {{(pid=101893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:03:42.658905 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59cff73b-a131-401b-9f5b-7ebb2413ae0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cec56f74b2fa4826a506dc7b919465be', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:03:42.659820 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59cff73b-a131-401b-9f5b-7ebb2413ae0f admin admin] REQUEST_METHOD: `DELETE` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:03:42.660104 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59cff73b-a131-401b-9f5b-7ebb2413ae0f admin admin] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:03:42.660381 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59cff73b-a131-401b-9f5b-7ebb2413ae0f admin admin] PATH_INFO: `/v3/projects/bcf76d1b454346e4a68b1be5acae9390` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:03:42.661589 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59cff73b-a131-401b-9f5b-7ebb2413ae0f admin admin] RBAC: Authorizing `identity:delete_project(project_id=bcf76d1b454346e4a68b1be5acae9390)` {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:03:42.663526 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59cff73b-a131-401b-9f5b-7ebb2413ae0f admin admin] RBAC: Authorization granted {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:03:42.771385 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.notifications [None req-59cff73b-a131-401b-9f5b-7ebb2413ae0f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bcf76d1b454346e4a68b1be5acae9390', 'request_id': 'req-59cff73b-a131-401b-9f5b-7ebb2413ae0f'} {{(pid=101893) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:03:42.778992 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.notifications [None req-59cff73b-a131-401b-9f5b-7ebb2413ae0f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bcf76d1b454346e4a68b1be5acae9390', 'request_id': 'req-59cff73b-a131-401b-9f5b-7ebb2413ae0f'} {{(pid=101893) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:03:42.785323 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.notifications [None req-59cff73b-a131-401b-9f5b-7ebb2413ae0f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bcf76d1b454346e4a68b1be5acae9390', 'request_id': 'req-59cff73b-a131-401b-9f5b-7ebb2413ae0f'} {{(pid=101893) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:03:42.841157 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG dbcounter [-] [101893] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=101893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:03:42.845929 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.notifications [None req-59cff73b-a131-401b-9f5b-7ebb2413ae0f admin admin] The token cache is being invalidate because project bcf76d1b454346e4a68b1be5acae9390 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=101893) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 25 15:03:42.846298 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.notifications [None req-59cff73b-a131-401b-9f5b-7ebb2413ae0f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=101893) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:03:42.846926 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.notifications [None req-59cff73b-a131-401b-9f5b-7ebb2413ae0f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=101893) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:03:42.848596 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 940/1851] 10.222.0.84 () {58 vars in 1232 bytes} [Wed May 25 15:03:42 2022] DELETE /identity/v3/projects/bcf76d1b454346e4a68b1be5acae9390 => generated 0 bytes in 269 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 15:03:42.854168 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96d8f27-f019-48f5-97a9-4c015e26fc3d None None] REQUEST_METHOD: `POST` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:03:42.855020 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96d8f27-f019-48f5-97a9-4c015e26fc3d None None] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:03:42.855300 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96d8f27-f019-48f5-97a9-4c015e26fc3d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:03:42.873486 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.auth.core [None req-b96d8f27-f019-48f5-97a9-4c015e26fc3d None None] MFA Rules not processed for user `05d87e87798e429aa1c10b24391f915e`. Rule list: `[]` (Enabled: `True`). {{(pid=101892) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:03:42.874703 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.fernet_utils [None req-b96d8f27-f019-48f5-97a9-4c015e26fc3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=101892) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:03:42.936011 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 912/1852] 10.222.0.84 () {58 vars in 957 bytes} [Wed May 25 15:03:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 15:03:42.943843 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a92ea1-a72a-41f2-b6bb-a35d39a8c183 None None] REQUEST_METHOD: `POST` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:03:42.944135 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a92ea1-a72a-41f2-b6bb-a35d39a8c183 None None] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:03:42.944417 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a92ea1-a72a-41f2-b6bb-a35d39a8c183 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:03:42.964810 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.auth.core [None req-b7a92ea1-a72a-41f2-b6bb-a35d39a8c183 None None] MFA Rules not processed for user `05d87e87798e429aa1c10b24391f915e`. Rule list: `[]` (Enabled: `True`). {{(pid=101893) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:03:42.966052 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.fernet_utils [None req-b7a92ea1-a72a-41f2-b6bb-a35d39a8c183 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=101893) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:03:42.974537 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 941/1853] 10.222.0.84 () {58 vars in 957 bytes} [Wed May 25 15:03:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 15:03:42.979526 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b96d8f27-f019-48f5-97a9-4c015e26fc3d None None] Authenticating user token {{(pid=101892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:03:42.989135 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b96d8f27-f019-48f5-97a9-4c015e26fc3d None None] Validating token access rules against request {{(pid=101892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:03:42.993793 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b73a31e2-5416-4d36-8a9b-1f15288d5868 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cec56f74b2fa4826a506dc7b919465be', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:03:42.994449 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73a31e2-5416-4d36-8a9b-1f15288d5868 admin admin] REQUEST_METHOD: `GET` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:03:42.994738 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73a31e2-5416-4d36-8a9b-1f15288d5868 admin admin] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:03:42.995021 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73a31e2-5416-4d36-8a9b-1f15288d5868 admin admin] PATH_INFO: `/v3/domains` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:03:42.995796 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b73a31e2-5416-4d36-8a9b-1f15288d5868 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=101892) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 15:03:42.996109 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b73a31e2-5416-4d36-8a9b-1f15288d5868 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:03:42.997714 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b73a31e2-5416-4d36-8a9b-1f15288d5868 admin admin] RBAC: Authorization granted {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:03:43.009216 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 913/1854] 10.222.0.84 () {58 vars in 1152 bytes} [Wed May 25 15:03:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 15:03:43.013484 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a92ea1-a72a-41f2-b6bb-a35d39a8c183 None None] Authenticating user token {{(pid=101893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:03:43.023027 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a92ea1-a72a-41f2-b6bb-a35d39a8c183 None None] Validating token access rules against request {{(pid=101893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:03:43.031771 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e70545db-108e-46a5-b853-1192e16b600c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cec56f74b2fa4826a506dc7b919465be', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:03:43.032488 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70545db-108e-46a5-b853-1192e16b600c admin admin] REQUEST_METHOD: `POST` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:03:43.032773 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70545db-108e-46a5-b853-1192e16b600c admin admin] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:03:43.033069 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70545db-108e-46a5-b853-1192e16b600c admin admin] PATH_INFO: `/v3/projects` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:03:43.033803 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e70545db-108e-46a5-b853-1192e16b600c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:03:43.035848 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e70545db-108e-46a5-b853-1192e16b600c admin admin] RBAC: Authorization granted {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:03:43.114977 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 942/1855] 10.222.0.84 () {60 vars in 1152 bytes} [Wed May 25 15:03:43 2022] POST /identity/v3/projects => generated 381 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 25 15:03:43.119356 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b73a31e2-5416-4d36-8a9b-1f15288d5868 admin admin] Authenticating user token {{(pid=101892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:03:43.129426 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b73a31e2-5416-4d36-8a9b-1f15288d5868 admin admin] Validating token access rules against request {{(pid=101892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:03:43.197137 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76057973-6307-4199-a87a-054d4fd2c1a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cec56f74b2fa4826a506dc7b919465be', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:03:43.197808 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76057973-6307-4199-a87a-054d4fd2c1a1 admin admin] REQUEST_METHOD: `POST` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:03:43.198089 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76057973-6307-4199-a87a-054d4fd2c1a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:03:43.198364 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76057973-6307-4199-a87a-054d4fd2c1a1 admin admin] PATH_INFO: `/v3/users` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:03:43.199053 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76057973-6307-4199-a87a-054d4fd2c1a1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:03:43.200996 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76057973-6307-4199-a87a-054d4fd2c1a1 admin admin] RBAC: Authorization granted {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:03:43.316371 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 914/1856] 10.222.0.84 () {60 vars in 1143 bytes} [Wed May 25 15:03:43 2022] POST /identity/v3/users => generated 291 bytes in 198 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 15:03:43.320979 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e70545db-108e-46a5-b853-1192e16b600c admin admin] Authenticating user token {{(pid=101893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:03:43.332574 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e70545db-108e-46a5-b853-1192e16b600c admin admin] Validating token access rules against request {{(pid=101893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:03:43.337282 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d3dcedf-f8cb-4b18-81e9-48a8973ada63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cec56f74b2fa4826a506dc7b919465be', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:03:43.337974 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3dcedf-f8cb-4b18-81e9-48a8973ada63 admin admin] REQUEST_METHOD: `GET` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:03:43.338264 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3dcedf-f8cb-4b18-81e9-48a8973ada63 admin admin] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:03:43.338574 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3dcedf-f8cb-4b18-81e9-48a8973ada63 admin admin] PATH_INFO: `/v3/roles` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:03:43.339305 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d3dcedf-f8cb-4b18-81e9-48a8973ada63 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:03:43.340961 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d3dcedf-f8cb-4b18-81e9-48a8973ada63 admin admin] RBAC: Authorization granted {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:03:43.352620 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 943/1857] 10.222.0.84 () {58 vars in 1121 bytes} [Wed May 25 15:03:43 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 25 15:03:43.356735 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76057973-6307-4199-a87a-054d4fd2c1a1 admin admin] Authenticating user token {{(pid=101892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:03:43.367069 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76057973-6307-4199-a87a-054d4fd2c1a1 admin admin] Validating token access rules against request {{(pid=101892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:03:43.372814 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccbc0881-b24e-4b8a-9a02-2f57e0ac73a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cec56f74b2fa4826a506dc7b919465be', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:03:43.373533 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccbc0881-b24e-4b8a-9a02-2f57e0ac73a0 admin admin] REQUEST_METHOD: `GET` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:03:43.373807 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccbc0881-b24e-4b8a-9a02-2f57e0ac73a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:03:43.374112 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccbc0881-b24e-4b8a-9a02-2f57e0ac73a0 admin admin] PATH_INFO: `/v3/roles` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:03:43.374850 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccbc0881-b24e-4b8a-9a02-2f57e0ac73a0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:03:43.376509 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccbc0881-b24e-4b8a-9a02-2f57e0ac73a0 admin admin] RBAC: Authorization granted {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:03:43.390332 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 915/1858] 10.222.0.84 () {58 vars in 1121 bytes} [Wed May 25 15:03:43 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 25 15:03:43.391491 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d3dcedf-f8cb-4b18-81e9-48a8973ada63 admin admin] Authenticating user token {{(pid=101893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:03:43.402054 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d3dcedf-f8cb-4b18-81e9-48a8973ada63 admin admin] Validating token access rules against request {{(pid=101893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:03:43.407312 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f81e95d-d61c-47d8-962d-ba8a1c5dd008 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cec56f74b2fa4826a506dc7b919465be', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:03:43.408375 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f81e95d-d61c-47d8-962d-ba8a1c5dd008 admin admin] REQUEST_METHOD: `PUT` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:03:43.408739 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f81e95d-d61c-47d8-962d-ba8a1c5dd008 admin admin] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:03:43.409095 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f81e95d-d61c-47d8-962d-ba8a1c5dd008 admin admin] PATH_INFO: `/v3/projects/c69c84df41744414ac610a7756820061/users/661787c9d5d34276a4e260c382942d2d/roles/ff664fa0db7e4262a5accde96c3df4c3` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:03:43.426460 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f81e95d-d61c-47d8-962d-ba8a1c5dd008 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c69c84df41744414ac610a7756820061, user_id=661787c9d5d34276a4e260c382942d2d, role_id=ff664fa0db7e4262a5accde96c3df4c3)` {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:03:43.429305 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f81e95d-d61c-47d8-962d-ba8a1c5dd008 admin admin] RBAC: Authorization granted {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:03:43.502358 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 944/1859] 10.222.0.84 () {60 vars in 1482 bytes} [Wed May 25 15:03:43 2022] PUT /identity/v3/projects/c69c84df41744414ac610a7756820061/users/661787c9d5d34276a4e260c382942d2d/roles/ff664fa0db7e4262a5accde96c3df4c3 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 15:03:43.515687 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe3f183-ccec-4603-a068-e5351eb4b49f None None] REQUEST_METHOD: `POST` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:03:43.516009 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe3f183-ccec-4603-a068-e5351eb4b49f None None] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:03:43.516298 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe3f183-ccec-4603-a068-e5351eb4b49f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:03:43.544141 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.auth.core [None req-dfe3f183-ccec-4603-a068-e5351eb4b49f None None] MFA Rules not processed for user `661787c9d5d34276a4e260c382942d2d`. Rule list: `[]` (Enabled: `True`). {{(pid=101892) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:03:43.545297 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.fernet_utils [None req-dfe3f183-ccec-4603-a068-e5351eb4b49f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=101892) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:03:43.593024 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG dbcounter [-] [101892] Writing DB stats keystone:SELECT=94,keystone:DELETE=2,keystone:INSERT=4 {{(pid=101892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:03:43.626236 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 916/1860] 10.222.0.84 () {58 vars in 957 bytes} [Wed May 25 15:03:43 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 25 15:03:43.630702 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f81e95d-d61c-47d8-962d-ba8a1c5dd008 admin admin] Authenticating user token {{(pid=101893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:03:43.695420 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f81e95d-d61c-47d8-962d-ba8a1c5dd008 admin admin] Validating token access rules against request {{(pid=101893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:03:43.700808 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a3ac899-6811-4a2c-b828-b0529fb42b70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cec56f74b2fa4826a506dc7b919465be', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:03:43.701730 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3ac899-6811-4a2c-b828-b0529fb42b70 admin admin] REQUEST_METHOD: `POST` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:03:43.702017 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3ac899-6811-4a2c-b828-b0529fb42b70 admin admin] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:03:43.702427 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3ac899-6811-4a2c-b828-b0529fb42b70 admin admin] PATH_INFO: `/v3/projects` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:03:43.703114 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a3ac899-6811-4a2c-b828-b0529fb42b70 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:03:43.705061 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a3ac899-6811-4a2c-b828-b0529fb42b70 admin admin] RBAC: Authorization granted {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:03:43.799929 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 945/1861] 10.222.0.84 () {60 vars in 1152 bytes} [Wed May 25 15:03:43 2022] POST /identity/v3/projects => generated 381 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 15:03:43.800627 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfe3f183-ccec-4603-a068-e5351eb4b49f None None] Authenticating user token {{(pid=101892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:03:43.812644 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfe3f183-ccec-4603-a068-e5351eb4b49f None None] Validating token access rules against request {{(pid=101892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:03:43.874618 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acd2d815-8026-49f1-bfc7-ea4a5e69ec86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cec56f74b2fa4826a506dc7b919465be', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:03:43.875234 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd2d815-8026-49f1-bfc7-ea4a5e69ec86 admin admin] REQUEST_METHOD: `POST` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:03:43.875496 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd2d815-8026-49f1-bfc7-ea4a5e69ec86 admin admin] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:03:43.875802 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd2d815-8026-49f1-bfc7-ea4a5e69ec86 admin admin] PATH_INFO: `/v3/users` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:03:43.876486 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acd2d815-8026-49f1-bfc7-ea4a5e69ec86 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:03:43.878500 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acd2d815-8026-49f1-bfc7-ea4a5e69ec86 admin admin] RBAC: Authorization granted {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:03:44.003207 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 917/1862] 10.222.0.84 () {60 vars in 1143 bytes} [Wed May 25 15:03:43 2022] POST /identity/v3/users => generated 297 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 25 15:03:44.009042 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a3ac899-6811-4a2c-b828-b0529fb42b70 admin admin] Authenticating user token {{(pid=101893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:03:44.017378 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a3ac899-6811-4a2c-b828-b0529fb42b70 admin admin] Validating token access rules against request {{(pid=101893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:03:44.024274 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c3350f2-9f63-4257-9f19-a430669cdff3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cec56f74b2fa4826a506dc7b919465be', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:03:44.025273 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3350f2-9f63-4257-9f19-a430669cdff3 admin admin] REQUEST_METHOD: `GET` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:03:44.025704 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3350f2-9f63-4257-9f19-a430669cdff3 admin admin] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:03:44.026225 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3350f2-9f63-4257-9f19-a430669cdff3 admin admin] PATH_INFO: `/v3/roles` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:03:44.027106 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c3350f2-9f63-4257-9f19-a430669cdff3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:03:44.029355 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c3350f2-9f63-4257-9f19-a430669cdff3 admin admin] RBAC: Authorization granted {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:03:44.042610 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 946/1863] 10.222.0.84 () {58 vars in 1121 bytes} [Wed May 25 15:03:44 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 15:03:44.046984 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acd2d815-8026-49f1-bfc7-ea4a5e69ec86 admin admin] Authenticating user token {{(pid=101892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:03:44.057800 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acd2d815-8026-49f1-bfc7-ea4a5e69ec86 admin admin] Validating token access rules against request {{(pid=101892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:03:44.065041 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-565f7f2d-6409-40fb-b9e7-00e5f123c9b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cec56f74b2fa4826a506dc7b919465be', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:03:44.065998 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565f7f2d-6409-40fb-b9e7-00e5f123c9b9 admin admin] REQUEST_METHOD: `PUT` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:03:44.066284 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565f7f2d-6409-40fb-b9e7-00e5f123c9b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:03:44.066566 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565f7f2d-6409-40fb-b9e7-00e5f123c9b9 admin admin] PATH_INFO: `/v3/projects/2f334e199b9f442a8a534eb39abd6650/users/adda66a24bc348a1ad277ddfa9630567/roles/a3b78e7d547d4d2d998b4c99a4396bba` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:03:44.095911 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-565f7f2d-6409-40fb-b9e7-00e5f123c9b9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2f334e199b9f442a8a534eb39abd6650, user_id=adda66a24bc348a1ad277ddfa9630567, role_id=a3b78e7d547d4d2d998b4c99a4396bba)` {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:03:44.098864 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-565f7f2d-6409-40fb-b9e7-00e5f123c9b9 admin admin] RBAC: Authorization granted {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:03:44.188004 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 918/1864] 10.222.0.84 () {60 vars in 1482 bytes} [Wed May 25 15:03:44 2022] PUT /identity/v3/projects/2f334e199b9f442a8a534eb39abd6650/users/adda66a24bc348a1ad277ddfa9630567/roles/a3b78e7d547d4d2d998b4c99a4396bba => generated 0 bytes in 141 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 15:03:44.192119 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c3350f2-9f63-4257-9f19-a430669cdff3 admin admin] Authenticating user token {{(pid=101893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:03:44.205211 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c3350f2-9f63-4257-9f19-a430669cdff3 admin admin] Validating token access rules against request {{(pid=101893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:03:44.309667 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6006a05f-0586-41f9-88f1-a941de9e7403 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cec56f74b2fa4826a506dc7b919465be', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:03:44.310364 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6006a05f-0586-41f9-88f1-a941de9e7403 admin admin] REQUEST_METHOD: `GET` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:03:44.310650 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6006a05f-0586-41f9-88f1-a941de9e7403 admin admin] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:03:44.310941 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6006a05f-0586-41f9-88f1-a941de9e7403 admin admin] PATH_INFO: `/v3/roles` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:03:44.311799 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6006a05f-0586-41f9-88f1-a941de9e7403 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:03:44.313400 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6006a05f-0586-41f9-88f1-a941de9e7403 admin admin] RBAC: Authorization granted {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:03:44.325071 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 947/1865] 10.222.0.84 () {58 vars in 1121 bytes} [Wed May 25 15:03:44 2022] GET /identity/v3/roles => generated 1420 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 15:03:44.329641 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-565f7f2d-6409-40fb-b9e7-00e5f123c9b9 admin admin] Authenticating user token {{(pid=101892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:03:44.341152 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-565f7f2d-6409-40fb-b9e7-00e5f123c9b9 admin admin] Validating token access rules against request {{(pid=101892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:03:44.346011 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd240ee-af29-45ce-a1ad-af947a1783ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cec56f74b2fa4826a506dc7b919465be', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:03:44.346921 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd240ee-af29-45ce-a1ad-af947a1783ed admin admin] REQUEST_METHOD: `PUT` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:03:44.347229 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd240ee-af29-45ce-a1ad-af947a1783ed admin admin] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:03:44.347505 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd240ee-af29-45ce-a1ad-af947a1783ed admin admin] PATH_INFO: `/v3/projects/2f334e199b9f442a8a534eb39abd6650/users/adda66a24bc348a1ad277ddfa9630567/roles/a3b78e7d547d4d2d998b4c99a4396bba` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:03:44.351799 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dd240ee-af29-45ce-a1ad-af947a1783ed admin admin] RBAC: Authorizing `identity:create_grant(project_id=2f334e199b9f442a8a534eb39abd6650, user_id=adda66a24bc348a1ad277ddfa9630567, role_id=a3b78e7d547d4d2d998b4c99a4396bba)` {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:03:44.354448 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dd240ee-af29-45ce-a1ad-af947a1783ed admin admin] RBAC: Authorization granted {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:03:44.382691 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 919/1866] 10.222.0.84 () {60 vars in 1482 bytes} [Wed May 25 15:03:44 2022] PUT /identity/v3/projects/2f334e199b9f442a8a534eb39abd6650/users/adda66a24bc348a1ad277ddfa9630567/roles/a3b78e7d547d4d2d998b4c99a4396bba => generated 0 bytes in 45 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 25 15:03:44.384524 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4cfd437-0f3c-48b8-9893-c7d983520c1c None None] REQUEST_METHOD: `POST` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:03:44.384923 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4cfd437-0f3c-48b8-9893-c7d983520c1c None None] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:03:44.385310 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4cfd437-0f3c-48b8-9893-c7d983520c1c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:03:44.393756 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG dbcounter [-] [101893] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=101893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:03:44.418997 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.auth.core [None req-a4cfd437-0f3c-48b8-9893-c7d983520c1c None None] MFA Rules not processed for user `adda66a24bc348a1ad277ddfa9630567`. Rule list: `[]` (Enabled: `True`). {{(pid=101893) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:03:44.420618 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.fernet_utils [None req-a4cfd437-0f3c-48b8-9893-c7d983520c1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=101893) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:03:44.515773 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 948/1867] 10.222.0.84 () {58 vars in 957 bytes} [Wed May 25 15:03:44 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 15:03:44.544857 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd240ee-af29-45ce-a1ad-af947a1783ed admin admin] Authenticating user token {{(pid=101892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:03:44.550748 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.fernet_utils [None req-2dd240ee-af29-45ce-a1ad-af947a1783ed admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=101892) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:03:44.636698 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd240ee-af29-45ce-a1ad-af947a1783ed admin admin] Validating token access rules against request {{(pid=101892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:03:44.640692 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e85e6a-334a-40e7-bc8f-d5cf70c25940 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e079f89a5e524ab6ad4183e4f690de07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a000829c658c4a7cab67f7b6353ba3fa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:03:44.641440 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e85e6a-334a-40e7-bc8f-d5cf70c25940 service cinder] REQUEST_METHOD: `GET` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:03:44.641799 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e85e6a-334a-40e7-bc8f-d5cf70c25940 service cinder] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:03:44.642283 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e85e6a-334a-40e7-bc8f-d5cf70c25940 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:03:44.658797 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91e85e6a-334a-40e7-bc8f-d5cf70c25940 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:03:44.661406 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91e85e6a-334a-40e7-bc8f-d5cf70c25940 service cinder] RBAC: Authorization granted {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:03:44.674693 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 920/1868] 10.222.0.84 () {60 vars in 1365 bytes} [Wed May 25 15:03:44 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 130 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 15:03:45.486174 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4cfd437-0f3c-48b8-9893-c7d983520c1c None None] Authenticating user token {{(pid=101893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:03:45.496073 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4cfd437-0f3c-48b8-9893-c7d983520c1c None None] Validating token access rules against request {{(pid=101893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:03:45.500738 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66264862-71bf-427e-bd3b-38b1acd07f57 tempest-VolumeQuotaClassesTest-1357915870 tempest-VolumeQuotaClassesTest-1357915870-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'adda66a24bc348a1ad277ddfa9630567', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2f334e199b9f442a8a534eb39abd6650', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:03:45.501407 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66264862-71bf-427e-bd3b-38b1acd07f57 tempest-VolumeQuotaClassesTest-1357915870 tempest-VolumeQuotaClassesTest-1357915870-project-admin] REQUEST_METHOD: `GET` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:03:45.501696 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66264862-71bf-427e-bd3b-38b1acd07f57 tempest-VolumeQuotaClassesTest-1357915870 tempest-VolumeQuotaClassesTest-1357915870-project-admin] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:03:45.502008 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66264862-71bf-427e-bd3b-38b1acd07f57 tempest-VolumeQuotaClassesTest-1357915870 tempest-VolumeQuotaClassesTest-1357915870-project-admin] PATH_INFO: `/v3/domains` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:03:45.502745 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66264862-71bf-427e-bd3b-38b1acd07f57 tempest-VolumeQuotaClassesTest-1357915870 tempest-VolumeQuotaClassesTest-1357915870-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=101893) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 15:03:45.503060 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66264862-71bf-427e-bd3b-38b1acd07f57 tempest-VolumeQuotaClassesTest-1357915870 tempest-VolumeQuotaClassesTest-1357915870-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:03:45.504701 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66264862-71bf-427e-bd3b-38b1acd07f57 tempest-VolumeQuotaClassesTest-1357915870 tempest-VolumeQuotaClassesTest-1357915870-project-admin] RBAC: Authorization granted {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:03:45.517619 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 949/1869] 10.222.0.84 () {58 vars in 1152 bytes} [Wed May 25 15:03:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 15:03:45.521649 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e85e6a-334a-40e7-bc8f-d5cf70c25940 service cinder] Authenticating user token {{(pid=101892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:03:45.531400 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e85e6a-334a-40e7-bc8f-d5cf70c25940 service cinder] Validating token access rules against request {{(pid=101892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:03:45.536481 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbd471fd-c75e-4568-a561-e7861f7260ef tempest-VolumeQuotaClassesTest-1357915870 tempest-VolumeQuotaClassesTest-1357915870-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'adda66a24bc348a1ad277ddfa9630567', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2f334e199b9f442a8a534eb39abd6650', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:03:45.537157 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd471fd-c75e-4568-a561-e7861f7260ef tempest-VolumeQuotaClassesTest-1357915870 tempest-VolumeQuotaClassesTest-1357915870-project-admin] REQUEST_METHOD: `POST` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:03:45.537450 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd471fd-c75e-4568-a561-e7861f7260ef tempest-VolumeQuotaClassesTest-1357915870 tempest-VolumeQuotaClassesTest-1357915870-project-admin] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:03:45.537735 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd471fd-c75e-4568-a561-e7861f7260ef tempest-VolumeQuotaClassesTest-1357915870 tempest-VolumeQuotaClassesTest-1357915870-project-admin] PATH_INFO: `/v3/projects` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:03:45.538477 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbd471fd-c75e-4568-a561-e7861f7260ef tempest-VolumeQuotaClassesTest-1357915870 tempest-VolumeQuotaClassesTest-1357915870-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:03:45.540980 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbd471fd-c75e-4568-a561-e7861f7260ef tempest-VolumeQuotaClassesTest-1357915870 tempest-VolumeQuotaClassesTest-1357915870-project-admin] RBAC: Authorization granted {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:03:45.617468 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 921/1870] 10.222.0.84 () {60 vars in 1152 bytes} [Wed May 25 15:03:45 2022] POST /identity/v3/projects => generated 353 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 25 15:03:45.622450 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66264862-71bf-427e-bd3b-38b1acd07f57 tempest-VolumeQuotaClassesTest-1357915870 tempest-VolumeQuotaClassesTest-1357915870-project-admin] Authenticating user token {{(pid=101893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:03:45.632783 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66264862-71bf-427e-bd3b-38b1acd07f57 tempest-VolumeQuotaClassesTest-1357915870 tempest-VolumeQuotaClassesTest-1357915870-project-admin] Validating token access rules against request {{(pid=101893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:03:45.688042 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-784f820e-5240-4df4-bc76-5f116cfe4bd6 tempest-VolumeQuotaClassesTest-1357915870 tempest-VolumeQuotaClassesTest-1357915870-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'adda66a24bc348a1ad277ddfa9630567', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2f334e199b9f442a8a534eb39abd6650', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:03:45.688704 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784f820e-5240-4df4-bc76-5f116cfe4bd6 tempest-VolumeQuotaClassesTest-1357915870 tempest-VolumeQuotaClassesTest-1357915870-project-admin] REQUEST_METHOD: `GET` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:03:45.688992 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784f820e-5240-4df4-bc76-5f116cfe4bd6 tempest-VolumeQuotaClassesTest-1357915870 tempest-VolumeQuotaClassesTest-1357915870-project-admin] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:03:45.689273 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784f820e-5240-4df4-bc76-5f116cfe4bd6 tempest-VolumeQuotaClassesTest-1357915870 tempest-VolumeQuotaClassesTest-1357915870-project-admin] PATH_INFO: `/v3/domains` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:03:45.690002 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-784f820e-5240-4df4-bc76-5f116cfe4bd6 tempest-VolumeQuotaClassesTest-1357915870 tempest-VolumeQuotaClassesTest-1357915870-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=101893) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 15:03:45.690339 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-784f820e-5240-4df4-bc76-5f116cfe4bd6 tempest-VolumeQuotaClassesTest-1357915870 tempest-VolumeQuotaClassesTest-1357915870-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:03:45.691988 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-784f820e-5240-4df4-bc76-5f116cfe4bd6 tempest-VolumeQuotaClassesTest-1357915870 tempest-VolumeQuotaClassesTest-1357915870-project-admin] RBAC: Authorization granted {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:03:45.703367 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 950/1871] 10.222.0.84 () {58 vars in 1152 bytes} [Wed May 25 15:03:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 15:03:45.741625 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbd471fd-c75e-4568-a561-e7861f7260ef tempest-VolumeQuotaClassesTest-1357915870 tempest-VolumeQuotaClassesTest-1357915870-project-admin] Authenticating user token {{(pid=101892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:03:45.751764 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbd471fd-c75e-4568-a561-e7861f7260ef tempest-VolumeQuotaClassesTest-1357915870 tempest-VolumeQuotaClassesTest-1357915870-project-admin] Validating token access rules against request {{(pid=101892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:03:45.756233 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a63a35d-10e7-4171-98bf-cf4b00e72568 tempest-VolumeQuotaClassesTest-1357915870 tempest-VolumeQuotaClassesTest-1357915870-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'adda66a24bc348a1ad277ddfa9630567', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2f334e199b9f442a8a534eb39abd6650', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:03:45.757172 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a63a35d-10e7-4171-98bf-cf4b00e72568 tempest-VolumeQuotaClassesTest-1357915870 tempest-VolumeQuotaClassesTest-1357915870-project-admin] REQUEST_METHOD: `DELETE` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:03:45.757455 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a63a35d-10e7-4171-98bf-cf4b00e72568 tempest-VolumeQuotaClassesTest-1357915870 tempest-VolumeQuotaClassesTest-1357915870-project-admin] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:03:45.757730 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a63a35d-10e7-4171-98bf-cf4b00e72568 tempest-VolumeQuotaClassesTest-1357915870 tempest-VolumeQuotaClassesTest-1357915870-project-admin] PATH_INFO: `/v3/projects/545616907ba74ba48bcf558bf3807cc8` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:03:45.758966 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a63a35d-10e7-4171-98bf-cf4b00e72568 tempest-VolumeQuotaClassesTest-1357915870 tempest-VolumeQuotaClassesTest-1357915870-project-admin] RBAC: Authorizing `identity:delete_project(project_id=545616907ba74ba48bcf558bf3807cc8)` {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:03:45.760909 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a63a35d-10e7-4171-98bf-cf4b00e72568 tempest-VolumeQuotaClassesTest-1357915870 tempest-VolumeQuotaClassesTest-1357915870-project-admin] RBAC: Authorization granted {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:03:45.767182 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG dbcounter [-] [101892] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=101892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:03:45.846756 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.notifications [None req-8a63a35d-10e7-4171-98bf-cf4b00e72568 tempest-VolumeQuotaClassesTest-1357915870 tempest-VolumeQuotaClassesTest-1357915870-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '545616907ba74ba48bcf558bf3807cc8', 'request_id': 'req-8a63a35d-10e7-4171-98bf-cf4b00e72568'} {{(pid=101892) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:03:45.854034 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.notifications [None req-8a63a35d-10e7-4171-98bf-cf4b00e72568 tempest-VolumeQuotaClassesTest-1357915870 tempest-VolumeQuotaClassesTest-1357915870-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '545616907ba74ba48bcf558bf3807cc8', 'request_id': 'req-8a63a35d-10e7-4171-98bf-cf4b00e72568'} {{(pid=101892) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:03:45.859935 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.notifications [None req-8a63a35d-10e7-4171-98bf-cf4b00e72568 tempest-VolumeQuotaClassesTest-1357915870 tempest-VolumeQuotaClassesTest-1357915870-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '545616907ba74ba48bcf558bf3807cc8', 'request_id': 'req-8a63a35d-10e7-4171-98bf-cf4b00e72568'} {{(pid=101892) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:03:45.906868 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.notifications [None req-8a63a35d-10e7-4171-98bf-cf4b00e72568 tempest-VolumeQuotaClassesTest-1357915870 tempest-VolumeQuotaClassesTest-1357915870-project-admin] The token cache is being invalidate because project 545616907ba74ba48bcf558bf3807cc8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=101892) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 25 15:03:45.907162 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.notifications [None req-8a63a35d-10e7-4171-98bf-cf4b00e72568 tempest-VolumeQuotaClassesTest-1357915870 tempest-VolumeQuotaClassesTest-1357915870-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=101892) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:03:45.907845 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.notifications [None req-8a63a35d-10e7-4171-98bf-cf4b00e72568 tempest-VolumeQuotaClassesTest-1357915870 tempest-VolumeQuotaClassesTest-1357915870-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=101892) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:03:45.909711 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 922/1872] 10.222.0.84 () {58 vars in 1232 bytes} [Wed May 25 15:03:45 2022] DELETE /identity/v3/projects/545616907ba74ba48bcf558bf3807cc8 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 15:03:46.608483 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-784f820e-5240-4df4-bc76-5f116cfe4bd6 tempest-VolumeQuotaClassesTest-1357915870 tempest-VolumeQuotaClassesTest-1357915870-project-admin] Authenticating user token {{(pid=101893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:03:46.613402 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.fernet_utils [None req-784f820e-5240-4df4-bc76-5f116cfe4bd6 tempest-VolumeQuotaClassesTest-1357915870 tempest-VolumeQuotaClassesTest-1357915870-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=101893) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:03:46.690033 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-784f820e-5240-4df4-bc76-5f116cfe4bd6 tempest-VolumeQuotaClassesTest-1357915870 tempest-VolumeQuotaClassesTest-1357915870-project-admin] Validating token access rules against request {{(pid=101893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:03:46.702483 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG dbcounter [-] [101893] Writing DB stats keystone:SELECT=100 {{(pid=101893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:03:46.751939 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d23c41e5-0553-45da-8a01-66984e09acfd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cec56f74b2fa4826a506dc7b919465be', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:03:46.753389 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23c41e5-0553-45da-8a01-66984e09acfd admin admin] REQUEST_METHOD: `DELETE` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:03:46.754012 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23c41e5-0553-45da-8a01-66984e09acfd admin admin] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:03:46.754992 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23c41e5-0553-45da-8a01-66984e09acfd admin admin] PATH_INFO: `/v3/users/661787c9d5d34276a4e260c382942d2d` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:03:46.755881 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d23c41e5-0553-45da-8a01-66984e09acfd admin admin] RBAC: Authorizing `identity:delete_user(user_id=661787c9d5d34276a4e260c382942d2d)` {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:03:46.758669 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d23c41e5-0553-45da-8a01-66984e09acfd admin admin] RBAC: Authorization granted {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:03:46.935197 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.notifications [None req-d23c41e5-0553-45da-8a01-66984e09acfd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '661787c9d5d34276a4e260c382942d2d'} {{(pid=101893) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:03:46.948666 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.notifications [None req-d23c41e5-0553-45da-8a01-66984e09acfd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '661787c9d5d34276a4e260c382942d2d'} {{(pid=101893) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:03:46.966733 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.notifications [None req-d23c41e5-0553-45da-8a01-66984e09acfd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '661787c9d5d34276a4e260c382942d2d'} {{(pid=101893) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:03:46.967588 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.notifications [None req-d23c41e5-0553-45da-8a01-66984e09acfd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '661787c9d5d34276a4e260c382942d2d'} {{(pid=101893) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:03:46.976863 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.notifications [None req-d23c41e5-0553-45da-8a01-66984e09acfd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '661787c9d5d34276a4e260c382942d2d'} {{(pid=101893) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:03:47.079023 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 951/1873] 10.222.0.84 () {58 vars in 1223 bytes} [Wed May 25 15:03:46 2022] DELETE /identity/v3/users/661787c9d5d34276a4e260c382942d2d => generated 0 bytes in 468 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 15:03:47.080581 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974c6934-f56e-4202-b11e-0b90a4d6609a None None] REQUEST_METHOD: `POST` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:03:47.081034 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974c6934-f56e-4202-b11e-0b90a4d6609a None None] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:03:47.081150 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974c6934-f56e-4202-b11e-0b90a4d6609a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:03:47.101411 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.auth.core [None req-974c6934-f56e-4202-b11e-0b90a4d6609a None None] MFA Rules not processed for user `05d87e87798e429aa1c10b24391f915e`. Rule list: `[]` (Enabled: `True`). {{(pid=101892) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:03:47.102906 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.fernet_utils [None req-974c6934-f56e-4202-b11e-0b90a4d6609a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=101892) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:03:47.166963 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 923/1874] 10.222.0.84 () {58 vars in 957 bytes} [Wed May 25 15:03:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 25 15:03:47.176842 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d23c41e5-0553-45da-8a01-66984e09acfd admin admin] Authenticating user token {{(pid=101893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:03:47.178444 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.fernet_utils [None req-d23c41e5-0553-45da-8a01-66984e09acfd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=101893) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:03:47.245610 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d23c41e5-0553-45da-8a01-66984e09acfd admin admin] Validating token access rules against request {{(pid=101893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:03:47.249422 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b91a369-bac7-4e1e-9bfa-e0850bc6ef3c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ce28b25b907473588ccb87dc4acc06a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a000829c658c4a7cab67f7b6353ba3fa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:03:47.250131 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b91a369-bac7-4e1e-9bfa-e0850bc6ef3c service neutron] REQUEST_METHOD: `GET` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:03:47.250422 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b91a369-bac7-4e1e-9bfa-e0850bc6ef3c service neutron] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:03:47.250699 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b91a369-bac7-4e1e-9bfa-e0850bc6ef3c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:03:47.260548 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b91a369-bac7-4e1e-9bfa-e0850bc6ef3c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:03:47.262013 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b91a369-bac7-4e1e-9bfa-e0850bc6ef3c service neutron] RBAC: Authorization granted {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:03:47.281930 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 952/1875] 10.222.0.84 () {60 vars in 1365 bytes} [Wed May 25 15:03:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 15:03:48.178120 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-974c6934-f56e-4202-b11e-0b90a4d6609a None None] Authenticating user token {{(pid=101892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:03:48.181001 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.fernet_utils [None req-974c6934-f56e-4202-b11e-0b90a4d6609a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=101892) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:03:48.200718 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-974c6934-f56e-4202-b11e-0b90a4d6609a None None] Validating token access rules against request {{(pid=101892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:03:48.200718 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee254284-ad0a-4204-8cb9-a921782ada5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cec56f74b2fa4826a506dc7b919465be', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:03:48.201791 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee254284-ad0a-4204-8cb9-a921782ada5d admin admin] REQUEST_METHOD: `DELETE` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:03:48.202356 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee254284-ad0a-4204-8cb9-a921782ada5d admin admin] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:03:48.202878 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee254284-ad0a-4204-8cb9-a921782ada5d admin admin] PATH_INFO: `/v3/projects/c69c84df41744414ac610a7756820061` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:03:48.204094 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee254284-ad0a-4204-8cb9-a921782ada5d admin admin] RBAC: Authorizing `identity:delete_project(project_id=c69c84df41744414ac610a7756820061)` {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:03:48.213155 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee254284-ad0a-4204-8cb9-a921782ada5d admin admin] RBAC: Authorization granted {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:03:48.393046 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.notifications [None req-ee254284-ad0a-4204-8cb9-a921782ada5d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c69c84df41744414ac610a7756820061', 'request_id': 'req-ee254284-ad0a-4204-8cb9-a921782ada5d'} {{(pid=101892) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:03:48.399765 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.notifications [None req-ee254284-ad0a-4204-8cb9-a921782ada5d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c69c84df41744414ac610a7756820061', 'request_id': 'req-ee254284-ad0a-4204-8cb9-a921782ada5d'} {{(pid=101892) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:03:48.405760 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.notifications [None req-ee254284-ad0a-4204-8cb9-a921782ada5d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c69c84df41744414ac610a7756820061', 'request_id': 'req-ee254284-ad0a-4204-8cb9-a921782ada5d'} {{(pid=101892) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:03:48.493693 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.notifications [None req-ee254284-ad0a-4204-8cb9-a921782ada5d admin admin] The token cache is being invalidate because project c69c84df41744414ac610a7756820061 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=101892) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 25 15:03:48.494250 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.notifications [None req-ee254284-ad0a-4204-8cb9-a921782ada5d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=101892) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:03:48.495841 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.notifications [None req-ee254284-ad0a-4204-8cb9-a921782ada5d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=101892) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:03:48.497405 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 924/1876] 10.222.0.84 () {58 vars in 1232 bytes} [Wed May 25 15:03:48 2022] DELETE /identity/v3/projects/c69c84df41744414ac610a7756820061 => generated 0 bytes in 320 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 15:03:48.501480 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b91a369-bac7-4e1e-9bfa-e0850bc6ef3c service neutron] Authenticating user token {{(pid=101893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:03:48.512266 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b91a369-bac7-4e1e-9bfa-e0850bc6ef3c service neutron] Validating token access rules against request {{(pid=101893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:03:48.561721 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG dbcounter [-] [101893] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=101893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:03:48.586842 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cbb8b65-ae74-4f5d-957b-7177a4653007 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cec56f74b2fa4826a506dc7b919465be', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:03:48.587271 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cbb8b65-ae74-4f5d-957b-7177a4653007 admin admin] REQUEST_METHOD: `DELETE` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:03:48.587271 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cbb8b65-ae74-4f5d-957b-7177a4653007 admin admin] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:03:48.587508 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cbb8b65-ae74-4f5d-957b-7177a4653007 admin admin] PATH_INFO: `/v3/users/adda66a24bc348a1ad277ddfa9630567` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:03:48.588871 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cbb8b65-ae74-4f5d-957b-7177a4653007 admin admin] RBAC: Authorizing `identity:delete_user(user_id=adda66a24bc348a1ad277ddfa9630567)` {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:03:48.591041 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cbb8b65-ae74-4f5d-957b-7177a4653007 admin admin] RBAC: Authorization granted {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:03:48.852592 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.notifications [None req-3cbb8b65-ae74-4f5d-957b-7177a4653007 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'adda66a24bc348a1ad277ddfa9630567'} {{(pid=101893) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:03:48.863265 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.notifications [None req-3cbb8b65-ae74-4f5d-957b-7177a4653007 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'adda66a24bc348a1ad277ddfa9630567'} {{(pid=101893) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:03:48.880196 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.notifications [None req-3cbb8b65-ae74-4f5d-957b-7177a4653007 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'adda66a24bc348a1ad277ddfa9630567'} {{(pid=101893) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:03:48.880940 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.notifications [None req-3cbb8b65-ae74-4f5d-957b-7177a4653007 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'adda66a24bc348a1ad277ddfa9630567'} {{(pid=101893) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:03:48.881574 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.notifications [None req-3cbb8b65-ae74-4f5d-957b-7177a4653007 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'adda66a24bc348a1ad277ddfa9630567'} {{(pid=101893) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:03:48.995095 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 953/1877] 10.222.0.84 () {58 vars in 1223 bytes} [Wed May 25 15:03:48 2022] DELETE /identity/v3/users/adda66a24bc348a1ad277ddfa9630567 => generated 0 bytes in 494 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 15:03:49.333812 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee254284-ad0a-4204-8cb9-a921782ada5d admin admin] Authenticating user token {{(pid=101892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:03:49.335325 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.fernet_utils [None req-ee254284-ad0a-4204-8cb9-a921782ada5d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=101892) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:03:49.348277 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee254284-ad0a-4204-8cb9-a921782ada5d admin admin] Validating token access rules against request {{(pid=101892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:03:49.360994 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG dbcounter [-] [101892] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=101892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:03:49.409828 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cbb8b65-ae74-4f5d-957b-7177a4653007 admin admin] Authenticating user token {{(pid=101893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:03:49.412616 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.fernet_utils [None req-3cbb8b65-ae74-4f5d-957b-7177a4653007 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=101893) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:03:49.412829 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7368a5e-2756-408d-98d3-9adf5ca2e9a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cec56f74b2fa4826a506dc7b919465be', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:03:49.415285 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7368a5e-2756-408d-98d3-9adf5ca2e9a1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:03:49.415890 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7368a5e-2756-408d-98d3-9adf5ca2e9a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:03:49.416784 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7368a5e-2756-408d-98d3-9adf5ca2e9a1 admin admin] PATH_INFO: `/v3/users/298a40038f254b4db8ce9f2bed476ebb` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:03:49.426561 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7368a5e-2756-408d-98d3-9adf5ca2e9a1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=298a40038f254b4db8ce9f2bed476ebb)` {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:03:49.426561 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7368a5e-2756-408d-98d3-9adf5ca2e9a1 admin admin] RBAC: Authorization granted {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:03:49.435936 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cbb8b65-ae74-4f5d-957b-7177a4653007 admin admin] Validating token access rules against request {{(pid=101893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:03:49.443893 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9db42904-48aa-40cc-aa49-103fbed27e02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cec56f74b2fa4826a506dc7b919465be', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:03:49.445362 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db42904-48aa-40cc-aa49-103fbed27e02 admin admin] REQUEST_METHOD: `DELETE` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:03:49.445866 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db42904-48aa-40cc-aa49-103fbed27e02 admin admin] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:03:49.446295 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db42904-48aa-40cc-aa49-103fbed27e02 admin admin] PATH_INFO: `/v3/projects/2f334e199b9f442a8a534eb39abd6650` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:03:49.448193 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9db42904-48aa-40cc-aa49-103fbed27e02 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2f334e199b9f442a8a534eb39abd6650)` {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:03:49.451616 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9db42904-48aa-40cc-aa49-103fbed27e02 admin admin] RBAC: Authorization granted {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:03:49.629911 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.notifications [None req-b7368a5e-2756-408d-98d3-9adf5ca2e9a1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '298a40038f254b4db8ce9f2bed476ebb'} {{(pid=101892) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:03:49.630161 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.notifications [None req-9db42904-48aa-40cc-aa49-103fbed27e02 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2f334e199b9f442a8a534eb39abd6650', 'request_id': 'req-9db42904-48aa-40cc-aa49-103fbed27e02'} {{(pid=101893) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:03:49.636523 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.notifications [None req-9db42904-48aa-40cc-aa49-103fbed27e02 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2f334e199b9f442a8a534eb39abd6650', 'request_id': 'req-9db42904-48aa-40cc-aa49-103fbed27e02'} {{(pid=101893) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:03:49.637442 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.notifications [None req-b7368a5e-2756-408d-98d3-9adf5ca2e9a1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '298a40038f254b4db8ce9f2bed476ebb'} {{(pid=101892) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:03:49.642343 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.notifications [None req-9db42904-48aa-40cc-aa49-103fbed27e02 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2f334e199b9f442a8a534eb39abd6650', 'request_id': 'req-9db42904-48aa-40cc-aa49-103fbed27e02'} {{(pid=101893) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:03:49.656179 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.notifications [None req-b7368a5e-2756-408d-98d3-9adf5ca2e9a1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '298a40038f254b4db8ce9f2bed476ebb'} {{(pid=101892) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:03:49.656988 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.notifications [None req-b7368a5e-2756-408d-98d3-9adf5ca2e9a1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '298a40038f254b4db8ce9f2bed476ebb'} {{(pid=101892) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:03:49.730735 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.notifications [None req-9db42904-48aa-40cc-aa49-103fbed27e02 admin admin] The token cache is being invalidate because project 2f334e199b9f442a8a534eb39abd6650 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=101893) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 25 15:03:49.731039 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.notifications [None req-9db42904-48aa-40cc-aa49-103fbed27e02 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=101893) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:03:49.731724 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.notifications [None req-9db42904-48aa-40cc-aa49-103fbed27e02 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=101893) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:03:49.733289 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 954/1878] 10.222.0.84 () {58 vars in 1232 bytes} [Wed May 25 15:03:49 2022] DELETE /identity/v3/projects/2f334e199b9f442a8a534eb39abd6650 => generated 0 bytes in 325 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 15:03:49.738127 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff61823-ece0-479b-b67d-a9118444d3d7 None None] REQUEST_METHOD: `POST` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:03:49.738418 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff61823-ece0-479b-b67d-a9118444d3d7 None None] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:03:49.738705 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff61823-ece0-479b-b67d-a9118444d3d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:03:49.758333 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.auth.core [None req-8ff61823-ece0-479b-b67d-a9118444d3d7 None None] MFA Rules not processed for user `05d87e87798e429aa1c10b24391f915e`. Rule list: `[]` (Enabled: `True`). {{(pid=101893) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:03:49.760087 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.fernet_utils [None req-8ff61823-ece0-479b-b67d-a9118444d3d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=101893) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:03:49.787513 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.notifications [None req-b7368a5e-2756-408d-98d3-9adf5ca2e9a1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '298a40038f254b4db8ce9f2bed476ebb'} {{(pid=101892) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:03:49.795335 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 925/1879] 10.222.0.84 () {58 vars in 1223 bytes} [Wed May 25 15:03:49 2022] DELETE /identity/v3/users/298a40038f254b4db8ce9f2bed476ebb => generated 0 bytes in 462 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 15:03:49.804337 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f908b92-14f9-4215-947d-e00e979ad678 None None] REQUEST_METHOD: `POST` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:03:49.804337 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f908b92-14f9-4215-947d-e00e979ad678 None None] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:03:49.804337 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f908b92-14f9-4215-947d-e00e979ad678 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:03:49.825337 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG dbcounter [-] [101893] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=101893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:03:49.827151 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.auth.core [None req-3f908b92-14f9-4215-947d-e00e979ad678 None None] MFA Rules not processed for user `05d87e87798e429aa1c10b24391f915e`. Rule list: `[]` (Enabled: `True`). {{(pid=101892) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:03:49.828763 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.fernet_utils [None req-3f908b92-14f9-4215-947d-e00e979ad678 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=101892) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:03:49.855697 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 955/1880] 10.222.0.84 () {58 vars in 957 bytes} [Wed May 25 15:03:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 25 15:03:49.861880 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231f6960-6500-417b-99b1-166c31450e46 None None] REQUEST_METHOD: `POST` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:03:49.862368 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231f6960-6500-417b-99b1-166c31450e46 None None] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:03:49.862818 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231f6960-6500-417b-99b1-166c31450e46 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:03:49.889377 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.auth.core [None req-231f6960-6500-417b-99b1-166c31450e46 None None] MFA Rules not processed for user `05d87e87798e429aa1c10b24391f915e`. Rule list: `[]` (Enabled: `True`). {{(pid=101893) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:03:49.890806 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.fernet_utils [None req-231f6960-6500-417b-99b1-166c31450e46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=101893) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:03:49.933229 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 926/1881] 10.222.0.84 () {58 vars in 957 bytes} [Wed May 25 15:03:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 15:03:49.945334 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f908b92-14f9-4215-947d-e00e979ad678 None None] Authenticating user token {{(pid=101892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:03:49.949175 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.fernet_utils [None req-3f908b92-14f9-4215-947d-e00e979ad678 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=101892) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:03:49.984122 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 956/1882] 10.222.0.84 () {58 vars in 957 bytes} [Wed May 25 15:03:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 15:03:49.987602 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-231f6960-6500-417b-99b1-166c31450e46 None None] Authenticating user token {{(pid=101893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:03:50.004279 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-231f6960-6500-417b-99b1-166c31450e46 None None] Validating token access rules against request {{(pid=101893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:03:50.013154 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG dbcounter [-] [101892] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=101892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:03:50.016009 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ede1979-c8b3-42f1-93b0-558abc973105 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cec56f74b2fa4826a506dc7b919465be', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:03:50.019112 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ede1979-c8b3-42f1-93b0-558abc973105 admin admin] REQUEST_METHOD: `GET` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:03:50.019478 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ede1979-c8b3-42f1-93b0-558abc973105 admin admin] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:03:50.019779 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ede1979-c8b3-42f1-93b0-558abc973105 admin admin] PATH_INFO: `/v3/domains` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:03:50.020532 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ede1979-c8b3-42f1-93b0-558abc973105 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=101893) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 15:03:50.020842 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ede1979-c8b3-42f1-93b0-558abc973105 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:03:50.023071 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ede1979-c8b3-42f1-93b0-558abc973105 admin admin] RBAC: Authorization granted {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:03:50.040095 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 957/1883] 10.222.0.84 () {58 vars in 1152 bytes} [Wed May 25 15:03:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 15:03:50.041555 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ede1979-c8b3-42f1-93b0-558abc973105 admin admin] Authenticating user token {{(pid=101893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:03:50.045441 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f908b92-14f9-4215-947d-e00e979ad678 None None] Validating token access rules against request {{(pid=101892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:03:50.051450 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f89d1e64-2128-43a1-929e-c2ec7399c3ce service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ce28b25b907473588ccb87dc4acc06a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a000829c658c4a7cab67f7b6353ba3fa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:03:50.052170 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89d1e64-2128-43a1-929e-c2ec7399c3ce service neutron] REQUEST_METHOD: `GET` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:03:50.052463 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89d1e64-2128-43a1-929e-c2ec7399c3ce service neutron] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:03:50.052743 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89d1e64-2128-43a1-929e-c2ec7399c3ce service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:03:50.052929 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ede1979-c8b3-42f1-93b0-558abc973105 admin admin] Validating token access rules against request {{(pid=101893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:03:50.059597 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d0356d3-bbcf-4114-819f-b546ef5928e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cec56f74b2fa4826a506dc7b919465be', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:03:50.060771 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0356d3-bbcf-4114-819f-b546ef5928e4 admin admin] REQUEST_METHOD: `POST` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:03:50.060771 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0356d3-bbcf-4114-819f-b546ef5928e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:03:50.060980 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0356d3-bbcf-4114-819f-b546ef5928e4 admin admin] PATH_INFO: `/v3/projects` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:03:50.061645 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d0356d3-bbcf-4114-819f-b546ef5928e4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:03:50.063598 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d0356d3-bbcf-4114-819f-b546ef5928e4 admin admin] RBAC: Authorization granted {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:03:50.065527 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f89d1e64-2128-43a1-929e-c2ec7399c3ce service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:03:50.067241 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f89d1e64-2128-43a1-929e-c2ec7399c3ce service neutron] RBAC: Authorization granted {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:03:50.080949 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 927/1884] 10.222.0.84 () {60 vars in 1365 bytes} [Wed May 25 15:03:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 136 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 15:03:50.174909 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 958/1885] 10.222.0.84 () {60 vars in 1152 bytes} [Wed May 25 15:03:50 2022] POST /identity/v3/projects => generated 387 bytes in 134 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 15:03:50.179166 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f89d1e64-2128-43a1-929e-c2ec7399c3ce service neutron] Authenticating user token {{(pid=101892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:03:50.192772 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f89d1e64-2128-43a1-929e-c2ec7399c3ce service neutron] Validating token access rules against request {{(pid=101892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:03:50.265692 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a03010d4-9bcb-4181-b3f0-88730050f618 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cec56f74b2fa4826a506dc7b919465be', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:03:50.266378 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03010d4-9bcb-4181-b3f0-88730050f618 admin admin] REQUEST_METHOD: `POST` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:03:50.266651 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03010d4-9bcb-4181-b3f0-88730050f618 admin admin] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:03:50.266943 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03010d4-9bcb-4181-b3f0-88730050f618 admin admin] PATH_INFO: `/v3/users` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:03:50.267784 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a03010d4-9bcb-4181-b3f0-88730050f618 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:03:50.269742 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a03010d4-9bcb-4181-b3f0-88730050f618 admin admin] RBAC: Authorization granted {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:03:50.355358 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 928/1886] 10.222.0.84 () {60 vars in 1143 bytes} [Wed May 25 15:03:50 2022] POST /identity/v3/users => generated 294 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 25 15:03:50.363752 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d0356d3-bbcf-4114-819f-b546ef5928e4 admin admin] Authenticating user token {{(pid=101893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:03:50.375001 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d0356d3-bbcf-4114-819f-b546ef5928e4 admin admin] Validating token access rules against request {{(pid=101893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:03:50.379378 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72ffc4e2-2d52-40ed-8de0-07de076c3041 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cec56f74b2fa4826a506dc7b919465be', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:03:50.380095 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ffc4e2-2d52-40ed-8de0-07de076c3041 admin admin] REQUEST_METHOD: `GET` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:03:50.380385 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ffc4e2-2d52-40ed-8de0-07de076c3041 admin admin] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:03:50.380657 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ffc4e2-2d52-40ed-8de0-07de076c3041 admin admin] PATH_INFO: `/v3/roles` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:03:50.381579 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72ffc4e2-2d52-40ed-8de0-07de076c3041 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:03:50.383200 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72ffc4e2-2d52-40ed-8de0-07de076c3041 admin admin] RBAC: Authorization granted {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:03:50.394149 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 959/1887] 10.222.0.84 () {58 vars in 1121 bytes} [Wed May 25 15:03:50 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 15:03:50.398303 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a03010d4-9bcb-4181-b3f0-88730050f618 admin admin] Authenticating user token {{(pid=101892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:03:50.409325 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a03010d4-9bcb-4181-b3f0-88730050f618 admin admin] Validating token access rules against request {{(pid=101892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:03:50.414233 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c0468c9-146a-4f35-bc71-489a0304faf6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cec56f74b2fa4826a506dc7b919465be', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:03:50.415521 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c0468c9-146a-4f35-bc71-489a0304faf6 admin admin] REQUEST_METHOD: `GET` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:03:50.415829 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c0468c9-146a-4f35-bc71-489a0304faf6 admin admin] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:03:50.416105 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c0468c9-146a-4f35-bc71-489a0304faf6 admin admin] PATH_INFO: `/v3/roles` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:03:50.416828 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c0468c9-146a-4f35-bc71-489a0304faf6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:03:50.418432 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c0468c9-146a-4f35-bc71-489a0304faf6 admin admin] RBAC: Authorization granted {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:03:50.429648 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 929/1888] 10.222.0.84 () {58 vars in 1121 bytes} [Wed May 25 15:03:50 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 15:03:50.434202 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72ffc4e2-2d52-40ed-8de0-07de076c3041 admin admin] Authenticating user token {{(pid=101893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:03:50.447421 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72ffc4e2-2d52-40ed-8de0-07de076c3041 admin admin] Validating token access rules against request {{(pid=101893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:03:50.452836 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0704ffbe-e74d-46a4-97be-6fbd9a31690e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cec56f74b2fa4826a506dc7b919465be', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:03:50.453731 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0704ffbe-e74d-46a4-97be-6fbd9a31690e admin admin] REQUEST_METHOD: `PUT` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:03:50.454016 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0704ffbe-e74d-46a4-97be-6fbd9a31690e admin admin] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:03:50.454295 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0704ffbe-e74d-46a4-97be-6fbd9a31690e admin admin] PATH_INFO: `/v3/projects/a21cc4af0c5049a98e609967f13e2faf/users/8c698bddc453472e8820aed953929efa/roles/ff664fa0db7e4262a5accde96c3df4c3` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:03:50.469930 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0704ffbe-e74d-46a4-97be-6fbd9a31690e admin admin] RBAC: Authorizing `identity:create_grant(project_id=a21cc4af0c5049a98e609967f13e2faf, user_id=8c698bddc453472e8820aed953929efa, role_id=ff664fa0db7e4262a5accde96c3df4c3)` {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:03:50.472685 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0704ffbe-e74d-46a4-97be-6fbd9a31690e admin admin] RBAC: Authorization granted {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:03:50.544590 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c0468c9-146a-4f35-bc71-489a0304faf6 admin admin] Authenticating user token {{(pid=101892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:03:50.546689 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.fernet_utils [None req-4c0468c9-146a-4f35-bc71-489a0304faf6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=101892) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:03:50.563429 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c0468c9-146a-4f35-bc71-489a0304faf6 admin admin] Validating token access rules against request {{(pid=101892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:03:50.570459 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 960/1889] 10.222.0.84 () {60 vars in 1482 bytes} [Wed May 25 15:03:50 2022] PUT /identity/v3/projects/a21cc4af0c5049a98e609967f13e2faf/users/8c698bddc453472e8820aed953929efa/roles/ff664fa0db7e4262a5accde96c3df4c3 => generated 0 bytes in 136 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 15:03:50.580766 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c1d4f4-4e19-4cfd-a169-680e14090c49 None None] REQUEST_METHOD: `POST` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:03:50.581126 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c1d4f4-4e19-4cfd-a169-680e14090c49 None None] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:03:50.581504 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c1d4f4-4e19-4cfd-a169-680e14090c49 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:03:50.609513 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.auth.core [None req-11c1d4f4-4e19-4cfd-a169-680e14090c49 None None] MFA Rules not processed for user `8c698bddc453472e8820aed953929efa`. Rule list: `[]` (Enabled: `True`). {{(pid=101893) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:03:50.611497 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.fernet_utils [None req-11c1d4f4-4e19-4cfd-a169-680e14090c49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=101893) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:03:50.636583 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26551a54-d03c-4429-b06e-bbb8f2d62333 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cec56f74b2fa4826a506dc7b919465be', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:03:50.637484 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26551a54-d03c-4429-b06e-bbb8f2d62333 admin admin] REQUEST_METHOD: `DELETE` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:03:50.637764 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26551a54-d03c-4429-b06e-bbb8f2d62333 admin admin] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:03:50.638041 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26551a54-d03c-4429-b06e-bbb8f2d62333 admin admin] PATH_INFO: `/v3/projects/8c7a02523aef47f7afa4d8f152db8ea9` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:03:50.639334 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26551a54-d03c-4429-b06e-bbb8f2d62333 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8c7a02523aef47f7afa4d8f152db8ea9)` {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:03:50.641303 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26551a54-d03c-4429-b06e-bbb8f2d62333 admin admin] RBAC: Authorization granted {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:03:50.687359 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 961/1890] 10.222.0.84 () {58 vars in 957 bytes} [Wed May 25 15:03:50 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 25 15:03:50.691883 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c1d4f4-4e19-4cfd-a169-680e14090c49 None None] Authenticating user token {{(pid=101893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:03:50.697447 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG dbcounter [-] [101893] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=101893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:03:50.703175 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c1d4f4-4e19-4cfd-a169-680e14090c49 None None] Validating token access rules against request {{(pid=101893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:03:50.707789 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c95235a2-003f-4a94-a3fa-4ee79e45c226 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cec56f74b2fa4826a506dc7b919465be', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:03:50.708454 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95235a2-003f-4a94-a3fa-4ee79e45c226 admin admin] REQUEST_METHOD: `POST` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:03:50.708723 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95235a2-003f-4a94-a3fa-4ee79e45c226 admin admin] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:03:50.709000 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95235a2-003f-4a94-a3fa-4ee79e45c226 admin admin] PATH_INFO: `/v3/projects` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:03:50.709679 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c95235a2-003f-4a94-a3fa-4ee79e45c226 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:03:50.712338 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c95235a2-003f-4a94-a3fa-4ee79e45c226 admin admin] RBAC: Authorization granted {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:03:50.731807 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.notifications [None req-26551a54-d03c-4429-b06e-bbb8f2d62333 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8c7a02523aef47f7afa4d8f152db8ea9', 'request_id': 'req-26551a54-d03c-4429-b06e-bbb8f2d62333'} {{(pid=101892) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:03:50.738912 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.notifications [None req-26551a54-d03c-4429-b06e-bbb8f2d62333 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8c7a02523aef47f7afa4d8f152db8ea9', 'request_id': 'req-26551a54-d03c-4429-b06e-bbb8f2d62333'} {{(pid=101892) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:03:50.744073 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG dbcounter [-] [101892] Writing DB stats keystone:SELECT=91,keystone:INSERT=3,keystone:DELETE=6 {{(pid=101892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:03:50.745334 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.notifications [None req-26551a54-d03c-4429-b06e-bbb8f2d62333 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8c7a02523aef47f7afa4d8f152db8ea9', 'request_id': 'req-26551a54-d03c-4429-b06e-bbb8f2d62333'} {{(pid=101892) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:03:50.800763 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 962/1891] 10.222.0.84 () {60 vars in 1152 bytes} [Wed May 25 15:03:50 2022] POST /identity/v3/projects => generated 383 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 25 15:03:50.805820 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c95235a2-003f-4a94-a3fa-4ee79e45c226 admin admin] Authenticating user token {{(pid=101893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:03:50.826025 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.notifications [None req-26551a54-d03c-4429-b06e-bbb8f2d62333 admin admin] The token cache is being invalidate because project 8c7a02523aef47f7afa4d8f152db8ea9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=101892) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 25 15:03:50.826634 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.notifications [None req-26551a54-d03c-4429-b06e-bbb8f2d62333 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=101892) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:03:50.827288 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.notifications [None req-26551a54-d03c-4429-b06e-bbb8f2d62333 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=101892) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:03:50.828906 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 930/1892] 10.222.0.84 () {58 vars in 1232 bytes} [Wed May 25 15:03:50 2022] DELETE /identity/v3/projects/8c7a02523aef47f7afa4d8f152db8ea9 => generated 0 bytes in 285 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 25 15:03:50.833668 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127f0101-08e7-4dd4-bbf5-f9b6310d6dca None None] REQUEST_METHOD: `POST` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:03:50.834010 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127f0101-08e7-4dd4-bbf5-f9b6310d6dca None None] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:03:50.834297 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127f0101-08e7-4dd4-bbf5-f9b6310d6dca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:03:50.854267 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.auth.core [None req-127f0101-08e7-4dd4-bbf5-f9b6310d6dca None None] MFA Rules not processed for user `05d87e87798e429aa1c10b24391f915e`. Rule list: `[]` (Enabled: `True`). {{(pid=101892) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:03:50.855514 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.fernet_utils [None req-127f0101-08e7-4dd4-bbf5-f9b6310d6dca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=101892) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:03:50.874305 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c95235a2-003f-4a94-a3fa-4ee79e45c226 admin admin] Validating token access rules against request {{(pid=101893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:03:50.879649 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67eb0477-0879-4916-977c-b11d11a980cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cec56f74b2fa4826a506dc7b919465be', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:03:50.880337 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67eb0477-0879-4916-977c-b11d11a980cd admin admin] REQUEST_METHOD: `POST` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:03:50.880625 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67eb0477-0879-4916-977c-b11d11a980cd admin admin] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:03:50.880904 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67eb0477-0879-4916-977c-b11d11a980cd admin admin] PATH_INFO: `/v3/users` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:03:50.881603 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67eb0477-0879-4916-977c-b11d11a980cd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:03:50.883966 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67eb0477-0879-4916-977c-b11d11a980cd admin admin] RBAC: Authorization granted {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:03:50.942468 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 931/1893] 10.222.0.84 () {58 vars in 957 bytes} [Wed May 25 15:03:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 25 15:03:50.952178 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f4eab5-a40d-416d-81ea-6d718f5599c3 None None] REQUEST_METHOD: `POST` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:03:50.952479 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f4eab5-a40d-416d-81ea-6d718f5599c3 None None] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:03:50.952765 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f4eab5-a40d-416d-81ea-6d718f5599c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:03:50.971443 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.auth.core [None req-c0f4eab5-a40d-416d-81ea-6d718f5599c3 None None] MFA Rules not processed for user `05d87e87798e429aa1c10b24391f915e`. Rule list: `[]` (Enabled: `True`). {{(pid=101892) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:03:50.972876 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.fernet_utils [None req-c0f4eab5-a40d-416d-81ea-6d718f5599c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=101892) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:03:50.981738 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 932/1894] 10.222.0.84 () {58 vars in 957 bytes} [Wed May 25 15:03:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 25 15:03:50.985955 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f4eab5-a40d-416d-81ea-6d718f5599c3 None None] Authenticating user token {{(pid=101892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:03:50.995833 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 963/1895] 10.222.0.84 () {60 vars in 1143 bytes} [Wed May 25 15:03:50 2022] POST /identity/v3/users => generated 298 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 25 15:03:51.000237 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67eb0477-0879-4916-977c-b11d11a980cd admin admin] Authenticating user token {{(pid=101893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:03:51.002066 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.fernet_utils [None req-67eb0477-0879-4916-977c-b11d11a980cd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=101893) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:03:51.007773 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f4eab5-a40d-416d-81ea-6d718f5599c3 None None] Validating token access rules against request {{(pid=101892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:03:51.014298 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-218750c3-5c31-4ff0-8bf7-88d73986ee29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cec56f74b2fa4826a506dc7b919465be', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:03:51.015286 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218750c3-5c31-4ff0-8bf7-88d73986ee29 admin admin] REQUEST_METHOD: `GET` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:03:51.015674 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218750c3-5c31-4ff0-8bf7-88d73986ee29 admin admin] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:03:51.015939 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218750c3-5c31-4ff0-8bf7-88d73986ee29 admin admin] PATH_INFO: `/v3/domains` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:03:51.020358 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-218750c3-5c31-4ff0-8bf7-88d73986ee29 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=101892) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 15:03:51.020358 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-218750c3-5c31-4ff0-8bf7-88d73986ee29 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:03:51.020358 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-218750c3-5c31-4ff0-8bf7-88d73986ee29 admin admin] RBAC: Authorization granted {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:03:51.021545 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67eb0477-0879-4916-977c-b11d11a980cd admin admin] Validating token access rules against request {{(pid=101893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:03:51.026712 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75d807fc-819c-49ef-af88-e8ad0cec076d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cec56f74b2fa4826a506dc7b919465be', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:03:51.027667 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d807fc-819c-49ef-af88-e8ad0cec076d admin admin] REQUEST_METHOD: `GET` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:03:51.027962 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d807fc-819c-49ef-af88-e8ad0cec076d admin admin] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:03:51.028246 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d807fc-819c-49ef-af88-e8ad0cec076d admin admin] PATH_INFO: `/v3/roles` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:03:51.028984 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75d807fc-819c-49ef-af88-e8ad0cec076d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:03:51.031180 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75d807fc-819c-49ef-af88-e8ad0cec076d admin admin] RBAC: Authorization granted {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:03:51.037808 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 933/1896] 10.222.0.84 () {58 vars in 1152 bytes} [Wed May 25 15:03:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 15:03:51.043644 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-218750c3-5c31-4ff0-8bf7-88d73986ee29 admin admin] Authenticating user token {{(pid=101892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:03:51.043762 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 964/1897] 10.222.0.84 () {58 vars in 1121 bytes} [Wed May 25 15:03:50 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 25 15:03:51.046370 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75d807fc-819c-49ef-af88-e8ad0cec076d admin admin] Authenticating user token {{(pid=101893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:03:51.051078 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-218750c3-5c31-4ff0-8bf7-88d73986ee29 admin admin] Validating token access rules against request {{(pid=101892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:03:51.057005 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75d807fc-819c-49ef-af88-e8ad0cec076d admin admin] Validating token access rules against request {{(pid=101893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:03:51.062113 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f93f483b-39b1-4d2c-aacb-44decce39aca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cec56f74b2fa4826a506dc7b919465be', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:03:51.063082 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93f483b-39b1-4d2c-aacb-44decce39aca admin admin] REQUEST_METHOD: `PUT` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:03:51.063437 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93f483b-39b1-4d2c-aacb-44decce39aca admin admin] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:03:51.063790 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80576d5b-a0f1-471e-8193-47acb5ee161d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cec56f74b2fa4826a506dc7b919465be', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:03:51.063937 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93f483b-39b1-4d2c-aacb-44decce39aca admin admin] PATH_INFO: `/v3/projects/c551cfb3553e46dcb10a1361a557360e/users/42449a45fa54477d99d52c3b120fdcdb/roles/a3b78e7d547d4d2d998b4c99a4396bba` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:03:51.065182 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80576d5b-a0f1-471e-8193-47acb5ee161d admin admin] REQUEST_METHOD: `POST` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:03:51.065633 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80576d5b-a0f1-471e-8193-47acb5ee161d admin admin] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:03:51.066080 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80576d5b-a0f1-471e-8193-47acb5ee161d admin admin] PATH_INFO: `/v3/projects` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:03:51.067506 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80576d5b-a0f1-471e-8193-47acb5ee161d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:03:51.073749 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80576d5b-a0f1-471e-8193-47acb5ee161d admin admin] RBAC: Authorization granted {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:03:51.082749 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f93f483b-39b1-4d2c-aacb-44decce39aca admin admin] RBAC: Authorizing `identity:create_grant(project_id=c551cfb3553e46dcb10a1361a557360e, user_id=42449a45fa54477d99d52c3b120fdcdb, role_id=a3b78e7d547d4d2d998b4c99a4396bba)` {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:03:51.085754 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f93f483b-39b1-4d2c-aacb-44decce39aca admin admin] RBAC: Authorization granted {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:03:51.154937 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 965/1898] 10.222.0.84 () {60 vars in 1482 bytes} [Wed May 25 15:03:51 2022] PUT /identity/v3/projects/c551cfb3553e46dcb10a1361a557360e/users/42449a45fa54477d99d52c3b120fdcdb/roles/a3b78e7d547d4d2d998b4c99a4396bba => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 15:03:51.158568 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f93f483b-39b1-4d2c-aacb-44decce39aca admin admin] Authenticating user token {{(pid=101893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:03:51.202330 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 934/1899] 10.222.0.84 () {60 vars in 1152 bytes} [Wed May 25 15:03:51 2022] POST /identity/v3/projects => generated 373 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 15:03:51.206387 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80576d5b-a0f1-471e-8193-47acb5ee161d admin admin] Authenticating user token {{(pid=101892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:03:51.251086 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f93f483b-39b1-4d2c-aacb-44decce39aca admin admin] Validating token access rules against request {{(pid=101893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:03:51.305011 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG dbcounter [-] [101893] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=101893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:03:51.315548 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80576d5b-a0f1-471e-8193-47acb5ee161d admin admin] Validating token access rules against request {{(pid=101892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:03:51.322731 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99d4b588-9dcb-4d3d-a090-ac76a7afd82f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cec56f74b2fa4826a506dc7b919465be', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:03:51.323799 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d4b588-9dcb-4d3d-a090-ac76a7afd82f admin admin] REQUEST_METHOD: `POST` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:03:51.324138 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d4b588-9dcb-4d3d-a090-ac76a7afd82f admin admin] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:03:51.324421 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d4b588-9dcb-4d3d-a090-ac76a7afd82f admin admin] PATH_INFO: `/v3/users` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:03:51.325193 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99d4b588-9dcb-4d3d-a090-ac76a7afd82f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:03:51.329231 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99d4b588-9dcb-4d3d-a090-ac76a7afd82f admin admin] RBAC: Authorization granted {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:03:51.348088 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-814cdae3-1b30-4b83-b0e7-4d5333744132 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cec56f74b2fa4826a506dc7b919465be', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:03:51.348924 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814cdae3-1b30-4b83-b0e7-4d5333744132 admin admin] REQUEST_METHOD: `GET` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:03:51.349236 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814cdae3-1b30-4b83-b0e7-4d5333744132 admin admin] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:03:51.349736 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814cdae3-1b30-4b83-b0e7-4d5333744132 admin admin] PATH_INFO: `/v3/roles` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:03:51.350736 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-814cdae3-1b30-4b83-b0e7-4d5333744132 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:03:51.353184 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-814cdae3-1b30-4b83-b0e7-4d5333744132 admin admin] RBAC: Authorization granted {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:03:51.364718 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 966/1900] 10.222.0.84 () {58 vars in 1121 bytes} [Wed May 25 15:03:51 2022] GET /identity/v3/roles => generated 1420 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 25 15:03:51.369617 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-814cdae3-1b30-4b83-b0e7-4d5333744132 admin admin] Authenticating user token {{(pid=101893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:03:51.381428 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-814cdae3-1b30-4b83-b0e7-4d5333744132 admin admin] Validating token access rules against request {{(pid=101893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:03:51.386878 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83924545-d6cc-497f-834b-b43980301654 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cec56f74b2fa4826a506dc7b919465be', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:03:51.388199 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83924545-d6cc-497f-834b-b43980301654 admin admin] REQUEST_METHOD: `PUT` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:03:51.388645 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83924545-d6cc-497f-834b-b43980301654 admin admin] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:03:51.390467 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83924545-d6cc-497f-834b-b43980301654 admin admin] PATH_INFO: `/v3/projects/c551cfb3553e46dcb10a1361a557360e/users/42449a45fa54477d99d52c3b120fdcdb/roles/a3b78e7d547d4d2d998b4c99a4396bba` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:03:51.391426 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83924545-d6cc-497f-834b-b43980301654 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c551cfb3553e46dcb10a1361a557360e, user_id=42449a45fa54477d99d52c3b120fdcdb, role_id=a3b78e7d547d4d2d998b4c99a4396bba)` {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:03:51.394390 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83924545-d6cc-497f-834b-b43980301654 admin admin] RBAC: Authorization granted {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:03:51.409902 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 967/1901] 10.222.0.84 () {60 vars in 1482 bytes} [Wed May 25 15:03:51 2022] PUT /identity/v3/projects/c551cfb3553e46dcb10a1361a557360e/users/42449a45fa54477d99d52c3b120fdcdb/roles/a3b78e7d547d4d2d998b4c99a4396bba => generated 0 bytes in 41 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 15:03:51.421245 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ddc310b-3820-4b45-8089-c90f725777cc None None] REQUEST_METHOD: `POST` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:03:51.421659 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ddc310b-3820-4b45-8089-c90f725777cc None None] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:03:51.422109 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ddc310b-3820-4b45-8089-c90f725777cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:03:51.424056 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 935/1902] 10.222.0.84 () {60 vars in 1143 bytes} [Wed May 25 15:03:51 2022] POST /identity/v3/users => generated 287 bytes in 218 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 25 15:03:51.426237 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99d4b588-9dcb-4d3d-a090-ac76a7afd82f admin admin] Authenticating user token {{(pid=101892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:03:51.446409 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99d4b588-9dcb-4d3d-a090-ac76a7afd82f admin admin] Validating token access rules against request {{(pid=101892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:03:51.456609 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.auth.core [None req-5ddc310b-3820-4b45-8089-c90f725777cc None None] MFA Rules not processed for user `42449a45fa54477d99d52c3b120fdcdb`. Rule list: `[]` (Enabled: `True`). {{(pid=101893) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:03:51.457885 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.fernet_utils [None req-5ddc310b-3820-4b45-8089-c90f725777cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=101893) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:03:51.488319 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG dbcounter [-] [101892] Writing DB stats keystone:SELECT=94,keystone:INSERT=5,keystone:DELETE=1 {{(pid=101892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:03:51.514604 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9d0afa3-cbaa-4dcb-bc1a-5fc95bd8ef69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cec56f74b2fa4826a506dc7b919465be', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:03:51.515305 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d0afa3-cbaa-4dcb-bc1a-5fc95bd8ef69 admin admin] REQUEST_METHOD: `GET` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:03:51.518733 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d0afa3-cbaa-4dcb-bc1a-5fc95bd8ef69 admin admin] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:03:51.518733 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d0afa3-cbaa-4dcb-bc1a-5fc95bd8ef69 admin admin] PATH_INFO: `/v3/roles` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:03:51.518733 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9d0afa3-cbaa-4dcb-bc1a-5fc95bd8ef69 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:03:51.518733 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9d0afa3-cbaa-4dcb-bc1a-5fc95bd8ef69 admin admin] RBAC: Authorization granted {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:03:51.528482 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 936/1903] 10.222.0.84 () {58 vars in 1121 bytes} [Wed May 25 15:03:51 2022] GET /identity/v3/roles => generated 1420 bytes in 103 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 15:03:51.532570 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9d0afa3-cbaa-4dcb-bc1a-5fc95bd8ef69 admin admin] Authenticating user token {{(pid=101892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:03:51.543839 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9d0afa3-cbaa-4dcb-bc1a-5fc95bd8ef69 admin admin] Validating token access rules against request {{(pid=101892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:03:51.546519 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 968/1904] 10.222.0.84 () {58 vars in 957 bytes} [Wed May 25 15:03:51 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 25 15:03:51.551611 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-123cd83e-ce6d-4c2d-9c90-ee87fa3e3752 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cec56f74b2fa4826a506dc7b919465be', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:03:51.551611 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123cd83e-ce6d-4c2d-9c90-ee87fa3e3752 admin admin] REQUEST_METHOD: `GET` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:03:51.551611 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123cd83e-ce6d-4c2d-9c90-ee87fa3e3752 admin admin] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:03:51.551611 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123cd83e-ce6d-4c2d-9c90-ee87fa3e3752 admin admin] PATH_INFO: `/v3/roles` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:03:51.552057 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-123cd83e-ce6d-4c2d-9c90-ee87fa3e3752 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:03:51.552407 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-123cd83e-ce6d-4c2d-9c90-ee87fa3e3752 admin admin] RBAC: Authorization granted {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:03:51.560544 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ddc310b-3820-4b45-8089-c90f725777cc None None] Authenticating user token {{(pid=101893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:03:51.562306 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.fernet_utils [None req-5ddc310b-3820-4b45-8089-c90f725777cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=101893) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:03:51.565283 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 937/1905] 10.222.0.84 () {58 vars in 1121 bytes} [Wed May 25 15:03:51 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 15:03:51.569383 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-123cd83e-ce6d-4c2d-9c90-ee87fa3e3752 admin admin] Authenticating user token {{(pid=101892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:03:51.579154 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-123cd83e-ce6d-4c2d-9c90-ee87fa3e3752 admin admin] Validating token access rules against request {{(pid=101892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:03:51.583818 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f506d71b-d1b3-450b-a02f-6a38e745b44f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cec56f74b2fa4826a506dc7b919465be', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:03:51.584685 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f506d71b-d1b3-450b-a02f-6a38e745b44f admin admin] REQUEST_METHOD: `PUT` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:03:51.584965 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f506d71b-d1b3-450b-a02f-6a38e745b44f admin admin] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:03:51.585242 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f506d71b-d1b3-450b-a02f-6a38e745b44f admin admin] PATH_INFO: `/v3/projects/755f7a564dbd48d5ac275a9342b04366/users/43a138df43514fecb16b49a1ccad150d/roles/ff664fa0db7e4262a5accde96c3df4c3` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:03:51.599936 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f506d71b-d1b3-450b-a02f-6a38e745b44f admin admin] RBAC: Authorizing `identity:create_grant(project_id=755f7a564dbd48d5ac275a9342b04366, user_id=43a138df43514fecb16b49a1ccad150d, role_id=ff664fa0db7e4262a5accde96c3df4c3)` {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:03:51.603151 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f506d71b-d1b3-450b-a02f-6a38e745b44f admin admin] RBAC: Authorization granted {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:03:51.621421 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ddc310b-3820-4b45-8089-c90f725777cc None None] Validating token access rules against request {{(pid=101893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:03:51.625087 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06e0304f-b7a9-423f-81f7-629a00194727 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e079f89a5e524ab6ad4183e4f690de07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a000829c658c4a7cab67f7b6353ba3fa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:03:51.625804 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e0304f-b7a9-423f-81f7-629a00194727 service cinder] REQUEST_METHOD: `GET` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:03:51.626074 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e0304f-b7a9-423f-81f7-629a00194727 service cinder] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:03:51.636006 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e0304f-b7a9-423f-81f7-629a00194727 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:03:51.637760 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06e0304f-b7a9-423f-81f7-629a00194727 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:03:51.639254 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06e0304f-b7a9-423f-81f7-629a00194727 service cinder] RBAC: Authorization granted {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:03:51.649682 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 969/1906] 10.222.0.84 () {60 vars in 1365 bytes} [Wed May 25 15:03:51 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 25 15:03:51.696277 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 938/1907] 10.222.0.84 () {60 vars in 1482 bytes} [Wed May 25 15:03:51 2022] PUT /identity/v3/projects/755f7a564dbd48d5ac275a9342b04366/users/43a138df43514fecb16b49a1ccad150d/roles/ff664fa0db7e4262a5accde96c3df4c3 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 25 15:03:51.702488 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53dae72f-11de-4f40-99b8-3f134a10d8d2 None None] REQUEST_METHOD: `POST` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:03:51.703050 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53dae72f-11de-4f40-99b8-3f134a10d8d2 None None] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:03:51.703179 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53dae72f-11de-4f40-99b8-3f134a10d8d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:03:51.720772 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.auth.core [None req-53dae72f-11de-4f40-99b8-3f134a10d8d2 None None] MFA Rules not processed for user `05d87e87798e429aa1c10b24391f915e`. Rule list: `[]` (Enabled: `True`). {{(pid=101893) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:03:51.722035 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.fernet_utils [None req-53dae72f-11de-4f40-99b8-3f134a10d8d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=101893) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:03:51.776951 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG dbcounter [-] [101893] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=101893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:03:51.786484 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 970/1908] 10.222.0.84 () {58 vars in 957 bytes} [Wed May 25 15:03:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 15:03:51.796716 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f506d71b-d1b3-450b-a02f-6a38e745b44f admin admin] Authenticating user token {{(pid=101892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:03:51.798668 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.fernet_utils [None req-f506d71b-d1b3-450b-a02f-6a38e745b44f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=101892) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:03:51.856830 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f506d71b-d1b3-450b-a02f-6a38e745b44f admin admin] Validating token access rules against request {{(pid=101892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:03:51.860500 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb836fee-6ec0-4a05-acdb-2c27c7dc7757 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ce28b25b907473588ccb87dc4acc06a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a000829c658c4a7cab67f7b6353ba3fa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:03:51.861143 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb836fee-6ec0-4a05-acdb-2c27c7dc7757 service neutron] REQUEST_METHOD: `GET` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:03:51.861424 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb836fee-6ec0-4a05-acdb-2c27c7dc7757 service neutron] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:03:51.861699 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb836fee-6ec0-4a05-acdb-2c27c7dc7757 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:03:51.870594 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb836fee-6ec0-4a05-acdb-2c27c7dc7757 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:03:51.872111 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb836fee-6ec0-4a05-acdb-2c27c7dc7757 service neutron] RBAC: Authorization granted {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:03:51.881243 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 939/1909] 10.222.0.84 () {60 vars in 1365 bytes} [Wed May 25 15:03:51 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 15:03:52.995290 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53dae72f-11de-4f40-99b8-3f134a10d8d2 None None] Authenticating user token {{(pid=101893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:03:53.013794 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53dae72f-11de-4f40-99b8-3f134a10d8d2 None None] Validating token access rules against request {{(pid=101893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:03:53.021608 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1b6c3c4-4bb1-4bad-a689-886541bdfa9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cec56f74b2fa4826a506dc7b919465be', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:03:53.023281 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b6c3c4-4bb1-4bad-a689-886541bdfa9b admin admin] REQUEST_METHOD: `DELETE` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:03:53.023281 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b6c3c4-4bb1-4bad-a689-886541bdfa9b admin admin] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:03:53.023610 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b6c3c4-4bb1-4bad-a689-886541bdfa9b admin admin] PATH_INFO: `/v3/users/8c698bddc453472e8820aed953929efa` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:03:53.025645 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1b6c3c4-4bb1-4bad-a689-886541bdfa9b admin admin] RBAC: Authorizing `identity:delete_user(user_id=8c698bddc453472e8820aed953929efa)` {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:03:53.027896 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1b6c3c4-4bb1-4bad-a689-886541bdfa9b admin admin] RBAC: Authorization granted {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:03:53.241512 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.notifications [None req-c1b6c3c4-4bb1-4bad-a689-886541bdfa9b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8c698bddc453472e8820aed953929efa'} {{(pid=101893) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:03:53.250629 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.notifications [None req-c1b6c3c4-4bb1-4bad-a689-886541bdfa9b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8c698bddc453472e8820aed953929efa'} {{(pid=101893) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:03:53.273168 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.notifications [None req-c1b6c3c4-4bb1-4bad-a689-886541bdfa9b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8c698bddc453472e8820aed953929efa'} {{(pid=101893) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:03:53.274670 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.notifications [None req-c1b6c3c4-4bb1-4bad-a689-886541bdfa9b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8c698bddc453472e8820aed953929efa'} {{(pid=101893) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:03:53.275385 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.notifications [None req-c1b6c3c4-4bb1-4bad-a689-886541bdfa9b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8c698bddc453472e8820aed953929efa'} {{(pid=101893) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:03:53.365924 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 971/1910] 10.222.0.84 () {58 vars in 1223 bytes} [Wed May 25 15:03:52 2022] DELETE /identity/v3/users/8c698bddc453472e8820aed953929efa => generated 0 bytes in 371 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 15:03:53.370934 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4415bfb6-5d20-4938-8bf2-20e7e598cb28 None None] REQUEST_METHOD: `POST` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:03:53.371463 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4415bfb6-5d20-4938-8bf2-20e7e598cb28 None None] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:03:53.371689 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4415bfb6-5d20-4938-8bf2-20e7e598cb28 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:03:53.392875 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.auth.core [None req-4415bfb6-5d20-4938-8bf2-20e7e598cb28 None None] MFA Rules not processed for user `05d87e87798e429aa1c10b24391f915e`. Rule list: `[]` (Enabled: `True`). {{(pid=101892) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:03:53.394660 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.fernet_utils [None req-4415bfb6-5d20-4938-8bf2-20e7e598cb28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=101892) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:03:53.517975 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 940/1911] 10.222.0.84 () {58 vars in 957 bytes} [Wed May 25 15:03:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 15:03:53.535689 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1b6c3c4-4bb1-4bad-a689-886541bdfa9b admin admin] Authenticating user token {{(pid=101893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:03:53.535689 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.fernet_utils [None req-c1b6c3c4-4bb1-4bad-a689-886541bdfa9b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=101893) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:03:53.675434 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1b6c3c4-4bb1-4bad-a689-886541bdfa9b admin admin] Validating token access rules against request {{(pid=101893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:03:53.679117 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-693836c8-7d87-45b9-8764-6f1fdb9966bc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ce28b25b907473588ccb87dc4acc06a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a000829c658c4a7cab67f7b6353ba3fa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:03:53.679956 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693836c8-7d87-45b9-8764-6f1fdb9966bc service neutron] REQUEST_METHOD: `GET` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:03:53.680340 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693836c8-7d87-45b9-8764-6f1fdb9966bc service neutron] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:03:53.680682 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693836c8-7d87-45b9-8764-6f1fdb9966bc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:03:53.702961 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-693836c8-7d87-45b9-8764-6f1fdb9966bc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:03:53.704649 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-693836c8-7d87-45b9-8764-6f1fdb9966bc service neutron] RBAC: Authorization granted {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:03:53.721136 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 972/1912] 10.222.0.84 () {60 vars in 1365 bytes} [Wed May 25 15:03:53 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 188 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 15:03:54.073598 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df67134-e975-49e3-9b77-d4287207371a None None] REQUEST_METHOD: `POST` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:03:54.073894 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df67134-e975-49e3-9b77-d4287207371a None None] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:03:54.074178 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df67134-e975-49e3-9b77-d4287207371a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:03:54.137657 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.auth.core [None req-1df67134-e975-49e3-9b77-d4287207371a None None] MFA Rules not processed for user `43a138df43514fecb16b49a1ccad150d`. Rule list: `[]` (Enabled: `True`). {{(pid=101892) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:03:54.141090 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.fernet_utils [None req-1df67134-e975-49e3-9b77-d4287207371a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=101892) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:03:54.238767 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG dbcounter [-] [101892] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=101892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:03:54.322810 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 941/1913] 10.222.0.84 () {58 vars in 957 bytes} [Wed May 25 15:03:54 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 250 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 15:03:54.334424 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-693836c8-7d87-45b9-8764-6f1fdb9966bc service neutron] Authenticating user token {{(pid=101893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:03:54.336752 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.fernet_utils [None req-693836c8-7d87-45b9-8764-6f1fdb9966bc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=101893) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:03:54.429253 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1df67134-e975-49e3-9b77-d4287207371a None None] Authenticating user token {{(pid=101892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:03:54.431412 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.fernet_utils [None req-1df67134-e975-49e3-9b77-d4287207371a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=101892) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:03:54.469940 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1df67134-e975-49e3-9b77-d4287207371a None None] Validating token access rules against request {{(pid=101892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:03:54.475935 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-693836c8-7d87-45b9-8764-6f1fdb9966bc service neutron] Validating token access rules against request {{(pid=101893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:03:54.479979 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a22c97-e09f-41f3-9856-ddff4c30fd66 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e079f89a5e524ab6ad4183e4f690de07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a000829c658c4a7cab67f7b6353ba3fa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:03:54.481246 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a22c97-e09f-41f3-9856-ddff4c30fd66 service cinder] REQUEST_METHOD: `GET` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:03:54.481471 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a22c97-e09f-41f3-9856-ddff4c30fd66 service cinder] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:03:54.481711 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f1b574-280e-42a2-8f30-06ad8b8dfe38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cec56f74b2fa4826a506dc7b919465be', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:03:54.481831 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a22c97-e09f-41f3-9856-ddff4c30fd66 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:03:54.483177 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f1b574-280e-42a2-8f30-06ad8b8dfe38 admin admin] REQUEST_METHOD: `DELETE` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:03:54.483508 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f1b574-280e-42a2-8f30-06ad8b8dfe38 admin admin] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:03:54.484072 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f1b574-280e-42a2-8f30-06ad8b8dfe38 admin admin] PATH_INFO: `/v3/projects/a21cc4af0c5049a98e609967f13e2faf` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:03:54.485685 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44f1b574-280e-42a2-8f30-06ad8b8dfe38 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a21cc4af0c5049a98e609967f13e2faf)` {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:03:54.488341 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44f1b574-280e-42a2-8f30-06ad8b8dfe38 admin admin] RBAC: Authorization granted {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:03:54.492086 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7a22c97-e09f-41f3-9856-ddff4c30fd66 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:03:54.493617 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7a22c97-e09f-41f3-9856-ddff4c30fd66 service cinder] RBAC: Authorization granted {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:03:54.506174 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 973/1914] 10.222.0.84 () {60 vars in 1365 bytes} [Wed May 25 15:03:54 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 172 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 25 15:03:54.628710 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.notifications [None req-44f1b574-280e-42a2-8f30-06ad8b8dfe38 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a21cc4af0c5049a98e609967f13e2faf', 'request_id': 'req-44f1b574-280e-42a2-8f30-06ad8b8dfe38'} {{(pid=101892) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:03:54.637586 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.notifications [None req-44f1b574-280e-42a2-8f30-06ad8b8dfe38 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a21cc4af0c5049a98e609967f13e2faf', 'request_id': 'req-44f1b574-280e-42a2-8f30-06ad8b8dfe38'} {{(pid=101892) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:03:54.646883 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.notifications [None req-44f1b574-280e-42a2-8f30-06ad8b8dfe38 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a21cc4af0c5049a98e609967f13e2faf', 'request_id': 'req-44f1b574-280e-42a2-8f30-06ad8b8dfe38'} {{(pid=101892) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:03:54.715443 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.notifications [None req-44f1b574-280e-42a2-8f30-06ad8b8dfe38 admin admin] The token cache is being invalidate because project a21cc4af0c5049a98e609967f13e2faf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=101892) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 25 15:03:54.715755 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.notifications [None req-44f1b574-280e-42a2-8f30-06ad8b8dfe38 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=101892) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:03:54.717044 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.notifications [None req-44f1b574-280e-42a2-8f30-06ad8b8dfe38 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=101892) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:03:54.722939 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 942/1915] 10.222.0.84 () {58 vars in 1232 bytes} [Wed May 25 15:03:54 2022] DELETE /identity/v3/projects/a21cc4af0c5049a98e609967f13e2faf => generated 0 bytes in 291 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 15:03:54.723681 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a22c97-e09f-41f3-9856-ddff4c30fd66 service cinder] Authenticating user token {{(pid=101893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:03:54.735331 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a22c97-e09f-41f3-9856-ddff4c30fd66 service cinder] Validating token access rules against request {{(pid=101893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:03:54.744425 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG dbcounter [-] [101893] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=101893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:03:54.818114 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79bae7fd-e4dc-4f92-a3f7-06eacf27adf3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cec56f74b2fa4826a506dc7b919465be', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:03:54.819149 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79bae7fd-e4dc-4f92-a3f7-06eacf27adf3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:03:54.819440 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79bae7fd-e4dc-4f92-a3f7-06eacf27adf3 admin admin] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:03:54.819752 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79bae7fd-e4dc-4f92-a3f7-06eacf27adf3 admin admin] PATH_INFO: `/v3/users/42449a45fa54477d99d52c3b120fdcdb` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:03:54.821888 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79bae7fd-e4dc-4f92-a3f7-06eacf27adf3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=42449a45fa54477d99d52c3b120fdcdb)` {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:03:54.824480 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79bae7fd-e4dc-4f92-a3f7-06eacf27adf3 admin admin] RBAC: Authorization granted {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:03:55.025905 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.notifications [None req-79bae7fd-e4dc-4f92-a3f7-06eacf27adf3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '42449a45fa54477d99d52c3b120fdcdb'} {{(pid=101893) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:03:55.035257 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.notifications [None req-79bae7fd-e4dc-4f92-a3f7-06eacf27adf3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '42449a45fa54477d99d52c3b120fdcdb'} {{(pid=101893) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:03:55.049856 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.notifications [None req-79bae7fd-e4dc-4f92-a3f7-06eacf27adf3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '42449a45fa54477d99d52c3b120fdcdb'} {{(pid=101893) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:03:55.050713 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.notifications [None req-79bae7fd-e4dc-4f92-a3f7-06eacf27adf3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '42449a45fa54477d99d52c3b120fdcdb'} {{(pid=101893) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:03:55.051479 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.notifications [None req-79bae7fd-e4dc-4f92-a3f7-06eacf27adf3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '42449a45fa54477d99d52c3b120fdcdb'} {{(pid=101893) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:03:55.114791 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 974/1916] 10.222.0.84 () {58 vars in 1223 bytes} [Wed May 25 15:03:54 2022] DELETE /identity/v3/users/42449a45fa54477d99d52c3b120fdcdb => generated 0 bytes in 391 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 15:03:55.795311 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f1b574-280e-42a2-8f30-06ad8b8dfe38 admin admin] Authenticating user token {{(pid=101892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:03:55.796890 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.fernet_utils [None req-44f1b574-280e-42a2-8f30-06ad8b8dfe38 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=101892) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:03:55.823604 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f1b574-280e-42a2-8f30-06ad8b8dfe38 admin admin] Validating token access rules against request {{(pid=101892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:03:55.894212 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a5fe86e-5c21-4961-a165-c13ebfa1b91c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cec56f74b2fa4826a506dc7b919465be', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:03:55.895113 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a5fe86e-5c21-4961-a165-c13ebfa1b91c admin admin] REQUEST_METHOD: `DELETE` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:03:55.895394 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a5fe86e-5c21-4961-a165-c13ebfa1b91c admin admin] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:03:55.895707 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a5fe86e-5c21-4961-a165-c13ebfa1b91c admin admin] PATH_INFO: `/v3/projects/c551cfb3553e46dcb10a1361a557360e` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:03:55.896970 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a5fe86e-5c21-4961-a165-c13ebfa1b91c admin admin] RBAC: Authorizing `identity:delete_project(project_id=c551cfb3553e46dcb10a1361a557360e)` {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:03:55.899925 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a5fe86e-5c21-4961-a165-c13ebfa1b91c admin admin] RBAC: Authorization granted {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:03:56.022452 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.notifications [None req-2a5fe86e-5c21-4961-a165-c13ebfa1b91c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c551cfb3553e46dcb10a1361a557360e', 'request_id': 'req-2a5fe86e-5c21-4961-a165-c13ebfa1b91c'} {{(pid=101892) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:03:56.029425 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.notifications [None req-2a5fe86e-5c21-4961-a165-c13ebfa1b91c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c551cfb3553e46dcb10a1361a557360e', 'request_id': 'req-2a5fe86e-5c21-4961-a165-c13ebfa1b91c'} {{(pid=101892) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:03:56.031400 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG dbcounter [-] [101892] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=101892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:03:56.035483 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.notifications [None req-2a5fe86e-5c21-4961-a165-c13ebfa1b91c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c551cfb3553e46dcb10a1361a557360e', 'request_id': 'req-2a5fe86e-5c21-4961-a165-c13ebfa1b91c'} {{(pid=101892) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:03:56.140979 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.notifications [None req-2a5fe86e-5c21-4961-a165-c13ebfa1b91c admin admin] The token cache is being invalidate because project c551cfb3553e46dcb10a1361a557360e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=101892) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 25 15:03:56.141265 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.notifications [None req-2a5fe86e-5c21-4961-a165-c13ebfa1b91c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=101892) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:03:56.141876 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.notifications [None req-2a5fe86e-5c21-4961-a165-c13ebfa1b91c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=101892) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:03:56.143463 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 943/1917] 10.222.0.84 () {58 vars in 1232 bytes} [Wed May 25 15:03:55 2022] DELETE /identity/v3/projects/c551cfb3553e46dcb10a1361a557360e => generated 0 bytes in 349 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 15:03:56.149445 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8dc108-6759-4946-b86f-8084eb173dcb None None] REQUEST_METHOD: `POST` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:03:56.149882 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8dc108-6759-4946-b86f-8084eb173dcb None None] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:03:56.150018 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8dc108-6759-4946-b86f-8084eb173dcb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:03:56.167338 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.auth.core [None req-0b8dc108-6759-4946-b86f-8084eb173dcb None None] MFA Rules not processed for user `05d87e87798e429aa1c10b24391f915e`. Rule list: `[]` (Enabled: `True`). {{(pid=101893) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:03:56.168658 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.fernet_utils [None req-0b8dc108-6759-4946-b86f-8084eb173dcb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=101893) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:03:56.241749 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 975/1918] 10.222.0.84 () {58 vars in 957 bytes} [Wed May 25 15:03:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 15:03:56.250906 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4445bc1a-dad8-4d7a-88bc-6bdcd6e06b46 None None] REQUEST_METHOD: `POST` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:03:56.251203 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4445bc1a-dad8-4d7a-88bc-6bdcd6e06b46 None None] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:03:56.251492 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4445bc1a-dad8-4d7a-88bc-6bdcd6e06b46 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:03:56.278538 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.auth.core [None req-4445bc1a-dad8-4d7a-88bc-6bdcd6e06b46 None None] MFA Rules not processed for user `05d87e87798e429aa1c10b24391f915e`. Rule list: `[]` (Enabled: `True`). {{(pid=101892) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:03:56.279784 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.fernet_utils [None req-4445bc1a-dad8-4d7a-88bc-6bdcd6e06b46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=101892) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:03:56.288398 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 944/1919] 10.222.0.84 () {58 vars in 957 bytes} [Wed May 25 15:03:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 15:03:56.292532 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b8dc108-6759-4946-b86f-8084eb173dcb None None] Authenticating user token {{(pid=101893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:03:56.303918 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b8dc108-6759-4946-b86f-8084eb173dcb None None] Validating token access rules against request {{(pid=101893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:03:56.310076 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c93bdf-222a-49ed-81a0-94c7d155f0c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cec56f74b2fa4826a506dc7b919465be', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:03:56.310825 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c93bdf-222a-49ed-81a0-94c7d155f0c8 admin admin] REQUEST_METHOD: `GET` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:03:56.311173 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c93bdf-222a-49ed-81a0-94c7d155f0c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:03:56.312018 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c93bdf-222a-49ed-81a0-94c7d155f0c8 admin admin] PATH_INFO: `/v3/domains` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:03:56.312481 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71c93bdf-222a-49ed-81a0-94c7d155f0c8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=101893) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 15:03:56.312872 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71c93bdf-222a-49ed-81a0-94c7d155f0c8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:03:56.314598 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71c93bdf-222a-49ed-81a0-94c7d155f0c8 admin admin] RBAC: Authorization granted {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:03:56.328227 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 976/1920] 10.222.0.84 () {58 vars in 1152 bytes} [Wed May 25 15:03:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 15:03:56.332428 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4445bc1a-dad8-4d7a-88bc-6bdcd6e06b46 None None] Authenticating user token {{(pid=101892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:03:56.342005 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4445bc1a-dad8-4d7a-88bc-6bdcd6e06b46 None None] Validating token access rules against request {{(pid=101892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:03:56.346675 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39f957d4-3851-40ad-97ba-bae4b30290ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cec56f74b2fa4826a506dc7b919465be', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:03:56.347716 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f957d4-3851-40ad-97ba-bae4b30290ec admin admin] REQUEST_METHOD: `POST` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:03:56.347716 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f957d4-3851-40ad-97ba-bae4b30290ec admin admin] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:03:56.347918 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f957d4-3851-40ad-97ba-bae4b30290ec admin admin] PATH_INFO: `/v3/projects` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:03:56.348595 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39f957d4-3851-40ad-97ba-bae4b30290ec admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:03:56.350486 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39f957d4-3851-40ad-97ba-bae4b30290ec admin admin] RBAC: Authorization granted {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:03:56.429245 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 945/1921] 10.222.0.84 () {60 vars in 1152 bytes} [Wed May 25 15:03:56 2022] POST /identity/v3/projects => generated 371 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 15:03:56.433853 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c93bdf-222a-49ed-81a0-94c7d155f0c8 admin admin] Authenticating user token {{(pid=101893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:03:56.443992 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c93bdf-222a-49ed-81a0-94c7d155f0c8 admin admin] Validating token access rules against request {{(pid=101893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:03:56.457347 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG dbcounter [-] [101893] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=101893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:03:56.501853 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d9c319f-a9ea-4e82-bdf8-3fced3934b40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cec56f74b2fa4826a506dc7b919465be', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:03:56.502516 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d9c319f-a9ea-4e82-bdf8-3fced3934b40 admin admin] REQUEST_METHOD: `POST` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:03:56.502802 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d9c319f-a9ea-4e82-bdf8-3fced3934b40 admin admin] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:03:56.503085 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d9c319f-a9ea-4e82-bdf8-3fced3934b40 admin admin] PATH_INFO: `/v3/users` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:03:56.503794 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d9c319f-a9ea-4e82-bdf8-3fced3934b40 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:03:56.505715 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d9c319f-a9ea-4e82-bdf8-3fced3934b40 admin admin] RBAC: Authorization granted {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:03:56.599023 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 977/1922] 10.222.0.84 () {60 vars in 1143 bytes} [Wed May 25 15:03:56 2022] POST /identity/v3/users => generated 286 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 15:03:56.603574 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39f957d4-3851-40ad-97ba-bae4b30290ec admin admin] Authenticating user token {{(pid=101892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:03:56.613942 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39f957d4-3851-40ad-97ba-bae4b30290ec admin admin] Validating token access rules against request {{(pid=101892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:03:56.619916 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1750f26-3d8f-4231-9e9a-49aa83f4312d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cec56f74b2fa4826a506dc7b919465be', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:03:56.620570 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1750f26-3d8f-4231-9e9a-49aa83f4312d admin admin] REQUEST_METHOD: `GET` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:03:56.620855 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1750f26-3d8f-4231-9e9a-49aa83f4312d admin admin] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:03:56.621133 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1750f26-3d8f-4231-9e9a-49aa83f4312d admin admin] PATH_INFO: `/v3/roles` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:03:56.621854 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1750f26-3d8f-4231-9e9a-49aa83f4312d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:03:56.623478 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1750f26-3d8f-4231-9e9a-49aa83f4312d admin admin] RBAC: Authorization granted {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:03:56.633621 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 946/1923] 10.222.0.84 () {58 vars in 1121 bytes} [Wed May 25 15:03:56 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 15:03:56.637541 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d9c319f-a9ea-4e82-bdf8-3fced3934b40 admin admin] Authenticating user token {{(pid=101893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:03:56.647718 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d9c319f-a9ea-4e82-bdf8-3fced3934b40 admin admin] Validating token access rules against request {{(pid=101893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:03:56.652380 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af2e222a-a15b-4c61-86d9-4b3c732b53f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cec56f74b2fa4826a506dc7b919465be', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:03:56.653043 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af2e222a-a15b-4c61-86d9-4b3c732b53f1 admin admin] REQUEST_METHOD: `GET` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:03:56.653330 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af2e222a-a15b-4c61-86d9-4b3c732b53f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:03:56.653611 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af2e222a-a15b-4c61-86d9-4b3c732b53f1 admin admin] PATH_INFO: `/v3/roles` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:03:56.654330 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af2e222a-a15b-4c61-86d9-4b3c732b53f1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:03:56.656039 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af2e222a-a15b-4c61-86d9-4b3c732b53f1 admin admin] RBAC: Authorization granted {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:03:56.666475 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 978/1924] 10.222.0.84 () {58 vars in 1121 bytes} [Wed May 25 15:03:56 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 15:03:56.675753 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1750f26-3d8f-4231-9e9a-49aa83f4312d admin admin] Authenticating user token {{(pid=101892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:03:56.686151 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1750f26-3d8f-4231-9e9a-49aa83f4312d admin admin] Validating token access rules against request {{(pid=101892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:03:56.690669 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e86a5d7-db56-47bc-95ea-cac60462e5b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cec56f74b2fa4826a506dc7b919465be', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:03:56.691585 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e86a5d7-db56-47bc-95ea-cac60462e5b8 admin admin] REQUEST_METHOD: `PUT` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:03:56.691872 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e86a5d7-db56-47bc-95ea-cac60462e5b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:03:56.692146 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e86a5d7-db56-47bc-95ea-cac60462e5b8 admin admin] PATH_INFO: `/v3/projects/2a9edfa1aa93438e9f964a903335daf7/users/633d0f7ef5da4b01bac2aafabb3c5036/roles/ff664fa0db7e4262a5accde96c3df4c3` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:03:56.707485 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e86a5d7-db56-47bc-95ea-cac60462e5b8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2a9edfa1aa93438e9f964a903335daf7, user_id=633d0f7ef5da4b01bac2aafabb3c5036, role_id=ff664fa0db7e4262a5accde96c3df4c3)` {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:03:56.710173 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e86a5d7-db56-47bc-95ea-cac60462e5b8 admin admin] RBAC: Authorization granted {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:03:56.787980 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 947/1925] 10.222.0.84 () {60 vars in 1482 bytes} [Wed May 25 15:03:56 2022] PUT /identity/v3/projects/2a9edfa1aa93438e9f964a903335daf7/users/633d0f7ef5da4b01bac2aafabb3c5036/roles/ff664fa0db7e4262a5accde96c3df4c3 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 15:03:56.793610 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78613865-d660-4408-b583-ff986e3613b3 None None] REQUEST_METHOD: `POST` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:03:56.793926 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78613865-d660-4408-b583-ff986e3613b3 None None] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:03:56.794213 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78613865-d660-4408-b583-ff986e3613b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:03:56.813496 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.auth.core [None req-78613865-d660-4408-b583-ff986e3613b3 None None] MFA Rules not processed for user `05d87e87798e429aa1c10b24391f915e`. Rule list: `[]` (Enabled: `True`). {{(pid=101893) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:03:56.814726 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.fernet_utils [None req-78613865-d660-4408-b583-ff986e3613b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=101893) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:03:56.884015 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 979/1926] 10.222.0.84 () {58 vars in 957 bytes} [Wed May 25 15:03:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 15:03:56.887193 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e86a5d7-db56-47bc-95ea-cac60462e5b8 admin admin] Authenticating user token {{(pid=101892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:03:56.889123 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.fernet_utils [None req-1e86a5d7-db56-47bc-95ea-cac60462e5b8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=101892) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:03:56.951913 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e86a5d7-db56-47bc-95ea-cac60462e5b8 admin admin] Validating token access rules against request {{(pid=101892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:03:56.955680 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc745b80-c5f1-4450-a638-2db3d58ce8ec service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ce28b25b907473588ccb87dc4acc06a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a000829c658c4a7cab67f7b6353ba3fa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:03:56.956337 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc745b80-c5f1-4450-a638-2db3d58ce8ec service neutron] REQUEST_METHOD: `GET` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:03:56.956624 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc745b80-c5f1-4450-a638-2db3d58ce8ec service neutron] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:03:56.956906 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc745b80-c5f1-4450-a638-2db3d58ce8ec service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:03:56.966579 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc745b80-c5f1-4450-a638-2db3d58ce8ec service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:03:56.968179 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc745b80-c5f1-4450-a638-2db3d58ce8ec service neutron] RBAC: Authorization granted {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:03:56.978521 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 948/1927] 10.222.0.84 () {60 vars in 1365 bytes} [Wed May 25 15:03:56 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 15:03:57.334971 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f23d4674-78a7-48f5-aeb5-08cefb53c046 None None] REQUEST_METHOD: `POST` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:03:57.335424 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f23d4674-78a7-48f5-aeb5-08cefb53c046 None None] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:03:57.335622 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f23d4674-78a7-48f5-aeb5-08cefb53c046 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:03:57.354877 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.auth.core [None req-f23d4674-78a7-48f5-aeb5-08cefb53c046 None None] MFA Rules not processed for user `43a138df43514fecb16b49a1ccad150d`. Rule list: `[]` (Enabled: `True`). {{(pid=101893) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:03:57.356262 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.fernet_utils [None req-f23d4674-78a7-48f5-aeb5-08cefb53c046 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=101893) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:03:57.419734 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 980/1928] 10.222.0.84 () {58 vars in 957 bytes} [Wed May 25 15:03:57 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 15:03:58.219461 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8146e6b5-15f2-463d-bf35-0117c4ce2bca None None] REQUEST_METHOD: `POST` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:03:58.220616 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8146e6b5-15f2-463d-bf35-0117c4ce2bca None None] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:03:58.221119 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8146e6b5-15f2-463d-bf35-0117c4ce2bca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:03:58.268144 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.auth.core [None req-8146e6b5-15f2-463d-bf35-0117c4ce2bca None None] MFA Rules not processed for user `633d0f7ef5da4b01bac2aafabb3c5036`. Rule list: `[]` (Enabled: `True`). {{(pid=101892) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:03:58.270234 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.fernet_utils [None req-8146e6b5-15f2-463d-bf35-0117c4ce2bca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=101892) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:03:58.387347 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 949/1929] 10.222.0.84 () {58 vars in 957 bytes} [Wed May 25 15:03:58 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 15:03:58.391744 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f23d4674-78a7-48f5-aeb5-08cefb53c046 None None] Authenticating user token {{(pid=101893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:03:58.406656 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f23d4674-78a7-48f5-aeb5-08cefb53c046 None None] Validating token access rules against request {{(pid=101893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:03:58.411964 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f865b977-2226-4770-b581-13d823eb8b5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cec56f74b2fa4826a506dc7b919465be', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:03:58.412852 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f865b977-2226-4770-b581-13d823eb8b5e admin admin] REQUEST_METHOD: `POST` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:03:58.413133 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f865b977-2226-4770-b581-13d823eb8b5e admin admin] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:03:58.413404 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f865b977-2226-4770-b581-13d823eb8b5e admin admin] PATH_INFO: `/v3/projects` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:03:58.414135 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f865b977-2226-4770-b581-13d823eb8b5e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:03:58.416868 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f865b977-2226-4770-b581-13d823eb8b5e admin admin] RBAC: Authorization granted {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:03:58.497764 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 981/1930] 10.222.0.84 () {60 vars in 1152 bytes} [Wed May 25 15:03:58 2022] POST /identity/v3/projects => generated 371 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 15:03:58.502028 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8146e6b5-15f2-463d-bf35-0117c4ce2bca None None] Authenticating user token {{(pid=101892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:03:58.512967 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8146e6b5-15f2-463d-bf35-0117c4ce2bca None None] Validating token access rules against request {{(pid=101892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:03:58.523727 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG dbcounter [-] [101892] Writing DB stats keystone:SELECT=95,keystone:DELETE=2,keystone:INSERT=3 {{(pid=101892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:03:58.586472 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab23916-d73d-4dd9-aa53-3f1b0d20eedf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cec56f74b2fa4826a506dc7b919465be', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:03:58.587768 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab23916-d73d-4dd9-aa53-3f1b0d20eedf admin admin] REQUEST_METHOD: `POST` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:03:58.588055 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab23916-d73d-4dd9-aa53-3f1b0d20eedf admin admin] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:03:58.588334 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab23916-d73d-4dd9-aa53-3f1b0d20eedf admin admin] PATH_INFO: `/v3/users` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:03:58.589060 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eab23916-d73d-4dd9-aa53-3f1b0d20eedf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:03:58.590967 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eab23916-d73d-4dd9-aa53-3f1b0d20eedf admin admin] RBAC: Authorization granted {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:03:58.711194 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 950/1931] 10.222.0.84 () {60 vars in 1143 bytes} [Wed May 25 15:03:58 2022] POST /identity/v3/users => generated 292 bytes in 207 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 15:03:58.713393 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f865b977-2226-4770-b581-13d823eb8b5e admin admin] Authenticating user token {{(pid=101893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:03:58.723814 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f865b977-2226-4770-b581-13d823eb8b5e admin admin] Validating token access rules against request {{(pid=101893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:03:58.729198 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12eaa6c4-383a-464b-ad16-4f3d31b1fdce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cec56f74b2fa4826a506dc7b919465be', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:03:58.729886 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12eaa6c4-383a-464b-ad16-4f3d31b1fdce admin admin] REQUEST_METHOD: `GET` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:03:58.730254 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12eaa6c4-383a-464b-ad16-4f3d31b1fdce admin admin] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:03:58.734219 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12eaa6c4-383a-464b-ad16-4f3d31b1fdce admin admin] PATH_INFO: `/v3/roles` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:03:58.734219 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12eaa6c4-383a-464b-ad16-4f3d31b1fdce admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:03:58.734219 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12eaa6c4-383a-464b-ad16-4f3d31b1fdce admin admin] RBAC: Authorization granted {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:03:58.746537 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 982/1932] 10.222.0.84 () {58 vars in 1121 bytes} [Wed May 25 15:03:58 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 15:03:58.750834 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab23916-d73d-4dd9-aa53-3f1b0d20eedf admin admin] Authenticating user token {{(pid=101892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:03:58.763599 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab23916-d73d-4dd9-aa53-3f1b0d20eedf admin admin] Validating token access rules against request {{(pid=101892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:03:58.769954 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b87c33c3-de99-4ef7-9fcd-f3e0c1ae46f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cec56f74b2fa4826a506dc7b919465be', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:03:58.770863 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87c33c3-de99-4ef7-9fcd-f3e0c1ae46f6 admin admin] REQUEST_METHOD: `PUT` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:03:58.771154 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87c33c3-de99-4ef7-9fcd-f3e0c1ae46f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:03:58.771428 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87c33c3-de99-4ef7-9fcd-f3e0c1ae46f6 admin admin] PATH_INFO: `/v3/projects/8c16ec4eb86b4d23b41af699e3587cef/users/72d282e722624907848aba031fb5e317/roles/a3b78e7d547d4d2d998b4c99a4396bba` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:03:58.787980 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b87c33c3-de99-4ef7-9fcd-f3e0c1ae46f6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8c16ec4eb86b4d23b41af699e3587cef, user_id=72d282e722624907848aba031fb5e317, role_id=a3b78e7d547d4d2d998b4c99a4396bba)` {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:03:58.790697 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b87c33c3-de99-4ef7-9fcd-f3e0c1ae46f6 admin admin] RBAC: Authorization granted {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:03:58.856485 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 951/1933] 10.222.0.84 () {60 vars in 1482 bytes} [Wed May 25 15:03:58 2022] PUT /identity/v3/projects/8c16ec4eb86b4d23b41af699e3587cef/users/72d282e722624907848aba031fb5e317/roles/a3b78e7d547d4d2d998b4c99a4396bba => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 15:03:58.860671 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12eaa6c4-383a-464b-ad16-4f3d31b1fdce admin admin] Authenticating user token {{(pid=101893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:03:58.870974 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12eaa6c4-383a-464b-ad16-4f3d31b1fdce admin admin] Validating token access rules against request {{(pid=101893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:03:58.876252 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG dbcounter [-] [101893] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=101893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:03:58.930966 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67ccce15-05eb-45b6-b39f-3aa6598711fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cec56f74b2fa4826a506dc7b919465be', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:03:58.931693 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ccce15-05eb-45b6-b39f-3aa6598711fe admin admin] REQUEST_METHOD: `GET` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:03:58.931974 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ccce15-05eb-45b6-b39f-3aa6598711fe admin admin] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:03:58.932450 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ccce15-05eb-45b6-b39f-3aa6598711fe admin admin] PATH_INFO: `/v3/roles` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:03:58.933890 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67ccce15-05eb-45b6-b39f-3aa6598711fe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:03:58.935705 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67ccce15-05eb-45b6-b39f-3aa6598711fe admin admin] RBAC: Authorization granted {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:03:58.949337 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 983/1934] 10.222.0.84 () {58 vars in 1121 bytes} [Wed May 25 15:03:58 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 15:03:58.954700 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b87c33c3-de99-4ef7-9fcd-f3e0c1ae46f6 admin admin] Authenticating user token {{(pid=101892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:03:58.968813 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b87c33c3-de99-4ef7-9fcd-f3e0c1ae46f6 admin admin] Validating token access rules against request {{(pid=101892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:03:58.975785 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca955042-d13a-4f2c-b123-10d1e85b1aad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cec56f74b2fa4826a506dc7b919465be', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:03:58.976984 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca955042-d13a-4f2c-b123-10d1e85b1aad admin admin] REQUEST_METHOD: `PUT` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:03:58.978193 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca955042-d13a-4f2c-b123-10d1e85b1aad admin admin] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:03:58.978477 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca955042-d13a-4f2c-b123-10d1e85b1aad admin admin] PATH_INFO: `/v3/projects/8c16ec4eb86b4d23b41af699e3587cef/users/72d282e722624907848aba031fb5e317/roles/a3b78e7d547d4d2d998b4c99a4396bba` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:03:58.981276 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca955042-d13a-4f2c-b123-10d1e85b1aad admin admin] RBAC: Authorizing `identity:create_grant(project_id=8c16ec4eb86b4d23b41af699e3587cef, user_id=72d282e722624907848aba031fb5e317, role_id=a3b78e7d547d4d2d998b4c99a4396bba)` {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:03:58.984322 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca955042-d13a-4f2c-b123-10d1e85b1aad admin admin] RBAC: Authorization granted {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:03:58.997376 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 952/1935] 10.222.0.84 () {60 vars in 1482 bytes} [Wed May 25 15:03:58 2022] PUT /identity/v3/projects/8c16ec4eb86b4d23b41af699e3587cef/users/72d282e722624907848aba031fb5e317/roles/a3b78e7d547d4d2d998b4c99a4396bba => generated 0 bytes in 43 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 15:04:00.382143 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a8f846-5632-4bc1-a248-e79a68d1a24a None None] REQUEST_METHOD: `POST` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:04:00.383114 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a8f846-5632-4bc1-a248-e79a68d1a24a None None] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:04:00.384197 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a8f846-5632-4bc1-a248-e79a68d1a24a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:04:00.429734 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.auth.core [None req-61a8f846-5632-4bc1-a248-e79a68d1a24a None None] MFA Rules not processed for user `72d282e722624907848aba031fb5e317`. Rule list: `[]` (Enabled: `True`). {{(pid=101893) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:04:00.432192 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.fernet_utils [None req-61a8f846-5632-4bc1-a248-e79a68d1a24a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=101893) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:04:00.573878 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 984/1936] 10.222.0.84 () {58 vars in 957 bytes} [Wed May 25 15:04:00 2022] POST /identity/v3/auth/tokens => generated 3305 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 15:04:00.585883 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b16c520-8956-46c4-8e77-d0d15f9df7c3 None None] REQUEST_METHOD: `POST` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:04:00.586389 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b16c520-8956-46c4-8e77-d0d15f9df7c3 None None] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:04:00.586494 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b16c520-8956-46c4-8e77-d0d15f9df7c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:04:00.606218 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.auth.core [None req-7b16c520-8956-46c4-8e77-d0d15f9df7c3 None None] MFA Rules not processed for user `633d0f7ef5da4b01bac2aafabb3c5036`. Rule list: `[]` (Enabled: `True`). {{(pid=101892) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:04:00.607467 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.fernet_utils [None req-7b16c520-8956-46c4-8e77-d0d15f9df7c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=101892) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:04:00.667190 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 953/1937] 10.222.0.84 () {58 vars in 957 bytes} [Wed May 25 15:04:00 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 15:04:00.677857 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61a8f846-5632-4bc1-a248-e79a68d1a24a None None] Authenticating user token {{(pid=101893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:04:00.679791 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.fernet_utils [None req-61a8f846-5632-4bc1-a248-e79a68d1a24a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=101893) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:04:00.746477 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG dbcounter [-] [101893] Writing DB stats keystone:SELECT=100 {{(pid=101893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:04:00.777821 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61a8f846-5632-4bc1-a248-e79a68d1a24a None None] Validating token access rules against request {{(pid=101893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:04:00.783514 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b6246c2-1e71-4d0a-b024-e94ac60edc9b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2aeb182e6a5b43cfb0cc347ec847c848', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a000829c658c4a7cab67f7b6353ba3fa', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:04:00.784207 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6246c2-1e71-4d0a-b024-e94ac60edc9b service nova] REQUEST_METHOD: `GET` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:04:00.784496 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6246c2-1e71-4d0a-b024-e94ac60edc9b service nova] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:04:00.784785 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6246c2-1e71-4d0a-b024-e94ac60edc9b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:04:00.793882 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b6246c2-1e71-4d0a-b024-e94ac60edc9b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:04:00.795507 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b6246c2-1e71-4d0a-b024-e94ac60edc9b service nova] RBAC: Authorization granted {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:04:00.806366 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 985/1938] 10.222.0.84 () {60 vars in 1365 bytes} [Wed May 25 15:04:00 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 129 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 15:04:05.798907 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-129ea7b9-bb52-4996-bb84-2549f9326672 None None] REQUEST_METHOD: `GET` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:04:05.799393 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-129ea7b9-bb52-4996-bb84-2549f9326672 None None] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:04:05.799500 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-129ea7b9-bb52-4996-bb84-2549f9326672 None None] PATH_INFO: `/` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:04:05.800883 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 954/1939] 10.222.0.84 () {54 vars in 921 bytes} [Wed May 25 15:04:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 15:04:05.831981 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018f22d6-97b2-45ef-bf54-7ec96ddd5020 None None] REQUEST_METHOD: `POST` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:04:05.832891 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018f22d6-97b2-45ef-bf54-7ec96ddd5020 None None] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:04:05.834413 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018f22d6-97b2-45ef-bf54-7ec96ddd5020 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:04:05.855646 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.auth.core [None req-018f22d6-97b2-45ef-bf54-7ec96ddd5020 None None] MFA Rules not processed for user `d18c4a1d92b94c0087a203db4fed22f2`. Rule list: `[]` (Enabled: `True`). {{(pid=101893) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:04:05.857443 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.fernet_utils [None req-018f22d6-97b2-45ef-bf54-7ec96ddd5020 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=101893) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:04:05.928191 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 986/1940] 10.222.0.84 () {58 vars in 1018 bytes} [Wed May 25 15:04:05 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 15:04:05.952822 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-129ea7b9-bb52-4996-bb84-2549f9326672 None None] Authenticating user token {{(pid=101892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:04:05.954066 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.fernet_utils [None req-129ea7b9-bb52-4996-bb84-2549f9326672 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=101892) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:04:05.974709 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-129ea7b9-bb52-4996-bb84-2549f9326672 None None] Validating token access rules against request {{(pid=101892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:04:05.980653 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93e4fc30-dae0-47b9-a76b-c427c4419b59 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd18c4a1d92b94c0087a203db4fed22f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a000829c658c4a7cab67f7b6353ba3fa', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:04:05.981420 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e4fc30-dae0-47b9-a76b-c427c4419b59 service placement] REQUEST_METHOD: `GET` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:04:05.981711 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e4fc30-dae0-47b9-a76b-c427c4419b59 service placement] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:04:05.981988 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e4fc30-dae0-47b9-a76b-c427c4419b59 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:04:05.991235 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93e4fc30-dae0-47b9-a76b-c427c4419b59 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:04:05.992870 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93e4fc30-dae0-47b9-a76b-c427c4419b59 service placement] RBAC: Authorization granted {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:04:06.001513 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-018f22d6-97b2-45ef-bf54-7ec96ddd5020 None None] Authenticating user token {{(pid=101893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:04:06.004660 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.fernet_utils [None req-018f22d6-97b2-45ef-bf54-7ec96ddd5020 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=101893) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:04:06.005410 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 955/1941] 10.222.0.84 () {60 vars in 1365 bytes} [Wed May 25 15:04:05 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 15:04:06.115595 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-018f22d6-97b2-45ef-bf54-7ec96ddd5020 None None] Validating token access rules against request {{(pid=101893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:04:06.120587 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43873d2e-a2cc-48fa-9888-c284c14b4d10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cec56f74b2fa4826a506dc7b919465be', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:04:06.121493 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43873d2e-a2cc-48fa-9888-c284c14b4d10 admin admin] REQUEST_METHOD: `DELETE` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:04:06.121777 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43873d2e-a2cc-48fa-9888-c284c14b4d10 admin admin] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:04:06.122052 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43873d2e-a2cc-48fa-9888-c284c14b4d10 admin admin] PATH_INFO: `/v3/users/487533f39e944ceaad952200101f021f` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:04:06.123410 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43873d2e-a2cc-48fa-9888-c284c14b4d10 admin admin] RBAC: Authorizing `identity:delete_user(user_id=487533f39e944ceaad952200101f021f)` {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:04:06.125400 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43873d2e-a2cc-48fa-9888-c284c14b4d10 admin admin] RBAC: Authorization granted {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:04:06.239935 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG dbcounter [-] [101893] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=101893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:04:06.249070 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.notifications [None req-43873d2e-a2cc-48fa-9888-c284c14b4d10 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '487533f39e944ceaad952200101f021f'} {{(pid=101893) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:04:06.256166 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.notifications [None req-43873d2e-a2cc-48fa-9888-c284c14b4d10 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '487533f39e944ceaad952200101f021f'} {{(pid=101893) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:04:06.269572 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.notifications [None req-43873d2e-a2cc-48fa-9888-c284c14b4d10 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '487533f39e944ceaad952200101f021f'} {{(pid=101893) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:04:06.270935 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.notifications [None req-43873d2e-a2cc-48fa-9888-c284c14b4d10 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '487533f39e944ceaad952200101f021f'} {{(pid=101893) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:04:06.271053 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.notifications [None req-43873d2e-a2cc-48fa-9888-c284c14b4d10 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '487533f39e944ceaad952200101f021f'} {{(pid=101893) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:04:06.342088 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 987/1942] 10.222.0.84 () {58 vars in 1223 bytes} [Wed May 25 15:04:06 2022] DELETE /identity/v3/users/487533f39e944ceaad952200101f021f => generated 0 bytes in 341 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 25 15:04:06.569135 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93e4fc30-dae0-47b9-a76b-c427c4419b59 service placement] Authenticating user token {{(pid=101892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:04:06.581681 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93e4fc30-dae0-47b9-a76b-c427c4419b59 service placement] Validating token access rules against request {{(pid=101892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:04:06.640610 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG dbcounter [-] [101892] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=101892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:04:06.646963 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8553168f-e3ed-43d1-8ede-8ef8e0b33c75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cec56f74b2fa4826a506dc7b919465be', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:04:06.647890 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8553168f-e3ed-43d1-8ede-8ef8e0b33c75 admin admin] REQUEST_METHOD: `DELETE` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:04:06.648170 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8553168f-e3ed-43d1-8ede-8ef8e0b33c75 admin admin] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:04:06.648446 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8553168f-e3ed-43d1-8ede-8ef8e0b33c75 admin admin] PATH_INFO: `/v3/projects/e16d2e514b824e0896c5272e2d0a5e29` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:04:06.650165 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8553168f-e3ed-43d1-8ede-8ef8e0b33c75 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e16d2e514b824e0896c5272e2d0a5e29)` {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:04:06.652122 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8553168f-e3ed-43d1-8ede-8ef8e0b33c75 admin admin] RBAC: Authorization granted {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:04:06.744318 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.notifications [None req-8553168f-e3ed-43d1-8ede-8ef8e0b33c75 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e16d2e514b824e0896c5272e2d0a5e29', 'request_id': 'req-8553168f-e3ed-43d1-8ede-8ef8e0b33c75'} {{(pid=101892) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:04:06.751112 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.notifications [None req-8553168f-e3ed-43d1-8ede-8ef8e0b33c75 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e16d2e514b824e0896c5272e2d0a5e29', 'request_id': 'req-8553168f-e3ed-43d1-8ede-8ef8e0b33c75'} {{(pid=101892) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:04:06.756675 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.notifications [None req-8553168f-e3ed-43d1-8ede-8ef8e0b33c75 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e16d2e514b824e0896c5272e2d0a5e29', 'request_id': 'req-8553168f-e3ed-43d1-8ede-8ef8e0b33c75'} {{(pid=101892) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:04:06.822132 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.notifications [None req-8553168f-e3ed-43d1-8ede-8ef8e0b33c75 admin admin] The token cache is being invalidate because project e16d2e514b824e0896c5272e2d0a5e29 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=101892) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 25 15:04:06.822697 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.notifications [None req-8553168f-e3ed-43d1-8ede-8ef8e0b33c75 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=101892) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:04:06.823063 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.notifications [None req-8553168f-e3ed-43d1-8ede-8ef8e0b33c75 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=101892) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:04:06.824627 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 956/1943] 10.222.0.84 () {58 vars in 1232 bytes} [Wed May 25 15:04:06 2022] DELETE /identity/v3/projects/e16d2e514b824e0896c5272e2d0a5e29 => generated 0 bytes in 257 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 25 15:04:06.833571 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a736d2ef-58ac-42b1-aec4-7695ac45e311 None None] REQUEST_METHOD: `POST` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:04:06.834070 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a736d2ef-58ac-42b1-aec4-7695ac45e311 None None] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:04:06.834247 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a736d2ef-58ac-42b1-aec4-7695ac45e311 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:04:06.880836 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.auth.core [None req-a736d2ef-58ac-42b1-aec4-7695ac45e311 None None] MFA Rules not processed for user `05d87e87798e429aa1c10b24391f915e`. Rule list: `[]` (Enabled: `True`). {{(pid=101893) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:04:06.882047 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.fernet_utils [None req-a736d2ef-58ac-42b1-aec4-7695ac45e311 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=101893) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:04:06.940665 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 988/1944] 10.222.0.84 () {58 vars in 957 bytes} [Wed May 25 15:04:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 15:04:06.949174 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4cd562f-d949-4af7-b38e-d5f60e9e848f None None] REQUEST_METHOD: `POST` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:04:06.949454 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4cd562f-d949-4af7-b38e-d5f60e9e848f None None] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:04:06.954647 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4cd562f-d949-4af7-b38e-d5f60e9e848f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:04:06.969340 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.auth.core [None req-f4cd562f-d949-4af7-b38e-d5f60e9e848f None None] MFA Rules not processed for user `05d87e87798e429aa1c10b24391f915e`. Rule list: `[]` (Enabled: `True`). {{(pid=101892) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:04:06.970534 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.fernet_utils [None req-f4cd562f-d949-4af7-b38e-d5f60e9e848f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=101892) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:04:06.978832 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 957/1945] 10.222.0.84 () {58 vars in 957 bytes} [Wed May 25 15:04:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 15:04:06.983139 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a736d2ef-58ac-42b1-aec4-7695ac45e311 None None] Authenticating user token {{(pid=101893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:04:06.993878 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a736d2ef-58ac-42b1-aec4-7695ac45e311 None None] Validating token access rules against request {{(pid=101893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:04:06.998722 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b72836ea-e009-4526-b1b6-200a4f572292 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cec56f74b2fa4826a506dc7b919465be', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:04:07.000572 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72836ea-e009-4526-b1b6-200a4f572292 admin admin] REQUEST_METHOD: `GET` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:04:07.000572 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72836ea-e009-4526-b1b6-200a4f572292 admin admin] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:04:07.000572 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72836ea-e009-4526-b1b6-200a4f572292 admin admin] PATH_INFO: `/v3/domains` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:04:07.000832 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b72836ea-e009-4526-b1b6-200a4f572292 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=101893) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 15:04:07.000999 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b72836ea-e009-4526-b1b6-200a4f572292 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:04:07.002645 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b72836ea-e009-4526-b1b6-200a4f572292 admin admin] RBAC: Authorization granted {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:04:07.015113 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 989/1946] 10.222.0.84 () {58 vars in 1152 bytes} [Wed May 25 15:04:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 15:04:07.019471 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4cd562f-d949-4af7-b38e-d5f60e9e848f None None] Authenticating user token {{(pid=101892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:04:07.029089 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4cd562f-d949-4af7-b38e-d5f60e9e848f None None] Validating token access rules against request {{(pid=101892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:04:07.033961 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac6444af-dcfc-445a-bd10-ea7cd7034a36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cec56f74b2fa4826a506dc7b919465be', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:04:07.034637 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6444af-dcfc-445a-bd10-ea7cd7034a36 admin admin] REQUEST_METHOD: `POST` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:04:07.034917 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6444af-dcfc-445a-bd10-ea7cd7034a36 admin admin] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:04:07.035190 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6444af-dcfc-445a-bd10-ea7cd7034a36 admin admin] PATH_INFO: `/v3/projects` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:04:07.035920 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac6444af-dcfc-445a-bd10-ea7cd7034a36 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:04:07.037910 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac6444af-dcfc-445a-bd10-ea7cd7034a36 admin admin] RBAC: Authorization granted {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:04:07.139431 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 958/1947] 10.222.0.84 () {60 vars in 1152 bytes} [Wed May 25 15:04:07 2022] POST /identity/v3/projects => generated 373 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 15:04:07.143703 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b72836ea-e009-4526-b1b6-200a4f572292 admin admin] Authenticating user token {{(pid=101893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:04:07.153967 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b72836ea-e009-4526-b1b6-200a4f572292 admin admin] Validating token access rules against request {{(pid=101893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:04:07.216797 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f21295-327a-4334-840d-7a4063ddb08d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cec56f74b2fa4826a506dc7b919465be', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:04:07.217434 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f21295-327a-4334-840d-7a4063ddb08d admin admin] REQUEST_METHOD: `POST` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:04:07.217719 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f21295-327a-4334-840d-7a4063ddb08d admin admin] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:04:07.217994 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f21295-327a-4334-840d-7a4063ddb08d admin admin] PATH_INFO: `/v3/users` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:04:07.219452 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49f21295-327a-4334-840d-7a4063ddb08d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:04:07.220683 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49f21295-327a-4334-840d-7a4063ddb08d admin admin] RBAC: Authorization granted {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:04:07.325277 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 990/1948] 10.222.0.84 () {60 vars in 1143 bytes} [Wed May 25 15:04:07 2022] POST /identity/v3/users => generated 287 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 15:04:07.330715 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac6444af-dcfc-445a-bd10-ea7cd7034a36 admin admin] Authenticating user token {{(pid=101892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:04:07.350448 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac6444af-dcfc-445a-bd10-ea7cd7034a36 admin admin] Validating token access rules against request {{(pid=101892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:04:07.357030 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee91d100-a12c-4aa5-aeca-6fcd703a6ed4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cec56f74b2fa4826a506dc7b919465be', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:04:07.357707 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee91d100-a12c-4aa5-aeca-6fcd703a6ed4 admin admin] REQUEST_METHOD: `GET` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:04:07.358222 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee91d100-a12c-4aa5-aeca-6fcd703a6ed4 admin admin] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:04:07.358505 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee91d100-a12c-4aa5-aeca-6fcd703a6ed4 admin admin] PATH_INFO: `/v3/roles` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:04:07.359232 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee91d100-a12c-4aa5-aeca-6fcd703a6ed4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:04:07.360968 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee91d100-a12c-4aa5-aeca-6fcd703a6ed4 admin admin] RBAC: Authorization granted {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:04:07.373298 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 959/1949] 10.222.0.84 () {58 vars in 1121 bytes} [Wed May 25 15:04:07 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 25 15:04:07.377134 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f21295-327a-4334-840d-7a4063ddb08d admin admin] Authenticating user token {{(pid=101893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:04:07.387729 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f21295-327a-4334-840d-7a4063ddb08d admin admin] Validating token access rules against request {{(pid=101893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:04:07.392762 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b7f162d-34fe-475f-8eae-22102ae0b92e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cec56f74b2fa4826a506dc7b919465be', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:04:07.393510 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b7f162d-34fe-475f-8eae-22102ae0b92e admin admin] REQUEST_METHOD: `GET` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:04:07.393894 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b7f162d-34fe-475f-8eae-22102ae0b92e admin admin] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:04:07.394374 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b7f162d-34fe-475f-8eae-22102ae0b92e admin admin] PATH_INFO: `/v3/roles` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:04:07.395385 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b7f162d-34fe-475f-8eae-22102ae0b92e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:04:07.398561 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b7f162d-34fe-475f-8eae-22102ae0b92e admin admin] RBAC: Authorization granted {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:04:07.400763 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG dbcounter [-] [101893] Writing DB stats keystone:SELECT=91,keystone:DELETE=5,keystone:INSERT=4 {{(pid=101893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:04:07.412121 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 991/1950] 10.222.0.84 () {58 vars in 1121 bytes} [Wed May 25 15:04:07 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 25 15:04:07.417476 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee91d100-a12c-4aa5-aeca-6fcd703a6ed4 admin admin] Authenticating user token {{(pid=101892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:04:07.428485 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee91d100-a12c-4aa5-aeca-6fcd703a6ed4 admin admin] Validating token access rules against request {{(pid=101892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:04:07.438714 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac2b8a68-18ae-497a-949d-20f2a5a77a28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cec56f74b2fa4826a506dc7b919465be', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:04:07.439665 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2b8a68-18ae-497a-949d-20f2a5a77a28 admin admin] REQUEST_METHOD: `PUT` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:04:07.439953 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2b8a68-18ae-497a-949d-20f2a5a77a28 admin admin] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:04:07.440230 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2b8a68-18ae-497a-949d-20f2a5a77a28 admin admin] PATH_INFO: `/v3/projects/3c691e7a0ad946e4866b5cd17008a3ea/users/fce490f6f1e34a2781fc203e09dafd2c/roles/ff664fa0db7e4262a5accde96c3df4c3` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:04:07.456694 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac2b8a68-18ae-497a-949d-20f2a5a77a28 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3c691e7a0ad946e4866b5cd17008a3ea, user_id=fce490f6f1e34a2781fc203e09dafd2c, role_id=ff664fa0db7e4262a5accde96c3df4c3)` {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:04:07.459347 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac2b8a68-18ae-497a-949d-20f2a5a77a28 admin admin] RBAC: Authorization granted {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:04:07.533643 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 960/1951] 10.222.0.84 () {60 vars in 1482 bytes} [Wed May 25 15:04:07 2022] PUT /identity/v3/projects/3c691e7a0ad946e4866b5cd17008a3ea/users/fce490f6f1e34a2781fc203e09dafd2c/roles/ff664fa0db7e4262a5accde96c3df4c3 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 15:04:07.547296 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c48f57-7cb5-4b75-bfb1-15aae606e8d8 None None] REQUEST_METHOD: `POST` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:04:07.547635 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c48f57-7cb5-4b75-bfb1-15aae606e8d8 None None] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:04:07.547924 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c48f57-7cb5-4b75-bfb1-15aae606e8d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:04:07.578961 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.auth.core [None req-27c48f57-7cb5-4b75-bfb1-15aae606e8d8 None None] MFA Rules not processed for user `fce490f6f1e34a2781fc203e09dafd2c`. Rule list: `[]` (Enabled: `True`). {{(pid=101893) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:04:07.580312 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.fernet_utils [None req-27c48f57-7cb5-4b75-bfb1-15aae606e8d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=101893) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:04:07.666791 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 992/1952] 10.222.0.84 () {58 vars in 957 bytes} [Wed May 25 15:04:07 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 15:04:07.677538 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac2b8a68-18ae-497a-949d-20f2a5a77a28 admin admin] Authenticating user token {{(pid=101892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:04:07.679417 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.fernet_utils [None req-ac2b8a68-18ae-497a-949d-20f2a5a77a28 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=101892) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:04:07.773990 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac2b8a68-18ae-497a-949d-20f2a5a77a28 admin admin] Validating token access rules against request {{(pid=101892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:04:07.782670 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65717435-864a-4d98-bcec-f724853753e8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2aeb182e6a5b43cfb0cc347ec847c848', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a000829c658c4a7cab67f7b6353ba3fa', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:04:07.783485 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65717435-864a-4d98-bcec-f724853753e8 service nova] REQUEST_METHOD: `GET` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:04:07.784341 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65717435-864a-4d98-bcec-f724853753e8 service nova] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:04:07.784629 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65717435-864a-4d98-bcec-f724853753e8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:04:07.796531 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65717435-864a-4d98-bcec-f724853753e8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:04:07.798531 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65717435-864a-4d98-bcec-f724853753e8 service nova] RBAC: Authorization granted {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:04:07.816012 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 961/1953] 10.222.0.84 () {60 vars in 1365 bytes} [Wed May 25 15:04:07 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 139 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 15:04:08.078901 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27c48f57-7cb5-4b75-bfb1-15aae606e8d8 None None] Authenticating user token {{(pid=101893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:04:08.171012 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27c48f57-7cb5-4b75-bfb1-15aae606e8d8 None None] Validating token access rules against request {{(pid=101893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:04:08.184524 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-680bd2d4-cc2c-4839-9c94-a2f59f6cdacb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cec56f74b2fa4826a506dc7b919465be', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:04:08.185442 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680bd2d4-cc2c-4839-9c94-a2f59f6cdacb admin admin] REQUEST_METHOD: `DELETE` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:04:08.185744 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680bd2d4-cc2c-4839-9c94-a2f59f6cdacb admin admin] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:04:08.186011 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680bd2d4-cc2c-4839-9c94-a2f59f6cdacb admin admin] PATH_INFO: `/v3/users/fce490f6f1e34a2781fc203e09dafd2c` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:04:08.187818 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-680bd2d4-cc2c-4839-9c94-a2f59f6cdacb admin admin] RBAC: Authorizing `identity:delete_user(user_id=fce490f6f1e34a2781fc203e09dafd2c)` {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:04:08.189935 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-680bd2d4-cc2c-4839-9c94-a2f59f6cdacb admin admin] RBAC: Authorization granted {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:04:08.405435 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.notifications [None req-680bd2d4-cc2c-4839-9c94-a2f59f6cdacb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fce490f6f1e34a2781fc203e09dafd2c'} {{(pid=101893) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:04:08.414858 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.notifications [None req-680bd2d4-cc2c-4839-9c94-a2f59f6cdacb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fce490f6f1e34a2781fc203e09dafd2c'} {{(pid=101893) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:04:08.427531 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.notifications [None req-680bd2d4-cc2c-4839-9c94-a2f59f6cdacb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fce490f6f1e34a2781fc203e09dafd2c'} {{(pid=101893) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:04:08.428500 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.notifications [None req-680bd2d4-cc2c-4839-9c94-a2f59f6cdacb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fce490f6f1e34a2781fc203e09dafd2c'} {{(pid=101893) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:04:08.429838 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.notifications [None req-680bd2d4-cc2c-4839-9c94-a2f59f6cdacb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fce490f6f1e34a2781fc203e09dafd2c'} {{(pid=101893) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:04:08.534867 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 993/1954] 10.222.0.84 () {58 vars in 1223 bytes} [Wed May 25 15:04:08 2022] DELETE /identity/v3/users/fce490f6f1e34a2781fc203e09dafd2c => generated 0 bytes in 456 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 15:04:08.540824 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517f44d8-e87a-4b82-b2c0-3947d8473efe None None] REQUEST_METHOD: `POST` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:04:08.541653 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517f44d8-e87a-4b82-b2c0-3947d8473efe None None] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:04:08.542073 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517f44d8-e87a-4b82-b2c0-3947d8473efe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:04:08.570549 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.auth.core [None req-517f44d8-e87a-4b82-b2c0-3947d8473efe None None] MFA Rules not processed for user `05d87e87798e429aa1c10b24391f915e`. Rule list: `[]` (Enabled: `True`). {{(pid=101892) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:04:08.572416 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.fernet_utils [None req-517f44d8-e87a-4b82-b2c0-3947d8473efe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=101892) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:04:08.577272 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG dbcounter [-] [101892] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=101892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:04:08.647132 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 962/1955] 10.222.0.84 () {58 vars in 957 bytes} [Wed May 25 15:04:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 25 15:04:08.659738 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-680bd2d4-cc2c-4839-9c94-a2f59f6cdacb admin admin] Authenticating user token {{(pid=101893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:04:08.659738 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.fernet_utils [None req-680bd2d4-cc2c-4839-9c94-a2f59f6cdacb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=101893) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:04:08.669440 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG dbcounter [-] [101893] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=101893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:04:08.744481 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-680bd2d4-cc2c-4839-9c94-a2f59f6cdacb admin admin] Validating token access rules against request {{(pid=101893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:04:08.749396 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-294f8c9a-5695-45b9-b974-31727c809498 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ce28b25b907473588ccb87dc4acc06a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a000829c658c4a7cab67f7b6353ba3fa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:04:08.757173 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294f8c9a-5695-45b9-b974-31727c809498 service neutron] REQUEST_METHOD: `GET` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:04:08.757173 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294f8c9a-5695-45b9-b974-31727c809498 service neutron] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:04:08.757173 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294f8c9a-5695-45b9-b974-31727c809498 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:04:08.761346 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-294f8c9a-5695-45b9-b974-31727c809498 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:04:08.762806 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-294f8c9a-5695-45b9-b974-31727c809498 service neutron] RBAC: Authorization granted {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:04:08.773606 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 994/1956] 10.222.0.84 () {60 vars in 1365 bytes} [Wed May 25 15:04:08 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 15:04:09.286610 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-517f44d8-e87a-4b82-b2c0-3947d8473efe None None] Authenticating user token {{(pid=101892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:04:09.288063 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.fernet_utils [None req-517f44d8-e87a-4b82-b2c0-3947d8473efe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=101892) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:04:09.302361 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-517f44d8-e87a-4b82-b2c0-3947d8473efe None None] Validating token access rules against request {{(pid=101892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:04:09.307626 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d67c9a2-2324-4f71-8966-f675f8d1e641 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cec56f74b2fa4826a506dc7b919465be', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:04:09.308502 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d67c9a2-2324-4f71-8966-f675f8d1e641 admin admin] REQUEST_METHOD: `DELETE` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:04:09.308782 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d67c9a2-2324-4f71-8966-f675f8d1e641 admin admin] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:04:09.309056 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d67c9a2-2324-4f71-8966-f675f8d1e641 admin admin] PATH_INFO: `/v3/projects/3c691e7a0ad946e4866b5cd17008a3ea` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:04:09.310256 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d67c9a2-2324-4f71-8966-f675f8d1e641 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3c691e7a0ad946e4866b5cd17008a3ea)` {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:04:09.312189 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d67c9a2-2324-4f71-8966-f675f8d1e641 admin admin] RBAC: Authorization granted {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:04:09.426297 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.notifications [None req-7d67c9a2-2324-4f71-8966-f675f8d1e641 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3c691e7a0ad946e4866b5cd17008a3ea', 'request_id': 'req-7d67c9a2-2324-4f71-8966-f675f8d1e641'} {{(pid=101892) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:04:09.433461 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.notifications [None req-7d67c9a2-2324-4f71-8966-f675f8d1e641 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3c691e7a0ad946e4866b5cd17008a3ea', 'request_id': 'req-7d67c9a2-2324-4f71-8966-f675f8d1e641'} {{(pid=101892) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:04:09.439067 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.notifications [None req-7d67c9a2-2324-4f71-8966-f675f8d1e641 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3c691e7a0ad946e4866b5cd17008a3ea', 'request_id': 'req-7d67c9a2-2324-4f71-8966-f675f8d1e641'} {{(pid=101892) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:04:09.541760 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.notifications [None req-7d67c9a2-2324-4f71-8966-f675f8d1e641 admin admin] The token cache is being invalidate because project 3c691e7a0ad946e4866b5cd17008a3ea was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=101892) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 25 15:04:09.542394 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.notifications [None req-7d67c9a2-2324-4f71-8966-f675f8d1e641 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=101892) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:04:09.542687 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.notifications [None req-7d67c9a2-2324-4f71-8966-f675f8d1e641 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=101892) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:04:09.544288 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 963/1957] 10.222.0.84 () {58 vars in 1232 bytes} [Wed May 25 15:04:09 2022] DELETE /identity/v3/projects/3c691e7a0ad946e4866b5cd17008a3ea => generated 0 bytes in 258 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 15:04:09.549161 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73af1511-5b6d-452a-a7f7-c7ccea196e9a None None] REQUEST_METHOD: `POST` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:04:09.549608 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73af1511-5b6d-452a-a7f7-c7ccea196e9a None None] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:04:09.549701 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73af1511-5b6d-452a-a7f7-c7ccea196e9a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:04:09.568545 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.auth.core [None req-73af1511-5b6d-452a-a7f7-c7ccea196e9a None None] MFA Rules not processed for user `05d87e87798e429aa1c10b24391f915e`. Rule list: `[]` (Enabled: `True`). {{(pid=101893) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:04:09.569745 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.fernet_utils [None req-73af1511-5b6d-452a-a7f7-c7ccea196e9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=101893) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:04:09.641687 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 995/1958] 10.222.0.84 () {58 vars in 957 bytes} [Wed May 25 15:04:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 15:04:09.650599 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef53253-1b33-49e4-9d34-7387468ad1e5 None None] REQUEST_METHOD: `POST` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:04:09.650896 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef53253-1b33-49e4-9d34-7387468ad1e5 None None] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:04:09.651181 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef53253-1b33-49e4-9d34-7387468ad1e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:04:09.676193 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.auth.core [None req-fef53253-1b33-49e4-9d34-7387468ad1e5 None None] MFA Rules not processed for user `05d87e87798e429aa1c10b24391f915e`. Rule list: `[]` (Enabled: `True`). {{(pid=101892) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:04:09.677537 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.fernet_utils [None req-fef53253-1b33-49e4-9d34-7387468ad1e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=101892) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:04:09.685772 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 964/1959] 10.222.0.84 () {58 vars in 957 bytes} [Wed May 25 15:04:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 15:04:09.689987 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73af1511-5b6d-452a-a7f7-c7ccea196e9a None None] Authenticating user token {{(pid=101893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:04:09.700688 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73af1511-5b6d-452a-a7f7-c7ccea196e9a None None] Validating token access rules against request {{(pid=101893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:04:09.705684 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ecfa842-da3c-468a-8f3c-30fcf70ceba3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cec56f74b2fa4826a506dc7b919465be', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:04:09.706335 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ecfa842-da3c-468a-8f3c-30fcf70ceba3 admin admin] REQUEST_METHOD: `GET` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:04:09.706621 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ecfa842-da3c-468a-8f3c-30fcf70ceba3 admin admin] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:04:09.706901 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ecfa842-da3c-468a-8f3c-30fcf70ceba3 admin admin] PATH_INFO: `/v3/domains` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:04:09.707656 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ecfa842-da3c-468a-8f3c-30fcf70ceba3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=101893) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 15:04:09.707969 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ecfa842-da3c-468a-8f3c-30fcf70ceba3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:04:09.709587 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ecfa842-da3c-468a-8f3c-30fcf70ceba3 admin admin] RBAC: Authorization granted {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:04:09.725763 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 996/1960] 10.222.0.84 () {58 vars in 1152 bytes} [Wed May 25 15:04:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 15:04:09.727045 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef53253-1b33-49e4-9d34-7387468ad1e5 None None] Authenticating user token {{(pid=101892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:04:09.738096 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef53253-1b33-49e4-9d34-7387468ad1e5 None None] Validating token access rules against request {{(pid=101892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:04:09.743177 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d8b71b6-4c9c-46b2-a1ba-8eb2df33a225 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cec56f74b2fa4826a506dc7b919465be', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:04:09.743974 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8b71b6-4c9c-46b2-a1ba-8eb2df33a225 admin admin] REQUEST_METHOD: `POST` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:04:09.744324 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8b71b6-4c9c-46b2-a1ba-8eb2df33a225 admin admin] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:04:09.744668 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8b71b6-4c9c-46b2-a1ba-8eb2df33a225 admin admin] PATH_INFO: `/v3/projects` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:04:09.745531 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d8b71b6-4c9c-46b2-a1ba-8eb2df33a225 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:04:09.747536 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d8b71b6-4c9c-46b2-a1ba-8eb2df33a225 admin admin] RBAC: Authorization granted {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:04:09.849160 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 965/1961] 10.222.0.84 () {60 vars in 1152 bytes} [Wed May 25 15:04:09 2022] POST /identity/v3/projects => generated 373 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 15:04:09.855238 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ecfa842-da3c-468a-8f3c-30fcf70ceba3 admin admin] Authenticating user token {{(pid=101893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:04:09.866427 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ecfa842-da3c-468a-8f3c-30fcf70ceba3 admin admin] Validating token access rules against request {{(pid=101893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:04:09.927240 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8593397c-1c56-4b73-8844-efe45a84e998 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cec56f74b2fa4826a506dc7b919465be', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:04:09.927951 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8593397c-1c56-4b73-8844-efe45a84e998 admin admin] REQUEST_METHOD: `POST` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:04:09.928239 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8593397c-1c56-4b73-8844-efe45a84e998 admin admin] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:04:09.928595 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8593397c-1c56-4b73-8844-efe45a84e998 admin admin] PATH_INFO: `/v3/users` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:04:09.929406 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8593397c-1c56-4b73-8844-efe45a84e998 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:04:09.931376 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8593397c-1c56-4b73-8844-efe45a84e998 admin admin] RBAC: Authorization granted {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:04:10.044988 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 997/1962] 10.222.0.84 () {60 vars in 1143 bytes} [Wed May 25 15:04:09 2022] POST /identity/v3/users => generated 287 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 15:04:10.049278 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d8b71b6-4c9c-46b2-a1ba-8eb2df33a225 admin admin] Authenticating user token {{(pid=101892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:04:10.059592 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d8b71b6-4c9c-46b2-a1ba-8eb2df33a225 admin admin] Validating token access rules against request {{(pid=101892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:04:10.064463 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ea1a9c-8ef6-452f-b8d7-0384d82ea6f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cec56f74b2fa4826a506dc7b919465be', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:04:10.072520 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ea1a9c-8ef6-452f-b8d7-0384d82ea6f1 admin admin] REQUEST_METHOD: `GET` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:04:10.072520 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ea1a9c-8ef6-452f-b8d7-0384d82ea6f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:04:10.072520 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ea1a9c-8ef6-452f-b8d7-0384d82ea6f1 admin admin] PATH_INFO: `/v3/roles` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:04:10.072520 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89ea1a9c-8ef6-452f-b8d7-0384d82ea6f1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:04:10.072520 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89ea1a9c-8ef6-452f-b8d7-0384d82ea6f1 admin admin] RBAC: Authorization granted {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:04:10.079263 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 966/1963] 10.222.0.84 () {58 vars in 1121 bytes} [Wed May 25 15:04:10 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 15:04:10.083531 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8593397c-1c56-4b73-8844-efe45a84e998 admin admin] Authenticating user token {{(pid=101893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:04:10.094690 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8593397c-1c56-4b73-8844-efe45a84e998 admin admin] Validating token access rules against request {{(pid=101893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:04:10.099591 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb780df3-230a-4cc0-a4fb-c856fa187896 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cec56f74b2fa4826a506dc7b919465be', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:04:10.100332 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb780df3-230a-4cc0-a4fb-c856fa187896 admin admin] REQUEST_METHOD: `GET` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:04:10.100671 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb780df3-230a-4cc0-a4fb-c856fa187896 admin admin] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:04:10.100950 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb780df3-230a-4cc0-a4fb-c856fa187896 admin admin] PATH_INFO: `/v3/roles` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:04:10.101803 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb780df3-230a-4cc0-a4fb-c856fa187896 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:04:10.103478 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb780df3-230a-4cc0-a4fb-c856fa187896 admin admin] RBAC: Authorization granted {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:04:10.104822 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG dbcounter [-] [101893] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=101893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:04:10.116102 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 998/1964] 10.222.0.84 () {58 vars in 1121 bytes} [Wed May 25 15:04:10 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 15:04:10.120576 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ea1a9c-8ef6-452f-b8d7-0384d82ea6f1 admin admin] Authenticating user token {{(pid=101892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:04:10.130809 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ea1a9c-8ef6-452f-b8d7-0384d82ea6f1 admin admin] Validating token access rules against request {{(pid=101892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:04:10.136167 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a408ab9e-7028-4793-86d2-c4c405523ee3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cec56f74b2fa4826a506dc7b919465be', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:04:10.137094 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a408ab9e-7028-4793-86d2-c4c405523ee3 admin admin] REQUEST_METHOD: `PUT` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:04:10.137375 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a408ab9e-7028-4793-86d2-c4c405523ee3 admin admin] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:04:10.137649 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a408ab9e-7028-4793-86d2-c4c405523ee3 admin admin] PATH_INFO: `/v3/projects/eaa9a01240a440d1b7fa7ad90003a7da/users/9d79e7742e9747db9a2992e44bb26957/roles/ff664fa0db7e4262a5accde96c3df4c3` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:04:10.152994 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a408ab9e-7028-4793-86d2-c4c405523ee3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=eaa9a01240a440d1b7fa7ad90003a7da, user_id=9d79e7742e9747db9a2992e44bb26957, role_id=ff664fa0db7e4262a5accde96c3df4c3)` {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:04:10.155672 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a408ab9e-7028-4793-86d2-c4c405523ee3 admin admin] RBAC: Authorization granted {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:04:10.273867 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 967/1965] 10.222.0.84 () {60 vars in 1482 bytes} [Wed May 25 15:04:10 2022] PUT /identity/v3/projects/eaa9a01240a440d1b7fa7ad90003a7da/users/9d79e7742e9747db9a2992e44bb26957/roles/ff664fa0db7e4262a5accde96c3df4c3 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 15:04:10.284813 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af07de87-2db6-40b2-aa2f-f082f8e98805 None None] REQUEST_METHOD: `POST` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:04:10.285171 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af07de87-2db6-40b2-aa2f-f082f8e98805 None None] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:04:10.285508 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af07de87-2db6-40b2-aa2f-f082f8e98805 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:04:10.316113 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.auth.core [None req-af07de87-2db6-40b2-aa2f-f082f8e98805 None None] MFA Rules not processed for user `9d79e7742e9747db9a2992e44bb26957`. Rule list: `[]` (Enabled: `True`). {{(pid=101893) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:04:10.317341 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.fernet_utils [None req-af07de87-2db6-40b2-aa2f-f082f8e98805 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=101893) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:04:10.387736 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 999/1966] 10.222.0.84 () {58 vars in 957 bytes} [Wed May 25 15:04:10 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 15:04:10.392345 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a408ab9e-7028-4793-86d2-c4c405523ee3 admin admin] Authenticating user token {{(pid=101892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:04:10.423424 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG dbcounter [-] [101892] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=101892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:04:10.455031 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a408ab9e-7028-4793-86d2-c4c405523ee3 admin admin] Validating token access rules against request {{(pid=101892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:04:10.459809 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-add15dc4-4358-4116-a2c5-2c83cb941631 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cec56f74b2fa4826a506dc7b919465be', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:04:10.460703 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add15dc4-4358-4116-a2c5-2c83cb941631 admin admin] REQUEST_METHOD: `POST` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:04:10.460703 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add15dc4-4358-4116-a2c5-2c83cb941631 admin admin] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:04:10.460994 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add15dc4-4358-4116-a2c5-2c83cb941631 admin admin] PATH_INFO: `/v3/projects` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:04:10.461697 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-add15dc4-4358-4116-a2c5-2c83cb941631 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:04:10.463652 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-add15dc4-4358-4116-a2c5-2c83cb941631 admin admin] RBAC: Authorization granted {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:04:10.566004 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 968/1967] 10.222.0.84 () {60 vars in 1152 bytes} [Wed May 25 15:04:10 2022] POST /identity/v3/projects => generated 373 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 25 15:04:10.570123 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af07de87-2db6-40b2-aa2f-f082f8e98805 None None] Authenticating user token {{(pid=101893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:04:10.582012 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af07de87-2db6-40b2-aa2f-f082f8e98805 None None] Validating token access rules against request {{(pid=101893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:04:10.640602 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f2bd800-dc2a-4bfa-b975-d3772c0054b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cec56f74b2fa4826a506dc7b919465be', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:04:10.641276 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2bd800-dc2a-4bfa-b975-d3772c0054b4 admin admin] REQUEST_METHOD: `POST` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:04:10.641571 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2bd800-dc2a-4bfa-b975-d3772c0054b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:04:10.641851 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2bd800-dc2a-4bfa-b975-d3772c0054b4 admin admin] PATH_INFO: `/v3/users` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:04:10.642540 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f2bd800-dc2a-4bfa-b975-d3772c0054b4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:04:10.644568 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f2bd800-dc2a-4bfa-b975-d3772c0054b4 admin admin] RBAC: Authorization granted {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:04:10.737794 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 1000/1968] 10.222.0.84 () {60 vars in 1143 bytes} [Wed May 25 15:04:10 2022] POST /identity/v3/users => generated 293 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 15:04:10.742251 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-add15dc4-4358-4116-a2c5-2c83cb941631 admin admin] Authenticating user token {{(pid=101892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:04:10.753699 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-add15dc4-4358-4116-a2c5-2c83cb941631 admin admin] Validating token access rules against request {{(pid=101892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:04:10.760063 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53d9497c-4cbd-49bb-8988-35e15d4ceb0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cec56f74b2fa4826a506dc7b919465be', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:04:10.760744 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d9497c-4cbd-49bb-8988-35e15d4ceb0e admin admin] REQUEST_METHOD: `GET` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:04:10.761028 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d9497c-4cbd-49bb-8988-35e15d4ceb0e admin admin] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:04:10.761303 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d9497c-4cbd-49bb-8988-35e15d4ceb0e admin admin] PATH_INFO: `/v3/roles` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:04:10.762031 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53d9497c-4cbd-49bb-8988-35e15d4ceb0e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:04:10.763766 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53d9497c-4cbd-49bb-8988-35e15d4ceb0e admin admin] RBAC: Authorization granted {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:04:10.775149 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 969/1969] 10.222.0.84 () {58 vars in 1121 bytes} [Wed May 25 15:04:10 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 25 15:04:10.782222 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f2bd800-dc2a-4bfa-b975-d3772c0054b4 admin admin] Authenticating user token {{(pid=101893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:04:10.792944 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f2bd800-dc2a-4bfa-b975-d3772c0054b4 admin admin] Validating token access rules against request {{(pid=101893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:04:10.797615 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0704bcc4-772e-43ba-84ce-d6e86833ddaf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cec56f74b2fa4826a506dc7b919465be', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:04:10.798495 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0704bcc4-772e-43ba-84ce-d6e86833ddaf admin admin] REQUEST_METHOD: `PUT` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:04:10.798777 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0704bcc4-772e-43ba-84ce-d6e86833ddaf admin admin] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:04:10.799053 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0704bcc4-772e-43ba-84ce-d6e86833ddaf admin admin] PATH_INFO: `/v3/projects/112c95514f5c43a88cb0c1224ee11dfc/users/6169cc36a49440cfa73d63999930bc15/roles/a3b78e7d547d4d2d998b4c99a4396bba` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:04:10.814353 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0704bcc4-772e-43ba-84ce-d6e86833ddaf admin admin] RBAC: Authorizing `identity:create_grant(project_id=112c95514f5c43a88cb0c1224ee11dfc, user_id=6169cc36a49440cfa73d63999930bc15, role_id=a3b78e7d547d4d2d998b4c99a4396bba)` {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:04:10.816996 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0704bcc4-772e-43ba-84ce-d6e86833ddaf admin admin] RBAC: Authorization granted {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:04:10.886049 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 1001/1970] 10.222.0.84 () {60 vars in 1482 bytes} [Wed May 25 15:04:10 2022] PUT /identity/v3/projects/112c95514f5c43a88cb0c1224ee11dfc/users/6169cc36a49440cfa73d63999930bc15/roles/a3b78e7d547d4d2d998b4c99a4396bba => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 15:04:10.890078 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53d9497c-4cbd-49bb-8988-35e15d4ceb0e admin admin] Authenticating user token {{(pid=101892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:04:10.900599 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53d9497c-4cbd-49bb-8988-35e15d4ceb0e admin admin] Validating token access rules against request {{(pid=101892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:04:10.962357 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ece2f3-5b6a-4daf-b4ce-8007ed22faba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cec56f74b2fa4826a506dc7b919465be', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:04:10.963029 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ece2f3-5b6a-4daf-b4ce-8007ed22faba admin admin] REQUEST_METHOD: `GET` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:04:10.963316 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ece2f3-5b6a-4daf-b4ce-8007ed22faba admin admin] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:04:10.963625 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ece2f3-5b6a-4daf-b4ce-8007ed22faba admin admin] PATH_INFO: `/v3/roles` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:04:10.964381 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8ece2f3-5b6a-4daf-b4ce-8007ed22faba admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:04:10.965992 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8ece2f3-5b6a-4daf-b4ce-8007ed22faba admin admin] RBAC: Authorization granted {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:04:10.976193 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 970/1971] 10.222.0.84 () {58 vars in 1121 bytes} [Wed May 25 15:04:10 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 15:04:10.981053 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0704bcc4-772e-43ba-84ce-d6e86833ddaf admin admin] Authenticating user token {{(pid=101893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:04:10.992773 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0704bcc4-772e-43ba-84ce-d6e86833ddaf admin admin] Validating token access rules against request {{(pid=101893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:04:10.998557 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18f71e79-7c29-48a7-ace4-2007a5533920 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cec56f74b2fa4826a506dc7b919465be', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:04:10.999493 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f71e79-7c29-48a7-ace4-2007a5533920 admin admin] REQUEST_METHOD: `PUT` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:04:11.003125 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f71e79-7c29-48a7-ace4-2007a5533920 admin admin] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:04:11.003125 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f71e79-7c29-48a7-ace4-2007a5533920 admin admin] PATH_INFO: `/v3/projects/112c95514f5c43a88cb0c1224ee11dfc/users/6169cc36a49440cfa73d63999930bc15/roles/a3b78e7d547d4d2d998b4c99a4396bba` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:04:11.003125 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18f71e79-7c29-48a7-ace4-2007a5533920 admin admin] RBAC: Authorizing `identity:create_grant(project_id=112c95514f5c43a88cb0c1224ee11dfc, user_id=6169cc36a49440cfa73d63999930bc15, role_id=a3b78e7d547d4d2d998b4c99a4396bba)` {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:04:11.004839 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18f71e79-7c29-48a7-ace4-2007a5533920 admin admin] RBAC: Authorization granted {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:04:11.016331 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 1002/1972] 10.222.0.84 () {60 vars in 1482 bytes} [Wed May 25 15:04:10 2022] PUT /identity/v3/projects/112c95514f5c43a88cb0c1224ee11dfc/users/6169cc36a49440cfa73d63999930bc15/roles/a3b78e7d547d4d2d998b4c99a4396bba => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 15:04:11.028618 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f44590-34b6-4aa2-bd8a-f9b9715a5fed None None] REQUEST_METHOD: `POST` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:04:11.028919 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f44590-34b6-4aa2-bd8a-f9b9715a5fed None None] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:04:11.029201 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f44590-34b6-4aa2-bd8a-f9b9715a5fed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:04:11.062615 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.auth.core [None req-b9f44590-34b6-4aa2-bd8a-f9b9715a5fed None None] MFA Rules not processed for user `6169cc36a49440cfa73d63999930bc15`. Rule list: `[]` (Enabled: `True`). {{(pid=101892) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:04:11.064649 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.fernet_utils [None req-b9f44590-34b6-4aa2-bd8a-f9b9715a5fed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=101892) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:04:11.143666 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 971/1973] 10.222.0.84 () {58 vars in 957 bytes} [Wed May 25 15:04:11 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 15:04:11.155749 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18f71e79-7c29-48a7-ace4-2007a5533920 admin admin] Authenticating user token {{(pid=101893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:04:11.157588 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.fernet_utils [None req-18f71e79-7c29-48a7-ace4-2007a5533920 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=101893) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:04:11.200344 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG dbcounter [-] [101893] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=101893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:04:11.216108 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18f71e79-7c29-48a7-ace4-2007a5533920 admin admin] Validating token access rules against request {{(pid=101893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:04:11.219847 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d75230a4-04db-45bb-abcd-220315a8fa17 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e079f89a5e524ab6ad4183e4f690de07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a000829c658c4a7cab67f7b6353ba3fa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:04:11.220492 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75230a4-04db-45bb-abcd-220315a8fa17 service cinder] REQUEST_METHOD: `GET` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:04:11.220809 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75230a4-04db-45bb-abcd-220315a8fa17 service cinder] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:04:11.221091 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75230a4-04db-45bb-abcd-220315a8fa17 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:04:11.230845 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d75230a4-04db-45bb-abcd-220315a8fa17 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:04:11.232361 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d75230a4-04db-45bb-abcd-220315a8fa17 service cinder] RBAC: Authorization granted {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:04:11.242598 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 1003/1974] 10.222.0.84 () {60 vars in 1365 bytes} [Wed May 25 15:04:11 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 15:04:11.423149 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f44590-34b6-4aa2-bd8a-f9b9715a5fed None None] Authenticating user token {{(pid=101892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:04:11.436275 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f44590-34b6-4aa2-bd8a-f9b9715a5fed None None] Validating token access rules against request {{(pid=101892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:04:11.440224 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2e4c702-5aaf-4715-b9e7-18f3d914cd7a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e079f89a5e524ab6ad4183e4f690de07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a000829c658c4a7cab67f7b6353ba3fa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:04:11.441030 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e4c702-5aaf-4715-b9e7-18f3d914cd7a service cinder] REQUEST_METHOD: `GET` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:04:11.441484 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e4c702-5aaf-4715-b9e7-18f3d914cd7a service cinder] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:04:11.441915 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e4c702-5aaf-4715-b9e7-18f3d914cd7a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:04:11.464151 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG dbcounter [-] [101892] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=101892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:04:11.505422 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2e4c702-5aaf-4715-b9e7-18f3d914cd7a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:04:11.506922 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2e4c702-5aaf-4715-b9e7-18f3d914cd7a service cinder] RBAC: Authorization granted {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:04:11.516467 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 972/1975] 10.222.0.84 () {60 vars in 1365 bytes} [Wed May 25 15:04:11 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 15:04:16.572966 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d75230a4-04db-45bb-abcd-220315a8fa17 service cinder] Authenticating user token {{(pid=101893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:04:16.574505 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.fernet_utils [None req-d75230a4-04db-45bb-abcd-220315a8fa17 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=101893) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:04:16.644882 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d75230a4-04db-45bb-abcd-220315a8fa17 service cinder] Validating token access rules against request {{(pid=101893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:04:16.650417 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ad43007-bb09-4b67-95de-8d2d3931c9d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cec56f74b2fa4826a506dc7b919465be', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:04:16.651307 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad43007-bb09-4b67-95de-8d2d3931c9d5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:04:16.651763 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad43007-bb09-4b67-95de-8d2d3931c9d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:04:16.652043 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad43007-bb09-4b67-95de-8d2d3931c9d5 admin admin] PATH_INFO: `/v3/users/cda62ae16d144dc3a3a866a061994568` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:04:16.653241 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ad43007-bb09-4b67-95de-8d2d3931c9d5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cda62ae16d144dc3a3a866a061994568)` {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:04:16.655177 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ad43007-bb09-4b67-95de-8d2d3931c9d5 admin admin] RBAC: Authorization granted {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:04:16.807872 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.notifications [None req-5ad43007-bb09-4b67-95de-8d2d3931c9d5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cda62ae16d144dc3a3a866a061994568'} {{(pid=101893) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:04:16.815637 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.notifications [None req-5ad43007-bb09-4b67-95de-8d2d3931c9d5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cda62ae16d144dc3a3a866a061994568'} {{(pid=101893) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:04:16.829871 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.notifications [None req-5ad43007-bb09-4b67-95de-8d2d3931c9d5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cda62ae16d144dc3a3a866a061994568'} {{(pid=101893) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:04:16.830963 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.notifications [None req-5ad43007-bb09-4b67-95de-8d2d3931c9d5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cda62ae16d144dc3a3a866a061994568'} {{(pid=101893) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:04:16.831616 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.notifications [None req-5ad43007-bb09-4b67-95de-8d2d3931c9d5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cda62ae16d144dc3a3a866a061994568'} {{(pid=101893) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:04:16.919391 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 1004/1976] 10.222.0.84 () {58 vars in 1223 bytes} [Wed May 25 15:04:16 2022] DELETE /identity/v3/users/cda62ae16d144dc3a3a866a061994568 => generated 0 bytes in 347 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 15:04:16.924565 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e121fd-29d2-4a06-a0b0-1b76a6662f67 None None] REQUEST_METHOD: `POST` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:04:16.925054 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e121fd-29d2-4a06-a0b0-1b76a6662f67 None None] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:04:16.925211 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e121fd-29d2-4a06-a0b0-1b76a6662f67 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:04:16.942758 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.auth.core [None req-09e121fd-29d2-4a06-a0b0-1b76a6662f67 None None] MFA Rules not processed for user `05d87e87798e429aa1c10b24391f915e`. Rule list: `[]` (Enabled: `True`). {{(pid=101892) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:04:16.943991 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.fernet_utils [None req-09e121fd-29d2-4a06-a0b0-1b76a6662f67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=101892) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:04:17.009968 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 973/1977] 10.222.0.84 () {58 vars in 957 bytes} [Wed May 25 15:04:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 15:04:17.019259 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ad43007-bb09-4b67-95de-8d2d3931c9d5 admin admin] Authenticating user token {{(pid=101893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:04:17.020988 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.fernet_utils [None req-5ad43007-bb09-4b67-95de-8d2d3931c9d5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=101893) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:04:17.083963 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ad43007-bb09-4b67-95de-8d2d3931c9d5 admin admin] Validating token access rules against request {{(pid=101893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:04:17.087837 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c17fc59-59cf-44e8-9bcd-5f170a8c1bd1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ce28b25b907473588ccb87dc4acc06a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a000829c658c4a7cab67f7b6353ba3fa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:04:17.088493 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c17fc59-59cf-44e8-9bcd-5f170a8c1bd1 service neutron] REQUEST_METHOD: `GET` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:04:17.088877 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c17fc59-59cf-44e8-9bcd-5f170a8c1bd1 service neutron] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:04:17.089158 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c17fc59-59cf-44e8-9bcd-5f170a8c1bd1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:04:17.098998 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c17fc59-59cf-44e8-9bcd-5f170a8c1bd1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:04:17.100637 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c17fc59-59cf-44e8-9bcd-5f170a8c1bd1 service neutron] RBAC: Authorization granted {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:04:17.111006 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 1005/1978] 10.222.0.84 () {60 vars in 1365 bytes} [Wed May 25 15:04:17 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 15:04:17.686585 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e121fd-29d2-4a06-a0b0-1b76a6662f67 None None] Authenticating user token {{(pid=101892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:04:17.688098 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.fernet_utils [None req-09e121fd-29d2-4a06-a0b0-1b76a6662f67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=101892) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:04:17.703953 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e121fd-29d2-4a06-a0b0-1b76a6662f67 None None] Validating token access rules against request {{(pid=101892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:04:17.710067 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf603139-7e47-4d6e-b6dc-7525773459aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cec56f74b2fa4826a506dc7b919465be', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:04:17.711034 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf603139-7e47-4d6e-b6dc-7525773459aa admin admin] REQUEST_METHOD: `DELETE` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:04:17.711390 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf603139-7e47-4d6e-b6dc-7525773459aa admin admin] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:04:17.712363 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf603139-7e47-4d6e-b6dc-7525773459aa admin admin] PATH_INFO: `/v3/projects/2fad216b9ab04ff3b56880b0f689b748` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:04:17.713723 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf603139-7e47-4d6e-b6dc-7525773459aa admin admin] RBAC: Authorizing `identity:delete_project(project_id=2fad216b9ab04ff3b56880b0f689b748)` {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:04:17.715686 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf603139-7e47-4d6e-b6dc-7525773459aa admin admin] RBAC: Authorization granted {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:04:17.823887 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.notifications [None req-bf603139-7e47-4d6e-b6dc-7525773459aa admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2fad216b9ab04ff3b56880b0f689b748', 'request_id': 'req-bf603139-7e47-4d6e-b6dc-7525773459aa'} {{(pid=101892) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:04:17.830504 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.notifications [None req-bf603139-7e47-4d6e-b6dc-7525773459aa admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2fad216b9ab04ff3b56880b0f689b748', 'request_id': 'req-bf603139-7e47-4d6e-b6dc-7525773459aa'} {{(pid=101892) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:04:17.836030 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.notifications [None req-bf603139-7e47-4d6e-b6dc-7525773459aa admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2fad216b9ab04ff3b56880b0f689b748', 'request_id': 'req-bf603139-7e47-4d6e-b6dc-7525773459aa'} {{(pid=101892) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:04:17.930069 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.notifications [None req-bf603139-7e47-4d6e-b6dc-7525773459aa admin admin] The token cache is being invalidate because project 2fad216b9ab04ff3b56880b0f689b748 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=101892) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 25 15:04:17.931287 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.notifications [None req-bf603139-7e47-4d6e-b6dc-7525773459aa admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=101892) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:04:17.931525 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.notifications [None req-bf603139-7e47-4d6e-b6dc-7525773459aa admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=101892) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:04:17.933116 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 974/1979] 10.222.0.84 () {58 vars in 1232 bytes} [Wed May 25 15:04:17 2022] DELETE /identity/v3/projects/2fad216b9ab04ff3b56880b0f689b748 => generated 0 bytes in 247 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 15:04:17.938031 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d35c37db-d6c6-4467-b938-dfae3a648fb6 None None] REQUEST_METHOD: `POST` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:04:17.938450 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d35c37db-d6c6-4467-b938-dfae3a648fb6 None None] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:04:17.938594 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d35c37db-d6c6-4467-b938-dfae3a648fb6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:04:17.942154 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG dbcounter [-] [101893] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=101893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:04:17.967725 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.auth.core [None req-d35c37db-d6c6-4467-b938-dfae3a648fb6 None None] MFA Rules not processed for user `05d87e87798e429aa1c10b24391f915e`. Rule list: `[]` (Enabled: `True`). {{(pid=101893) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:04:17.968954 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.fernet_utils [None req-d35c37db-d6c6-4467-b938-dfae3a648fb6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=101893) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:04:18.030276 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 1006/1980] 10.222.0.84 () {58 vars in 957 bytes} [Wed May 25 15:04:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 15:04:18.037973 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e11d63-2465-4c02-8bae-513fcf65b0b3 None None] REQUEST_METHOD: `POST` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:04:18.038257 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e11d63-2465-4c02-8bae-513fcf65b0b3 None None] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:04:18.038562 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e11d63-2465-4c02-8bae-513fcf65b0b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:04:18.058879 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.auth.core [None req-98e11d63-2465-4c02-8bae-513fcf65b0b3 None None] MFA Rules not processed for user `05d87e87798e429aa1c10b24391f915e`. Rule list: `[]` (Enabled: `True`). {{(pid=101892) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:04:18.060534 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.fernet_utils [None req-98e11d63-2465-4c02-8bae-513fcf65b0b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=101892) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:04:18.069724 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 975/1981] 10.222.0.84 () {58 vars in 957 bytes} [Wed May 25 15:04:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 15:04:18.079579 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d35c37db-d6c6-4467-b938-dfae3a648fb6 None None] Authenticating user token {{(pid=101893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:04:18.089413 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d35c37db-d6c6-4467-b938-dfae3a648fb6 None None] Validating token access rules against request {{(pid=101893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:04:18.094013 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e72d90c-cfc7-469b-8857-814a15f3b8b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cec56f74b2fa4826a506dc7b919465be', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:04:18.094719 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e72d90c-cfc7-469b-8857-814a15f3b8b8 admin admin] REQUEST_METHOD: `GET` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:04:18.095197 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e72d90c-cfc7-469b-8857-814a15f3b8b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:04:18.095733 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e72d90c-cfc7-469b-8857-814a15f3b8b8 admin admin] PATH_INFO: `/v3/domains` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:04:18.097079 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e72d90c-cfc7-469b-8857-814a15f3b8b8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=101893) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 15:04:18.097624 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e72d90c-cfc7-469b-8857-814a15f3b8b8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:04:18.100604 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e72d90c-cfc7-469b-8857-814a15f3b8b8 admin admin] RBAC: Authorization granted {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:04:18.121015 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 1007/1982] 10.222.0.84 () {58 vars in 1152 bytes} [Wed May 25 15:04:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 15:04:18.126337 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98e11d63-2465-4c02-8bae-513fcf65b0b3 None None] Authenticating user token {{(pid=101892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:04:18.137635 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98e11d63-2465-4c02-8bae-513fcf65b0b3 None None] Validating token access rules against request {{(pid=101892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:04:18.142367 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-660d51e9-ba39-4434-aebd-fabce4e24fec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cec56f74b2fa4826a506dc7b919465be', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:04:18.143059 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660d51e9-ba39-4434-aebd-fabce4e24fec admin admin] REQUEST_METHOD: `POST` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:04:18.143344 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660d51e9-ba39-4434-aebd-fabce4e24fec admin admin] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:04:18.143655 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660d51e9-ba39-4434-aebd-fabce4e24fec admin admin] PATH_INFO: `/v3/projects` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:04:18.144349 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-660d51e9-ba39-4434-aebd-fabce4e24fec admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:04:18.146266 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-660d51e9-ba39-4434-aebd-fabce4e24fec admin admin] RBAC: Authorization granted {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:04:18.234679 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 976/1983] 10.222.0.84 () {60 vars in 1152 bytes} [Wed May 25 15:04:18 2022] POST /identity/v3/projects => generated 365 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 15:04:18.239121 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e72d90c-cfc7-469b-8857-814a15f3b8b8 admin admin] Authenticating user token {{(pid=101893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:04:18.250792 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e72d90c-cfc7-469b-8857-814a15f3b8b8 admin admin] Validating token access rules against request {{(pid=101893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:04:18.322386 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc13dc88-30dc-429d-84f9-64c99a42dfbc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cec56f74b2fa4826a506dc7b919465be', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:04:18.323301 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc13dc88-30dc-429d-84f9-64c99a42dfbc admin admin] REQUEST_METHOD: `POST` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:04:18.323615 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc13dc88-30dc-429d-84f9-64c99a42dfbc admin admin] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:04:18.323934 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc13dc88-30dc-429d-84f9-64c99a42dfbc admin admin] PATH_INFO: `/v3/users` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:04:18.324655 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc13dc88-30dc-429d-84f9-64c99a42dfbc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:04:18.326956 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc13dc88-30dc-429d-84f9-64c99a42dfbc admin admin] RBAC: Authorization granted {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:04:18.404267 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 1008/1984] 10.222.0.84 () {60 vars in 1143 bytes} [Wed May 25 15:04:18 2022] POST /identity/v3/users => generated 283 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 15:04:18.405454 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-660d51e9-ba39-4434-aebd-fabce4e24fec admin admin] Authenticating user token {{(pid=101892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:04:18.418791 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-660d51e9-ba39-4434-aebd-fabce4e24fec admin admin] Validating token access rules against request {{(pid=101892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:04:18.425031 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd15d18c-4d8e-4633-b638-65c505b94422 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cec56f74b2fa4826a506dc7b919465be', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:04:18.425741 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd15d18c-4d8e-4633-b638-65c505b94422 admin admin] REQUEST_METHOD: `GET` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:04:18.426024 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd15d18c-4d8e-4633-b638-65c505b94422 admin admin] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:04:18.426303 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd15d18c-4d8e-4633-b638-65c505b94422 admin admin] PATH_INFO: `/v3/roles` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:04:18.427036 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd15d18c-4d8e-4633-b638-65c505b94422 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:04:18.428670 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd15d18c-4d8e-4633-b638-65c505b94422 admin admin] RBAC: Authorization granted {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:04:18.445849 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc13dc88-30dc-429d-84f9-64c99a42dfbc admin admin] Authenticating user token {{(pid=101893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:04:18.451848 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 977/1985] 10.222.0.84 () {58 vars in 1121 bytes} [Wed May 25 15:04:18 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 15:04:18.466641 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc13dc88-30dc-429d-84f9-64c99a42dfbc admin admin] Validating token access rules against request {{(pid=101893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:04:18.471443 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25b1caa5-98b9-4636-b6b5-a6b341f324a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cec56f74b2fa4826a506dc7b919465be', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:04:18.472189 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b1caa5-98b9-4636-b6b5-a6b341f324a8 admin admin] REQUEST_METHOD: `GET` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:04:18.472479 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b1caa5-98b9-4636-b6b5-a6b341f324a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:04:18.472762 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b1caa5-98b9-4636-b6b5-a6b341f324a8 admin admin] PATH_INFO: `/v3/roles` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:04:18.473483 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25b1caa5-98b9-4636-b6b5-a6b341f324a8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:04:18.475136 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25b1caa5-98b9-4636-b6b5-a6b341f324a8 admin admin] RBAC: Authorization granted {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:04:18.487116 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 1009/1986] 10.222.0.84 () {58 vars in 1121 bytes} [Wed May 25 15:04:18 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 15:04:18.491290 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd15d18c-4d8e-4633-b638-65c505b94422 admin admin] Authenticating user token {{(pid=101892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:04:18.501839 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd15d18c-4d8e-4633-b638-65c505b94422 admin admin] Validating token access rules against request {{(pid=101892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:04:18.506448 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-720aea6c-e872-4abd-bb0d-7e45260ce19d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cec56f74b2fa4826a506dc7b919465be', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:04:18.507349 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720aea6c-e872-4abd-bb0d-7e45260ce19d admin admin] REQUEST_METHOD: `PUT` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:04:18.507667 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720aea6c-e872-4abd-bb0d-7e45260ce19d admin admin] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:04:18.507947 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720aea6c-e872-4abd-bb0d-7e45260ce19d admin admin] PATH_INFO: `/v3/projects/2e5296676c9e404498293146b16e786f/users/d86d5d7466db4deb93c5d899a8ff4001/roles/ff664fa0db7e4262a5accde96c3df4c3` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:04:18.510129 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG dbcounter [-] [101892] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=101892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:04:18.522865 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-720aea6c-e872-4abd-bb0d-7e45260ce19d admin admin] RBAC: Authorizing `identity:create_grant(project_id=2e5296676c9e404498293146b16e786f, user_id=d86d5d7466db4deb93c5d899a8ff4001, role_id=ff664fa0db7e4262a5accde96c3df4c3)` {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:04:18.525605 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-720aea6c-e872-4abd-bb0d-7e45260ce19d admin admin] RBAC: Authorization granted {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:04:18.593383 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 978/1987] 10.222.0.84 () {60 vars in 1482 bytes} [Wed May 25 15:04:18 2022] PUT /identity/v3/projects/2e5296676c9e404498293146b16e786f/users/d86d5d7466db4deb93c5d899a8ff4001/roles/ff664fa0db7e4262a5accde96c3df4c3 => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 15:04:18.605072 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47f534b-caf5-4a18-9f27-a07a6c018e8a None None] REQUEST_METHOD: `POST` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:04:18.605440 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47f534b-caf5-4a18-9f27-a07a6c018e8a None None] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:04:18.605812 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47f534b-caf5-4a18-9f27-a07a6c018e8a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:04:18.636910 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.auth.core [None req-d47f534b-caf5-4a18-9f27-a07a6c018e8a None None] MFA Rules not processed for user `d86d5d7466db4deb93c5d899a8ff4001`. Rule list: `[]` (Enabled: `True`). {{(pid=101893) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:04:18.638224 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.fernet_utils [None req-d47f534b-caf5-4a18-9f27-a07a6c018e8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=101893) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:04:18.689350 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG dbcounter [-] [101893] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=101893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:04:18.712190 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 1010/1988] 10.222.0.84 () {58 vars in 957 bytes} [Wed May 25 15:04:18 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 15:04:18.719818 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-720aea6c-e872-4abd-bb0d-7e45260ce19d admin admin] Authenticating user token {{(pid=101892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:04:18.721599 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.fernet_utils [None req-720aea6c-e872-4abd-bb0d-7e45260ce19d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=101892) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:04:18.783123 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-720aea6c-e872-4abd-bb0d-7e45260ce19d admin admin] Validating token access rules against request {{(pid=101892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:04:18.787002 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ddb5ce8-a0aa-4756-a71d-94cdd323006a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e079f89a5e524ab6ad4183e4f690de07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a000829c658c4a7cab67f7b6353ba3fa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:04:18.787710 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ddb5ce8-a0aa-4756-a71d-94cdd323006a service cinder] REQUEST_METHOD: `GET` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:04:18.787999 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ddb5ce8-a0aa-4756-a71d-94cdd323006a service cinder] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:04:18.788281 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ddb5ce8-a0aa-4756-a71d-94cdd323006a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:04:18.799638 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ddb5ce8-a0aa-4756-a71d-94cdd323006a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:04:18.801114 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ddb5ce8-a0aa-4756-a71d-94cdd323006a service cinder] RBAC: Authorization granted {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:04:18.811187 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 979/1989] 10.222.0.84 () {60 vars in 1365 bytes} [Wed May 25 15:04:18 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 15:04:22.466414 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3f1eec-593c-455b-a900-2c823dbb0002 None None] REQUEST_METHOD: `POST` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:04:22.466414 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3f1eec-593c-455b-a900-2c823dbb0002 None None] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:04:22.466414 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3f1eec-593c-455b-a900-2c823dbb0002 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:04:22.485748 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.auth.core [None req-0e3f1eec-593c-455b-a900-2c823dbb0002 None None] MFA Rules not processed for user `43a138df43514fecb16b49a1ccad150d`. Rule list: `[]` (Enabled: `True`). {{(pid=101893) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:04:22.488945 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.fernet_utils [None req-0e3f1eec-593c-455b-a900-2c823dbb0002 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=101893) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:04:22.558505 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 1011/1990] 10.222.0.84 () {58 vars in 957 bytes} [Wed May 25 15:04:22 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 25 15:04:24.897097 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ddb5ce8-a0aa-4756-a71d-94cdd323006a service cinder] Authenticating user token {{(pid=101892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:04:24.909269 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ddb5ce8-a0aa-4756-a71d-94cdd323006a service cinder] Validating token access rules against request {{(pid=101892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:04:24.913948 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde89e7b-3a20-4022-abd3-0c001bad93dd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e079f89a5e524ab6ad4183e4f690de07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a000829c658c4a7cab67f7b6353ba3fa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:04:24.914682 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde89e7b-3a20-4022-abd3-0c001bad93dd service cinder] REQUEST_METHOD: `GET` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:04:24.915037 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde89e7b-3a20-4022-abd3-0c001bad93dd service cinder] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:04:24.916199 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde89e7b-3a20-4022-abd3-0c001bad93dd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:04:24.918274 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.fernet_utils [None req-dde89e7b-3a20-4022-abd3-0c001bad93dd service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=101892) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:04:24.984179 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dde89e7b-3a20-4022-abd3-0c001bad93dd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:04:24.985695 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dde89e7b-3a20-4022-abd3-0c001bad93dd service cinder] RBAC: Authorization granted {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:04:24.996511 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 980/1991] 10.222.0.84 () {60 vars in 1365 bytes} [Wed May 25 15:04:24 2022] GET /identity/v3/auth/tokens => generated 3305 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 15:04:32.544856 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG dbcounter [-] [101893] Writing DB stats keystone:SELECT=30 {{(pid=101893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:04:34.991382 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG dbcounter [-] [101892] Writing DB stats keystone:SELECT=63,keystone:INSERT=1 {{(pid=101892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:04:55.003925 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5974603c-fc94-41f0-a0d5-e9535aef9218 None None] REQUEST_METHOD: `GET` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:04:55.004506 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5974603c-fc94-41f0-a0d5-e9535aef9218 None None] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:04:55.004632 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5974603c-fc94-41f0-a0d5-e9535aef9218 None None] PATH_INFO: `/` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:04:55.005934 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 1012/1992] 10.222.0.84 () {54 vars in 921 bytes} [Wed May 25 15:04:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 15:04:55.015583 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc683fcb-5376-4454-8932-5508606376d4 None None] REQUEST_METHOD: `POST` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:04:55.016169 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc683fcb-5376-4454-8932-5508606376d4 None None] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:04:55.016907 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc683fcb-5376-4454-8932-5508606376d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:04:55.079806 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.auth.core [None req-fc683fcb-5376-4454-8932-5508606376d4 None None] MFA Rules not processed for user `d18c4a1d92b94c0087a203db4fed22f2`. Rule list: `[]` (Enabled: `True`). {{(pid=101892) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:04:55.081028 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.fernet_utils [None req-fc683fcb-5376-4454-8932-5508606376d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=101892) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:04:55.157274 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 981/1993] 10.222.0.84 () {58 vars in 1018 bytes} [Wed May 25 15:04:55 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 15:04:55.173303 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5974603c-fc94-41f0-a0d5-e9535aef9218 None None] Authenticating user token {{(pid=101893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:04:55.175360 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.fernet_utils [None req-5974603c-fc94-41f0-a0d5-e9535aef9218 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=101893) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:04:55.199803 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5974603c-fc94-41f0-a0d5-e9535aef9218 None None] Validating token access rules against request {{(pid=101893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:04:55.206818 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68d195fd-ac34-4bba-bb01-675dd784bcea service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd18c4a1d92b94c0087a203db4fed22f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a000829c658c4a7cab67f7b6353ba3fa', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:04:55.207492 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d195fd-ac34-4bba-bb01-675dd784bcea service placement] REQUEST_METHOD: `GET` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:04:55.207883 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d195fd-ac34-4bba-bb01-675dd784bcea service placement] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:04:55.208161 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d195fd-ac34-4bba-bb01-675dd784bcea service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:04:55.217481 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68d195fd-ac34-4bba-bb01-675dd784bcea service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:04:55.219094 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68d195fd-ac34-4bba-bb01-675dd784bcea service placement] RBAC: Authorization granted {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:04:55.232055 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 1013/1994] 10.222.0.84 () {60 vars in 1365 bytes} [Wed May 25 15:04:55 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 61 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 15:04:56.003352 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f0b766-6126-453b-a392-e1dd88c4f28c None None] REQUEST_METHOD: `POST` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:04:56.003811 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f0b766-6126-453b-a392-e1dd88c4f28c None None] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:04:56.004187 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f0b766-6126-453b-a392-e1dd88c4f28c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:04:56.061907 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.auth.core [None req-e2f0b766-6126-453b-a392-e1dd88c4f28c None None] MFA Rules not processed for user `049a7ab3f95f460e908f79cc321176fd`. Rule list: `[]` (Enabled: `True`). {{(pid=101892) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:04:56.064071 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.fernet_utils [None req-e2f0b766-6126-453b-a392-e1dd88c4f28c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=101892) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:04:56.151721 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 982/1995] 10.222.0.84 () {58 vars in 1009 bytes} [Wed May 25 15:04:56 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 15:04:56.203241 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68d195fd-ac34-4bba-bb01-675dd784bcea service placement] Authenticating user token {{(pid=101893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:04:56.205791 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.fernet_utils [None req-68d195fd-ac34-4bba-bb01-675dd784bcea service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=101893) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:04:56.230892 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2f0b766-6126-453b-a392-e1dd88c4f28c None None] Authenticating user token {{(pid=101892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:04:56.232545 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.fernet_utils [None req-e2f0b766-6126-453b-a392-e1dd88c4f28c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=101892) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:04:56.267206 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG dbcounter [-] [101892] Writing DB stats keystone:SELECT=100 {{(pid=101892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:04:56.312397 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2f0b766-6126-453b-a392-e1dd88c4f28c None None] Validating token access rules against request {{(pid=101892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:04:56.317617 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c13d314-e72b-4303-9588-4ab0a6aabaae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cec56f74b2fa4826a506dc7b919465be', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:04:56.318505 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c13d314-e72b-4303-9588-4ab0a6aabaae admin admin] REQUEST_METHOD: `DELETE` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:04:56.318791 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c13d314-e72b-4303-9588-4ab0a6aabaae admin admin] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:04:56.319070 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c13d314-e72b-4303-9588-4ab0a6aabaae admin admin] PATH_INFO: `/v3/users/633d0f7ef5da4b01bac2aafabb3c5036` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:04:56.319313 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68d195fd-ac34-4bba-bb01-675dd784bcea service placement] Validating token access rules against request {{(pid=101893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:04:56.320355 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c13d314-e72b-4303-9588-4ab0a6aabaae admin admin] RBAC: Authorizing `identity:delete_user(user_id=633d0f7ef5da4b01bac2aafabb3c5036)` {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:04:56.322332 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c13d314-e72b-4303-9588-4ab0a6aabaae admin admin] RBAC: Authorization granted {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:04:56.326342 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a851385c-5fa6-4f3c-807f-628b81ea3aa6 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e196f0897b98455c9e164271d7d0070a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a000829c658c4a7cab67f7b6353ba3fa', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:04:56.332571 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a851385c-5fa6-4f3c-807f-628b81ea3aa6 service swift] REQUEST_METHOD: `GET` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:04:56.332571 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a851385c-5fa6-4f3c-807f-628b81ea3aa6 service swift] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:04:56.332571 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a851385c-5fa6-4f3c-807f-628b81ea3aa6 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:04:56.337410 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a851385c-5fa6-4f3c-807f-628b81ea3aa6 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:04:56.339045 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a851385c-5fa6-4f3c-807f-628b81ea3aa6 service swift] RBAC: Authorization granted {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:04:56.348243 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 1014/1996] 10.222.0.84 () {60 vars in 1384 bytes} [Wed May 25 15:04:56 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 145 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 25 15:04:56.565625 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.notifications [None req-6c13d314-e72b-4303-9588-4ab0a6aabaae admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '633d0f7ef5da4b01bac2aafabb3c5036'} {{(pid=101892) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:04:56.573519 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.notifications [None req-6c13d314-e72b-4303-9588-4ab0a6aabaae admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '633d0f7ef5da4b01bac2aafabb3c5036'} {{(pid=101892) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:04:56.586397 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.notifications [None req-6c13d314-e72b-4303-9588-4ab0a6aabaae admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '633d0f7ef5da4b01bac2aafabb3c5036'} {{(pid=101892) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:04:56.587124 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.notifications [None req-6c13d314-e72b-4303-9588-4ab0a6aabaae admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '633d0f7ef5da4b01bac2aafabb3c5036'} {{(pid=101892) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:04:56.647030 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.notifications [None req-6c13d314-e72b-4303-9588-4ab0a6aabaae admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '633d0f7ef5da4b01bac2aafabb3c5036'} {{(pid=101892) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:04:56.665159 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 983/1997] 10.222.0.84 () {58 vars in 1223 bytes} [Wed May 25 15:04:56 2022] DELETE /identity/v3/users/633d0f7ef5da4b01bac2aafabb3c5036 => generated 0 bytes in 431 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 25 15:04:56.815272 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa412b7-4922-4720-9959-bf4d950cfdba None None] REQUEST_METHOD: `POST` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:04:56.815713 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa412b7-4922-4720-9959-bf4d950cfdba None None] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:04:56.816093 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa412b7-4922-4720-9959-bf4d950cfdba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:04:56.848329 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.auth.core [None req-8fa412b7-4922-4720-9959-bf4d950cfdba None None] MFA Rules not processed for user `81783c1018864448aaf753c7c2da4c84`. Rule list: `[]` (Enabled: `True`). {{(pid=101893) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:04:56.850297 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.fernet_utils [None req-8fa412b7-4922-4720-9959-bf4d950cfdba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=101893) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:04:56.943082 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 1015/1998] 10.222.0.84 () {58 vars in 957 bytes} [Wed May 25 15:04:56 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 15:04:57.164679 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c13d314-e72b-4303-9588-4ab0a6aabaae admin admin] Authenticating user token {{(pid=101892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:04:57.165346 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.fernet_utils [None req-6c13d314-e72b-4303-9588-4ab0a6aabaae admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=101892) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:04:57.299124 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c13d314-e72b-4303-9588-4ab0a6aabaae admin admin] Validating token access rules against request {{(pid=101892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:04:57.306809 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1ede156-a442-4416-bf85-d12b2baba135 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cec56f74b2fa4826a506dc7b919465be', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:04:57.307707 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ede156-a442-4416-bf85-d12b2baba135 admin admin] REQUEST_METHOD: `DELETE` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:04:57.308006 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ede156-a442-4416-bf85-d12b2baba135 admin admin] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:04:57.309500 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ede156-a442-4416-bf85-d12b2baba135 admin admin] PATH_INFO: `/v3/projects/2a9edfa1aa93438e9f964a903335daf7` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:04:57.310157 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1ede156-a442-4416-bf85-d12b2baba135 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2a9edfa1aa93438e9f964a903335daf7)` {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:04:57.312309 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1ede156-a442-4416-bf85-d12b2baba135 admin admin] RBAC: Authorization granted {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:04:57.458153 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG dbcounter [-] [101892] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=101892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:04:57.467536 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.notifications [None req-d1ede156-a442-4416-bf85-d12b2baba135 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2a9edfa1aa93438e9f964a903335daf7', 'request_id': 'req-d1ede156-a442-4416-bf85-d12b2baba135'} {{(pid=101892) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:04:57.491146 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.notifications [None req-d1ede156-a442-4416-bf85-d12b2baba135 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2a9edfa1aa93438e9f964a903335daf7', 'request_id': 'req-d1ede156-a442-4416-bf85-d12b2baba135'} {{(pid=101892) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:04:57.495673 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.notifications [None req-d1ede156-a442-4416-bf85-d12b2baba135 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2a9edfa1aa93438e9f964a903335daf7', 'request_id': 'req-d1ede156-a442-4416-bf85-d12b2baba135'} {{(pid=101892) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:04:57.571148 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.notifications [None req-d1ede156-a442-4416-bf85-d12b2baba135 admin admin] The token cache is being invalidate because project 2a9edfa1aa93438e9f964a903335daf7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=101892) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 25 15:04:57.571587 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.notifications [None req-d1ede156-a442-4416-bf85-d12b2baba135 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=101892) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:04:57.575156 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.notifications [None req-d1ede156-a442-4416-bf85-d12b2baba135 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=101892) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:04:57.575156 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 984/1999] 10.222.0.84 () {58 vars in 1232 bytes} [Wed May 25 15:04:57 2022] DELETE /identity/v3/projects/2a9edfa1aa93438e9f964a903335daf7 => generated 0 bytes in 411 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 15:04:57.578336 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fa412b7-4922-4720-9959-bf4d950cfdba None None] Authenticating user token {{(pid=101893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:04:57.590548 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fa412b7-4922-4720-9959-bf4d950cfdba None None] Validating token access rules against request {{(pid=101893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:04:57.705011 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2074c309-f2d5-4468-a0e6-2471016d981b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cec56f74b2fa4826a506dc7b919465be', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:04:57.706331 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2074c309-f2d5-4468-a0e6-2471016d981b admin admin] REQUEST_METHOD: `DELETE` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:04:57.706722 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2074c309-f2d5-4468-a0e6-2471016d981b admin admin] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:04:57.707142 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2074c309-f2d5-4468-a0e6-2471016d981b admin admin] PATH_INFO: `/v3/users/72d282e722624907848aba031fb5e317` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:04:57.708828 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2074c309-f2d5-4468-a0e6-2471016d981b admin admin] RBAC: Authorizing `identity:delete_user(user_id=72d282e722624907848aba031fb5e317)` {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:04:57.711312 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2074c309-f2d5-4468-a0e6-2471016d981b admin admin] RBAC: Authorization granted {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:04:57.715442 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG dbcounter [-] [101893] Writing DB stats keystone:SELECT=100 {{(pid=101893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:04:57.925759 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.notifications [None req-2074c309-f2d5-4468-a0e6-2471016d981b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '72d282e722624907848aba031fb5e317'} {{(pid=101893) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:04:57.937071 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.notifications [None req-2074c309-f2d5-4468-a0e6-2471016d981b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '72d282e722624907848aba031fb5e317'} {{(pid=101893) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:04:57.978584 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.notifications [None req-2074c309-f2d5-4468-a0e6-2471016d981b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '72d282e722624907848aba031fb5e317'} {{(pid=101893) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:04:57.979543 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.notifications [None req-2074c309-f2d5-4468-a0e6-2471016d981b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '72d282e722624907848aba031fb5e317'} {{(pid=101893) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:04:57.980497 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.notifications [None req-2074c309-f2d5-4468-a0e6-2471016d981b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '72d282e722624907848aba031fb5e317'} {{(pid=101893) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:04:58.077621 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 1016/2000] 10.222.0.84 () {58 vars in 1223 bytes} [Wed May 25 15:04:57 2022] DELETE /identity/v3/users/72d282e722624907848aba031fb5e317 => generated 0 bytes in 500 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 15:04:58.395884 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1ede156-a442-4416-bf85-d12b2baba135 admin admin] Authenticating user token {{(pid=101892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:04:58.397338 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.fernet_utils [None req-d1ede156-a442-4416-bf85-d12b2baba135 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=101892) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:04:58.426566 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1ede156-a442-4416-bf85-d12b2baba135 admin admin] Validating token access rules against request {{(pid=101892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:04:58.523816 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d02236d0-e5cc-451c-85a5-bae939c8554f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cec56f74b2fa4826a506dc7b919465be', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:04:58.525987 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02236d0-e5cc-451c-85a5-bae939c8554f admin admin] REQUEST_METHOD: `DELETE` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:04:58.525987 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02236d0-e5cc-451c-85a5-bae939c8554f admin admin] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:04:58.525987 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02236d0-e5cc-451c-85a5-bae939c8554f admin admin] PATH_INFO: `/v3/projects/8c16ec4eb86b4d23b41af699e3587cef` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:04:58.527107 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d02236d0-e5cc-451c-85a5-bae939c8554f admin admin] RBAC: Authorizing `identity:delete_project(project_id=8c16ec4eb86b4d23b41af699e3587cef)` {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:04:58.529250 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d02236d0-e5cc-451c-85a5-bae939c8554f admin admin] RBAC: Authorization granted {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:04:58.681761 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.notifications [None req-d02236d0-e5cc-451c-85a5-bae939c8554f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8c16ec4eb86b4d23b41af699e3587cef', 'request_id': 'req-d02236d0-e5cc-451c-85a5-bae939c8554f'} {{(pid=101892) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:04:58.690442 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.notifications [None req-d02236d0-e5cc-451c-85a5-bae939c8554f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8c16ec4eb86b4d23b41af699e3587cef', 'request_id': 'req-d02236d0-e5cc-451c-85a5-bae939c8554f'} {{(pid=101892) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:04:58.697509 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.notifications [None req-d02236d0-e5cc-451c-85a5-bae939c8554f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8c16ec4eb86b4d23b41af699e3587cef', 'request_id': 'req-d02236d0-e5cc-451c-85a5-bae939c8554f'} {{(pid=101892) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:04:58.788919 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.notifications [None req-d02236d0-e5cc-451c-85a5-bae939c8554f admin admin] The token cache is being invalidate because project 8c16ec4eb86b4d23b41af699e3587cef was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=101892) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 25 15:04:58.789525 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.notifications [None req-d02236d0-e5cc-451c-85a5-bae939c8554f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=101892) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:04:58.790392 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.notifications [None req-d02236d0-e5cc-451c-85a5-bae939c8554f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=101892) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:04:58.797232 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 985/2001] 10.222.0.84 () {58 vars in 1232 bytes} [Wed May 25 15:04:58 2022] DELETE /identity/v3/projects/8c16ec4eb86b4d23b41af699e3587cef => generated 0 bytes in 397 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 15:04:58.799462 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44832fd7-75ca-4150-a454-a6effe3357f6 None None] REQUEST_METHOD: `POST` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:04:58.800000 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44832fd7-75ca-4150-a454-a6effe3357f6 None None] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:04:58.800334 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44832fd7-75ca-4150-a454-a6effe3357f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:04:58.824472 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.auth.core [None req-44832fd7-75ca-4150-a454-a6effe3357f6 None None] MFA Rules not processed for user `05d87e87798e429aa1c10b24391f915e`. Rule list: `[]` (Enabled: `True`). {{(pid=101893) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:04:58.826384 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.fernet_utils [None req-44832fd7-75ca-4150-a454-a6effe3357f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=101893) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:04:58.948204 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 1017/2002] 10.222.0.84 () {58 vars in 957 bytes} [Wed May 25 15:04:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 15:04:58.948411 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742dcda2-3547-4ad2-a24c-871ed8097d97 None None] REQUEST_METHOD: `POST` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:04:58.948411 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742dcda2-3547-4ad2-a24c-871ed8097d97 None None] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:04:58.948411 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742dcda2-3547-4ad2-a24c-871ed8097d97 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:04:58.983548 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.auth.core [None req-742dcda2-3547-4ad2-a24c-871ed8097d97 None None] MFA Rules not processed for user `05d87e87798e429aa1c10b24391f915e`. Rule list: `[]` (Enabled: `True`). {{(pid=101892) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:04:58.985589 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.fernet_utils [None req-742dcda2-3547-4ad2-a24c-871ed8097d97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=101892) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:04:59.013128 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 986/2003] 10.222.0.84 () {58 vars in 957 bytes} [Wed May 25 15:04:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 70 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 15:04:59.017271 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44832fd7-75ca-4150-a454-a6effe3357f6 None None] Authenticating user token {{(pid=101893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:04:59.045658 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44832fd7-75ca-4150-a454-a6effe3357f6 None None] Validating token access rules against request {{(pid=101893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:04:59.045658 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80738b14-4d58-4a31-be83-a9ca0208f16d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cec56f74b2fa4826a506dc7b919465be', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:04:59.045658 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80738b14-4d58-4a31-be83-a9ca0208f16d admin admin] REQUEST_METHOD: `GET` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:04:59.045658 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80738b14-4d58-4a31-be83-a9ca0208f16d admin admin] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:04:59.046588 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80738b14-4d58-4a31-be83-a9ca0208f16d admin admin] PATH_INFO: `/v3/domains` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:04:59.047937 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80738b14-4d58-4a31-be83-a9ca0208f16d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=101893) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 15:04:59.048468 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80738b14-4d58-4a31-be83-a9ca0208f16d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:04:59.050114 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80738b14-4d58-4a31-be83-a9ca0208f16d admin admin] RBAC: Authorization granted {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:04:59.073728 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 1018/2004] 10.222.0.84 () {58 vars in 1152 bytes} [Wed May 25 15:04:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 15:04:59.078677 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-742dcda2-3547-4ad2-a24c-871ed8097d97 None None] Authenticating user token {{(pid=101892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:04:59.094755 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-742dcda2-3547-4ad2-a24c-871ed8097d97 None None] Validating token access rules against request {{(pid=101892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:04:59.104075 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc6a558-44f9-45a6-8cf8-167faff86a11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cec56f74b2fa4826a506dc7b919465be', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:04:59.104075 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc6a558-44f9-45a6-8cf8-167faff86a11 admin admin] REQUEST_METHOD: `POST` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:04:59.104075 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc6a558-44f9-45a6-8cf8-167faff86a11 admin admin] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:04:59.104075 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc6a558-44f9-45a6-8cf8-167faff86a11 admin admin] PATH_INFO: `/v3/projects` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:04:59.104433 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adc6a558-44f9-45a6-8cf8-167faff86a11 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:04:59.106008 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adc6a558-44f9-45a6-8cf8-167faff86a11 admin admin] RBAC: Authorization granted {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:04:59.246130 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 987/2005] 10.222.0.84 () {60 vars in 1152 bytes} [Wed May 25 15:04:59 2022] POST /identity/v3/projects => generated 373 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 25 15:04:59.246858 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80738b14-4d58-4a31-be83-a9ca0208f16d admin admin] Authenticating user token {{(pid=101893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:04:59.272016 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80738b14-4d58-4a31-be83-a9ca0208f16d admin admin] Validating token access rules against request {{(pid=101893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:04:59.380619 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53f93b44-7ed6-4534-9647-a8fe448d0fb3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cec56f74b2fa4826a506dc7b919465be', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:04:59.382364 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f93b44-7ed6-4534-9647-a8fe448d0fb3 admin admin] REQUEST_METHOD: `POST` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:04:59.383002 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f93b44-7ed6-4534-9647-a8fe448d0fb3 admin admin] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:04:59.383942 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f93b44-7ed6-4534-9647-a8fe448d0fb3 admin admin] PATH_INFO: `/v3/users` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:04:59.384977 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53f93b44-7ed6-4534-9647-a8fe448d0fb3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:04:59.387821 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53f93b44-7ed6-4534-9647-a8fe448d0fb3 admin admin] RBAC: Authorization granted {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:04:59.477116 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG dbcounter [-] [101893] Writing DB stats keystone:SELECT=86,keystone:DELETE=10,keystone:INSERT=4 {{(pid=101893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:04:59.486547 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 1019/2006] 10.222.0.84 () {60 vars in 1143 bytes} [Wed May 25 15:04:59 2022] POST /identity/v3/users => generated 287 bytes in 240 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 15:04:59.490460 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc6a558-44f9-45a6-8cf8-167faff86a11 admin admin] Authenticating user token {{(pid=101892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:04:59.505751 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc6a558-44f9-45a6-8cf8-167faff86a11 admin admin] Validating token access rules against request {{(pid=101892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:04:59.512601 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf9e25da-e09e-4c51-9b6d-013c3eca47af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cec56f74b2fa4826a506dc7b919465be', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:04:59.513483 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9e25da-e09e-4c51-9b6d-013c3eca47af admin admin] REQUEST_METHOD: `GET` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:04:59.513769 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9e25da-e09e-4c51-9b6d-013c3eca47af admin admin] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:04:59.514223 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9e25da-e09e-4c51-9b6d-013c3eca47af admin admin] PATH_INFO: `/v3/roles` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:04:59.514960 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf9e25da-e09e-4c51-9b6d-013c3eca47af admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:04:59.517337 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf9e25da-e09e-4c51-9b6d-013c3eca47af admin admin] RBAC: Authorization granted {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:04:59.545674 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 988/2007] 10.222.0.84 () {58 vars in 1121 bytes} [Wed May 25 15:04:59 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 15:04:59.546302 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53f93b44-7ed6-4534-9647-a8fe448d0fb3 admin admin] Authenticating user token {{(pid=101893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:04:59.568507 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53f93b44-7ed6-4534-9647-a8fe448d0fb3 admin admin] Validating token access rules against request {{(pid=101893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:04:59.573573 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94aa4e22-15fa-4dad-89bc-34dfcb404ac7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cec56f74b2fa4826a506dc7b919465be', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:04:59.574510 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94aa4e22-15fa-4dad-89bc-34dfcb404ac7 admin admin] REQUEST_METHOD: `GET` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:04:59.576477 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94aa4e22-15fa-4dad-89bc-34dfcb404ac7 admin admin] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:04:59.576846 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94aa4e22-15fa-4dad-89bc-34dfcb404ac7 admin admin] PATH_INFO: `/v3/roles` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:04:59.577831 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94aa4e22-15fa-4dad-89bc-34dfcb404ac7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:04:59.580363 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94aa4e22-15fa-4dad-89bc-34dfcb404ac7 admin admin] RBAC: Authorization granted {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:04:59.591616 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 1020/2008] 10.222.0.84 () {58 vars in 1121 bytes} [Wed May 25 15:04:59 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 25 15:04:59.596592 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf9e25da-e09e-4c51-9b6d-013c3eca47af admin admin] Authenticating user token {{(pid=101892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:04:59.608598 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf9e25da-e09e-4c51-9b6d-013c3eca47af admin admin] Validating token access rules against request {{(pid=101892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:04:59.614424 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c15e8ce-2613-4439-8b4e-8574af647d08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cec56f74b2fa4826a506dc7b919465be', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:04:59.615606 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c15e8ce-2613-4439-8b4e-8574af647d08 admin admin] REQUEST_METHOD: `PUT` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:04:59.616091 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c15e8ce-2613-4439-8b4e-8574af647d08 admin admin] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:04:59.616572 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c15e8ce-2613-4439-8b4e-8574af647d08 admin admin] PATH_INFO: `/v3/projects/4fb09473d22a407ca6c87a65433c5f1b/users/101c2903c56543bcb6ebd4e3d4bdf5c4/roles/ff664fa0db7e4262a5accde96c3df4c3` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:04:59.637480 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c15e8ce-2613-4439-8b4e-8574af647d08 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4fb09473d22a407ca6c87a65433c5f1b, user_id=101c2903c56543bcb6ebd4e3d4bdf5c4, role_id=ff664fa0db7e4262a5accde96c3df4c3)` {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:04:59.640287 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c15e8ce-2613-4439-8b4e-8574af647d08 admin admin] RBAC: Authorization granted {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:04:59.644159 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG dbcounter [-] [101892] Writing DB stats keystone:SELECT=85,keystone:DELETE=11,keystone:INSERT=4 {{(pid=101892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:04:59.720785 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 989/2009] 10.222.0.84 () {60 vars in 1482 bytes} [Wed May 25 15:04:59 2022] PUT /identity/v3/projects/4fb09473d22a407ca6c87a65433c5f1b/users/101c2903c56543bcb6ebd4e3d4bdf5c4/roles/ff664fa0db7e4262a5accde96c3df4c3 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 15:04:59.731779 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42064c49-b223-40db-9dc2-283a42d1511a None None] REQUEST_METHOD: `POST` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:04:59.731779 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42064c49-b223-40db-9dc2-283a42d1511a None None] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:04:59.731779 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42064c49-b223-40db-9dc2-283a42d1511a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:04:59.815117 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.auth.core [None req-42064c49-b223-40db-9dc2-283a42d1511a None None] MFA Rules not processed for user `101c2903c56543bcb6ebd4e3d4bdf5c4`. Rule list: `[]` (Enabled: `True`). {{(pid=101893) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:04:59.819402 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.fernet_utils [None req-42064c49-b223-40db-9dc2-283a42d1511a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=101893) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:04:59.912556 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 1021/2010] 10.222.0.84 () {58 vars in 957 bytes} [Wed May 25 15:04:59 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 15:04:59.920862 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c15e8ce-2613-4439-8b4e-8574af647d08 admin admin] Authenticating user token {{(pid=101892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:04:59.923997 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.fernet_utils [None req-4c15e8ce-2613-4439-8b4e-8574af647d08 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=101892) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:04:59.946741 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42064c49-b223-40db-9dc2-283a42d1511a None None] Authenticating user token {{(pid=101893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:04:59.951758 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.fernet_utils [None req-42064c49-b223-40db-9dc2-283a42d1511a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=101893) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:05:00.052698 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42064c49-b223-40db-9dc2-283a42d1511a None None] Validating token access rules against request {{(pid=101893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:05:00.057582 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95f57358-edd9-4def-b871-1c3f2c304cff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cec56f74b2fa4826a506dc7b919465be', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:05:00.058766 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f57358-edd9-4def-b871-1c3f2c304cff admin admin] REQUEST_METHOD: `DELETE` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:05:00.059125 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f57358-edd9-4def-b871-1c3f2c304cff admin admin] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:05:00.059466 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f57358-edd9-4def-b871-1c3f2c304cff admin admin] PATH_INFO: `/v3/users/9d79e7742e9747db9a2992e44bb26957` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:05:00.060862 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95f57358-edd9-4def-b871-1c3f2c304cff admin admin] RBAC: Authorizing `identity:delete_user(user_id=9d79e7742e9747db9a2992e44bb26957)` {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:05:00.063378 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95f57358-edd9-4def-b871-1c3f2c304cff admin admin] RBAC: Authorization granted {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:05:00.065988 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c15e8ce-2613-4439-8b4e-8574af647d08 admin admin] Validating token access rules against request {{(pid=101892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:05:00.070105 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e15881-44d5-4b43-a603-d7f74a5aea48 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e079f89a5e524ab6ad4183e4f690de07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a000829c658c4a7cab67f7b6353ba3fa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:05:00.071014 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e15881-44d5-4b43-a603-d7f74a5aea48 service cinder] REQUEST_METHOD: `GET` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:05:00.071450 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e15881-44d5-4b43-a603-d7f74a5aea48 service cinder] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:05:00.071937 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e15881-44d5-4b43-a603-d7f74a5aea48 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:05:00.083101 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4e15881-44d5-4b43-a603-d7f74a5aea48 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:05:00.085110 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4e15881-44d5-4b43-a603-d7f74a5aea48 service cinder] RBAC: Authorization granted {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:05:00.097813 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 990/2011] 10.222.0.84 () {60 vars in 1365 bytes} [Wed May 25 15:04:59 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 178 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 15:05:00.122029 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e15881-44d5-4b43-a603-d7f74a5aea48 service cinder] Authenticating user token {{(pid=101892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:05:00.136719 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e15881-44d5-4b43-a603-d7f74a5aea48 service cinder] Validating token access rules against request {{(pid=101892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:05:00.157042 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be57d613-c898-4aef-a432-e9ea55262fd4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cec56f74b2fa4826a506dc7b919465be', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:05:00.158131 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be57d613-c898-4aef-a432-e9ea55262fd4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:05:00.161832 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be57d613-c898-4aef-a432-e9ea55262fd4 admin admin] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:05:00.162240 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be57d613-c898-4aef-a432-e9ea55262fd4 admin admin] PATH_INFO: `/v3/users/101c2903c56543bcb6ebd4e3d4bdf5c4` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:05:00.165222 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be57d613-c898-4aef-a432-e9ea55262fd4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=101c2903c56543bcb6ebd4e3d4bdf5c4)` {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:05:00.174105 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be57d613-c898-4aef-a432-e9ea55262fd4 admin admin] RBAC: Authorization granted {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:05:00.227792 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.notifications [None req-95f57358-edd9-4def-b871-1c3f2c304cff admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9d79e7742e9747db9a2992e44bb26957'} {{(pid=101893) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:05:00.237264 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.notifications [None req-95f57358-edd9-4def-b871-1c3f2c304cff admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9d79e7742e9747db9a2992e44bb26957'} {{(pid=101893) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:05:00.260100 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.notifications [None req-95f57358-edd9-4def-b871-1c3f2c304cff admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9d79e7742e9747db9a2992e44bb26957'} {{(pid=101893) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:05:00.263267 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.notifications [None req-95f57358-edd9-4def-b871-1c3f2c304cff admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9d79e7742e9747db9a2992e44bb26957'} {{(pid=101893) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:05:00.264855 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.notifications [None req-95f57358-edd9-4def-b871-1c3f2c304cff admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9d79e7742e9747db9a2992e44bb26957'} {{(pid=101893) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:05:00.273054 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG dbcounter [-] [101893] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=101893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:05:00.353317 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 1022/2012] 10.222.0.84 () {58 vars in 1223 bytes} [Wed May 25 15:04:59 2022] DELETE /identity/v3/users/9d79e7742e9747db9a2992e44bb26957 => generated 0 bytes in 407 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 15:05:00.358716 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-139c5fba-23e2-43d4-8ec2-ce249caca61e None None] REQUEST_METHOD: `POST` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:05:00.359176 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-139c5fba-23e2-43d4-8ec2-ce249caca61e None None] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:05:00.359624 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-139c5fba-23e2-43d4-8ec2-ce249caca61e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:05:00.389229 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.auth.core [None req-139c5fba-23e2-43d4-8ec2-ce249caca61e None None] MFA Rules not processed for user `05d87e87798e429aa1c10b24391f915e`. Rule list: `[]` (Enabled: `True`). {{(pid=101893) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:05:00.390477 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.fernet_utils [None req-139c5fba-23e2-43d4-8ec2-ce249caca61e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=101893) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:05:00.486951 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.notifications [None req-be57d613-c898-4aef-a432-e9ea55262fd4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '101c2903c56543bcb6ebd4e3d4bdf5c4'} {{(pid=101892) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:05:00.499115 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.notifications [None req-be57d613-c898-4aef-a432-e9ea55262fd4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '101c2903c56543bcb6ebd4e3d4bdf5c4'} {{(pid=101892) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:05:00.501383 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 1023/2013] 10.222.0.84 () {58 vars in 957 bytes} [Wed May 25 15:05:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 15:05:00.507715 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-139c5fba-23e2-43d4-8ec2-ce249caca61e None None] Authenticating user token {{(pid=101893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:05:00.509445 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.fernet_utils [None req-139c5fba-23e2-43d4-8ec2-ce249caca61e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=101893) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:05:00.516210 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.notifications [None req-be57d613-c898-4aef-a432-e9ea55262fd4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '101c2903c56543bcb6ebd4e3d4bdf5c4'} {{(pid=101892) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:05:00.517269 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.notifications [None req-be57d613-c898-4aef-a432-e9ea55262fd4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '101c2903c56543bcb6ebd4e3d4bdf5c4'} {{(pid=101892) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:05:00.590589 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-139c5fba-23e2-43d4-8ec2-ce249caca61e None None] Validating token access rules against request {{(pid=101893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:05:00.595123 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6525e99a-f9cf-4e16-8fd4-408fb608ba60 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ce28b25b907473588ccb87dc4acc06a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a000829c658c4a7cab67f7b6353ba3fa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:05:00.595934 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6525e99a-f9cf-4e16-8fd4-408fb608ba60 service neutron] REQUEST_METHOD: `GET` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:05:00.596231 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6525e99a-f9cf-4e16-8fd4-408fb608ba60 service neutron] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:05:00.596676 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6525e99a-f9cf-4e16-8fd4-408fb608ba60 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:05:00.608912 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6525e99a-f9cf-4e16-8fd4-408fb608ba60 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:05:00.611154 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6525e99a-f9cf-4e16-8fd4-408fb608ba60 service neutron] RBAC: Authorization granted {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:05:00.624000 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 1024/2014] 10.222.0.84 () {60 vars in 1365 bytes} [Wed May 25 15:05:00 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 25 15:05:00.627816 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.notifications [None req-be57d613-c898-4aef-a432-e9ea55262fd4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '101c2903c56543bcb6ebd4e3d4bdf5c4'} {{(pid=101892) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:05:00.635987 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 991/2015] 10.222.0.84 () {58 vars in 1223 bytes} [Wed May 25 15:05:00 2022] DELETE /identity/v3/users/101c2903c56543bcb6ebd4e3d4bdf5c4 => generated 0 bytes in 517 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 25 15:05:00.642420 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91642e9e-b027-4148-8e2d-139e9cae58ee None None] REQUEST_METHOD: `POST` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:05:00.642420 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91642e9e-b027-4148-8e2d-139e9cae58ee None None] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:05:00.642420 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91642e9e-b027-4148-8e2d-139e9cae58ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:05:00.679282 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.auth.core [None req-91642e9e-b027-4148-8e2d-139e9cae58ee None None] MFA Rules not processed for user `05d87e87798e429aa1c10b24391f915e`. Rule list: `[]` (Enabled: `True`). {{(pid=101893) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:05:00.680601 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.fernet_utils [None req-91642e9e-b027-4148-8e2d-139e9cae58ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=101893) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:05:00.777754 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 1025/2016] 10.222.0.84 () {58 vars in 957 bytes} [Wed May 25 15:05:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 25 15:05:00.789198 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be57d613-c898-4aef-a432-e9ea55262fd4 admin admin] Authenticating user token {{(pid=101892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:05:00.790692 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.fernet_utils [None req-be57d613-c898-4aef-a432-e9ea55262fd4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=101892) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:05:00.858640 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be57d613-c898-4aef-a432-e9ea55262fd4 admin admin] Validating token access rules against request {{(pid=101892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:05:00.863090 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ab7e94-7d9f-4857-8b83-5c2d05c9c815 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ce28b25b907473588ccb87dc4acc06a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a000829c658c4a7cab67f7b6353ba3fa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:05:00.863777 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ab7e94-7d9f-4857-8b83-5c2d05c9c815 service neutron] REQUEST_METHOD: `GET` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:05:00.864059 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ab7e94-7d9f-4857-8b83-5c2d05c9c815 service neutron] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:05:00.864337 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ab7e94-7d9f-4857-8b83-5c2d05c9c815 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:05:00.871619 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG dbcounter [-] [101892] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=101892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:05:00.876929 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4ab7e94-7d9f-4857-8b83-5c2d05c9c815 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:05:00.878427 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4ab7e94-7d9f-4857-8b83-5c2d05c9c815 service neutron] RBAC: Authorization granted {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:05:00.889188 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 992/2017] 10.222.0.84 () {60 vars in 1365 bytes} [Wed May 25 15:05:00 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 15:05:01.275413 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91642e9e-b027-4148-8e2d-139e9cae58ee None None] Authenticating user token {{(pid=101893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:05:01.277125 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.fernet_utils [None req-91642e9e-b027-4148-8e2d-139e9cae58ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=101893) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:05:01.291865 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91642e9e-b027-4148-8e2d-139e9cae58ee None None] Validating token access rules against request {{(pid=101893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:05:01.301951 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19f63cb1-d419-4310-9d2a-04fd67fc3bc6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cec56f74b2fa4826a506dc7b919465be', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:05:01.303002 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f63cb1-d419-4310-9d2a-04fd67fc3bc6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:05:01.308529 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f63cb1-d419-4310-9d2a-04fd67fc3bc6 admin admin] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:05:01.308937 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f63cb1-d419-4310-9d2a-04fd67fc3bc6 admin admin] PATH_INFO: `/v3/projects/eaa9a01240a440d1b7fa7ad90003a7da` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:05:01.310424 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19f63cb1-d419-4310-9d2a-04fd67fc3bc6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=eaa9a01240a440d1b7fa7ad90003a7da)` {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:05:01.312517 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19f63cb1-d419-4310-9d2a-04fd67fc3bc6 admin admin] RBAC: Authorization granted {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:05:01.475473 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG dbcounter [-] [101893] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=101893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:05:01.500579 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.notifications [None req-19f63cb1-d419-4310-9d2a-04fd67fc3bc6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'eaa9a01240a440d1b7fa7ad90003a7da', 'request_id': 'req-19f63cb1-d419-4310-9d2a-04fd67fc3bc6'} {{(pid=101893) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:05:01.516431 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.notifications [None req-19f63cb1-d419-4310-9d2a-04fd67fc3bc6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'eaa9a01240a440d1b7fa7ad90003a7da', 'request_id': 'req-19f63cb1-d419-4310-9d2a-04fd67fc3bc6'} {{(pid=101893) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:05:01.530611 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.notifications [None req-19f63cb1-d419-4310-9d2a-04fd67fc3bc6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'eaa9a01240a440d1b7fa7ad90003a7da', 'request_id': 'req-19f63cb1-d419-4310-9d2a-04fd67fc3bc6'} {{(pid=101893) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:05:01.645633 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.notifications [None req-19f63cb1-d419-4310-9d2a-04fd67fc3bc6 admin admin] The token cache is being invalidate because project eaa9a01240a440d1b7fa7ad90003a7da was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=101893) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 25 15:05:01.645633 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.notifications [None req-19f63cb1-d419-4310-9d2a-04fd67fc3bc6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=101893) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:05:01.646277 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.notifications [None req-19f63cb1-d419-4310-9d2a-04fd67fc3bc6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=101893) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:05:01.648256 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 1026/2018] 10.222.0.84 () {58 vars in 1232 bytes} [Wed May 25 15:05:01 2022] DELETE /identity/v3/projects/eaa9a01240a440d1b7fa7ad90003a7da => generated 0 bytes in 373 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 15:05:01.652053 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ab7e94-7d9f-4857-8b83-5c2d05c9c815 service neutron] Authenticating user token {{(pid=101892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:05:01.663341 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ab7e94-7d9f-4857-8b83-5c2d05c9c815 service neutron] Validating token access rules against request {{(pid=101892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:05:01.747702 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45bb224c-7493-4a4b-8eea-37604c827364 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cec56f74b2fa4826a506dc7b919465be', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:05:01.749038 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45bb224c-7493-4a4b-8eea-37604c827364 admin admin] REQUEST_METHOD: `DELETE` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:05:01.749619 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45bb224c-7493-4a4b-8eea-37604c827364 admin admin] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:05:01.750106 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45bb224c-7493-4a4b-8eea-37604c827364 admin admin] PATH_INFO: `/v3/users/6169cc36a49440cfa73d63999930bc15` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:05:01.751698 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45bb224c-7493-4a4b-8eea-37604c827364 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6169cc36a49440cfa73d63999930bc15)` {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:05:01.754155 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45bb224c-7493-4a4b-8eea-37604c827364 admin admin] RBAC: Authorization granted {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:05:01.925250 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19f63cb1-d419-4310-9d2a-04fd67fc3bc6 admin admin] Authenticating user token {{(pid=101893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:05:01.926717 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.fernet_utils [None req-19f63cb1-d419-4310-9d2a-04fd67fc3bc6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=101893) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:05:01.942871 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19f63cb1-d419-4310-9d2a-04fd67fc3bc6 admin admin] Validating token access rules against request {{(pid=101893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:05:01.951765 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0a46197-7f96-45e1-ba07-be60a0926653 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cec56f74b2fa4826a506dc7b919465be', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:05:01.952848 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a46197-7f96-45e1-ba07-be60a0926653 admin admin] REQUEST_METHOD: `DELETE` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:05:01.953214 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a46197-7f96-45e1-ba07-be60a0926653 admin admin] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:05:01.953609 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a46197-7f96-45e1-ba07-be60a0926653 admin admin] PATH_INFO: `/v3/projects/4fb09473d22a407ca6c87a65433c5f1b` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:05:01.955150 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0a46197-7f96-45e1-ba07-be60a0926653 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4fb09473d22a407ca6c87a65433c5f1b)` {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:05:01.957258 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0a46197-7f96-45e1-ba07-be60a0926653 admin admin] RBAC: Authorization granted {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:05:02.010054 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.notifications [None req-45bb224c-7493-4a4b-8eea-37604c827364 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6169cc36a49440cfa73d63999930bc15'} {{(pid=101892) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:05:02.019533 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.notifications [None req-45bb224c-7493-4a4b-8eea-37604c827364 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6169cc36a49440cfa73d63999930bc15'} {{(pid=101892) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:05:02.040012 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.notifications [None req-45bb224c-7493-4a4b-8eea-37604c827364 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6169cc36a49440cfa73d63999930bc15'} {{(pid=101892) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:05:02.040900 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.notifications [None req-45bb224c-7493-4a4b-8eea-37604c827364 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6169cc36a49440cfa73d63999930bc15'} {{(pid=101892) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:05:02.132667 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.notifications [None req-f0a46197-7f96-45e1-ba07-be60a0926653 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4fb09473d22a407ca6c87a65433c5f1b', 'request_id': 'req-f0a46197-7f96-45e1-ba07-be60a0926653'} {{(pid=101893) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:05:02.140774 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.notifications [None req-f0a46197-7f96-45e1-ba07-be60a0926653 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4fb09473d22a407ca6c87a65433c5f1b', 'request_id': 'req-f0a46197-7f96-45e1-ba07-be60a0926653'} {{(pid=101893) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:05:02.149117 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.notifications [None req-f0a46197-7f96-45e1-ba07-be60a0926653 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4fb09473d22a407ca6c87a65433c5f1b', 'request_id': 'req-f0a46197-7f96-45e1-ba07-be60a0926653'} {{(pid=101893) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:05:02.160648 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.notifications [None req-45bb224c-7493-4a4b-8eea-37604c827364 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6169cc36a49440cfa73d63999930bc15'} {{(pid=101892) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:05:02.168873 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 993/2019] 10.222.0.84 () {58 vars in 1223 bytes} [Wed May 25 15:05:01 2022] DELETE /identity/v3/users/6169cc36a49440cfa73d63999930bc15 => generated 0 bytes in 517 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 15:05:02.249201 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.notifications [None req-f0a46197-7f96-45e1-ba07-be60a0926653 admin admin] The token cache is being invalidate because project 4fb09473d22a407ca6c87a65433c5f1b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=101893) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 25 15:05:02.261559 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.notifications [None req-f0a46197-7f96-45e1-ba07-be60a0926653 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=101893) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:05:02.263718 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.notifications [None req-f0a46197-7f96-45e1-ba07-be60a0926653 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=101893) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:05:02.267887 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 1027/2020] 10.222.0.84 () {58 vars in 1232 bytes} [Wed May 25 15:05:01 2022] DELETE /identity/v3/projects/4fb09473d22a407ca6c87a65433c5f1b => generated 0 bytes in 343 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 15:05:02.275146 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9a3d45-f487-4564-b640-ebed84024fc1 None None] REQUEST_METHOD: `POST` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:05:02.278535 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9a3d45-f487-4564-b640-ebed84024fc1 None None] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:05:02.278995 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9a3d45-f487-4564-b640-ebed84024fc1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:05:02.318321 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.auth.core [None req-ae9a3d45-f487-4564-b640-ebed84024fc1 None None] MFA Rules not processed for user `05d87e87798e429aa1c10b24391f915e`. Rule list: `[]` (Enabled: `True`). {{(pid=101892) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:05:02.320033 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.fernet_utils [None req-ae9a3d45-f487-4564-b640-ebed84024fc1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=101892) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:05:02.402405 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 994/2021] 10.222.0.84 () {58 vars in 957 bytes} [Wed May 25 15:05:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 15:05:02.410518 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ac540f-b064-4348-bf5e-e38f0d80c295 None None] REQUEST_METHOD: `POST` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:05:02.411029 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ac540f-b064-4348-bf5e-e38f0d80c295 None None] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:05:02.411124 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ac540f-b064-4348-bf5e-e38f0d80c295 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:05:02.458757 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.auth.core [None req-97ac540f-b064-4348-bf5e-e38f0d80c295 None None] MFA Rules not processed for user `05d87e87798e429aa1c10b24391f915e`. Rule list: `[]` (Enabled: `True`). {{(pid=101893) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:05:02.464130 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.fernet_utils [None req-97ac540f-b064-4348-bf5e-e38f0d80c295 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=101893) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:05:02.490192 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 1028/2022] 10.222.0.84 () {58 vars in 957 bytes} [Wed May 25 15:05:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 15:05:02.495211 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae9a3d45-f487-4564-b640-ebed84024fc1 None None] Authenticating user token {{(pid=101892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:05:02.507957 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae9a3d45-f487-4564-b640-ebed84024fc1 None None] Validating token access rules against request {{(pid=101892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:05:02.525634 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-702fb304-fbbb-49c0-9d00-35c60dc3669d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cec56f74b2fa4826a506dc7b919465be', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:05:02.532311 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702fb304-fbbb-49c0-9d00-35c60dc3669d admin admin] REQUEST_METHOD: `GET` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:05:02.532726 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702fb304-fbbb-49c0-9d00-35c60dc3669d admin admin] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:05:02.533014 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702fb304-fbbb-49c0-9d00-35c60dc3669d admin admin] PATH_INFO: `/v3/domains` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:05:02.533812 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-702fb304-fbbb-49c0-9d00-35c60dc3669d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=101892) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 15:05:02.534130 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-702fb304-fbbb-49c0-9d00-35c60dc3669d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:05:02.540605 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-702fb304-fbbb-49c0-9d00-35c60dc3669d admin admin] RBAC: Authorization granted {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:05:02.565810 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 995/2023] 10.222.0.84 () {58 vars in 1152 bytes} [Wed May 25 15:05:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 15:05:02.565810 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG dbcounter [-] [101892] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=101892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:05:02.569163 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ac540f-b064-4348-bf5e-e38f0d80c295 None None] Authenticating user token {{(pid=101893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:05:02.584633 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ac540f-b064-4348-bf5e-e38f0d80c295 None None] Validating token access rules against request {{(pid=101893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:05:02.591170 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8523b3a-aaaa-4157-87ce-136012bc6fc1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cec56f74b2fa4826a506dc7b919465be', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:05:02.592107 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8523b3a-aaaa-4157-87ce-136012bc6fc1 admin admin] REQUEST_METHOD: `POST` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:05:02.592604 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8523b3a-aaaa-4157-87ce-136012bc6fc1 admin admin] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:05:02.593036 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8523b3a-aaaa-4157-87ce-136012bc6fc1 admin admin] PATH_INFO: `/v3/projects` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:05:02.593962 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8523b3a-aaaa-4157-87ce-136012bc6fc1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:05:02.600132 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8523b3a-aaaa-4157-87ce-136012bc6fc1 admin admin] RBAC: Authorization granted {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:05:02.725497 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 1029/2024] 10.222.0.84 () {60 vars in 1152 bytes} [Wed May 25 15:05:02 2022] POST /identity/v3/projects => generated 383 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 15:05:02.729857 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-702fb304-fbbb-49c0-9d00-35c60dc3669d admin admin] Authenticating user token {{(pid=101892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:05:02.755761 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-702fb304-fbbb-49c0-9d00-35c60dc3669d admin admin] Validating token access rules against request {{(pid=101892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:05:02.898973 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5092a14d-c858-4802-8f09-cbb9b846ce90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cec56f74b2fa4826a506dc7b919465be', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:05:02.899709 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5092a14d-c858-4802-8f09-cbb9b846ce90 admin admin] REQUEST_METHOD: `POST` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:05:02.900004 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5092a14d-c858-4802-8f09-cbb9b846ce90 admin admin] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:05:02.902276 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5092a14d-c858-4802-8f09-cbb9b846ce90 admin admin] PATH_INFO: `/v3/users` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:05:02.903085 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5092a14d-c858-4802-8f09-cbb9b846ce90 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:05:02.909218 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5092a14d-c858-4802-8f09-cbb9b846ce90 admin admin] RBAC: Authorization granted {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:05:02.967916 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8523b3a-aaaa-4157-87ce-136012bc6fc1 admin admin] Authenticating user token {{(pid=101893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:05:02.969905 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.fernet_utils [None req-f8523b3a-aaaa-4157-87ce-136012bc6fc1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=101893) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:05:02.997109 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8523b3a-aaaa-4157-87ce-136012bc6fc1 admin admin] Validating token access rules against request {{(pid=101893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:05:03.003783 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50db0735-afb1-40dd-aae1-1ebd01b656d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cec56f74b2fa4826a506dc7b919465be', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:05:03.006035 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50db0735-afb1-40dd-aae1-1ebd01b656d1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:05:03.006035 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50db0735-afb1-40dd-aae1-1ebd01b656d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:05:03.006035 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50db0735-afb1-40dd-aae1-1ebd01b656d1 admin admin] PATH_INFO: `/v3/projects/112c95514f5c43a88cb0c1224ee11dfc` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:05:03.010113 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50db0735-afb1-40dd-aae1-1ebd01b656d1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=112c95514f5c43a88cb0c1224ee11dfc)` {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:05:03.010113 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50db0735-afb1-40dd-aae1-1ebd01b656d1 admin admin] RBAC: Authorization granted {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:05:03.036016 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 996/2025] 10.222.0.84 () {60 vars in 1143 bytes} [Wed May 25 15:05:02 2022] POST /identity/v3/users => generated 292 bytes in 307 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 25 15:05:03.040179 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5092a14d-c858-4802-8f09-cbb9b846ce90 admin admin] Authenticating user token {{(pid=101892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:05:03.057955 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5092a14d-c858-4802-8f09-cbb9b846ce90 admin admin] Validating token access rules against request {{(pid=101892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:05:03.067592 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e713e2bc-814f-4670-a3d8-63ff7c461051 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cec56f74b2fa4826a506dc7b919465be', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:05:03.068604 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e713e2bc-814f-4670-a3d8-63ff7c461051 admin admin] REQUEST_METHOD: `GET` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:05:03.069329 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e713e2bc-814f-4670-a3d8-63ff7c461051 admin admin] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:05:03.070588 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e713e2bc-814f-4670-a3d8-63ff7c461051 admin admin] PATH_INFO: `/v3/roles` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:05:03.071550 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e713e2bc-814f-4670-a3d8-63ff7c461051 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:05:03.073321 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e713e2bc-814f-4670-a3d8-63ff7c461051 admin admin] RBAC: Authorization granted {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:05:03.090479 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 997/2026] 10.222.0.84 () {58 vars in 1121 bytes} [Wed May 25 15:05:03 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 15:05:03.094106 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e713e2bc-814f-4670-a3d8-63ff7c461051 admin admin] Authenticating user token {{(pid=101892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:05:03.109645 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e713e2bc-814f-4670-a3d8-63ff7c461051 admin admin] Validating token access rules against request {{(pid=101892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:05:03.118874 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d29fd7f9-440d-46f6-8233-9650fc290d8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cec56f74b2fa4826a506dc7b919465be', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:05:03.119667 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d29fd7f9-440d-46f6-8233-9650fc290d8e admin admin] REQUEST_METHOD: `GET` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:05:03.119955 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d29fd7f9-440d-46f6-8233-9650fc290d8e admin admin] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:05:03.120234 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d29fd7f9-440d-46f6-8233-9650fc290d8e admin admin] PATH_INFO: `/v3/roles` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:05:03.121998 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d29fd7f9-440d-46f6-8233-9650fc290d8e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:05:03.128165 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d29fd7f9-440d-46f6-8233-9650fc290d8e admin admin] RBAC: Authorization granted {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:05:03.146836 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 998/2027] 10.222.0.84 () {58 vars in 1121 bytes} [Wed May 25 15:05:03 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 15:05:03.167426 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d29fd7f9-440d-46f6-8233-9650fc290d8e admin admin] Authenticating user token {{(pid=101892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:05:03.185495 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.notifications [None req-50db0735-afb1-40dd-aae1-1ebd01b656d1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '112c95514f5c43a88cb0c1224ee11dfc', 'request_id': 'req-50db0735-afb1-40dd-aae1-1ebd01b656d1'} {{(pid=101893) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:05:03.195416 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d29fd7f9-440d-46f6-8233-9650fc290d8e admin admin] Validating token access rules against request {{(pid=101892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:05:03.206422 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.notifications [None req-50db0735-afb1-40dd-aae1-1ebd01b656d1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '112c95514f5c43a88cb0c1224ee11dfc', 'request_id': 'req-50db0735-afb1-40dd-aae1-1ebd01b656d1'} {{(pid=101893) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:05:03.225434 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.notifications [None req-50db0735-afb1-40dd-aae1-1ebd01b656d1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '112c95514f5c43a88cb0c1224ee11dfc', 'request_id': 'req-50db0735-afb1-40dd-aae1-1ebd01b656d1'} {{(pid=101893) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:05:03.280087 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-372d12a2-85d4-4b3c-ad5d-478a04ff7e12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cec56f74b2fa4826a506dc7b919465be', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:05:03.281209 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372d12a2-85d4-4b3c-ad5d-478a04ff7e12 admin admin] REQUEST_METHOD: `PUT` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:05:03.281589 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372d12a2-85d4-4b3c-ad5d-478a04ff7e12 admin admin] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:05:03.282476 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372d12a2-85d4-4b3c-ad5d-478a04ff7e12 admin admin] PATH_INFO: `/v3/projects/acb3d37fdb3a4f149eb40e3dfd659448/users/6726643adf1d4788958e4a85ac75caca/roles/ff664fa0db7e4262a5accde96c3df4c3` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:05:03.293717 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG dbcounter [-] [101893] Writing DB stats keystone:DELETE=19,keystone:SELECT=77,keystone:INSERT=4 {{(pid=101893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:05:03.298075 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.notifications [None req-50db0735-afb1-40dd-aae1-1ebd01b656d1 admin admin] The token cache is being invalidate because project 112c95514f5c43a88cb0c1224ee11dfc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=101893) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 25 15:05:03.298495 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.notifications [None req-50db0735-afb1-40dd-aae1-1ebd01b656d1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=101893) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:05:03.300308 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.notifications [None req-50db0735-afb1-40dd-aae1-1ebd01b656d1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=101893) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:05:03.302682 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 1030/2028] 10.222.0.84 () {58 vars in 1232 bytes} [Wed May 25 15:05:02 2022] DELETE /identity/v3/projects/112c95514f5c43a88cb0c1224ee11dfc => generated 0 bytes in 336 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 25 15:05:03.307626 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d208adc3-19c1-47e6-83e6-aa169206a9c9 None None] REQUEST_METHOD: `POST` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:05:03.307927 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d208adc3-19c1-47e6-83e6-aa169206a9c9 None None] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:05:03.308515 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d208adc3-19c1-47e6-83e6-aa169206a9c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:05:03.308803 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-372d12a2-85d4-4b3c-ad5d-478a04ff7e12 admin admin] RBAC: Authorizing `identity:create_grant(project_id=acb3d37fdb3a4f149eb40e3dfd659448, user_id=6726643adf1d4788958e4a85ac75caca, role_id=ff664fa0db7e4262a5accde96c3df4c3)` {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:05:03.312278 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-372d12a2-85d4-4b3c-ad5d-478a04ff7e12 admin admin] RBAC: Authorization granted {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:05:03.333611 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.auth.core [None req-d208adc3-19c1-47e6-83e6-aa169206a9c9 None None] MFA Rules not processed for user `05d87e87798e429aa1c10b24391f915e`. Rule list: `[]` (Enabled: `True`). {{(pid=101893) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:05:03.334885 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.fernet_utils [None req-d208adc3-19c1-47e6-83e6-aa169206a9c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=101893) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:05:03.347654 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 1031/2029] 10.222.0.84 () {58 vars in 957 bytes} [Wed May 25 15:05:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 15:05:03.353726 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf9a362-6562-447e-bf80-771fd5bc863e None None] REQUEST_METHOD: `POST` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:05:03.357318 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf9a362-6562-447e-bf80-771fd5bc863e None None] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:05:03.357318 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf9a362-6562-447e-bf80-771fd5bc863e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:05:03.374852 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.auth.core [None req-7cf9a362-6562-447e-bf80-771fd5bc863e None None] MFA Rules not processed for user `05d87e87798e429aa1c10b24391f915e`. Rule list: `[]` (Enabled: `True`). {{(pid=101893) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:05:03.376722 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.fernet_utils [None req-7cf9a362-6562-447e-bf80-771fd5bc863e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=101893) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:05:03.388436 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 1032/2030] 10.222.0.84 () {58 vars in 957 bytes} [Wed May 25 15:05:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 25 15:05:03.393350 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cf9a362-6562-447e-bf80-771fd5bc863e None None] Authenticating user token {{(pid=101893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:05:03.410065 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cf9a362-6562-447e-bf80-771fd5bc863e None None] Validating token access rules against request {{(pid=101893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:05:03.415395 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d613d09-303b-4980-bd42-9895b22366fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cec56f74b2fa4826a506dc7b919465be', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:05:03.416122 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d613d09-303b-4980-bd42-9895b22366fd admin admin] REQUEST_METHOD: `GET` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:05:03.416409 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d613d09-303b-4980-bd42-9895b22366fd admin admin] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:05:03.416684 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d613d09-303b-4980-bd42-9895b22366fd admin admin] PATH_INFO: `/v3/domains` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:05:03.417820 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d613d09-303b-4980-bd42-9895b22366fd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=101893) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 15:05:03.418056 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d613d09-303b-4980-bd42-9895b22366fd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:05:03.421713 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d613d09-303b-4980-bd42-9895b22366fd admin admin] RBAC: Authorization granted {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:05:03.424024 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 999/2031] 10.222.0.84 () {60 vars in 1482 bytes} [Wed May 25 15:05:03 2022] PUT /identity/v3/projects/acb3d37fdb3a4f149eb40e3dfd659448/users/6726643adf1d4788958e4a85ac75caca/roles/ff664fa0db7e4262a5accde96c3df4c3 => generated 0 bytes in 257 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 15:05:03.435951 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2162252-fd3f-4c6c-9477-55f21a6e5318 None None] REQUEST_METHOD: `POST` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:05:03.435951 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2162252-fd3f-4c6c-9477-55f21a6e5318 None None] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:05:03.440589 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2162252-fd3f-4c6c-9477-55f21a6e5318 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:05:03.443981 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 1033/2032] 10.222.0.84 () {58 vars in 1152 bytes} [Wed May 25 15:05:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 15:05:03.448507 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d613d09-303b-4980-bd42-9895b22366fd admin admin] Authenticating user token {{(pid=101893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:05:03.468499 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d613d09-303b-4980-bd42-9895b22366fd admin admin] Validating token access rules against request {{(pid=101893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:05:03.470777 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.auth.core [None req-f2162252-fd3f-4c6c-9477-55f21a6e5318 None None] MFA Rules not processed for user `6726643adf1d4788958e4a85ac75caca`. Rule list: `[]` (Enabled: `True`). {{(pid=101892) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:05:03.472341 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.fernet_utils [None req-f2162252-fd3f-4c6c-9477-55f21a6e5318 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=101892) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:05:03.532041 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG dbcounter [-] [101892] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=101892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:05:03.575317 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4cdb88e-d8d7-406e-b75c-9cc577c86fd4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cec56f74b2fa4826a506dc7b919465be', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:05:03.576298 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4cdb88e-d8d7-406e-b75c-9cc577c86fd4 admin admin] REQUEST_METHOD: `POST` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:05:03.576585 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4cdb88e-d8d7-406e-b75c-9cc577c86fd4 admin admin] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:05:03.576867 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4cdb88e-d8d7-406e-b75c-9cc577c86fd4 admin admin] PATH_INFO: `/v3/projects` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:05:03.577650 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4cdb88e-d8d7-406e-b75c-9cc577c86fd4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:05:03.578024 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 1000/2033] 10.222.0.84 () {58 vars in 957 bytes} [Wed May 25 15:05:03 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 25 15:05:03.581013 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4cdb88e-d8d7-406e-b75c-9cc577c86fd4 admin admin] RBAC: Authorization granted {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:05:03.592164 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2162252-fd3f-4c6c-9477-55f21a6e5318 None None] Authenticating user token {{(pid=101892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:05:03.595862 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.fernet_utils [None req-f2162252-fd3f-4c6c-9477-55f21a6e5318 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=101892) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:05:03.662079 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2162252-fd3f-4c6c-9477-55f21a6e5318 None None] Validating token access rules against request {{(pid=101892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:05:03.667004 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07d43e79-2da9-4743-9811-7014a6bd7210 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e079f89a5e524ab6ad4183e4f690de07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a000829c658c4a7cab67f7b6353ba3fa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:05:03.669635 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d43e79-2da9-4743-9811-7014a6bd7210 service cinder] REQUEST_METHOD: `GET` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:05:03.674861 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d43e79-2da9-4743-9811-7014a6bd7210 service cinder] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:05:03.675164 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d43e79-2da9-4743-9811-7014a6bd7210 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:05:03.677492 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 1034/2034] 10.222.0.84 () {60 vars in 1152 bytes} [Wed May 25 15:05:03 2022] POST /identity/v3/projects => generated 365 bytes in 229 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 15:05:03.681815 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4cdb88e-d8d7-406e-b75c-9cc577c86fd4 admin admin] Authenticating user token {{(pid=101893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:05:03.692380 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07d43e79-2da9-4743-9811-7014a6bd7210 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:05:03.696435 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07d43e79-2da9-4743-9811-7014a6bd7210 service cinder] RBAC: Authorization granted {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:05:03.708084 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 1001/2035] 10.222.0.84 () {60 vars in 1365 bytes} [Wed May 25 15:05:03 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 25 15:05:03.782404 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4cdb88e-d8d7-406e-b75c-9cc577c86fd4 admin admin] Validating token access rules against request {{(pid=101893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:05:03.788307 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32712aeb-cd00-47e4-95a1-5c0da224d860 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cec56f74b2fa4826a506dc7b919465be', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:05:03.788968 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32712aeb-cd00-47e4-95a1-5c0da224d860 admin admin] REQUEST_METHOD: `POST` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:05:03.789253 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32712aeb-cd00-47e4-95a1-5c0da224d860 admin admin] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:05:03.789532 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32712aeb-cd00-47e4-95a1-5c0da224d860 admin admin] PATH_INFO: `/v3/users` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:05:03.790232 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32712aeb-cd00-47e4-95a1-5c0da224d860 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:05:03.792516 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32712aeb-cd00-47e4-95a1-5c0da224d860 admin admin] RBAC: Authorization granted {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:05:03.878091 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 1035/2036] 10.222.0.84 () {60 vars in 1143 bytes} [Wed May 25 15:05:03 2022] POST /identity/v3/users => generated 283 bytes in 197 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 25 15:05:03.882353 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07d43e79-2da9-4743-9811-7014a6bd7210 service cinder] Authenticating user token {{(pid=101892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:05:03.893647 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07d43e79-2da9-4743-9811-7014a6bd7210 service cinder] Validating token access rules against request {{(pid=101892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:05:03.898551 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd58dab0-ba3d-4e57-8db2-22510120bf16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cec56f74b2fa4826a506dc7b919465be', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:05:03.899290 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd58dab0-ba3d-4e57-8db2-22510120bf16 admin admin] REQUEST_METHOD: `GET` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:05:03.899669 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd58dab0-ba3d-4e57-8db2-22510120bf16 admin admin] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:05:03.900008 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd58dab0-ba3d-4e57-8db2-22510120bf16 admin admin] PATH_INFO: `/v3/roles` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:05:03.900848 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd58dab0-ba3d-4e57-8db2-22510120bf16 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:05:03.902808 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd58dab0-ba3d-4e57-8db2-22510120bf16 admin admin] RBAC: Authorization granted {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:05:03.920253 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 1002/2037] 10.222.0.84 () {58 vars in 1121 bytes} [Wed May 25 15:05:03 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 15:05:03.924892 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32712aeb-cd00-47e4-95a1-5c0da224d860 admin admin] Authenticating user token {{(pid=101893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:05:03.950044 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32712aeb-cd00-47e4-95a1-5c0da224d860 admin admin] Validating token access rules against request {{(pid=101893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:05:03.963647 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e01137e-599d-4e45-981e-6933793292f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cec56f74b2fa4826a506dc7b919465be', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:05:03.964588 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e01137e-599d-4e45-981e-6933793292f1 admin admin] REQUEST_METHOD: `GET` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:05:03.965061 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e01137e-599d-4e45-981e-6933793292f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:05:03.965471 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e01137e-599d-4e45-981e-6933793292f1 admin admin] PATH_INFO: `/v3/roles` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:05:03.966527 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e01137e-599d-4e45-981e-6933793292f1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:05:03.968459 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e01137e-599d-4e45-981e-6933793292f1 admin admin] RBAC: Authorization granted {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:05:03.981085 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 1036/2038] 10.222.0.84 () {58 vars in 1121 bytes} [Wed May 25 15:05:03 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 15:05:03.986310 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd58dab0-ba3d-4e57-8db2-22510120bf16 admin admin] Authenticating user token {{(pid=101892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:05:03.999790 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd58dab0-ba3d-4e57-8db2-22510120bf16 admin admin] Validating token access rules against request {{(pid=101892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:05:04.007487 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9830efa6-8632-4840-b0ca-4d17d193bdd3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cec56f74b2fa4826a506dc7b919465be', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:05:04.008504 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9830efa6-8632-4840-b0ca-4d17d193bdd3 admin admin] REQUEST_METHOD: `PUT` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:05:04.008921 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9830efa6-8632-4840-b0ca-4d17d193bdd3 admin admin] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:05:04.009367 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9830efa6-8632-4840-b0ca-4d17d193bdd3 admin admin] PATH_INFO: `/v3/projects/b796d153a2264b79a773cd13683592fa/users/3a277a79c07249908d9db05dac327555/roles/ff664fa0db7e4262a5accde96c3df4c3` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:05:04.040186 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9830efa6-8632-4840-b0ca-4d17d193bdd3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b796d153a2264b79a773cd13683592fa, user_id=3a277a79c07249908d9db05dac327555, role_id=ff664fa0db7e4262a5accde96c3df4c3)` {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:05:04.044055 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9830efa6-8632-4840-b0ca-4d17d193bdd3 admin admin] RBAC: Authorization granted {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:05:04.161992 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 1003/2039] 10.222.0.84 () {60 vars in 1482 bytes} [Wed May 25 15:05:03 2022] PUT /identity/v3/projects/b796d153a2264b79a773cd13683592fa/users/3a277a79c07249908d9db05dac327555/roles/ff664fa0db7e4262a5accde96c3df4c3 => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 25 15:05:04.174542 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1dd586d-0d28-4f27-8572-f87c02354b40 None None] REQUEST_METHOD: `POST` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:05:04.174835 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1dd586d-0d28-4f27-8572-f87c02354b40 None None] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:05:04.175111 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1dd586d-0d28-4f27-8572-f87c02354b40 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:05:04.207615 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.auth.core [None req-f1dd586d-0d28-4f27-8572-f87c02354b40 None None] MFA Rules not processed for user `3a277a79c07249908d9db05dac327555`. Rule list: `[]` (Enabled: `True`). {{(pid=101893) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:05:04.209129 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.fernet_utils [None req-f1dd586d-0d28-4f27-8572-f87c02354b40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=101893) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:05:04.239863 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG dbcounter [-] [101893] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=101893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:05:04.299379 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 1037/2040] 10.222.0.84 () {58 vars in 957 bytes} [Wed May 25 15:05:04 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 15:05:04.306269 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9830efa6-8632-4840-b0ca-4d17d193bdd3 admin admin] Authenticating user token {{(pid=101892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:05:04.388272 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9830efa6-8632-4840-b0ca-4d17d193bdd3 admin admin] Validating token access rules against request {{(pid=101892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:05:04.393571 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e69f936e-14be-48b0-9629-d0292563fd35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cec56f74b2fa4826a506dc7b919465be', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:05:04.394229 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69f936e-14be-48b0-9629-d0292563fd35 admin admin] REQUEST_METHOD: `POST` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:05:04.394514 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69f936e-14be-48b0-9629-d0292563fd35 admin admin] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:05:04.394792 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69f936e-14be-48b0-9629-d0292563fd35 admin admin] PATH_INFO: `/v3/projects` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:05:04.395471 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e69f936e-14be-48b0-9629-d0292563fd35 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:05:04.397418 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e69f936e-14be-48b0-9629-d0292563fd35 admin admin] RBAC: Authorization granted {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:05:04.513864 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 1004/2041] 10.222.0.84 () {60 vars in 1152 bytes} [Wed May 25 15:05:04 2022] POST /identity/v3/projects => generated 363 bytes in 209 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 15:05:04.518813 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1dd586d-0d28-4f27-8572-f87c02354b40 None None] Authenticating user token {{(pid=101893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:05:04.531474 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1dd586d-0d28-4f27-8572-f87c02354b40 None None] Validating token access rules against request {{(pid=101893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:05:04.640464 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bed017f1-0138-4211-a2ae-6d4d9f749916 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cec56f74b2fa4826a506dc7b919465be', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:05:04.641191 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed017f1-0138-4211-a2ae-6d4d9f749916 admin admin] REQUEST_METHOD: `POST` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:05:04.641472 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed017f1-0138-4211-a2ae-6d4d9f749916 admin admin] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:05:04.641753 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed017f1-0138-4211-a2ae-6d4d9f749916 admin admin] PATH_INFO: `/v3/users` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:05:04.642461 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bed017f1-0138-4211-a2ae-6d4d9f749916 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:05:04.654166 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bed017f1-0138-4211-a2ae-6d4d9f749916 admin admin] RBAC: Authorization granted {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:05:04.735770 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 1038/2042] 10.222.0.84 () {60 vars in 1143 bytes} [Wed May 25 15:05:04 2022] POST /identity/v3/users => generated 288 bytes in 214 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 15:05:04.737252 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e69f936e-14be-48b0-9629-d0292563fd35 admin admin] Authenticating user token {{(pid=101892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:05:04.749388 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e69f936e-14be-48b0-9629-d0292563fd35 admin admin] Validating token access rules against request {{(pid=101892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:05:04.755515 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e687c15-2d8d-429a-97d7-b5c6bfe7889f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cec56f74b2fa4826a506dc7b919465be', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:05:04.760336 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e687c15-2d8d-429a-97d7-b5c6bfe7889f admin admin] REQUEST_METHOD: `GET` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:05:04.760336 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e687c15-2d8d-429a-97d7-b5c6bfe7889f admin admin] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:05:04.760336 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e687c15-2d8d-429a-97d7-b5c6bfe7889f admin admin] PATH_INFO: `/v3/roles` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:05:04.760336 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e687c15-2d8d-429a-97d7-b5c6bfe7889f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:05:04.760336 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e687c15-2d8d-429a-97d7-b5c6bfe7889f admin admin] RBAC: Authorization granted {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:05:04.772812 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 1005/2043] 10.222.0.84 () {58 vars in 1121 bytes} [Wed May 25 15:05:04 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 15:05:04.777227 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bed017f1-0138-4211-a2ae-6d4d9f749916 admin admin] Authenticating user token {{(pid=101893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:05:04.788131 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bed017f1-0138-4211-a2ae-6d4d9f749916 admin admin] Validating token access rules against request {{(pid=101893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:05:04.799066 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d388cb2d-3a70-41af-8237-347af60505ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cec56f74b2fa4826a506dc7b919465be', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:05:04.805043 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d388cb2d-3a70-41af-8237-347af60505ff admin admin] REQUEST_METHOD: `PUT` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:05:04.805043 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d388cb2d-3a70-41af-8237-347af60505ff admin admin] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:05:04.805043 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d388cb2d-3a70-41af-8237-347af60505ff admin admin] PATH_INFO: `/v3/projects/33b603c097894e5b979f2d08afabcd1f/users/64fc4fbca80d425b80b791037bc86cf0/roles/a3b78e7d547d4d2d998b4c99a4396bba` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:05:04.819906 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d388cb2d-3a70-41af-8237-347af60505ff admin admin] RBAC: Authorizing `identity:create_grant(project_id=33b603c097894e5b979f2d08afabcd1f, user_id=64fc4fbca80d425b80b791037bc86cf0, role_id=a3b78e7d547d4d2d998b4c99a4396bba)` {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:05:04.823010 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d388cb2d-3a70-41af-8237-347af60505ff admin admin] RBAC: Authorization granted {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:05:04.914444 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 1039/2044] 10.222.0.84 () {60 vars in 1482 bytes} [Wed May 25 15:05:04 2022] PUT /identity/v3/projects/33b603c097894e5b979f2d08afabcd1f/users/64fc4fbca80d425b80b791037bc86cf0/roles/a3b78e7d547d4d2d998b4c99a4396bba => generated 0 bytes in 138 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 15:05:04.918451 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e687c15-2d8d-429a-97d7-b5c6bfe7889f admin admin] Authenticating user token {{(pid=101892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:05:04.928874 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e687c15-2d8d-429a-97d7-b5c6bfe7889f admin admin] Validating token access rules against request {{(pid=101892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:05:04.947572 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG dbcounter [-] [101892] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=101892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:05:04.992450 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-064f6f08-a4f2-481a-b83a-3f336bf402f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cec56f74b2fa4826a506dc7b919465be', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:05:04.993131 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064f6f08-a4f2-481a-b83a-3f336bf402f9 admin admin] REQUEST_METHOD: `GET` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:05:04.993417 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064f6f08-a4f2-481a-b83a-3f336bf402f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:05:04.993693 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064f6f08-a4f2-481a-b83a-3f336bf402f9 admin admin] PATH_INFO: `/v3/roles` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:05:04.994419 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-064f6f08-a4f2-481a-b83a-3f336bf402f9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:05:04.996071 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-064f6f08-a4f2-481a-b83a-3f336bf402f9 admin admin] RBAC: Authorization granted {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:05:05.005881 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 1006/2045] 10.222.0.84 () {58 vars in 1121 bytes} [Wed May 25 15:05:04 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 15:05:05.010010 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d388cb2d-3a70-41af-8237-347af60505ff admin admin] Authenticating user token {{(pid=101893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:05:05.020567 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d388cb2d-3a70-41af-8237-347af60505ff admin admin] Validating token access rules against request {{(pid=101893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:05:05.025281 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e7be54-2c71-4eed-bd01-badc62538bef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cec56f74b2fa4826a506dc7b919465be', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:05:05.026210 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e7be54-2c71-4eed-bd01-badc62538bef admin admin] REQUEST_METHOD: `PUT` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:05:05.026495 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e7be54-2c71-4eed-bd01-badc62538bef admin admin] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:05:05.026769 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e7be54-2c71-4eed-bd01-badc62538bef admin admin] PATH_INFO: `/v3/projects/33b603c097894e5b979f2d08afabcd1f/users/64fc4fbca80d425b80b791037bc86cf0/roles/a3b78e7d547d4d2d998b4c99a4396bba` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:05:05.028770 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21e7be54-2c71-4eed-bd01-badc62538bef admin admin] RBAC: Authorizing `identity:create_grant(project_id=33b603c097894e5b979f2d08afabcd1f, user_id=64fc4fbca80d425b80b791037bc86cf0, role_id=a3b78e7d547d4d2d998b4c99a4396bba)` {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:05:05.031432 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21e7be54-2c71-4eed-bd01-badc62538bef admin admin] RBAC: Authorization granted {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:05:05.042691 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 1040/2046] 10.222.0.84 () {60 vars in 1482 bytes} [Wed May 25 15:05:05 2022] PUT /identity/v3/projects/33b603c097894e5b979f2d08afabcd1f/users/64fc4fbca80d425b80b791037bc86cf0/roles/a3b78e7d547d4d2d998b4c99a4396bba => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 15:05:05.053498 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de00d5f-6f41-4295-8563-94be2c9c521b None None] REQUEST_METHOD: `POST` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:05:05.053793 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de00d5f-6f41-4295-8563-94be2c9c521b None None] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:05:05.054078 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de00d5f-6f41-4295-8563-94be2c9c521b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:05:05.080334 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.auth.core [None req-0de00d5f-6f41-4295-8563-94be2c9c521b None None] MFA Rules not processed for user `64fc4fbca80d425b80b791037bc86cf0`. Rule list: `[]` (Enabled: `True`). {{(pid=101892) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:05:05.081544 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.fernet_utils [None req-0de00d5f-6f41-4295-8563-94be2c9c521b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=101892) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:05:05.153386 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 1007/2047] 10.222.0.84 () {58 vars in 957 bytes} [Wed May 25 15:05:05 2022] POST /identity/v3/auth/tokens => generated 3297 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 15:05:05.167469 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e7be54-2c71-4eed-bd01-badc62538bef admin admin] Authenticating user token {{(pid=101893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:05:05.237245 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e7be54-2c71-4eed-bd01-badc62538bef admin admin] Validating token access rules against request {{(pid=101893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:05:05.241693 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c30516-e1b9-4930-9956-170ff620ab8b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e079f89a5e524ab6ad4183e4f690de07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a000829c658c4a7cab67f7b6353ba3fa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:05:05.242691 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c30516-e1b9-4930-9956-170ff620ab8b service cinder] REQUEST_METHOD: `GET` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:05:05.243272 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c30516-e1b9-4930-9956-170ff620ab8b service cinder] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:05:05.243390 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c30516-e1b9-4930-9956-170ff620ab8b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:05:05.254926 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0c30516-e1b9-4930-9956-170ff620ab8b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:05:05.256824 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0c30516-e1b9-4930-9956-170ff620ab8b service cinder] RBAC: Authorization granted {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:05:05.268852 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 1041/2048] 10.222.0.84 () {60 vars in 1365 bytes} [Wed May 25 15:05:05 2022] GET /identity/v3/auth/tokens => generated 3297 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 15:05:05.511854 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de00d5f-6f41-4295-8563-94be2c9c521b None None] Authenticating user token {{(pid=101892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:05:05.522213 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de00d5f-6f41-4295-8563-94be2c9c521b None None] Validating token access rules against request {{(pid=101892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:05:05.527210 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97f683af-a1d3-444b-a71f-d104691a992e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e079f89a5e524ab6ad4183e4f690de07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a000829c658c4a7cab67f7b6353ba3fa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:05:05.527990 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f683af-a1d3-444b-a71f-d104691a992e service cinder] REQUEST_METHOD: `GET` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:05:05.528280 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f683af-a1d3-444b-a71f-d104691a992e service cinder] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:05:05.528542 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f683af-a1d3-444b-a71f-d104691a992e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:05:05.602804 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97f683af-a1d3-444b-a71f-d104691a992e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:05:05.604807 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97f683af-a1d3-444b-a71f-d104691a992e service cinder] RBAC: Authorization granted {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:05:05.619796 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 1008/2049] 10.222.0.84 () {60 vars in 1365 bytes} [Wed May 25 15:05:05 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 15:05:12.571906 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c30516-e1b9-4930-9956-170ff620ab8b service cinder] Authenticating user token {{(pid=101893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:05:12.573366 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.fernet_utils [None req-f0c30516-e1b9-4930-9956-170ff620ab8b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=101893) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:05:12.623080 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG dbcounter [-] [101893] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=101893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:05:12.680272 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c30516-e1b9-4930-9956-170ff620ab8b service cinder] Validating token access rules against request {{(pid=101893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:05:12.689402 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff189d51-9e1c-404c-af51-a68f646e9a1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cec56f74b2fa4826a506dc7b919465be', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:05:12.690896 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff189d51-9e1c-404c-af51-a68f646e9a1e admin admin] REQUEST_METHOD: `DELETE` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:05:12.691275 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff189d51-9e1c-404c-af51-a68f646e9a1e admin admin] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:05:12.691719 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff189d51-9e1c-404c-af51-a68f646e9a1e admin admin] PATH_INFO: `/v3/users/6726643adf1d4788958e4a85ac75caca` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:05:12.693504 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff189d51-9e1c-404c-af51-a68f646e9a1e admin admin] RBAC: Authorizing `identity:delete_user(user_id=6726643adf1d4788958e4a85ac75caca)` {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:05:12.695486 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff189d51-9e1c-404c-af51-a68f646e9a1e admin admin] RBAC: Authorization granted {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:05:12.909997 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.notifications [None req-ff189d51-9e1c-404c-af51-a68f646e9a1e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6726643adf1d4788958e4a85ac75caca'} {{(pid=101893) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:05:12.916949 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.notifications [None req-ff189d51-9e1c-404c-af51-a68f646e9a1e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6726643adf1d4788958e4a85ac75caca'} {{(pid=101893) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:05:12.929460 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.notifications [None req-ff189d51-9e1c-404c-af51-a68f646e9a1e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6726643adf1d4788958e4a85ac75caca'} {{(pid=101893) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:05:12.930135 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.notifications [None req-ff189d51-9e1c-404c-af51-a68f646e9a1e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6726643adf1d4788958e4a85ac75caca'} {{(pid=101893) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:05:12.930732 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.notifications [None req-ff189d51-9e1c-404c-af51-a68f646e9a1e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6726643adf1d4788958e4a85ac75caca'} {{(pid=101893) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:05:13.005703 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 1042/2050] 10.222.0.84 () {58 vars in 1223 bytes} [Wed May 25 15:05:12 2022] DELETE /identity/v3/users/6726643adf1d4788958e4a85ac75caca => generated 0 bytes in 434 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 15:05:13.010309 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33533f1b-3661-4109-96c9-1b90e69da267 None None] REQUEST_METHOD: `POST` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:05:13.010883 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33533f1b-3661-4109-96c9-1b90e69da267 None None] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:05:13.011301 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33533f1b-3661-4109-96c9-1b90e69da267 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:05:13.045789 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.auth.core [None req-33533f1b-3661-4109-96c9-1b90e69da267 None None] MFA Rules not processed for user `05d87e87798e429aa1c10b24391f915e`. Rule list: `[]` (Enabled: `True`). {{(pid=101892) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:05:13.047537 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.fernet_utils [None req-33533f1b-3661-4109-96c9-1b90e69da267 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=101892) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:05:13.089297 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG dbcounter [-] [101892] Writing DB stats keystone:SELECT=100 {{(pid=101892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:05:13.111454 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 1009/2051] 10.222.0.84 () {58 vars in 957 bytes} [Wed May 25 15:05:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 15:05:13.121369 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff189d51-9e1c-404c-af51-a68f646e9a1e admin admin] Authenticating user token {{(pid=101893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:05:13.122813 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.fernet_utils [None req-ff189d51-9e1c-404c-af51-a68f646e9a1e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=101893) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:05:13.208785 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff189d51-9e1c-404c-af51-a68f646e9a1e admin admin] Validating token access rules against request {{(pid=101893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:05:13.212579 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3857fd80-3f9c-4475-bb92-fb671f6424cf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ce28b25b907473588ccb87dc4acc06a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a000829c658c4a7cab67f7b6353ba3fa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:05:13.213172 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3857fd80-3f9c-4475-bb92-fb671f6424cf service neutron] REQUEST_METHOD: `GET` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:05:13.213565 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3857fd80-3f9c-4475-bb92-fb671f6424cf service neutron] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:05:13.213749 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3857fd80-3f9c-4475-bb92-fb671f6424cf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:05:13.226703 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3857fd80-3f9c-4475-bb92-fb671f6424cf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:05:13.228254 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3857fd80-3f9c-4475-bb92-fb671f6424cf service neutron] RBAC: Authorization granted {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:05:13.251762 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 1043/2052] 10.222.0.84 () {60 vars in 1365 bytes} [Wed May 25 15:05:13 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 127 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 15:05:13.395527 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33533f1b-3661-4109-96c9-1b90e69da267 None None] Authenticating user token {{(pid=101892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:05:13.397751 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.fernet_utils [None req-33533f1b-3661-4109-96c9-1b90e69da267 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=101892) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:05:13.413847 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33533f1b-3661-4109-96c9-1b90e69da267 None None] Validating token access rules against request {{(pid=101892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:05:13.420892 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f5ffc90-c0ef-4701-812e-1b637b0f85ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cec56f74b2fa4826a506dc7b919465be', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:05:13.426094 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5ffc90-c0ef-4701-812e-1b637b0f85ce admin admin] REQUEST_METHOD: `DELETE` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:05:13.426094 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5ffc90-c0ef-4701-812e-1b637b0f85ce admin admin] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:05:13.426094 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5ffc90-c0ef-4701-812e-1b637b0f85ce admin admin] PATH_INFO: `/v3/users/d86d5d7466db4deb93c5d899a8ff4001` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:05:13.426094 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f5ffc90-c0ef-4701-812e-1b637b0f85ce admin admin] RBAC: Authorizing `identity:delete_user(user_id=d86d5d7466db4deb93c5d899a8ff4001)` {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:05:13.428005 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f5ffc90-c0ef-4701-812e-1b637b0f85ce admin admin] RBAC: Authorization granted {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:05:13.640061 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.notifications [None req-1f5ffc90-c0ef-4701-812e-1b637b0f85ce admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd86d5d7466db4deb93c5d899a8ff4001'} {{(pid=101892) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:05:13.651968 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.notifications [None req-1f5ffc90-c0ef-4701-812e-1b637b0f85ce admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd86d5d7466db4deb93c5d899a8ff4001'} {{(pid=101892) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:05:13.686940 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3857fd80-3f9c-4475-bb92-fb671f6424cf service neutron] Authenticating user token {{(pid=101893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:05:13.688202 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.fernet_utils [None req-3857fd80-3f9c-4475-bb92-fb671f6424cf service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=101893) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:05:13.689856 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.notifications [None req-1f5ffc90-c0ef-4701-812e-1b637b0f85ce admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd86d5d7466db4deb93c5d899a8ff4001'} {{(pid=101892) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:05:13.692678 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.notifications [None req-1f5ffc90-c0ef-4701-812e-1b637b0f85ce admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd86d5d7466db4deb93c5d899a8ff4001'} {{(pid=101892) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:05:13.720573 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3857fd80-3f9c-4475-bb92-fb671f6424cf service neutron] Validating token access rules against request {{(pid=101893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:05:13.744013 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c42fe52-1b46-415d-8534-816d3688c046 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cec56f74b2fa4826a506dc7b919465be', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:05:13.745184 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c42fe52-1b46-415d-8534-816d3688c046 admin admin] REQUEST_METHOD: `DELETE` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:05:13.745491 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c42fe52-1b46-415d-8534-816d3688c046 admin admin] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:05:13.745701 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c42fe52-1b46-415d-8534-816d3688c046 admin admin] PATH_INFO: `/v3/projects/acb3d37fdb3a4f149eb40e3dfd659448` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:05:13.748124 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c42fe52-1b46-415d-8534-816d3688c046 admin admin] RBAC: Authorizing `identity:delete_project(project_id=acb3d37fdb3a4f149eb40e3dfd659448)` {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:05:13.750133 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c42fe52-1b46-415d-8534-816d3688c046 admin admin] RBAC: Authorization granted {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:05:13.799631 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.notifications [None req-1f5ffc90-c0ef-4701-812e-1b637b0f85ce admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd86d5d7466db4deb93c5d899a8ff4001'} {{(pid=101892) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:05:13.810522 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 1010/2053] 10.222.0.84 () {58 vars in 1223 bytes} [Wed May 25 15:05:13 2022] DELETE /identity/v3/users/d86d5d7466db4deb93c5d899a8ff4001 => generated 0 bytes in 415 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 15:05:13.817385 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a68cc65-786c-4b48-a00b-093a6d4a1022 None None] REQUEST_METHOD: `POST` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:05:13.817747 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a68cc65-786c-4b48-a00b-093a6d4a1022 None None] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:05:13.818003 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a68cc65-786c-4b48-a00b-093a6d4a1022 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:05:13.869434 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.auth.core [None req-6a68cc65-786c-4b48-a00b-093a6d4a1022 None None] MFA Rules not processed for user `05d87e87798e429aa1c10b24391f915e`. Rule list: `[]` (Enabled: `True`). {{(pid=101892) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:05:13.869956 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.fernet_utils [None req-6a68cc65-786c-4b48-a00b-093a6d4a1022 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=101892) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:05:13.965241 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG dbcounter [-] [101893] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=101893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:05:13.978499 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 1011/2054] 10.222.0.84 () {58 vars in 957 bytes} [Wed May 25 15:05:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 15:05:13.979416 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a68cc65-786c-4b48-a00b-093a6d4a1022 None None] Authenticating user token {{(pid=101892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:05:13.981042 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.notifications [None req-2c42fe52-1b46-415d-8534-816d3688c046 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'acb3d37fdb3a4f149eb40e3dfd659448', 'request_id': 'req-2c42fe52-1b46-415d-8534-816d3688c046'} {{(pid=101893) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:05:13.992309 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.fernet_utils [None req-6a68cc65-786c-4b48-a00b-093a6d4a1022 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=101892) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:05:13.992407 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.notifications [None req-2c42fe52-1b46-415d-8534-816d3688c046 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'acb3d37fdb3a4f149eb40e3dfd659448', 'request_id': 'req-2c42fe52-1b46-415d-8534-816d3688c046'} {{(pid=101893) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:05:13.997095 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.notifications [None req-2c42fe52-1b46-415d-8534-816d3688c046 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'acb3d37fdb3a4f149eb40e3dfd659448', 'request_id': 'req-2c42fe52-1b46-415d-8534-816d3688c046'} {{(pid=101893) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:05:14.008720 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a68cc65-786c-4b48-a00b-093a6d4a1022 None None] Validating token access rules against request {{(pid=101892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:05:14.073610 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG dbcounter [-] [101892] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=101892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:05:14.087099 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-359158dd-40a6-4480-becf-05dfa26604da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cec56f74b2fa4826a506dc7b919465be', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:05:14.088034 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359158dd-40a6-4480-becf-05dfa26604da admin admin] REQUEST_METHOD: `DELETE` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:05:14.088323 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359158dd-40a6-4480-becf-05dfa26604da admin admin] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:05:14.088592 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359158dd-40a6-4480-becf-05dfa26604da admin admin] PATH_INFO: `/v3/users/3a277a79c07249908d9db05dac327555` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:05:14.090567 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-359158dd-40a6-4480-becf-05dfa26604da admin admin] RBAC: Authorizing `identity:delete_user(user_id=3a277a79c07249908d9db05dac327555)` {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:05:14.092550 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-359158dd-40a6-4480-becf-05dfa26604da admin admin] RBAC: Authorization granted {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:05:14.098952 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.notifications [None req-2c42fe52-1b46-415d-8534-816d3688c046 admin admin] The token cache is being invalidate because project acb3d37fdb3a4f149eb40e3dfd659448 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=101893) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 25 15:05:14.099249 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.notifications [None req-2c42fe52-1b46-415d-8534-816d3688c046 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=101893) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:05:14.100096 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.notifications [None req-2c42fe52-1b46-415d-8534-816d3688c046 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=101893) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:05:14.103163 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 1044/2055] 10.222.0.84 () {58 vars in 1232 bytes} [Wed May 25 15:05:13 2022] DELETE /identity/v3/projects/acb3d37fdb3a4f149eb40e3dfd659448 => generated 0 bytes in 417 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 25 15:05:14.113643 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c42fe52-1b46-415d-8534-816d3688c046 admin admin] Authenticating user token {{(pid=101893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:05:14.115555 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.fernet_utils [None req-2c42fe52-1b46-415d-8534-816d3688c046 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=101893) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:05:14.294605 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c42fe52-1b46-415d-8534-816d3688c046 admin admin] Validating token access rules against request {{(pid=101893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:05:14.302963 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b8304f3-d7c2-488e-a13c-b7c155b3af25 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ce28b25b907473588ccb87dc4acc06a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a000829c658c4a7cab67f7b6353ba3fa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:05:14.306183 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8304f3-d7c2-488e-a13c-b7c155b3af25 service neutron] REQUEST_METHOD: `GET` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:05:14.306987 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8304f3-d7c2-488e-a13c-b7c155b3af25 service neutron] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:05:14.307525 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8304f3-d7c2-488e-a13c-b7c155b3af25 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:05:14.314282 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.fernet_utils [None req-9b8304f3-d7c2-488e-a13c-b7c155b3af25 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=101893) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:05:14.334204 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b8304f3-d7c2-488e-a13c-b7c155b3af25 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:05:14.335744 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b8304f3-d7c2-488e-a13c-b7c155b3af25 service neutron] RBAC: Authorization granted {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:05:14.347022 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 1045/2056] 10.222.0.84 () {60 vars in 1365 bytes} [Wed May 25 15:05:14 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 243 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 15:05:14.401565 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.notifications [None req-359158dd-40a6-4480-becf-05dfa26604da admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3a277a79c07249908d9db05dac327555'} {{(pid=101892) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:05:14.413170 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.notifications [None req-359158dd-40a6-4480-becf-05dfa26604da admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3a277a79c07249908d9db05dac327555'} {{(pid=101892) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:05:14.426544 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.notifications [None req-359158dd-40a6-4480-becf-05dfa26604da admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3a277a79c07249908d9db05dac327555'} {{(pid=101892) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:05:14.427595 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.notifications [None req-359158dd-40a6-4480-becf-05dfa26604da admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3a277a79c07249908d9db05dac327555'} {{(pid=101892) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:05:14.502238 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.notifications [None req-359158dd-40a6-4480-becf-05dfa26604da admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3a277a79c07249908d9db05dac327555'} {{(pid=101892) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:05:14.512190 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 1012/2057] 10.222.0.84 () {58 vars in 1223 bytes} [Wed May 25 15:05:13 2022] DELETE /identity/v3/users/3a277a79c07249908d9db05dac327555 => generated 0 bytes in 530 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 15:05:14.515245 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e33af95-cbe8-4a9b-b608-547b50ed4218 None None] REQUEST_METHOD: `POST` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:05:14.519108 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e33af95-cbe8-4a9b-b608-547b50ed4218 None None] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:05:14.520758 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e33af95-cbe8-4a9b-b608-547b50ed4218 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:05:14.551070 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.auth.core [None req-2e33af95-cbe8-4a9b-b608-547b50ed4218 None None] MFA Rules not processed for user `05d87e87798e429aa1c10b24391f915e`. Rule list: `[]` (Enabled: `True`). {{(pid=101893) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:05:14.552941 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.fernet_utils [None req-2e33af95-cbe8-4a9b-b608-547b50ed4218 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=101893) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:05:14.667170 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 1046/2058] 10.222.0.84 () {58 vars in 957 bytes} [Wed May 25 15:05:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 15:05:14.680755 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-359158dd-40a6-4480-becf-05dfa26604da admin admin] Authenticating user token {{(pid=101892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:05:14.682230 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.fernet_utils [None req-359158dd-40a6-4480-becf-05dfa26604da admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=101892) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:05:14.795256 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-359158dd-40a6-4480-becf-05dfa26604da admin admin] Validating token access rules against request {{(pid=101892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:05:14.804074 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8463215-4782-4089-b93b-5a5287854378 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ce28b25b907473588ccb87dc4acc06a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a000829c658c4a7cab67f7b6353ba3fa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:05:14.804750 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8463215-4782-4089-b93b-5a5287854378 service neutron] REQUEST_METHOD: `GET` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:05:14.805036 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8463215-4782-4089-b93b-5a5287854378 service neutron] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:05:14.805643 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8463215-4782-4089-b93b-5a5287854378 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:05:14.817447 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8463215-4782-4089-b93b-5a5287854378 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:05:14.819027 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8463215-4782-4089-b93b-5a5287854378 service neutron] RBAC: Authorization granted {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:05:14.831266 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 1013/2059] 10.222.0.84 () {60 vars in 1365 bytes} [Wed May 25 15:05:14 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 151 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 15:05:15.030044 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e33af95-cbe8-4a9b-b608-547b50ed4218 None None] Authenticating user token {{(pid=101893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:05:15.034276 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.fernet_utils [None req-2e33af95-cbe8-4a9b-b608-547b50ed4218 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=101893) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:05:15.056967 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e33af95-cbe8-4a9b-b608-547b50ed4218 None None] Validating token access rules against request {{(pid=101893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:05:15.065702 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71d7ac09-bcbd-4bce-93a7-4d7e58b7b49f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cec56f74b2fa4826a506dc7b919465be', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:05:15.066988 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d7ac09-bcbd-4bce-93a7-4d7e58b7b49f admin admin] REQUEST_METHOD: `DELETE` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:05:15.071033 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d7ac09-bcbd-4bce-93a7-4d7e58b7b49f admin admin] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:05:15.071033 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d7ac09-bcbd-4bce-93a7-4d7e58b7b49f admin admin] PATH_INFO: `/v3/projects/2e5296676c9e404498293146b16e786f` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:05:15.071033 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71d7ac09-bcbd-4bce-93a7-4d7e58b7b49f admin admin] RBAC: Authorizing `identity:delete_project(project_id=2e5296676c9e404498293146b16e786f)` {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:05:15.071903 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71d7ac09-bcbd-4bce-93a7-4d7e58b7b49f admin admin] RBAC: Authorization granted {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:05:15.253252 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.notifications [None req-71d7ac09-bcbd-4bce-93a7-4d7e58b7b49f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2e5296676c9e404498293146b16e786f', 'request_id': 'req-71d7ac09-bcbd-4bce-93a7-4d7e58b7b49f'} {{(pid=101893) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:05:15.261918 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.notifications [None req-71d7ac09-bcbd-4bce-93a7-4d7e58b7b49f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2e5296676c9e404498293146b16e786f', 'request_id': 'req-71d7ac09-bcbd-4bce-93a7-4d7e58b7b49f'} {{(pid=101893) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:05:15.271944 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.notifications [None req-71d7ac09-bcbd-4bce-93a7-4d7e58b7b49f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2e5296676c9e404498293146b16e786f', 'request_id': 'req-71d7ac09-bcbd-4bce-93a7-4d7e58b7b49f'} {{(pid=101893) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:05:15.277708 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG dbcounter [-] [101893] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=101893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:05:15.356262 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.notifications [None req-71d7ac09-bcbd-4bce-93a7-4d7e58b7b49f admin admin] The token cache is being invalidate because project 2e5296676c9e404498293146b16e786f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=101893) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 25 15:05:15.356924 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.notifications [None req-71d7ac09-bcbd-4bce-93a7-4d7e58b7b49f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=101893) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:05:15.358134 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.notifications [None req-71d7ac09-bcbd-4bce-93a7-4d7e58b7b49f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=101893) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:05:15.362711 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 1047/2060] 10.222.0.84 () {58 vars in 1232 bytes} [Wed May 25 15:05:15 2022] DELETE /identity/v3/projects/2e5296676c9e404498293146b16e786f => generated 0 bytes in 333 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 15:05:15.367510 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f012de1-0aef-4fc0-995b-7b3a21983d6d None None] REQUEST_METHOD: `POST` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:05:15.368134 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f012de1-0aef-4fc0-995b-7b3a21983d6d None None] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:05:15.368310 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f012de1-0aef-4fc0-995b-7b3a21983d6d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:05:15.392383 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.auth.core [None req-8f012de1-0aef-4fc0-995b-7b3a21983d6d None None] MFA Rules not processed for user `05d87e87798e429aa1c10b24391f915e`. Rule list: `[]` (Enabled: `True`). {{(pid=101892) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:05:15.394320 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.fernet_utils [None req-8f012de1-0aef-4fc0-995b-7b3a21983d6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=101892) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:05:15.489264 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdab08a3-32e0-43a0-9eb3-710de5aa43a3 None None] REQUEST_METHOD: `POST` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:05:15.489552 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdab08a3-32e0-43a0-9eb3-710de5aa43a3 None None] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:05:15.489986 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdab08a3-32e0-43a0-9eb3-710de5aa43a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:05:15.498023 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 1014/2061] 10.222.0.84 () {58 vars in 957 bytes} [Wed May 25 15:05:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 15:05:15.515590 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.auth.core [None req-cdab08a3-32e0-43a0-9eb3-710de5aa43a3 None None] MFA Rules not processed for user `05d87e87798e429aa1c10b24391f915e`. Rule list: `[]` (Enabled: `True`). {{(pid=101893) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:05:15.517278 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.fernet_utils [None req-cdab08a3-32e0-43a0-9eb3-710de5aa43a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=101893) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:05:15.529740 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 1048/2062] 10.222.0.84 () {58 vars in 957 bytes} [Wed May 25 15:05:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 15:05:15.538981 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f012de1-0aef-4fc0-995b-7b3a21983d6d None None] Authenticating user token {{(pid=101892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:05:15.552444 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f012de1-0aef-4fc0-995b-7b3a21983d6d None None] Validating token access rules against request {{(pid=101892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:05:15.560154 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04d30acf-486c-41ac-8136-1f8acba77615 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cec56f74b2fa4826a506dc7b919465be', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:05:15.562892 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d30acf-486c-41ac-8136-1f8acba77615 admin admin] REQUEST_METHOD: `GET` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:05:15.562892 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d30acf-486c-41ac-8136-1f8acba77615 admin admin] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:05:15.563095 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d30acf-486c-41ac-8136-1f8acba77615 admin admin] PATH_INFO: `/v3/domains` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:05:15.563718 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04d30acf-486c-41ac-8136-1f8acba77615 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=101892) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 15:05:15.564077 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04d30acf-486c-41ac-8136-1f8acba77615 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:05:15.567047 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04d30acf-486c-41ac-8136-1f8acba77615 admin admin] RBAC: Authorization granted {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:05:15.581382 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 1015/2063] 10.222.0.84 () {58 vars in 1152 bytes} [Wed May 25 15:05:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 15:05:15.588546 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdab08a3-32e0-43a0-9eb3-710de5aa43a3 None None] Authenticating user token {{(pid=101893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:05:15.625029 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdab08a3-32e0-43a0-9eb3-710de5aa43a3 None None] Validating token access rules against request {{(pid=101893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:05:15.648593 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-592cc9a8-64a4-4f95-be1a-fb44a1f299ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cec56f74b2fa4826a506dc7b919465be', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:05:15.648928 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592cc9a8-64a4-4f95-be1a-fb44a1f299ad admin admin] REQUEST_METHOD: `POST` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:05:15.649137 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592cc9a8-64a4-4f95-be1a-fb44a1f299ad admin admin] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:05:15.663946 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592cc9a8-64a4-4f95-be1a-fb44a1f299ad admin admin] PATH_INFO: `/v3/projects` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:05:15.664975 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-592cc9a8-64a4-4f95-be1a-fb44a1f299ad admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:05:15.666976 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-592cc9a8-64a4-4f95-be1a-fb44a1f299ad admin admin] RBAC: Authorization granted {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:05:15.819364 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 1049/2064] 10.222.0.84 () {60 vars in 1152 bytes} [Wed May 25 15:05:15 2022] POST /identity/v3/projects => generated 381 bytes in 231 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 15:05:15.823485 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04d30acf-486c-41ac-8136-1f8acba77615 admin admin] Authenticating user token {{(pid=101892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:05:15.831202 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG dbcounter [-] [101892] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=101892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:05:15.834999 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04d30acf-486c-41ac-8136-1f8acba77615 admin admin] Validating token access rules against request {{(pid=101892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:05:15.916070 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-592cc9a8-64a4-4f95-be1a-fb44a1f299ad admin admin] Authenticating user token {{(pid=101893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:05:15.919155 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.fernet_utils [None req-592cc9a8-64a4-4f95-be1a-fb44a1f299ad admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=101893) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:05:15.931746 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9da4d42-1e59-45ab-82ed-4958acdd9c0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cec56f74b2fa4826a506dc7b919465be', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:05:15.933049 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9da4d42-1e59-45ab-82ed-4958acdd9c0d admin admin] REQUEST_METHOD: `POST` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:05:15.933347 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9da4d42-1e59-45ab-82ed-4958acdd9c0d admin admin] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:05:15.933627 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9da4d42-1e59-45ab-82ed-4958acdd9c0d admin admin] PATH_INFO: `/v3/users` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:05:15.934341 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9da4d42-1e59-45ab-82ed-4958acdd9c0d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:05:15.948162 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9da4d42-1e59-45ab-82ed-4958acdd9c0d admin admin] RBAC: Authorization granted {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:05:16.018877 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-592cc9a8-64a4-4f95-be1a-fb44a1f299ad admin admin] Validating token access rules against request {{(pid=101893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:05:16.024776 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40045dba-adcc-4bbb-9d78-daadd64b37aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cec56f74b2fa4826a506dc7b919465be', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:05:16.025944 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40045dba-adcc-4bbb-9d78-daadd64b37aa admin admin] REQUEST_METHOD: `DELETE` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:05:16.026333 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40045dba-adcc-4bbb-9d78-daadd64b37aa admin admin] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:05:16.026866 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40045dba-adcc-4bbb-9d78-daadd64b37aa admin admin] PATH_INFO: `/v3/projects/b796d153a2264b79a773cd13683592fa` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:05:16.028465 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40045dba-adcc-4bbb-9d78-daadd64b37aa admin admin] RBAC: Authorizing `identity:delete_project(project_id=b796d153a2264b79a773cd13683592fa)` {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:05:16.030740 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40045dba-adcc-4bbb-9d78-daadd64b37aa admin admin] RBAC: Authorization granted {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:05:16.037028 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 1016/2065] 10.222.0.84 () {60 vars in 1143 bytes} [Wed May 25 15:05:15 2022] POST /identity/v3/users => generated 291 bytes in 214 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 25 15:05:16.041431 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9da4d42-1e59-45ab-82ed-4958acdd9c0d admin admin] Authenticating user token {{(pid=101892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:05:16.061001 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9da4d42-1e59-45ab-82ed-4958acdd9c0d admin admin] Validating token access rules against request {{(pid=101892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:05:16.076488 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b10f047-6d47-4112-89e0-2da2604587a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cec56f74b2fa4826a506dc7b919465be', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:05:16.077428 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b10f047-6d47-4112-89e0-2da2604587a9 admin admin] REQUEST_METHOD: `GET` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:05:16.077866 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b10f047-6d47-4112-89e0-2da2604587a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:05:16.078999 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b10f047-6d47-4112-89e0-2da2604587a9 admin admin] PATH_INFO: `/v3/roles` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:05:16.082747 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b10f047-6d47-4112-89e0-2da2604587a9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:05:16.084621 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b10f047-6d47-4112-89e0-2da2604587a9 admin admin] RBAC: Authorization granted {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:05:16.111774 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 1017/2066] 10.222.0.84 () {58 vars in 1121 bytes} [Wed May 25 15:05:16 2022] GET /identity/v3/roles => generated 1420 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 25 15:05:16.116533 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b10f047-6d47-4112-89e0-2da2604587a9 admin admin] Authenticating user token {{(pid=101892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:05:16.146443 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b10f047-6d47-4112-89e0-2da2604587a9 admin admin] Validating token access rules against request {{(pid=101892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:05:16.155371 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6fb70a8-bfaf-4055-b42b-945c25580f60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cec56f74b2fa4826a506dc7b919465be', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:05:16.156092 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6fb70a8-bfaf-4055-b42b-945c25580f60 admin admin] REQUEST_METHOD: `GET` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:05:16.157248 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6fb70a8-bfaf-4055-b42b-945c25580f60 admin admin] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:05:16.157860 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6fb70a8-bfaf-4055-b42b-945c25580f60 admin admin] PATH_INFO: `/v3/roles` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:05:16.158612 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6fb70a8-bfaf-4055-b42b-945c25580f60 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:05:16.160903 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6fb70a8-bfaf-4055-b42b-945c25580f60 admin admin] RBAC: Authorization granted {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:05:16.180432 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 1018/2067] 10.222.0.84 () {58 vars in 1121 bytes} [Wed May 25 15:05:16 2022] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 15:05:16.185414 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6fb70a8-bfaf-4055-b42b-945c25580f60 admin admin] Authenticating user token {{(pid=101892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:05:16.194947 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.notifications [None req-40045dba-adcc-4bbb-9d78-daadd64b37aa admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b796d153a2264b79a773cd13683592fa', 'request_id': 'req-40045dba-adcc-4bbb-9d78-daadd64b37aa'} {{(pid=101893) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:05:16.202235 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6fb70a8-bfaf-4055-b42b-945c25580f60 admin admin] Validating token access rules against request {{(pid=101892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:05:16.207583 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.notifications [None req-40045dba-adcc-4bbb-9d78-daadd64b37aa admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b796d153a2264b79a773cd13683592fa', 'request_id': 'req-40045dba-adcc-4bbb-9d78-daadd64b37aa'} {{(pid=101893) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:05:16.224858 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.notifications [None req-40045dba-adcc-4bbb-9d78-daadd64b37aa admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b796d153a2264b79a773cd13683592fa', 'request_id': 'req-40045dba-adcc-4bbb-9d78-daadd64b37aa'} {{(pid=101893) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:05:16.324969 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43b9d876-a843-4bb4-b9f9-cab9fecc481f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cec56f74b2fa4826a506dc7b919465be', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:05:16.327276 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b9d876-a843-4bb4-b9f9-cab9fecc481f admin admin] REQUEST_METHOD: `PUT` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:05:16.327590 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b9d876-a843-4bb4-b9f9-cab9fecc481f admin admin] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:05:16.328216 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b9d876-a843-4bb4-b9f9-cab9fecc481f admin admin] PATH_INFO: `/v3/projects/f77740dd66aa4729a3a5003c84e4feeb/users/4f0e5c26a69548dfb71b4be306977caf/roles/ff664fa0db7e4262a5accde96c3df4c3` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:05:16.341026 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.notifications [None req-40045dba-adcc-4bbb-9d78-daadd64b37aa admin admin] The token cache is being invalidate because project b796d153a2264b79a773cd13683592fa was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=101893) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 25 15:05:16.341554 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.notifications [None req-40045dba-adcc-4bbb-9d78-daadd64b37aa admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=101893) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:05:16.342430 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.notifications [None req-40045dba-adcc-4bbb-9d78-daadd64b37aa admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=101893) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:05:16.345189 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 1050/2068] 10.222.0.84 () {58 vars in 1232 bytes} [Wed May 25 15:05:15 2022] DELETE /identity/v3/projects/b796d153a2264b79a773cd13683592fa => generated 0 bytes in 432 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 15:05:16.348785 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43b9d876-a843-4bb4-b9f9-cab9fecc481f admin admin] RBAC: Authorizing `identity:create_grant(project_id=f77740dd66aa4729a3a5003c84e4feeb, user_id=4f0e5c26a69548dfb71b4be306977caf, role_id=ff664fa0db7e4262a5accde96c3df4c3)` {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:05:16.349135 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40045dba-adcc-4bbb-9d78-daadd64b37aa admin admin] Authenticating user token {{(pid=101893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:05:16.351506 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43b9d876-a843-4bb4-b9f9-cab9fecc481f admin admin] RBAC: Authorization granted {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:05:16.352434 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.fernet_utils [None req-40045dba-adcc-4bbb-9d78-daadd64b37aa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=101893) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:05:16.379480 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40045dba-adcc-4bbb-9d78-daadd64b37aa admin admin] Validating token access rules against request {{(pid=101893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:05:16.385183 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f568e5f-0af7-49db-8fdd-732f23185e13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cec56f74b2fa4826a506dc7b919465be', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:05:16.386086 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f568e5f-0af7-49db-8fdd-732f23185e13 admin admin] REQUEST_METHOD: `DELETE` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:05:16.386375 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f568e5f-0af7-49db-8fdd-732f23185e13 admin admin] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:05:16.386647 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f568e5f-0af7-49db-8fdd-732f23185e13 admin admin] PATH_INFO: `/v3/users/64fc4fbca80d425b80b791037bc86cf0` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:05:16.387941 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f568e5f-0af7-49db-8fdd-732f23185e13 admin admin] RBAC: Authorizing `identity:delete_user(user_id=64fc4fbca80d425b80b791037bc86cf0)` {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:05:16.389931 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f568e5f-0af7-49db-8fdd-732f23185e13 admin admin] RBAC: Authorization granted {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:05:16.438991 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 1019/2069] 10.222.0.84 () {60 vars in 1482 bytes} [Wed May 25 15:05:16 2022] PUT /identity/v3/projects/f77740dd66aa4729a3a5003c84e4feeb/users/4f0e5c26a69548dfb71b4be306977caf/roles/ff664fa0db7e4262a5accde96c3df4c3 => generated 0 bytes in 254 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 15:05:16.453390 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5761e61-3891-4c4f-b2e4-6fa2cc8bed9f None None] REQUEST_METHOD: `POST` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:05:16.460020 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5761e61-3891-4c4f-b2e4-6fa2cc8bed9f None None] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:05:16.460515 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5761e61-3891-4c4f-b2e4-6fa2cc8bed9f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:05:16.501845 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.auth.core [None req-c5761e61-3891-4c4f-b2e4-6fa2cc8bed9f None None] MFA Rules not processed for user `05d87e87798e429aa1c10b24391f915e`. Rule list: `[]` (Enabled: `True`). {{(pid=101892) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:05:16.503096 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.fernet_utils [None req-c5761e61-3891-4c4f-b2e4-6fa2cc8bed9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=101892) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:05:16.598536 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.notifications [None req-9f568e5f-0af7-49db-8fdd-732f23185e13 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '64fc4fbca80d425b80b791037bc86cf0'} {{(pid=101893) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:05:16.601724 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG dbcounter [-] [101892] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=101892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:05:16.603115 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG dbcounter [-] [101893] Writing DB stats keystone:DELETE=15,keystone:SELECT=83,keystone:INSERT=2 {{(pid=101893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:05:16.618787 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.notifications [None req-9f568e5f-0af7-49db-8fdd-732f23185e13 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '64fc4fbca80d425b80b791037bc86cf0'} {{(pid=101893) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:05:16.631326 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 1020/2070] 10.222.0.84 () {58 vars in 957 bytes} [Wed May 25 15:05:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 15:05:16.642927 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5761e61-3891-4c4f-b2e4-6fa2cc8bed9f None None] Authenticating user token {{(pid=101892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:05:16.646541 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.fernet_utils [None req-c5761e61-3891-4c4f-b2e4-6fa2cc8bed9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=101892) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:05:16.648429 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.notifications [None req-9f568e5f-0af7-49db-8fdd-732f23185e13 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '64fc4fbca80d425b80b791037bc86cf0'} {{(pid=101893) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:05:16.649407 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.notifications [None req-9f568e5f-0af7-49db-8fdd-732f23185e13 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '64fc4fbca80d425b80b791037bc86cf0'} {{(pid=101893) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:05:16.650168 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.notifications [None req-9f568e5f-0af7-49db-8fdd-732f23185e13 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '64fc4fbca80d425b80b791037bc86cf0'} {{(pid=101893) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:05:16.744334 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5761e61-3891-4c4f-b2e4-6fa2cc8bed9f None None] Validating token access rules against request {{(pid=101892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:05:16.751440 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f253123c-326e-4ea6-8fe1-c7ab0b5e6e7d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ce28b25b907473588ccb87dc4acc06a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a000829c658c4a7cab67f7b6353ba3fa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:05:16.752620 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f253123c-326e-4ea6-8fe1-c7ab0b5e6e7d service neutron] REQUEST_METHOD: `GET` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:05:16.753080 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f253123c-326e-4ea6-8fe1-c7ab0b5e6e7d service neutron] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:05:16.753599 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f253123c-326e-4ea6-8fe1-c7ab0b5e6e7d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:05:16.756022 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.fernet_utils [None req-f253123c-326e-4ea6-8fe1-c7ab0b5e6e7d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=101892) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:05:16.758442 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 1051/2071] 10.222.0.84 () {58 vars in 1223 bytes} [Wed May 25 15:05:16 2022] DELETE /identity/v3/users/64fc4fbca80d425b80b791037bc86cf0 => generated 0 bytes in 409 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 15:05:16.771067 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f253123c-326e-4ea6-8fe1-c7ab0b5e6e7d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:05:16.772773 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f253123c-326e-4ea6-8fe1-c7ab0b5e6e7d service neutron] RBAC: Authorization granted {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:05:16.785001 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 1021/2072] 10.222.0.84 () {60 vars in 1365 bytes} [Wed May 25 15:05:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 145 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 15:05:17.348981 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f568e5f-0af7-49db-8fdd-732f23185e13 admin admin] Authenticating user token {{(pid=101893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:05:17.351188 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.fernet_utils [None req-9f568e5f-0af7-49db-8fdd-732f23185e13 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=101893) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:05:17.433402 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f568e5f-0af7-49db-8fdd-732f23185e13 admin admin] Validating token access rules against request {{(pid=101893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:05:17.440136 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8930dc0c-65ab-4d7c-92a3-f5d36bdec9ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cec56f74b2fa4826a506dc7b919465be', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:05:17.441194 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8930dc0c-65ab-4d7c-92a3-f5d36bdec9ca admin admin] REQUEST_METHOD: `DELETE` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:05:17.441621 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8930dc0c-65ab-4d7c-92a3-f5d36bdec9ca admin admin] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:05:17.442036 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8930dc0c-65ab-4d7c-92a3-f5d36bdec9ca admin admin] PATH_INFO: `/v3/projects/33b603c097894e5b979f2d08afabcd1f` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:05:17.443426 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8930dc0c-65ab-4d7c-92a3-f5d36bdec9ca admin admin] RBAC: Authorizing `identity:delete_project(project_id=33b603c097894e5b979f2d08afabcd1f)` {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:05:17.451212 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8930dc0c-65ab-4d7c-92a3-f5d36bdec9ca admin admin] RBAC: Authorization granted {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:05:17.641965 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.notifications [None req-8930dc0c-65ab-4d7c-92a3-f5d36bdec9ca admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '33b603c097894e5b979f2d08afabcd1f', 'request_id': 'req-8930dc0c-65ab-4d7c-92a3-f5d36bdec9ca'} {{(pid=101893) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:05:17.648977 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.notifications [None req-8930dc0c-65ab-4d7c-92a3-f5d36bdec9ca admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '33b603c097894e5b979f2d08afabcd1f', 'request_id': 'req-8930dc0c-65ab-4d7c-92a3-f5d36bdec9ca'} {{(pid=101893) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:05:17.654833 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.notifications [None req-8930dc0c-65ab-4d7c-92a3-f5d36bdec9ca admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '33b603c097894e5b979f2d08afabcd1f', 'request_id': 'req-8930dc0c-65ab-4d7c-92a3-f5d36bdec9ca'} {{(pid=101893) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:05:17.753715 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.notifications [None req-8930dc0c-65ab-4d7c-92a3-f5d36bdec9ca admin admin] The token cache is being invalidate because project 33b603c097894e5b979f2d08afabcd1f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=101893) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 25 15:05:17.754013 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.notifications [None req-8930dc0c-65ab-4d7c-92a3-f5d36bdec9ca admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=101893) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:05:17.754657 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.notifications [None req-8930dc0c-65ab-4d7c-92a3-f5d36bdec9ca admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=101893) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:05:17.756255 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 1052/2073] 10.222.0.84 () {58 vars in 1232 bytes} [Wed May 25 15:05:17 2022] DELETE /identity/v3/projects/33b603c097894e5b979f2d08afabcd1f => generated 0 bytes in 408 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 15:05:17.762333 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906bfc1e-0e45-4b69-87a6-cb6373b646a0 None None] REQUEST_METHOD: `POST` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:05:17.762806 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906bfc1e-0e45-4b69-87a6-cb6373b646a0 None None] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:05:17.762933 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906bfc1e-0e45-4b69-87a6-cb6373b646a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:05:17.780828 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.auth.core [None req-906bfc1e-0e45-4b69-87a6-cb6373b646a0 None None] MFA Rules not processed for user `05d87e87798e429aa1c10b24391f915e`. Rule list: `[]` (Enabled: `True`). {{(pid=101892) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:05:17.782539 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.fernet_utils [None req-906bfc1e-0e45-4b69-87a6-cb6373b646a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=101892) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:05:17.862711 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 1022/2074] 10.222.0.84 () {58 vars in 957 bytes} [Wed May 25 15:05:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 15:05:17.870460 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-626f9f5c-5953-4a36-9856-b2cdf2d85e7f None None] REQUEST_METHOD: `POST` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:05:17.870768 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-626f9f5c-5953-4a36-9856-b2cdf2d85e7f None None] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:05:17.871070 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-626f9f5c-5953-4a36-9856-b2cdf2d85e7f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:05:17.892159 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.auth.core [None req-626f9f5c-5953-4a36-9856-b2cdf2d85e7f None None] MFA Rules not processed for user `05d87e87798e429aa1c10b24391f915e`. Rule list: `[]` (Enabled: `True`). {{(pid=101893) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:05:17.893383 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.fernet_utils [None req-626f9f5c-5953-4a36-9856-b2cdf2d85e7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=101893) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:05:17.901881 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 1053/2075] 10.222.0.84 () {58 vars in 957 bytes} [Wed May 25 15:05:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 25 15:05:17.906250 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-906bfc1e-0e45-4b69-87a6-cb6373b646a0 None None] Authenticating user token {{(pid=101892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:05:17.916397 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-906bfc1e-0e45-4b69-87a6-cb6373b646a0 None None] Validating token access rules against request {{(pid=101892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:05:17.921476 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-250b9fe4-b55f-4584-8a8d-4c84daf29299 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cec56f74b2fa4826a506dc7b919465be', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:05:17.922181 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250b9fe4-b55f-4584-8a8d-4c84daf29299 admin admin] REQUEST_METHOD: `GET` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:05:17.922497 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250b9fe4-b55f-4584-8a8d-4c84daf29299 admin admin] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:05:17.922774 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250b9fe4-b55f-4584-8a8d-4c84daf29299 admin admin] PATH_INFO: `/v3/domains` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:05:17.923506 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-250b9fe4-b55f-4584-8a8d-4c84daf29299 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=101892) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 15:05:17.923852 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-250b9fe4-b55f-4584-8a8d-4c84daf29299 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:05:17.925533 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-250b9fe4-b55f-4584-8a8d-4c84daf29299 admin admin] RBAC: Authorization granted {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:05:17.941613 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 1023/2076] 10.222.0.84 () {58 vars in 1152 bytes} [Wed May 25 15:05:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 15:05:17.942993 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-626f9f5c-5953-4a36-9856-b2cdf2d85e7f None None] Authenticating user token {{(pid=101893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:05:17.953006 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-626f9f5c-5953-4a36-9856-b2cdf2d85e7f None None] Validating token access rules against request {{(pid=101893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:05:17.958387 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fae2710b-42a1-456c-839f-a956f976e01b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cec56f74b2fa4826a506dc7b919465be', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:05:17.959041 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae2710b-42a1-456c-839f-a956f976e01b admin admin] REQUEST_METHOD: `POST` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:05:17.959323 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae2710b-42a1-456c-839f-a956f976e01b admin admin] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:05:17.959818 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae2710b-42a1-456c-839f-a956f976e01b admin admin] PATH_INFO: `/v3/projects` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:05:17.960516 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fae2710b-42a1-456c-839f-a956f976e01b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:05:17.962424 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fae2710b-42a1-456c-839f-a956f976e01b admin admin] RBAC: Authorization granted {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:05:18.081584 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 1054/2077] 10.222.0.84 () {60 vars in 1152 bytes} [Wed May 25 15:05:17 2022] POST /identity/v3/projects => generated 361 bytes in 139 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 25 15:05:18.085824 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-250b9fe4-b55f-4584-8a8d-4c84daf29299 admin admin] Authenticating user token {{(pid=101892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:05:18.096435 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-250b9fe4-b55f-4584-8a8d-4c84daf29299 admin admin] Validating token access rules against request {{(pid=101892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:05:18.155244 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-045d59e4-66fe-47b5-9978-4982e5c8ef42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cec56f74b2fa4826a506dc7b919465be', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:05:18.155992 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045d59e4-66fe-47b5-9978-4982e5c8ef42 admin admin] REQUEST_METHOD: `POST` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:05:18.156342 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045d59e4-66fe-47b5-9978-4982e5c8ef42 admin admin] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:05:18.156611 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045d59e4-66fe-47b5-9978-4982e5c8ef42 admin admin] PATH_INFO: `/v3/users` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:05:18.157326 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-045d59e4-66fe-47b5-9978-4982e5c8ef42 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:05:18.159349 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-045d59e4-66fe-47b5-9978-4982e5c8ef42 admin admin] RBAC: Authorization granted {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:05:18.295195 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 1024/2078] 10.222.0.84 () {60 vars in 1143 bytes} [Wed May 25 15:05:18 2022] POST /identity/v3/users => generated 281 bytes in 210 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 15:05:18.299301 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fae2710b-42a1-456c-839f-a956f976e01b admin admin] Authenticating user token {{(pid=101893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:05:18.309731 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fae2710b-42a1-456c-839f-a956f976e01b admin admin] Validating token access rules against request {{(pid=101893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:05:18.314338 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6443c08e-d80a-4cbb-9927-2a4e403a5103 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cec56f74b2fa4826a506dc7b919465be', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:05:18.315012 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6443c08e-d80a-4cbb-9927-2a4e403a5103 admin admin] REQUEST_METHOD: `GET` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:05:18.315295 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6443c08e-d80a-4cbb-9927-2a4e403a5103 admin admin] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:05:18.315590 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6443c08e-d80a-4cbb-9927-2a4e403a5103 admin admin] PATH_INFO: `/v3/roles` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:05:18.316330 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6443c08e-d80a-4cbb-9927-2a4e403a5103 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:05:18.318111 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6443c08e-d80a-4cbb-9927-2a4e403a5103 admin admin] RBAC: Authorization granted {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:05:18.329780 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 1055/2079] 10.222.0.84 () {58 vars in 1121 bytes} [Wed May 25 15:05:18 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 15:05:18.333975 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-045d59e4-66fe-47b5-9978-4982e5c8ef42 admin admin] Authenticating user token {{(pid=101892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:05:18.346493 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-045d59e4-66fe-47b5-9978-4982e5c8ef42 admin admin] Validating token access rules against request {{(pid=101892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:05:18.351347 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a584b33-397d-4d70-830c-7ee9308e97d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cec56f74b2fa4826a506dc7b919465be', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:05:18.352079 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a584b33-397d-4d70-830c-7ee9308e97d3 admin admin] REQUEST_METHOD: `GET` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:05:18.352370 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a584b33-397d-4d70-830c-7ee9308e97d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:05:18.352652 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a584b33-397d-4d70-830c-7ee9308e97d3 admin admin] PATH_INFO: `/v3/roles` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:05:18.353382 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a584b33-397d-4d70-830c-7ee9308e97d3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:05:18.354983 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a584b33-397d-4d70-830c-7ee9308e97d3 admin admin] RBAC: Authorization granted {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:05:18.367854 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 1025/2080] 10.222.0.84 () {58 vars in 1121 bytes} [Wed May 25 15:05:18 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 15:05:18.372075 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6443c08e-d80a-4cbb-9927-2a4e403a5103 admin admin] Authenticating user token {{(pid=101893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:05:18.382503 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6443c08e-d80a-4cbb-9927-2a4e403a5103 admin admin] Validating token access rules against request {{(pid=101893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:05:18.387188 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00273202-8f1e-4613-8e8d-04570a40a90f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cec56f74b2fa4826a506dc7b919465be', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:05:18.388453 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00273202-8f1e-4613-8e8d-04570a40a90f admin admin] REQUEST_METHOD: `PUT` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:05:18.388453 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00273202-8f1e-4613-8e8d-04570a40a90f admin admin] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:05:18.391540 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00273202-8f1e-4613-8e8d-04570a40a90f admin admin] PATH_INFO: `/v3/projects/c995b9d233054e5ea588c659825b08be/users/7c6258bb77a34baeb53d1a38f2d1ccde/roles/ff664fa0db7e4262a5accde96c3df4c3` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:05:18.405043 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00273202-8f1e-4613-8e8d-04570a40a90f admin admin] RBAC: Authorizing `identity:create_grant(project_id=c995b9d233054e5ea588c659825b08be, user_id=7c6258bb77a34baeb53d1a38f2d1ccde, role_id=ff664fa0db7e4262a5accde96c3df4c3)` {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:05:18.408456 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00273202-8f1e-4613-8e8d-04570a40a90f admin admin] RBAC: Authorization granted {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:05:18.410900 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG dbcounter [-] [101893] Writing DB stats keystone:SELECT=87,keystone:DELETE=10,keystone:INSERT=3 {{(pid=101893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:05:18.428975 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa35d4be-6c64-486d-a814-9971b1c5442a None None] REQUEST_METHOD: `POST` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:05:18.429275 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa35d4be-6c64-486d-a814-9971b1c5442a None None] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:05:18.429561 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa35d4be-6c64-486d-a814-9971b1c5442a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:05:18.440009 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG dbcounter [-] [101892] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=101892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:05:18.460571 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.auth.core [None req-aa35d4be-6c64-486d-a814-9971b1c5442a None None] MFA Rules not processed for user `4f0e5c26a69548dfb71b4be306977caf`. Rule list: `[]` (Enabled: `True`). {{(pid=101892) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:05:18.461685 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.fernet_utils [None req-aa35d4be-6c64-486d-a814-9971b1c5442a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=101892) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:05:18.501371 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 1056/2081] 10.222.0.84 () {60 vars in 1482 bytes} [Wed May 25 15:05:18 2022] PUT /identity/v3/projects/c995b9d233054e5ea588c659825b08be/users/7c6258bb77a34baeb53d1a38f2d1ccde/roles/ff664fa0db7e4262a5accde96c3df4c3 => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 15:05:18.514387 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e6b287-c4de-4093-8393-048314d8ad8c None None] REQUEST_METHOD: `POST` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:05:18.515738 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e6b287-c4de-4093-8393-048314d8ad8c None None] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:05:18.516208 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e6b287-c4de-4093-8393-048314d8ad8c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:05:18.539462 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 1026/2082] 10.222.0.84 () {58 vars in 957 bytes} [Wed May 25 15:05:18 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 25 15:05:18.551767 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa35d4be-6c64-486d-a814-9971b1c5442a None None] Authenticating user token {{(pid=101892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:05:18.553523 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.fernet_utils [None req-aa35d4be-6c64-486d-a814-9971b1c5442a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=101892) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:05:18.554019 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.auth.core [None req-83e6b287-c4de-4093-8393-048314d8ad8c None None] MFA Rules not processed for user `7c6258bb77a34baeb53d1a38f2d1ccde`. Rule list: `[]` (Enabled: `True`). {{(pid=101893) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:05:18.556871 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.fernet_utils [None req-83e6b287-c4de-4093-8393-048314d8ad8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=101893) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:05:18.616661 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa35d4be-6c64-486d-a814-9971b1c5442a None None] Validating token access rules against request {{(pid=101892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:05:18.624052 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 1057/2083] 10.222.0.84 () {58 vars in 957 bytes} [Wed May 25 15:05:18 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 25 15:05:18.654116 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83e6b287-c4de-4093-8393-048314d8ad8c None None] Authenticating user token {{(pid=101893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:05:18.655531 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.fernet_utils [None req-83e6b287-c4de-4093-8393-048314d8ad8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=101893) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:05:18.667510 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e14d2af6-2c7d-423c-9cf7-da8eeb734ab0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e079f89a5e524ab6ad4183e4f690de07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a000829c658c4a7cab67f7b6353ba3fa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:05:18.668191 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e14d2af6-2c7d-423c-9cf7-da8eeb734ab0 service cinder] REQUEST_METHOD: `GET` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:05:18.668476 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e14d2af6-2c7d-423c-9cf7-da8eeb734ab0 service cinder] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:05:18.668754 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e14d2af6-2c7d-423c-9cf7-da8eeb734ab0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:05:18.712015 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83e6b287-c4de-4093-8393-048314d8ad8c None None] Validating token access rules against request {{(pid=101893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:05:18.715684 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dad69ad-1dbd-4f95-8294-858d663e9765 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e079f89a5e524ab6ad4183e4f690de07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a000829c658c4a7cab67f7b6353ba3fa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:05:18.716337 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dad69ad-1dbd-4f95-8294-858d663e9765 service cinder] REQUEST_METHOD: `GET` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:05:18.716623 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dad69ad-1dbd-4f95-8294-858d663e9765 service cinder] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:05:18.716898 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dad69ad-1dbd-4f95-8294-858d663e9765 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:05:18.725816 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dad69ad-1dbd-4f95-8294-858d663e9765 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:05:18.726565 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e14d2af6-2c7d-423c-9cf7-da8eeb734ab0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:05:18.727295 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dad69ad-1dbd-4f95-8294-858d663e9765 service cinder] RBAC: Authorization granted {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:05:18.728086 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e14d2af6-2c7d-423c-9cf7-da8eeb734ab0 service cinder] RBAC: Authorization granted {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:05:18.736623 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 1058/2084] 10.222.0.84 () {60 vars in 1365 bytes} [Wed May 25 15:05:18 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 15:05:18.737628 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 1027/2085] 10.222.0.84 () {60 vars in 1365 bytes} [Wed May 25 15:05:18 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 186 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 25 15:05:18.752047 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dad69ad-1dbd-4f95-8294-858d663e9765 service cinder] Authenticating user token {{(pid=101893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:05:18.816585 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dad69ad-1dbd-4f95-8294-858d663e9765 service cinder] Validating token access rules against request {{(pid=101893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:05:18.821343 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb7b981-4fb8-4537-ac52-3091752b383b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cec56f74b2fa4826a506dc7b919465be', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:05:18.822219 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb7b981-4fb8-4537-ac52-3091752b383b admin admin] REQUEST_METHOD: `DELETE` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:05:18.822503 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb7b981-4fb8-4537-ac52-3091752b383b admin admin] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:05:18.822808 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb7b981-4fb8-4537-ac52-3091752b383b admin admin] PATH_INFO: `/v3/users/7c6258bb77a34baeb53d1a38f2d1ccde` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:05:18.824043 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbb7b981-4fb8-4537-ac52-3091752b383b admin admin] RBAC: Authorizing `identity:delete_user(user_id=7c6258bb77a34baeb53d1a38f2d1ccde)` {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:05:18.826252 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbb7b981-4fb8-4537-ac52-3091752b383b admin admin] RBAC: Authorization granted {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:05:18.966011 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8689bebd-ae14-4dce-921f-50623540ae2d None None] REQUEST_METHOD: `POST` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:05:18.966438 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8689bebd-ae14-4dce-921f-50623540ae2d None None] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:05:18.966527 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8689bebd-ae14-4dce-921f-50623540ae2d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:05:18.973072 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG dbcounter [-] [101893] Writing DB stats keystone:INSERT=1,keystone:SELECT=94,keystone:DELETE=5 {{(pid=101893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:05:18.973952 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG dbcounter [-] [101892] Writing DB stats keystone:SELECT=100 {{(pid=101892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:05:18.985144 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.auth.core [None req-8689bebd-ae14-4dce-921f-50623540ae2d None None] MFA Rules not processed for user `049a7ab3f95f460e908f79cc321176fd`. Rule list: `[]` (Enabled: `True`). {{(pid=101892) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:05:18.986339 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.fernet_utils [None req-8689bebd-ae14-4dce-921f-50623540ae2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=101892) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:05:19.040569 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 1028/2086] 10.222.0.84 () {58 vars in 967 bytes} [Wed May 25 15:05:18 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 25 15:05:19.054641 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8689bebd-ae14-4dce-921f-50623540ae2d None None] Authenticating user token {{(pid=101892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:05:19.055999 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.fernet_utils [None req-8689bebd-ae14-4dce-921f-50623540ae2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=101892) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:05:19.079907 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.notifications [None req-bbb7b981-4fb8-4537-ac52-3091752b383b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7c6258bb77a34baeb53d1a38f2d1ccde'} {{(pid=101893) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:05:19.087008 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.notifications [None req-bbb7b981-4fb8-4537-ac52-3091752b383b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7c6258bb77a34baeb53d1a38f2d1ccde'} {{(pid=101893) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:05:19.099614 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.notifications [None req-bbb7b981-4fb8-4537-ac52-3091752b383b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7c6258bb77a34baeb53d1a38f2d1ccde'} {{(pid=101893) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:05:19.100370 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.notifications [None req-bbb7b981-4fb8-4537-ac52-3091752b383b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7c6258bb77a34baeb53d1a38f2d1ccde'} {{(pid=101893) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:05:19.101128 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.notifications [None req-bbb7b981-4fb8-4537-ac52-3091752b383b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7c6258bb77a34baeb53d1a38f2d1ccde'} {{(pid=101893) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:05:19.126512 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8689bebd-ae14-4dce-921f-50623540ae2d None None] Validating token access rules against request {{(pid=101892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:05:19.131550 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-680d5e72-1d78-4f77-907e-55ad14bf595a service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e196f0897b98455c9e164271d7d0070a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a000829c658c4a7cab67f7b6353ba3fa', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:05:19.132226 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680d5e72-1d78-4f77-907e-55ad14bf595a service swift] REQUEST_METHOD: `GET` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:05:19.132513 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680d5e72-1d78-4f77-907e-55ad14bf595a service swift] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:05:19.132792 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680d5e72-1d78-4f77-907e-55ad14bf595a service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:05:19.134587 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.fernet_utils [None req-680d5e72-1d78-4f77-907e-55ad14bf595a service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=101892) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:05:19.145346 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-680d5e72-1d78-4f77-907e-55ad14bf595a service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:05:19.146943 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-680d5e72-1d78-4f77-907e-55ad14bf595a service swift] RBAC: Authorization granted {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:05:19.155156 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 1029/2087] 10.222.0.84 () {60 vars in 1384 bytes} [Wed May 25 15:05:19 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) May 25 15:05:19.182703 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 1059/2088] 10.222.0.84 () {58 vars in 1223 bytes} [Wed May 25 15:05:18 2022] DELETE /identity/v3/users/7c6258bb77a34baeb53d1a38f2d1ccde => generated 0 bytes in 432 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 15:05:19.187328 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b631f3-01bd-484d-ae3a-e6be57b61dc8 None None] REQUEST_METHOD: `POST` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:05:19.188272 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b631f3-01bd-484d-ae3a-e6be57b61dc8 None None] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:05:19.188557 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b631f3-01bd-484d-ae3a-e6be57b61dc8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:05:19.205605 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.auth.core [None req-01b631f3-01bd-484d-ae3a-e6be57b61dc8 None None] MFA Rules not processed for user `05d87e87798e429aa1c10b24391f915e`. Rule list: `[]` (Enabled: `True`). {{(pid=101892) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:05:19.206798 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.fernet_utils [None req-01b631f3-01bd-484d-ae3a-e6be57b61dc8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=101892) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:05:19.265761 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 1030/2089] 10.222.0.84 () {58 vars in 957 bytes} [Wed May 25 15:05:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 25 15:05:19.276449 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb7b981-4fb8-4537-ac52-3091752b383b admin admin] Authenticating user token {{(pid=101893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:05:19.278063 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.fernet_utils [None req-bbb7b981-4fb8-4537-ac52-3091752b383b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=101893) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:05:19.351822 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb7b981-4fb8-4537-ac52-3091752b383b admin admin] Validating token access rules against request {{(pid=101893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:05:19.355388 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b703eee7-fc65-434d-b52f-f7be4d750f6f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ce28b25b907473588ccb87dc4acc06a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a000829c658c4a7cab67f7b6353ba3fa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:05:19.356072 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b703eee7-fc65-434d-b52f-f7be4d750f6f service neutron] REQUEST_METHOD: `GET` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:05:19.356356 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b703eee7-fc65-434d-b52f-f7be4d750f6f service neutron] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:05:19.356634 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b703eee7-fc65-434d-b52f-f7be4d750f6f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:05:19.367009 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b703eee7-fc65-434d-b52f-f7be4d750f6f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:05:19.368563 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b703eee7-fc65-434d-b52f-f7be4d750f6f service neutron] RBAC: Authorization granted {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:05:19.380882 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 1060/2090] 10.222.0.84 () {60 vars in 1365 bytes} [Wed May 25 15:05:19 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 15:05:19.770509 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01b631f3-01bd-484d-ae3a-e6be57b61dc8 None None] Authenticating user token {{(pid=101892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:05:19.772042 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.fernet_utils [None req-01b631f3-01bd-484d-ae3a-e6be57b61dc8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=101892) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:05:19.786140 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01b631f3-01bd-484d-ae3a-e6be57b61dc8 None None] Validating token access rules against request {{(pid=101892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:05:19.790805 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2719b37e-b132-4b2e-bf39-d8bae090770d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cec56f74b2fa4826a506dc7b919465be', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:05:19.792431 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2719b37e-b132-4b2e-bf39-d8bae090770d admin admin] REQUEST_METHOD: `DELETE` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:05:19.792728 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2719b37e-b132-4b2e-bf39-d8bae090770d admin admin] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:05:19.793012 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2719b37e-b132-4b2e-bf39-d8bae090770d admin admin] PATH_INFO: `/v3/projects/c995b9d233054e5ea588c659825b08be` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:05:19.794503 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2719b37e-b132-4b2e-bf39-d8bae090770d admin admin] RBAC: Authorizing `identity:delete_project(project_id=c995b9d233054e5ea588c659825b08be)` {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:05:19.797705 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2719b37e-b132-4b2e-bf39-d8bae090770d admin admin] RBAC: Authorization granted {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:05:19.996375 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG dbcounter [-] [101892] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=101892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:05:20.005615 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.notifications [None req-2719b37e-b132-4b2e-bf39-d8bae090770d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c995b9d233054e5ea588c659825b08be', 'request_id': 'req-2719b37e-b132-4b2e-bf39-d8bae090770d'} {{(pid=101892) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:05:20.012779 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.notifications [None req-2719b37e-b132-4b2e-bf39-d8bae090770d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c995b9d233054e5ea588c659825b08be', 'request_id': 'req-2719b37e-b132-4b2e-bf39-d8bae090770d'} {{(pid=101892) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:05:20.021321 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.notifications [None req-2719b37e-b132-4b2e-bf39-d8bae090770d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c995b9d233054e5ea588c659825b08be', 'request_id': 'req-2719b37e-b132-4b2e-bf39-d8bae090770d'} {{(pid=101892) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:05:20.114770 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.notifications [None req-2719b37e-b132-4b2e-bf39-d8bae090770d admin admin] The token cache is being invalidate because project c995b9d233054e5ea588c659825b08be was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=101892) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 25 15:05:20.115265 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.notifications [None req-2719b37e-b132-4b2e-bf39-d8bae090770d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=101892) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:05:20.116431 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.notifications [None req-2719b37e-b132-4b2e-bf39-d8bae090770d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=101892) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:05:20.118700 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 1031/2091] 10.222.0.84 () {58 vars in 1232 bytes} [Wed May 25 15:05:19 2022] DELETE /identity/v3/projects/c995b9d233054e5ea588c659825b08be => generated 0 bytes in 349 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 25 15:05:20.123655 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc0a466-6a94-4ef4-a21e-8fb26a86cce6 None None] REQUEST_METHOD: `POST` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:05:20.123953 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc0a466-6a94-4ef4-a21e-8fb26a86cce6 None None] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:05:20.124238 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc0a466-6a94-4ef4-a21e-8fb26a86cce6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:05:20.142751 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.auth.core [None req-9dc0a466-6a94-4ef4-a21e-8fb26a86cce6 None None] MFA Rules not processed for user `05d87e87798e429aa1c10b24391f915e`. Rule list: `[]` (Enabled: `True`). {{(pid=101893) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:05:20.144008 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.fernet_utils [None req-9dc0a466-6a94-4ef4-a21e-8fb26a86cce6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=101893) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:05:20.204589 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 1061/2092] 10.222.0.84 () {58 vars in 957 bytes} [Wed May 25 15:05:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 15:05:20.212457 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95334c0b-2fe5-4967-b534-93e69781e4e3 None None] REQUEST_METHOD: `POST` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:05:20.212798 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95334c0b-2fe5-4967-b534-93e69781e4e3 None None] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:05:20.213081 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95334c0b-2fe5-4967-b534-93e69781e4e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:05:20.231502 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.auth.core [None req-95334c0b-2fe5-4967-b534-93e69781e4e3 None None] MFA Rules not processed for user `05d87e87798e429aa1c10b24391f915e`. Rule list: `[]` (Enabled: `True`). {{(pid=101892) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:05:20.232781 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.fernet_utils [None req-95334c0b-2fe5-4967-b534-93e69781e4e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=101892) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:05:20.241809 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 1032/2093] 10.222.0.84 () {58 vars in 957 bytes} [Wed May 25 15:05:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 25 15:05:20.245908 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc0a466-6a94-4ef4-a21e-8fb26a86cce6 None None] Authenticating user token {{(pid=101893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:05:20.256429 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc0a466-6a94-4ef4-a21e-8fb26a86cce6 None None] Validating token access rules against request {{(pid=101893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:05:20.261087 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aa4cf39-ee7a-407e-baa1-c10ba6ac6b45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cec56f74b2fa4826a506dc7b919465be', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:05:20.261744 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa4cf39-ee7a-407e-baa1-c10ba6ac6b45 admin admin] REQUEST_METHOD: `GET` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:05:20.262024 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa4cf39-ee7a-407e-baa1-c10ba6ac6b45 admin admin] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:05:20.262295 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa4cf39-ee7a-407e-baa1-c10ba6ac6b45 admin admin] PATH_INFO: `/v3/domains` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:05:20.263013 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aa4cf39-ee7a-407e-baa1-c10ba6ac6b45 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=101893) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 15:05:20.263311 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aa4cf39-ee7a-407e-baa1-c10ba6ac6b45 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:05:20.265000 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aa4cf39-ee7a-407e-baa1-c10ba6ac6b45 admin admin] RBAC: Authorization granted {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:05:20.277588 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 1062/2094] 10.222.0.84 () {58 vars in 1152 bytes} [Wed May 25 15:05:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 15:05:20.282668 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95334c0b-2fe5-4967-b534-93e69781e4e3 None None] Authenticating user token {{(pid=101892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:05:20.292999 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95334c0b-2fe5-4967-b534-93e69781e4e3 None None] Validating token access rules against request {{(pid=101892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:05:20.298295 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26830b54-8a34-4e6f-b160-d76da6b71056 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cec56f74b2fa4826a506dc7b919465be', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:05:20.299007 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26830b54-8a34-4e6f-b160-d76da6b71056 admin admin] REQUEST_METHOD: `POST` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:05:20.299276 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26830b54-8a34-4e6f-b160-d76da6b71056 admin admin] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:05:20.299589 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26830b54-8a34-4e6f-b160-d76da6b71056 admin admin] PATH_INFO: `/v3/projects` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:05:20.300306 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26830b54-8a34-4e6f-b160-d76da6b71056 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:05:20.302205 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26830b54-8a34-4e6f-b160-d76da6b71056 admin admin] RBAC: Authorization granted {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:05:20.383146 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 1033/2095] 10.222.0.84 () {60 vars in 1152 bytes} [Wed May 25 15:05:20 2022] POST /identity/v3/projects => generated 373 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 15:05:20.387073 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aa4cf39-ee7a-407e-baa1-c10ba6ac6b45 admin admin] Authenticating user token {{(pid=101893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:05:20.398956 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aa4cf39-ee7a-407e-baa1-c10ba6ac6b45 admin admin] Validating token access rules against request {{(pid=101893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:05:20.433166 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG dbcounter [-] [101893] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=101893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:05:20.458414 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec28cb17-ac5b-4b20-9259-7cdad7c11156 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cec56f74b2fa4826a506dc7b919465be', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:05:20.459091 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec28cb17-ac5b-4b20-9259-7cdad7c11156 admin admin] REQUEST_METHOD: `POST` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:05:20.459378 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec28cb17-ac5b-4b20-9259-7cdad7c11156 admin admin] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:05:20.459800 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec28cb17-ac5b-4b20-9259-7cdad7c11156 admin admin] PATH_INFO: `/v3/users` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:05:20.460602 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec28cb17-ac5b-4b20-9259-7cdad7c11156 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:05:20.462479 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec28cb17-ac5b-4b20-9259-7cdad7c11156 admin admin] RBAC: Authorization granted {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:05:20.559864 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 1063/2096] 10.222.0.84 () {60 vars in 1143 bytes} [Wed May 25 15:05:20 2022] POST /identity/v3/users => generated 287 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 15:05:20.563899 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26830b54-8a34-4e6f-b160-d76da6b71056 admin admin] Authenticating user token {{(pid=101892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:05:20.574146 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26830b54-8a34-4e6f-b160-d76da6b71056 admin admin] Validating token access rules against request {{(pid=101892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:05:20.579791 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa7a2926-797f-4fbb-bdcb-3122c7ef1e48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cec56f74b2fa4826a506dc7b919465be', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:05:20.580448 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7a2926-797f-4fbb-bdcb-3122c7ef1e48 admin admin] REQUEST_METHOD: `GET` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:05:20.580735 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7a2926-797f-4fbb-bdcb-3122c7ef1e48 admin admin] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:05:20.581016 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7a2926-797f-4fbb-bdcb-3122c7ef1e48 admin admin] PATH_INFO: `/v3/roles` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:05:20.581743 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa7a2926-797f-4fbb-bdcb-3122c7ef1e48 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:05:20.583373 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa7a2926-797f-4fbb-bdcb-3122c7ef1e48 admin admin] RBAC: Authorization granted {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:05:20.595408 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 1034/2097] 10.222.0.84 () {58 vars in 1121 bytes} [Wed May 25 15:05:20 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 15:05:20.599383 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec28cb17-ac5b-4b20-9259-7cdad7c11156 admin admin] Authenticating user token {{(pid=101893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:05:20.609667 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec28cb17-ac5b-4b20-9259-7cdad7c11156 admin admin] Validating token access rules against request {{(pid=101893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:05:20.614377 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbd888a5-add7-4ebe-9e18-78555e36bc53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cec56f74b2fa4826a506dc7b919465be', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:05:20.615058 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd888a5-add7-4ebe-9e18-78555e36bc53 admin admin] REQUEST_METHOD: `GET` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:05:20.615351 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd888a5-add7-4ebe-9e18-78555e36bc53 admin admin] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:05:20.615676 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd888a5-add7-4ebe-9e18-78555e36bc53 admin admin] PATH_INFO: `/v3/roles` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:05:20.616423 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbd888a5-add7-4ebe-9e18-78555e36bc53 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:05:20.618071 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbd888a5-add7-4ebe-9e18-78555e36bc53 admin admin] RBAC: Authorization granted {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:05:20.628988 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 1064/2098] 10.222.0.84 () {58 vars in 1121 bytes} [Wed May 25 15:05:20 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 15:05:20.633309 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa7a2926-797f-4fbb-bdcb-3122c7ef1e48 admin admin] Authenticating user token {{(pid=101892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:05:20.643675 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa7a2926-797f-4fbb-bdcb-3122c7ef1e48 admin admin] Validating token access rules against request {{(pid=101892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:05:20.648774 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c03366fe-b72e-46b5-8c6b-b717304490cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cec56f74b2fa4826a506dc7b919465be', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:05:20.649657 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03366fe-b72e-46b5-8c6b-b717304490cd admin admin] REQUEST_METHOD: `PUT` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:05:20.649943 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03366fe-b72e-46b5-8c6b-b717304490cd admin admin] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:05:20.650220 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03366fe-b72e-46b5-8c6b-b717304490cd admin admin] PATH_INFO: `/v3/projects/545dca6cad924ad89df6e7317b7b3252/users/c9d93ef989b14e66bc0507c70cc624e2/roles/ff664fa0db7e4262a5accde96c3df4c3` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:05:20.665677 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c03366fe-b72e-46b5-8c6b-b717304490cd admin admin] RBAC: Authorizing `identity:create_grant(project_id=545dca6cad924ad89df6e7317b7b3252, user_id=c9d93ef989b14e66bc0507c70cc624e2, role_id=ff664fa0db7e4262a5accde96c3df4c3)` {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:05:20.668528 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c03366fe-b72e-46b5-8c6b-b717304490cd admin admin] RBAC: Authorization granted {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:05:20.731092 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 1035/2099] 10.222.0.84 () {60 vars in 1482 bytes} [Wed May 25 15:05:20 2022] PUT /identity/v3/projects/545dca6cad924ad89df6e7317b7b3252/users/c9d93ef989b14e66bc0507c70cc624e2/roles/ff664fa0db7e4262a5accde96c3df4c3 => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 15:05:20.742006 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e52d12-1f4f-4021-952c-2c5043d55cac None None] REQUEST_METHOD: `POST` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:05:20.742297 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e52d12-1f4f-4021-952c-2c5043d55cac None None] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:05:20.742577 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e52d12-1f4f-4021-952c-2c5043d55cac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:05:20.770796 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.auth.core [None req-b5e52d12-1f4f-4021-952c-2c5043d55cac None None] MFA Rules not processed for user `c9d93ef989b14e66bc0507c70cc624e2`. Rule list: `[]` (Enabled: `True`). {{(pid=101893) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:05:20.772040 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.fernet_utils [None req-b5e52d12-1f4f-4021-952c-2c5043d55cac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=101893) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:05:20.836649 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 1065/2100] 10.222.0.84 () {58 vars in 957 bytes} [Wed May 25 15:05:20 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 15:05:20.847677 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c03366fe-b72e-46b5-8c6b-b717304490cd admin admin] Authenticating user token {{(pid=101892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:05:20.849396 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.fernet_utils [None req-c03366fe-b72e-46b5-8c6b-b717304490cd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=101892) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:05:20.907787 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c03366fe-b72e-46b5-8c6b-b717304490cd admin admin] Validating token access rules against request {{(pid=101892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:05:20.911575 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c89179a-df4d-42a6-ae2e-915fedddfc6a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e079f89a5e524ab6ad4183e4f690de07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a000829c658c4a7cab67f7b6353ba3fa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:05:20.912226 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c89179a-df4d-42a6-ae2e-915fedddfc6a service cinder] REQUEST_METHOD: `GET` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:05:20.912526 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c89179a-df4d-42a6-ae2e-915fedddfc6a service cinder] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:05:20.912789 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c89179a-df4d-42a6-ae2e-915fedddfc6a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:05:20.921132 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c89179a-df4d-42a6-ae2e-915fedddfc6a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:05:20.922564 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c89179a-df4d-42a6-ae2e-915fedddfc6a service cinder] RBAC: Authorization granted {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:05:20.931444 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 1036/2101] 10.222.0.84 () {60 vars in 1365 bytes} [Wed May 25 15:05:20 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 15:05:21.489903 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8799d0c-209c-4eae-907b-b9af11eaf1d7 None None] REQUEST_METHOD: `POST` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:05:21.490462 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8799d0c-209c-4eae-907b-b9af11eaf1d7 None None] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:05:21.490462 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8799d0c-209c-4eae-907b-b9af11eaf1d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:05:21.508286 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.auth.core [None req-b8799d0c-209c-4eae-907b-b9af11eaf1d7 None None] MFA Rules not processed for user `4f0e5c26a69548dfb71b4be306977caf`. Rule list: `[]` (Enabled: `True`). {{(pid=101893) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:05:21.509504 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.fernet_utils [None req-b8799d0c-209c-4eae-907b-b9af11eaf1d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=101893) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:05:21.576110 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 1066/2102] 10.222.0.84 () {58 vars in 957 bytes} [Wed May 25 15:05:21 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 25 15:05:22.317715 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c89179a-df4d-42a6-ae2e-915fedddfc6a service cinder] Authenticating user token {{(pid=101892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:05:22.324550 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.fernet_utils [None req-4c89179a-df4d-42a6-ae2e-915fedddfc6a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=101892) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:05:22.401827 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c89179a-df4d-42a6-ae2e-915fedddfc6a service cinder] Validating token access rules against request {{(pid=101892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:05:22.406652 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af124554-51c8-409e-b759-6309cc0fc687 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cec56f74b2fa4826a506dc7b919465be', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:05:22.407720 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af124554-51c8-409e-b759-6309cc0fc687 admin admin] REQUEST_METHOD: `DELETE` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:05:22.407908 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af124554-51c8-409e-b759-6309cc0fc687 admin admin] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:05:22.408187 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af124554-51c8-409e-b759-6309cc0fc687 admin admin] PATH_INFO: `/v3/users/43a138df43514fecb16b49a1ccad150d` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:05:22.409429 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af124554-51c8-409e-b759-6309cc0fc687 admin admin] RBAC: Authorizing `identity:delete_user(user_id=43a138df43514fecb16b49a1ccad150d)` {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:05:22.411368 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af124554-51c8-409e-b759-6309cc0fc687 admin admin] RBAC: Authorization granted {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:05:22.416510 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG dbcounter [-] [101892] Writing DB stats keystone:DELETE=5,keystone:SELECT=92,keystone:INSERT=3 {{(pid=101892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:05:22.609146 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.notifications [None req-af124554-51c8-409e-b759-6309cc0fc687 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '43a138df43514fecb16b49a1ccad150d'} {{(pid=101892) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:05:22.616687 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.notifications [None req-af124554-51c8-409e-b759-6309cc0fc687 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '43a138df43514fecb16b49a1ccad150d'} {{(pid=101892) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:05:22.628996 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.notifications [None req-af124554-51c8-409e-b759-6309cc0fc687 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '43a138df43514fecb16b49a1ccad150d'} {{(pid=101892) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:05:22.629723 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.notifications [None req-af124554-51c8-409e-b759-6309cc0fc687 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '43a138df43514fecb16b49a1ccad150d'} {{(pid=101892) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:05:22.695793 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.notifications [None req-af124554-51c8-409e-b759-6309cc0fc687 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '43a138df43514fecb16b49a1ccad150d'} {{(pid=101892) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:05:22.702263 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 1037/2103] 10.222.0.84 () {58 vars in 1223 bytes} [Wed May 25 15:05:22 2022] DELETE /identity/v3/users/43a138df43514fecb16b49a1ccad150d => generated 0 bytes in 386 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 15:05:23.012891 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8799d0c-209c-4eae-907b-b9af11eaf1d7 None None] Authenticating user token {{(pid=101893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:05:23.025167 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8799d0c-209c-4eae-907b-b9af11eaf1d7 None None] Validating token access rules against request {{(pid=101893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:05:23.077081 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG dbcounter [-] [101893] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=101893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:05:23.089429 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68d48faf-d2ea-465f-83f6-c8d73e49b4e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cec56f74b2fa4826a506dc7b919465be', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:05:23.090352 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d48faf-d2ea-465f-83f6-c8d73e49b4e2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:05:23.090830 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d48faf-d2ea-465f-83f6-c8d73e49b4e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:05:23.091114 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d48faf-d2ea-465f-83f6-c8d73e49b4e2 admin admin] PATH_INFO: `/v3/projects/755f7a564dbd48d5ac275a9342b04366` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:05:23.092338 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68d48faf-d2ea-465f-83f6-c8d73e49b4e2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=755f7a564dbd48d5ac275a9342b04366)` {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:05:23.095099 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68d48faf-d2ea-465f-83f6-c8d73e49b4e2 admin admin] RBAC: Authorization granted {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:05:23.211593 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.notifications [None req-68d48faf-d2ea-465f-83f6-c8d73e49b4e2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '755f7a564dbd48d5ac275a9342b04366', 'request_id': 'req-68d48faf-d2ea-465f-83f6-c8d73e49b4e2'} {{(pid=101893) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:05:23.217977 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.notifications [None req-68d48faf-d2ea-465f-83f6-c8d73e49b4e2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '755f7a564dbd48d5ac275a9342b04366', 'request_id': 'req-68d48faf-d2ea-465f-83f6-c8d73e49b4e2'} {{(pid=101893) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:05:23.223943 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.notifications [None req-68d48faf-d2ea-465f-83f6-c8d73e49b4e2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '755f7a564dbd48d5ac275a9342b04366', 'request_id': 'req-68d48faf-d2ea-465f-83f6-c8d73e49b4e2'} {{(pid=101893) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:05:23.296002 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.notifications [None req-68d48faf-d2ea-465f-83f6-c8d73e49b4e2 admin admin] The token cache is being invalidate because project 755f7a564dbd48d5ac275a9342b04366 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=101893) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 25 15:05:23.296304 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.notifications [None req-68d48faf-d2ea-465f-83f6-c8d73e49b4e2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=101893) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:05:23.297522 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.notifications [None req-68d48faf-d2ea-465f-83f6-c8d73e49b4e2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=101893) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:05:23.299115 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 1067/2104] 10.222.0.84 () {58 vars in 1232 bytes} [Wed May 25 15:05:23 2022] DELETE /identity/v3/projects/755f7a564dbd48d5ac275a9342b04366 => generated 0 bytes in 287 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 15:05:23.304053 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505f38ad-327e-415f-b7bd-cae8e45db533 None None] REQUEST_METHOD: `POST` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:05:23.304353 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505f38ad-327e-415f-b7bd-cae8e45db533 None None] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:05:23.304607 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505f38ad-327e-415f-b7bd-cae8e45db533 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:05:23.324941 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.auth.core [None req-505f38ad-327e-415f-b7bd-cae8e45db533 None None] MFA Rules not processed for user `05d87e87798e429aa1c10b24391f915e`. Rule list: `[]` (Enabled: `True`). {{(pid=101892) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:05:23.326213 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.fernet_utils [None req-505f38ad-327e-415f-b7bd-cae8e45db533 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=101892) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:05:23.393977 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 1038/2105] 10.222.0.84 () {58 vars in 957 bytes} [Wed May 25 15:05:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 15:05:23.400247 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aefbeaba-a6eb-4788-a1ed-827233882b3a None None] REQUEST_METHOD: `POST` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:05:23.400542 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aefbeaba-a6eb-4788-a1ed-827233882b3a None None] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:05:23.400826 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aefbeaba-a6eb-4788-a1ed-827233882b3a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:05:23.420063 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.auth.core [None req-aefbeaba-a6eb-4788-a1ed-827233882b3a None None] MFA Rules not processed for user `05d87e87798e429aa1c10b24391f915e`. Rule list: `[]` (Enabled: `True`). {{(pid=101893) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:05:23.421324 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.fernet_utils [None req-aefbeaba-a6eb-4788-a1ed-827233882b3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=101893) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:05:23.430309 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 1068/2106] 10.222.0.84 () {58 vars in 957 bytes} [Wed May 25 15:05:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 15:05:23.434431 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-505f38ad-327e-415f-b7bd-cae8e45db533 None None] Authenticating user token {{(pid=101892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:05:23.447649 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-505f38ad-327e-415f-b7bd-cae8e45db533 None None] Validating token access rules against request {{(pid=101892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:05:23.454512 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-019b8e58-3827-4d03-a5fd-bd204fc47e3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cec56f74b2fa4826a506dc7b919465be', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:05:23.455189 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019b8e58-3827-4d03-a5fd-bd204fc47e3d admin admin] REQUEST_METHOD: `GET` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:05:23.455475 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019b8e58-3827-4d03-a5fd-bd204fc47e3d admin admin] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:05:23.455794 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019b8e58-3827-4d03-a5fd-bd204fc47e3d admin admin] PATH_INFO: `/v3/domains` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:05:23.456558 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-019b8e58-3827-4d03-a5fd-bd204fc47e3d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=101892) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 15:05:23.456893 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-019b8e58-3827-4d03-a5fd-bd204fc47e3d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:05:23.458581 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-019b8e58-3827-4d03-a5fd-bd204fc47e3d admin admin] RBAC: Authorization granted {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:05:23.473290 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 1039/2107] 10.222.0.84 () {58 vars in 1152 bytes} [Wed May 25 15:05:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 15:05:23.477780 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aefbeaba-a6eb-4788-a1ed-827233882b3a None None] Authenticating user token {{(pid=101893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:05:23.489742 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aefbeaba-a6eb-4788-a1ed-827233882b3a None None] Validating token access rules against request {{(pid=101893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:05:23.495038 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40534c86-f18a-401f-9541-c0def2004d46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cec56f74b2fa4826a506dc7b919465be', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:05:23.495802 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40534c86-f18a-401f-9541-c0def2004d46 admin admin] REQUEST_METHOD: `POST` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:05:23.496091 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40534c86-f18a-401f-9541-c0def2004d46 admin admin] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:05:23.496370 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40534c86-f18a-401f-9541-c0def2004d46 admin admin] PATH_INFO: `/v3/projects` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:05:23.497078 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40534c86-f18a-401f-9541-c0def2004d46 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:05:23.499032 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40534c86-f18a-401f-9541-c0def2004d46 admin admin] RBAC: Authorization granted {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:05:23.567826 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 1069/2108] 10.222.0.84 () {60 vars in 1152 bytes} [Wed May 25 15:05:23 2022] POST /identity/v3/projects => generated 371 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 15:05:23.572236 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-019b8e58-3827-4d03-a5fd-bd204fc47e3d admin admin] Authenticating user token {{(pid=101892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:05:23.583182 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-019b8e58-3827-4d03-a5fd-bd204fc47e3d admin admin] Validating token access rules against request {{(pid=101892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:05:23.646050 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a86f8c52-9384-462c-9235-a7cb7514f9e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cec56f74b2fa4826a506dc7b919465be', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:05:23.650168 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86f8c52-9384-462c-9235-a7cb7514f9e1 admin admin] REQUEST_METHOD: `POST` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:05:23.650168 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86f8c52-9384-462c-9235-a7cb7514f9e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:05:23.650168 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86f8c52-9384-462c-9235-a7cb7514f9e1 admin admin] PATH_INFO: `/v3/users` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:05:23.650168 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a86f8c52-9384-462c-9235-a7cb7514f9e1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:05:23.651028 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a86f8c52-9384-462c-9235-a7cb7514f9e1 admin admin] RBAC: Authorization granted {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:05:23.755696 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG dbcounter [-] [101892] Writing DB stats keystone:SELECT=86,keystone:DELETE=10,keystone:INSERT=4 {{(pid=101892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:05:23.759450 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 1040/2109] 10.222.0.84 () {60 vars in 1143 bytes} [Wed May 25 15:05:23 2022] POST /identity/v3/users => generated 286 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 25 15:05:23.763769 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40534c86-f18a-401f-9541-c0def2004d46 admin admin] Authenticating user token {{(pid=101893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:05:23.775301 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40534c86-f18a-401f-9541-c0def2004d46 admin admin] Validating token access rules against request {{(pid=101893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:05:23.780143 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a07f16ce-f1d3-4de0-b89e-9551867200f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cec56f74b2fa4826a506dc7b919465be', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:05:23.784374 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a07f16ce-f1d3-4de0-b89e-9551867200f0 admin admin] REQUEST_METHOD: `GET` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:05:23.784374 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a07f16ce-f1d3-4de0-b89e-9551867200f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:05:23.784374 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a07f16ce-f1d3-4de0-b89e-9551867200f0 admin admin] PATH_INFO: `/v3/roles` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:05:23.784374 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a07f16ce-f1d3-4de0-b89e-9551867200f0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:05:23.784374 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a07f16ce-f1d3-4de0-b89e-9551867200f0 admin admin] RBAC: Authorization granted {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:05:23.794548 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 1070/2110] 10.222.0.84 () {58 vars in 1121 bytes} [Wed May 25 15:05:23 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 15:05:23.798524 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a86f8c52-9384-462c-9235-a7cb7514f9e1 admin admin] Authenticating user token {{(pid=101892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:05:23.808437 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a86f8c52-9384-462c-9235-a7cb7514f9e1 admin admin] Validating token access rules against request {{(pid=101892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:05:23.813723 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-360b62ea-56f2-41d7-acba-5e50b5b61905 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cec56f74b2fa4826a506dc7b919465be', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:05:23.814375 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-360b62ea-56f2-41d7-acba-5e50b5b61905 admin admin] REQUEST_METHOD: `GET` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:05:23.814665 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-360b62ea-56f2-41d7-acba-5e50b5b61905 admin admin] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:05:23.814946 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-360b62ea-56f2-41d7-acba-5e50b5b61905 admin admin] PATH_INFO: `/v3/roles` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:05:23.815698 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-360b62ea-56f2-41d7-acba-5e50b5b61905 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:05:23.817286 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-360b62ea-56f2-41d7-acba-5e50b5b61905 admin admin] RBAC: Authorization granted {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:05:23.828965 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 1041/2111] 10.222.0.84 () {58 vars in 1121 bytes} [Wed May 25 15:05:23 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 15:05:23.833130 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a07f16ce-f1d3-4de0-b89e-9551867200f0 admin admin] Authenticating user token {{(pid=101893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:05:23.843761 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a07f16ce-f1d3-4de0-b89e-9551867200f0 admin admin] Validating token access rules against request {{(pid=101893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:05:23.848870 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65e02c48-462a-4ef6-8330-cf76f2073411 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cec56f74b2fa4826a506dc7b919465be', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:05:23.849825 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e02c48-462a-4ef6-8330-cf76f2073411 admin admin] REQUEST_METHOD: `PUT` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:05:23.850136 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e02c48-462a-4ef6-8330-cf76f2073411 admin admin] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:05:23.850418 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e02c48-462a-4ef6-8330-cf76f2073411 admin admin] PATH_INFO: `/v3/projects/0a852148782c46e98577c2141bd25d6b/users/b198f42e7a1142bbac7aa6eaf51264a2/roles/ff664fa0db7e4262a5accde96c3df4c3` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:05:23.867908 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65e02c48-462a-4ef6-8330-cf76f2073411 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0a852148782c46e98577c2141bd25d6b, user_id=b198f42e7a1142bbac7aa6eaf51264a2, role_id=ff664fa0db7e4262a5accde96c3df4c3)` {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:05:23.870663 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65e02c48-462a-4ef6-8330-cf76f2073411 admin admin] RBAC: Authorization granted {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:05:23.962515 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 1071/2112] 10.222.0.84 () {60 vars in 1482 bytes} [Wed May 25 15:05:23 2022] PUT /identity/v3/projects/0a852148782c46e98577c2141bd25d6b/users/b198f42e7a1142bbac7aa6eaf51264a2/roles/ff664fa0db7e4262a5accde96c3df4c3 => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 15:05:23.973913 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a9252d-406a-41a6-981c-811613cf376d None None] REQUEST_METHOD: `POST` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:05:23.974516 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a9252d-406a-41a6-981c-811613cf376d None None] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:05:23.975048 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a9252d-406a-41a6-981c-811613cf376d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:05:24.004041 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.auth.core [None req-c9a9252d-406a-41a6-981c-811613cf376d None None] MFA Rules not processed for user `b198f42e7a1142bbac7aa6eaf51264a2`. Rule list: `[]` (Enabled: `True`). {{(pid=101892) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:05:24.005164 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.fernet_utils [None req-c9a9252d-406a-41a6-981c-811613cf376d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=101892) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:05:24.070039 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 1042/2113] 10.222.0.84 () {58 vars in 957 bytes} [Wed May 25 15:05:23 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 15:05:24.082178 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65e02c48-462a-4ef6-8330-cf76f2073411 admin admin] Authenticating user token {{(pid=101893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:05:24.084171 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.fernet_utils [None req-65e02c48-462a-4ef6-8330-cf76f2073411 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=101893) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:05:24.143169 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65e02c48-462a-4ef6-8330-cf76f2073411 admin admin] Validating token access rules against request {{(pid=101893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:05:24.146869 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c917f074-03c0-4241-bac0-c9f5f3254822 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e079f89a5e524ab6ad4183e4f690de07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a000829c658c4a7cab67f7b6353ba3fa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:05:24.147645 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c917f074-03c0-4241-bac0-c9f5f3254822 service cinder] REQUEST_METHOD: `GET` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:05:24.147929 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c917f074-03c0-4241-bac0-c9f5f3254822 service cinder] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:05:24.148313 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c917f074-03c0-4241-bac0-c9f5f3254822 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:05:24.156829 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c917f074-03c0-4241-bac0-c9f5f3254822 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:05:24.158393 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c917f074-03c0-4241-bac0-c9f5f3254822 service cinder] RBAC: Authorization granted {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:05:24.167449 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 1072/2114] 10.222.0.84 () {60 vars in 1365 bytes} [Wed May 25 15:05:24 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 15:05:24.192483 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a9252d-406a-41a6-981c-811613cf376d None None] Authenticating user token {{(pid=101892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:05:24.253269 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a9252d-406a-41a6-981c-811613cf376d None None] Validating token access rules against request {{(pid=101892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:05:24.257653 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f100d7f8-8379-4d2e-9c87-77bae70b42df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cec56f74b2fa4826a506dc7b919465be', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:05:24.258523 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f100d7f8-8379-4d2e-9c87-77bae70b42df admin admin] REQUEST_METHOD: `DELETE` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:05:24.258804 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f100d7f8-8379-4d2e-9c87-77bae70b42df admin admin] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:05:24.259078 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f100d7f8-8379-4d2e-9c87-77bae70b42df admin admin] PATH_INFO: `/v3/users/b198f42e7a1142bbac7aa6eaf51264a2` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:05:24.260275 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f100d7f8-8379-4d2e-9c87-77bae70b42df admin admin] RBAC: Authorizing `identity:delete_user(user_id=b198f42e7a1142bbac7aa6eaf51264a2)` {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:05:24.262173 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f100d7f8-8379-4d2e-9c87-77bae70b42df admin admin] RBAC: Authorization granted {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:05:24.515912 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.notifications [None req-f100d7f8-8379-4d2e-9c87-77bae70b42df admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b198f42e7a1142bbac7aa6eaf51264a2'} {{(pid=101892) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:05:24.523552 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.notifications [None req-f100d7f8-8379-4d2e-9c87-77bae70b42df admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b198f42e7a1142bbac7aa6eaf51264a2'} {{(pid=101892) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:05:24.536431 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.notifications [None req-f100d7f8-8379-4d2e-9c87-77bae70b42df admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b198f42e7a1142bbac7aa6eaf51264a2'} {{(pid=101892) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:05:24.537147 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.notifications [None req-f100d7f8-8379-4d2e-9c87-77bae70b42df admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b198f42e7a1142bbac7aa6eaf51264a2'} {{(pid=101892) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:05:24.540863 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG dbcounter [-] [101892] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=101892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:05:24.594364 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.notifications [None req-f100d7f8-8379-4d2e-9c87-77bae70b42df admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b198f42e7a1142bbac7aa6eaf51264a2'} {{(pid=101892) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:05:24.601793 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 1043/2115] 10.222.0.84 () {58 vars in 1223 bytes} [Wed May 25 15:05:24 2022] DELETE /identity/v3/users/b198f42e7a1142bbac7aa6eaf51264a2 => generated 0 bytes in 410 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 15:05:24.606355 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bfd306f-8578-4f60-8327-61376132294d None None] REQUEST_METHOD: `POST` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:05:24.606651 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bfd306f-8578-4f60-8327-61376132294d None None] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:05:24.606931 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bfd306f-8578-4f60-8327-61376132294d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:05:24.628026 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.auth.core [None req-7bfd306f-8578-4f60-8327-61376132294d None None] MFA Rules not processed for user `05d87e87798e429aa1c10b24391f915e`. Rule list: `[]` (Enabled: `True`). {{(pid=101893) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:05:24.629355 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.fernet_utils [None req-7bfd306f-8578-4f60-8327-61376132294d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=101893) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:05:24.642150 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG dbcounter [-] [101893] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=101893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:05:24.697681 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 1073/2116] 10.222.0.84 () {58 vars in 957 bytes} [Wed May 25 15:05:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 15:05:24.707969 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f100d7f8-8379-4d2e-9c87-77bae70b42df admin admin] Authenticating user token {{(pid=101892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:05:24.709622 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.fernet_utils [None req-f100d7f8-8379-4d2e-9c87-77bae70b42df admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=101892) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:05:24.775255 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f100d7f8-8379-4d2e-9c87-77bae70b42df admin admin] Validating token access rules against request {{(pid=101892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:05:24.778943 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f672f9a-af73-48b3-9b02-3e951cfec6c3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ce28b25b907473588ccb87dc4acc06a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a000829c658c4a7cab67f7b6353ba3fa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:05:24.779647 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f672f9a-af73-48b3-9b02-3e951cfec6c3 service neutron] REQUEST_METHOD: `GET` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:05:24.779938 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f672f9a-af73-48b3-9b02-3e951cfec6c3 service neutron] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:05:24.780219 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f672f9a-af73-48b3-9b02-3e951cfec6c3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:05:24.791252 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f672f9a-af73-48b3-9b02-3e951cfec6c3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:05:24.792800 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f672f9a-af73-48b3-9b02-3e951cfec6c3 service neutron] RBAC: Authorization granted {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:05:24.805016 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 1044/2117] 10.222.0.84 () {60 vars in 1365 bytes} [Wed May 25 15:05:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 15:05:25.040555 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bfd306f-8578-4f60-8327-61376132294d None None] Authenticating user token {{(pid=101893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:05:25.042436 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.fernet_utils [None req-7bfd306f-8578-4f60-8327-61376132294d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=101893) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:05:25.055032 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bfd306f-8578-4f60-8327-61376132294d None None] Validating token access rules against request {{(pid=101893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:05:25.060390 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a44d73-0578-4954-9cc5-9e9af1e30063 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cec56f74b2fa4826a506dc7b919465be', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:05:25.061284 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a44d73-0578-4954-9cc5-9e9af1e30063 admin admin] REQUEST_METHOD: `DELETE` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:05:25.061574 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a44d73-0578-4954-9cc5-9e9af1e30063 admin admin] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:05:25.061853 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a44d73-0578-4954-9cc5-9e9af1e30063 admin admin] PATH_INFO: `/v3/users/c9d93ef989b14e66bc0507c70cc624e2` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:05:25.063091 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66a44d73-0578-4954-9cc5-9e9af1e30063 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c9d93ef989b14e66bc0507c70cc624e2)` {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:05:25.065088 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66a44d73-0578-4954-9cc5-9e9af1e30063 admin admin] RBAC: Authorization granted {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:05:25.245167 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.notifications [None req-66a44d73-0578-4954-9cc5-9e9af1e30063 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c9d93ef989b14e66bc0507c70cc624e2'} {{(pid=101893) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:05:25.252799 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.notifications [None req-66a44d73-0578-4954-9cc5-9e9af1e30063 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c9d93ef989b14e66bc0507c70cc624e2'} {{(pid=101893) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:05:25.268832 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.notifications [None req-66a44d73-0578-4954-9cc5-9e9af1e30063 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c9d93ef989b14e66bc0507c70cc624e2'} {{(pid=101893) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:05:25.273291 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.notifications [None req-66a44d73-0578-4954-9cc5-9e9af1e30063 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c9d93ef989b14e66bc0507c70cc624e2'} {{(pid=101893) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:05:25.273291 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.notifications [None req-66a44d73-0578-4954-9cc5-9e9af1e30063 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c9d93ef989b14e66bc0507c70cc624e2'} {{(pid=101893) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:05:25.275251 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f672f9a-af73-48b3-9b02-3e951cfec6c3 service neutron] Authenticating user token {{(pid=101892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:05:25.276888 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.fernet_utils [None req-7f672f9a-af73-48b3-9b02-3e951cfec6c3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=101892) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:05:25.291242 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f672f9a-af73-48b3-9b02-3e951cfec6c3 service neutron] Validating token access rules against request {{(pid=101892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:05:25.296153 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc2dcdea-48f9-41c7-9459-e5f20f70093d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cec56f74b2fa4826a506dc7b919465be', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:05:25.297126 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2dcdea-48f9-41c7-9459-e5f20f70093d admin admin] REQUEST_METHOD: `DELETE` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:05:25.297476 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2dcdea-48f9-41c7-9459-e5f20f70093d admin admin] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:05:25.297841 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2dcdea-48f9-41c7-9459-e5f20f70093d admin admin] PATH_INFO: `/v3/projects/0a852148782c46e98577c2141bd25d6b` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:05:25.299101 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc2dcdea-48f9-41c7-9459-e5f20f70093d admin admin] RBAC: Authorizing `identity:delete_project(project_id=0a852148782c46e98577c2141bd25d6b)` {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:05:25.301192 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc2dcdea-48f9-41c7-9459-e5f20f70093d admin admin] RBAC: Authorization granted {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:05:25.341108 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 1074/2118] 10.222.0.84 () {58 vars in 1223 bytes} [Wed May 25 15:05:25 2022] DELETE /identity/v3/users/c9d93ef989b14e66bc0507c70cc624e2 => generated 0 bytes in 301 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 15:05:25.348176 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f7164c-0f2b-42ad-99a5-34a9848e1feb None None] REQUEST_METHOD: `POST` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:05:25.348475 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f7164c-0f2b-42ad-99a5-34a9848e1feb None None] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:05:25.348762 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f7164c-0f2b-42ad-99a5-34a9848e1feb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:05:25.369620 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.auth.core [None req-31f7164c-0f2b-42ad-99a5-34a9848e1feb None None] MFA Rules not processed for user `05d87e87798e429aa1c10b24391f915e`. Rule list: `[]` (Enabled: `True`). {{(pid=101893) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:05:25.371101 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.fernet_utils [None req-31f7164c-0f2b-42ad-99a5-34a9848e1feb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=101893) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:05:25.423644 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.notifications [None req-fc2dcdea-48f9-41c7-9459-e5f20f70093d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0a852148782c46e98577c2141bd25d6b', 'request_id': 'req-fc2dcdea-48f9-41c7-9459-e5f20f70093d'} {{(pid=101892) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:05:25.442894 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.notifications [None req-fc2dcdea-48f9-41c7-9459-e5f20f70093d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0a852148782c46e98577c2141bd25d6b', 'request_id': 'req-fc2dcdea-48f9-41c7-9459-e5f20f70093d'} {{(pid=101892) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:05:25.452885 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.notifications [None req-fc2dcdea-48f9-41c7-9459-e5f20f70093d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0a852148782c46e98577c2141bd25d6b', 'request_id': 'req-fc2dcdea-48f9-41c7-9459-e5f20f70093d'} {{(pid=101892) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:05:25.467764 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 1075/2119] 10.222.0.84 () {58 vars in 957 bytes} [Wed May 25 15:05:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 25 15:05:25.477467 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f7164c-0f2b-42ad-99a5-34a9848e1feb None None] Authenticating user token {{(pid=101893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:05:25.479021 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.fernet_utils [None req-31f7164c-0f2b-42ad-99a5-34a9848e1feb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=101893) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:05:25.516712 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG dbcounter [-] [101893] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=101893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:05:25.524943 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.notifications [None req-fc2dcdea-48f9-41c7-9459-e5f20f70093d admin admin] The token cache is being invalidate because project 0a852148782c46e98577c2141bd25d6b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=101892) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 25 15:05:25.525491 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.notifications [None req-fc2dcdea-48f9-41c7-9459-e5f20f70093d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=101892) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:05:25.526092 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.notifications [None req-fc2dcdea-48f9-41c7-9459-e5f20f70093d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=101892) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:05:25.531130 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 1045/2120] 10.222.0.84 () {58 vars in 1232 bytes} [Wed May 25 15:05:25 2022] DELETE /identity/v3/projects/0a852148782c46e98577c2141bd25d6b => generated 0 bytes in 253 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 15:05:25.533042 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-193f60af-771d-43b1-9dee-dc8730ddd2ca None None] REQUEST_METHOD: `POST` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:05:25.533400 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-193f60af-771d-43b1-9dee-dc8730ddd2ca None None] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:05:25.533689 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-193f60af-771d-43b1-9dee-dc8730ddd2ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:05:25.549272 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f7164c-0f2b-42ad-99a5-34a9848e1feb None None] Validating token access rules against request {{(pid=101893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:05:25.555825 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.auth.core [None req-193f60af-771d-43b1-9dee-dc8730ddd2ca None None] MFA Rules not processed for user `05d87e87798e429aa1c10b24391f915e`. Rule list: `[]` (Enabled: `True`). {{(pid=101892) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:05:25.557159 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.fernet_utils [None req-193f60af-771d-43b1-9dee-dc8730ddd2ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=101892) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:05:25.600995 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d40178a-3ecc-475e-8ee4-23dba347f71e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ce28b25b907473588ccb87dc4acc06a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a000829c658c4a7cab67f7b6353ba3fa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:05:25.601664 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d40178a-3ecc-475e-8ee4-23dba347f71e service neutron] REQUEST_METHOD: `GET` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:05:25.601947 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d40178a-3ecc-475e-8ee4-23dba347f71e service neutron] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:05:25.602223 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d40178a-3ecc-475e-8ee4-23dba347f71e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:05:25.605030 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.fernet_utils [None req-3d40178a-3ecc-475e-8ee4-23dba347f71e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=101893) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:05:25.628978 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 1046/2121] 10.222.0.84 () {58 vars in 957 bytes} [Wed May 25 15:05:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 15:05:25.636484 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea059dc-72f5-4f78-83d7-9c28cf0af7e5 None None] REQUEST_METHOD: `POST` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:05:25.636778 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea059dc-72f5-4f78-83d7-9c28cf0af7e5 None None] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:05:25.637063 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea059dc-72f5-4f78-83d7-9c28cf0af7e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:05:25.658865 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.auth.core [None req-bea059dc-72f5-4f78-83d7-9c28cf0af7e5 None None] MFA Rules not processed for user `05d87e87798e429aa1c10b24391f915e`. Rule list: `[]` (Enabled: `True`). {{(pid=101892) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:05:25.660245 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.fernet_utils [None req-bea059dc-72f5-4f78-83d7-9c28cf0af7e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=101892) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:05:25.673251 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 1047/2122] 10.222.0.84 () {58 vars in 957 bytes} [Wed May 25 15:05:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 25 15:05:25.677431 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bea059dc-72f5-4f78-83d7-9c28cf0af7e5 None None] Authenticating user token {{(pid=101892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:05:25.688229 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bea059dc-72f5-4f78-83d7-9c28cf0af7e5 None None] Validating token access rules against request {{(pid=101892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:05:25.694663 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85be2a6c-ef73-4886-bb66-1b79532a5433 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cec56f74b2fa4826a506dc7b919465be', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:05:25.695410 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85be2a6c-ef73-4886-bb66-1b79532a5433 admin admin] REQUEST_METHOD: `GET` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:05:25.695799 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85be2a6c-ef73-4886-bb66-1b79532a5433 admin admin] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:05:25.696148 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85be2a6c-ef73-4886-bb66-1b79532a5433 admin admin] PATH_INFO: `/v3/domains` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:05:25.697710 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85be2a6c-ef73-4886-bb66-1b79532a5433 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=101892) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 15:05:25.698098 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85be2a6c-ef73-4886-bb66-1b79532a5433 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:05:25.700081 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85be2a6c-ef73-4886-bb66-1b79532a5433 admin admin] RBAC: Authorization granted {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:05:25.702004 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d40178a-3ecc-475e-8ee4-23dba347f71e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:05:25.705173 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d40178a-3ecc-475e-8ee4-23dba347f71e service neutron] RBAC: Authorization granted {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:05:25.715508 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 1048/2123] 10.222.0.84 () {58 vars in 1152 bytes} [Wed May 25 15:05:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 15:05:25.720442 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85be2a6c-ef73-4886-bb66-1b79532a5433 admin admin] Authenticating user token {{(pid=101892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:05:25.722104 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 1076/2124] 10.222.0.84 () {60 vars in 1365 bytes} [Wed May 25 15:05:25 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 245 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 25 15:05:25.726547 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG dbcounter [-] [101892] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=101892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:05:25.736599 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85be2a6c-ef73-4886-bb66-1b79532a5433 admin admin] Validating token access rules against request {{(pid=101892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:05:25.743913 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed3b346a-f09c-4336-a058-79c4ab96c749 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cec56f74b2fa4826a506dc7b919465be', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:05:25.744999 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3b346a-f09c-4336-a058-79c4ab96c749 admin admin] REQUEST_METHOD: `POST` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:05:25.745662 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3b346a-f09c-4336-a058-79c4ab96c749 admin admin] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:05:25.746085 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3b346a-f09c-4336-a058-79c4ab96c749 admin admin] PATH_INFO: `/v3/projects` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:05:25.747317 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed3b346a-f09c-4336-a058-79c4ab96c749 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:05:25.752710 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed3b346a-f09c-4336-a058-79c4ab96c749 admin admin] RBAC: Authorization granted {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:05:25.869418 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 1049/2125] 10.222.0.84 () {60 vars in 1152 bytes} [Wed May 25 15:05:25 2022] POST /identity/v3/projects => generated 399 bytes in 146 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 15:05:25.870786 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d40178a-3ecc-475e-8ee4-23dba347f71e service neutron] Authenticating user token {{(pid=101893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:05:25.885911 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d40178a-3ecc-475e-8ee4-23dba347f71e service neutron] Validating token access rules against request {{(pid=101893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:05:25.944917 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04d35c78-86f7-4da0-b6a6-5d74530ccbe4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cec56f74b2fa4826a506dc7b919465be', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:05:25.945614 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d35c78-86f7-4da0-b6a6-5d74530ccbe4 admin admin] REQUEST_METHOD: `POST` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:05:25.945892 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d35c78-86f7-4da0-b6a6-5d74530ccbe4 admin admin] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:05:25.946165 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d35c78-86f7-4da0-b6a6-5d74530ccbe4 admin admin] PATH_INFO: `/v3/users` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:05:25.946840 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04d35c78-86f7-4da0-b6a6-5d74530ccbe4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:05:25.948793 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04d35c78-86f7-4da0-b6a6-5d74530ccbe4 admin admin] RBAC: Authorization granted {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:05:26.071644 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 1077/2126] 10.222.0.84 () {60 vars in 1143 bytes} [Wed May 25 15:05:25 2022] POST /identity/v3/users => generated 300 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 15:05:26.072690 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed3b346a-f09c-4336-a058-79c4ab96c749 admin admin] Authenticating user token {{(pid=101892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:05:26.084170 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed3b346a-f09c-4336-a058-79c4ab96c749 admin admin] Validating token access rules against request {{(pid=101892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:05:26.089124 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98850676-6623-4a44-aefc-db226e67dfbe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cec56f74b2fa4826a506dc7b919465be', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:05:26.089953 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98850676-6623-4a44-aefc-db226e67dfbe admin admin] REQUEST_METHOD: `GET` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:05:26.090341 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98850676-6623-4a44-aefc-db226e67dfbe admin admin] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:05:26.090717 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98850676-6623-4a44-aefc-db226e67dfbe admin admin] PATH_INFO: `/v3/roles` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:05:26.091633 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98850676-6623-4a44-aefc-db226e67dfbe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:05:26.093502 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98850676-6623-4a44-aefc-db226e67dfbe admin admin] RBAC: Authorization granted {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:05:26.109321 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 1050/2127] 10.222.0.84 () {58 vars in 1121 bytes} [Wed May 25 15:05:26 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 15:05:26.111236 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04d35c78-86f7-4da0-b6a6-5d74530ccbe4 admin admin] Authenticating user token {{(pid=101893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:05:26.127948 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04d35c78-86f7-4da0-b6a6-5d74530ccbe4 admin admin] Validating token access rules against request {{(pid=101893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:05:26.133087 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a6492ab-190e-4f2e-bb63-07a89b90cbd0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cec56f74b2fa4826a506dc7b919465be', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:05:26.134289 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6492ab-190e-4f2e-bb63-07a89b90cbd0 admin admin] REQUEST_METHOD: `GET` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:05:26.134289 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6492ab-190e-4f2e-bb63-07a89b90cbd0 admin admin] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:05:26.134289 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6492ab-190e-4f2e-bb63-07a89b90cbd0 admin admin] PATH_INFO: `/v3/roles` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:05:26.135142 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a6492ab-190e-4f2e-bb63-07a89b90cbd0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:05:26.136848 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a6492ab-190e-4f2e-bb63-07a89b90cbd0 admin admin] RBAC: Authorization granted {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:05:26.147910 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 1078/2128] 10.222.0.84 () {58 vars in 1121 bytes} [Wed May 25 15:05:26 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 15:05:26.152494 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98850676-6623-4a44-aefc-db226e67dfbe admin admin] Authenticating user token {{(pid=101892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:05:26.163758 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98850676-6623-4a44-aefc-db226e67dfbe admin admin] Validating token access rules against request {{(pid=101892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:05:26.169069 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21d9c7dc-d797-498b-92c1-46b5801fd04d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cec56f74b2fa4826a506dc7b919465be', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:05:26.170716 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d9c7dc-d797-498b-92c1-46b5801fd04d admin admin] REQUEST_METHOD: `PUT` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:05:26.171171 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d9c7dc-d797-498b-92c1-46b5801fd04d admin admin] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:05:26.171650 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d9c7dc-d797-498b-92c1-46b5801fd04d admin admin] PATH_INFO: `/v3/projects/a710341039934096b04c667766880b99/users/494ce4763c854726a5ae5ca866a87e78/roles/ff664fa0db7e4262a5accde96c3df4c3` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:05:26.188413 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21d9c7dc-d797-498b-92c1-46b5801fd04d admin admin] RBAC: Authorizing `identity:create_grant(project_id=a710341039934096b04c667766880b99, user_id=494ce4763c854726a5ae5ca866a87e78, role_id=ff664fa0db7e4262a5accde96c3df4c3)` {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:05:26.191189 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21d9c7dc-d797-498b-92c1-46b5801fd04d admin admin] RBAC: Authorization granted {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:05:26.258639 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a6492ab-190e-4f2e-bb63-07a89b90cbd0 admin admin] Authenticating user token {{(pid=101893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:05:26.260669 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 1051/2129] 10.222.0.84 () {60 vars in 1482 bytes} [Wed May 25 15:05:26 2022] PUT /identity/v3/projects/a710341039934096b04c667766880b99/users/494ce4763c854726a5ae5ca866a87e78/roles/ff664fa0db7e4262a5accde96c3df4c3 => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 15:05:26.261268 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.fernet_utils [None req-4a6492ab-190e-4f2e-bb63-07a89b90cbd0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=101893) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:05:26.271544 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f027748-0f2e-47bc-a79f-d7a5193b9ce7 None None] REQUEST_METHOD: `POST` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:05:26.272872 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f027748-0f2e-47bc-a79f-d7a5193b9ce7 None None] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:05:26.274966 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f027748-0f2e-47bc-a79f-d7a5193b9ce7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:05:26.275121 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a6492ab-190e-4f2e-bb63-07a89b90cbd0 admin admin] Validating token access rules against request {{(pid=101893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:05:26.288482 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG dbcounter [-] [101893] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=101893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:05:26.308542 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.auth.core [None req-6f027748-0f2e-47bc-a79f-d7a5193b9ce7 None None] MFA Rules not processed for user `494ce4763c854726a5ae5ca866a87e78`. Rule list: `[]` (Enabled: `True`). {{(pid=101892) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:05:26.309906 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.fernet_utils [None req-6f027748-0f2e-47bc-a79f-d7a5193b9ce7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=101892) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:05:26.342481 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-918d34fa-06cc-40c7-b1db-d96cd1c9a576 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cec56f74b2fa4826a506dc7b919465be', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:05:26.342481 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918d34fa-06cc-40c7-b1db-d96cd1c9a576 admin admin] REQUEST_METHOD: `DELETE` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:05:26.342481 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918d34fa-06cc-40c7-b1db-d96cd1c9a576 admin admin] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:05:26.342794 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918d34fa-06cc-40c7-b1db-d96cd1c9a576 admin admin] PATH_INFO: `/v3/projects/545dca6cad924ad89df6e7317b7b3252` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:05:26.344508 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-918d34fa-06cc-40c7-b1db-d96cd1c9a576 admin admin] RBAC: Authorizing `identity:delete_project(project_id=545dca6cad924ad89df6e7317b7b3252)` {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:05:26.346504 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-918d34fa-06cc-40c7-b1db-d96cd1c9a576 admin admin] RBAC: Authorization granted {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:05:26.380301 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 1052/2130] 10.222.0.84 () {58 vars in 957 bytes} [Wed May 25 15:05:26 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 15:05:26.392396 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f027748-0f2e-47bc-a79f-d7a5193b9ce7 None None] Authenticating user token {{(pid=101892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:05:26.393716 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.fernet_utils [None req-6f027748-0f2e-47bc-a79f-d7a5193b9ce7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=101892) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:05:26.450739 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f027748-0f2e-47bc-a79f-d7a5193b9ce7 None None] Validating token access rules against request {{(pid=101892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:05:26.455299 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-863feca8-a9ab-4a65-8ac7-eb0ca9e2323b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e079f89a5e524ab6ad4183e4f690de07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a000829c658c4a7cab67f7b6353ba3fa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:05:26.456095 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-863feca8-a9ab-4a65-8ac7-eb0ca9e2323b service cinder] REQUEST_METHOD: `GET` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:05:26.456410 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-863feca8-a9ab-4a65-8ac7-eb0ca9e2323b service cinder] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:05:26.456759 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-863feca8-a9ab-4a65-8ac7-eb0ca9e2323b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:05:26.467876 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-863feca8-a9ab-4a65-8ac7-eb0ca9e2323b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:05:26.470281 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-863feca8-a9ab-4a65-8ac7-eb0ca9e2323b service cinder] RBAC: Authorization granted {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:05:26.480562 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.notifications [None req-918d34fa-06cc-40c7-b1db-d96cd1c9a576 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '545dca6cad924ad89df6e7317b7b3252', 'request_id': 'req-918d34fa-06cc-40c7-b1db-d96cd1c9a576'} {{(pid=101893) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:05:26.480778 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 1053/2131] 10.222.0.84 () {60 vars in 1365 bytes} [Wed May 25 15:05:26 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 25 15:05:26.487298 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.notifications [None req-918d34fa-06cc-40c7-b1db-d96cd1c9a576 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '545dca6cad924ad89df6e7317b7b3252', 'request_id': 'req-918d34fa-06cc-40c7-b1db-d96cd1c9a576'} {{(pid=101893) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:05:26.493095 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.notifications [None req-918d34fa-06cc-40c7-b1db-d96cd1c9a576 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '545dca6cad924ad89df6e7317b7b3252', 'request_id': 'req-918d34fa-06cc-40c7-b1db-d96cd1c9a576'} {{(pid=101893) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:05:26.572154 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.notifications [None req-918d34fa-06cc-40c7-b1db-d96cd1c9a576 admin admin] The token cache is being invalidate because project 545dca6cad924ad89df6e7317b7b3252 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=101893) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 25 15:05:26.572305 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.notifications [None req-918d34fa-06cc-40c7-b1db-d96cd1c9a576 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=101893) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:05:26.573003 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.notifications [None req-918d34fa-06cc-40c7-b1db-d96cd1c9a576 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=101893) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:05:26.575698 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 1079/2132] 10.222.0.84 () {58 vars in 1232 bytes} [Wed May 25 15:05:26 2022] DELETE /identity/v3/projects/545dca6cad924ad89df6e7317b7b3252 => generated 0 bytes in 317 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 25 15:05:33.438929 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-863feca8-a9ab-4a65-8ac7-eb0ca9e2323b service cinder] Authenticating user token {{(pid=101892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:05:33.449353 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-863feca8-a9ab-4a65-8ac7-eb0ca9e2323b service cinder] Validating token access rules against request {{(pid=101892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:05:33.485109 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG dbcounter [-] [101892] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=101892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:05:33.512905 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95735788-b09c-4707-b6b7-006aae29c48b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cec56f74b2fa4826a506dc7b919465be', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:05:33.513792 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95735788-b09c-4707-b6b7-006aae29c48b admin admin] REQUEST_METHOD: `DELETE` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:05:33.514077 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95735788-b09c-4707-b6b7-006aae29c48b admin admin] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:05:33.514360 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95735788-b09c-4707-b6b7-006aae29c48b admin admin] PATH_INFO: `/v3/users/494ce4763c854726a5ae5ca866a87e78` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:05:33.515695 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95735788-b09c-4707-b6b7-006aae29c48b admin admin] RBAC: Authorizing `identity:delete_user(user_id=494ce4763c854726a5ae5ca866a87e78)` {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:05:33.521316 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95735788-b09c-4707-b6b7-006aae29c48b admin admin] RBAC: Authorization granted {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:05:33.703342 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.notifications [None req-95735788-b09c-4707-b6b7-006aae29c48b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '494ce4763c854726a5ae5ca866a87e78'} {{(pid=101892) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:05:33.710979 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.notifications [None req-95735788-b09c-4707-b6b7-006aae29c48b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '494ce4763c854726a5ae5ca866a87e78'} {{(pid=101892) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:05:33.722989 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.notifications [None req-95735788-b09c-4707-b6b7-006aae29c48b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '494ce4763c854726a5ae5ca866a87e78'} {{(pid=101892) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:05:33.723971 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.notifications [None req-95735788-b09c-4707-b6b7-006aae29c48b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '494ce4763c854726a5ae5ca866a87e78'} {{(pid=101892) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:05:33.782108 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.notifications [None req-95735788-b09c-4707-b6b7-006aae29c48b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '494ce4763c854726a5ae5ca866a87e78'} {{(pid=101892) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:05:33.788935 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 1054/2133] 10.222.0.84 () {58 vars in 1223 bytes} [Wed May 25 15:05:33 2022] DELETE /identity/v3/users/494ce4763c854726a5ae5ca866a87e78 => generated 0 bytes in 351 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 15:05:33.793616 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33cc0de-4c14-4fc3-a9a5-e972ec5ef877 None None] REQUEST_METHOD: `POST` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:05:33.800195 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33cc0de-4c14-4fc3-a9a5-e972ec5ef877 None None] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:05:33.800195 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33cc0de-4c14-4fc3-a9a5-e972ec5ef877 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:05:33.813583 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.auth.core [None req-b33cc0de-4c14-4fc3-a9a5-e972ec5ef877 None None] MFA Rules not processed for user `05d87e87798e429aa1c10b24391f915e`. Rule list: `[]` (Enabled: `True`). {{(pid=101893) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:05:33.817440 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.fernet_utils [None req-b33cc0de-4c14-4fc3-a9a5-e972ec5ef877 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=101893) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:05:33.873337 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 1080/2134] 10.222.0.84 () {58 vars in 957 bytes} [Wed May 25 15:05:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 15:05:33.883306 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95735788-b09c-4707-b6b7-006aae29c48b admin admin] Authenticating user token {{(pid=101892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:05:33.884767 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.fernet_utils [None req-95735788-b09c-4707-b6b7-006aae29c48b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=101892) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:05:33.943252 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95735788-b09c-4707-b6b7-006aae29c48b admin admin] Validating token access rules against request {{(pid=101892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:05:33.946876 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4f0c799-126d-42b7-b211-03b29f1fa313 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ce28b25b907473588ccb87dc4acc06a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a000829c658c4a7cab67f7b6353ba3fa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:05:33.947529 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f0c799-126d-42b7-b211-03b29f1fa313 service neutron] REQUEST_METHOD: `GET` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:05:33.947838 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f0c799-126d-42b7-b211-03b29f1fa313 service neutron] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:05:33.948115 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f0c799-126d-42b7-b211-03b29f1fa313 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:05:33.958190 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4f0c799-126d-42b7-b211-03b29f1fa313 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:05:33.959744 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4f0c799-126d-42b7-b211-03b29f1fa313 service neutron] RBAC: Authorization granted {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:05:33.970224 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 1055/2135] 10.222.0.84 () {60 vars in 1365 bytes} [Wed May 25 15:05:33 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 15:05:34.479161 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b33cc0de-4c14-4fc3-a9a5-e972ec5ef877 None None] Authenticating user token {{(pid=101893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:05:34.480761 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.fernet_utils [None req-b33cc0de-4c14-4fc3-a9a5-e972ec5ef877 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=101893) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:05:34.495161 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b33cc0de-4c14-4fc3-a9a5-e972ec5ef877 None None] Validating token access rules against request {{(pid=101893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:05:34.500488 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba768c2b-9e1d-415f-a90f-10a7a364bf33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cec56f74b2fa4826a506dc7b919465be', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:05:34.501403 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba768c2b-9e1d-415f-a90f-10a7a364bf33 admin admin] REQUEST_METHOD: `DELETE` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:05:34.501694 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba768c2b-9e1d-415f-a90f-10a7a364bf33 admin admin] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:05:34.502000 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba768c2b-9e1d-415f-a90f-10a7a364bf33 admin admin] PATH_INFO: `/v3/projects/a710341039934096b04c667766880b99` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:05:34.510407 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba768c2b-9e1d-415f-a90f-10a7a364bf33 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a710341039934096b04c667766880b99)` {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:05:34.512481 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba768c2b-9e1d-415f-a90f-10a7a364bf33 admin admin] RBAC: Authorization granted {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:05:34.593561 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG dbcounter [-] [101893] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=101893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:05:34.600343 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.notifications [None req-ba768c2b-9e1d-415f-a90f-10a7a364bf33 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a710341039934096b04c667766880b99', 'request_id': 'req-ba768c2b-9e1d-415f-a90f-10a7a364bf33'} {{(pid=101893) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:05:34.606540 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.notifications [None req-ba768c2b-9e1d-415f-a90f-10a7a364bf33 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a710341039934096b04c667766880b99', 'request_id': 'req-ba768c2b-9e1d-415f-a90f-10a7a364bf33'} {{(pid=101893) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:05:34.612212 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.notifications [None req-ba768c2b-9e1d-415f-a90f-10a7a364bf33 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a710341039934096b04c667766880b99', 'request_id': 'req-ba768c2b-9e1d-415f-a90f-10a7a364bf33'} {{(pid=101893) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:05:34.689309 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.notifications [None req-ba768c2b-9e1d-415f-a90f-10a7a364bf33 admin admin] The token cache is being invalidate because project a710341039934096b04c667766880b99 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=101893) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 25 15:05:34.689619 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.notifications [None req-ba768c2b-9e1d-415f-a90f-10a7a364bf33 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=101893) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:05:34.690224 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.notifications [None req-ba768c2b-9e1d-415f-a90f-10a7a364bf33 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=101893) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:05:34.691798 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 1081/2136] 10.222.0.84 () {58 vars in 1232 bytes} [Wed May 25 15:05:34 2022] DELETE /identity/v3/projects/a710341039934096b04c667766880b99 => generated 0 bytes in 213 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 15:05:34.697040 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b99520-59dd-4b29-b73e-08fa18f5248f None None] REQUEST_METHOD: `POST` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:05:34.702752 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b99520-59dd-4b29-b73e-08fa18f5248f None None] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:05:34.702752 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b99520-59dd-4b29-b73e-08fa18f5248f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:05:34.718274 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.auth.core [None req-37b99520-59dd-4b29-b73e-08fa18f5248f None None] MFA Rules not processed for user `05d87e87798e429aa1c10b24391f915e`. Rule list: `[]` (Enabled: `True`). {{(pid=101892) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:05:34.721114 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.fernet_utils [None req-37b99520-59dd-4b29-b73e-08fa18f5248f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=101892) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:05:34.776764 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG dbcounter [-] [101892] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=101892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:05:34.785964 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 1056/2137] 10.222.0.84 () {58 vars in 957 bytes} [Wed May 25 15:05:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 15:05:34.795247 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae04187-59c8-4400-9cd3-bffaa9cc01aa None None] REQUEST_METHOD: `POST` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:05:34.795771 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae04187-59c8-4400-9cd3-bffaa9cc01aa None None] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:05:34.795926 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae04187-59c8-4400-9cd3-bffaa9cc01aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:05:34.815944 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.auth.core [None req-eae04187-59c8-4400-9cd3-bffaa9cc01aa None None] MFA Rules not processed for user `05d87e87798e429aa1c10b24391f915e`. Rule list: `[]` (Enabled: `True`). {{(pid=101893) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:05:34.817541 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.fernet_utils [None req-eae04187-59c8-4400-9cd3-bffaa9cc01aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=101893) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:05:34.827931 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 1082/2138] 10.222.0.84 () {58 vars in 957 bytes} [Wed May 25 15:05:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 15:05:34.835587 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37b99520-59dd-4b29-b73e-08fa18f5248f None None] Authenticating user token {{(pid=101892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:05:34.851628 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37b99520-59dd-4b29-b73e-08fa18f5248f None None] Validating token access rules against request {{(pid=101892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:05:34.858480 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9636862b-aed6-43a3-a2c4-c9b2cfdcf5aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cec56f74b2fa4826a506dc7b919465be', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:05:34.859646 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9636862b-aed6-43a3-a2c4-c9b2cfdcf5aa admin admin] REQUEST_METHOD: `GET` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:05:34.860063 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9636862b-aed6-43a3-a2c4-c9b2cfdcf5aa admin admin] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:05:34.860583 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9636862b-aed6-43a3-a2c4-c9b2cfdcf5aa admin admin] PATH_INFO: `/v3/domains` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:05:34.861630 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9636862b-aed6-43a3-a2c4-c9b2cfdcf5aa admin admin] RBAC: Adding query filter params (name=Default) {{(pid=101892) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 15:05:34.862151 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9636862b-aed6-43a3-a2c4-c9b2cfdcf5aa admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:05:34.864798 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9636862b-aed6-43a3-a2c4-c9b2cfdcf5aa admin admin] RBAC: Authorization granted {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:05:34.878400 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 1057/2139] 10.222.0.84 () {58 vars in 1152 bytes} [Wed May 25 15:05:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 15:05:34.883024 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae04187-59c8-4400-9cd3-bffaa9cc01aa None None] Authenticating user token {{(pid=101893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:05:34.893287 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae04187-59c8-4400-9cd3-bffaa9cc01aa None None] Validating token access rules against request {{(pid=101893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:05:34.898147 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-affe2c77-114b-485c-b3da-ed1e8a8876d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cec56f74b2fa4826a506dc7b919465be', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:05:34.898831 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-affe2c77-114b-485c-b3da-ed1e8a8876d5 admin admin] REQUEST_METHOD: `POST` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:05:34.899117 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-affe2c77-114b-485c-b3da-ed1e8a8876d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:05:34.899401 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-affe2c77-114b-485c-b3da-ed1e8a8876d5 admin admin] PATH_INFO: `/v3/projects` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:05:34.900126 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-affe2c77-114b-485c-b3da-ed1e8a8876d5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:05:34.902043 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-affe2c77-114b-485c-b3da-ed1e8a8876d5 admin admin] RBAC: Authorization granted {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:05:34.983638 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 1083/2140] 10.222.0.84 () {60 vars in 1152 bytes} [Wed May 25 15:05:34 2022] POST /identity/v3/projects => generated 385 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 25 15:05:34.988007 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9636862b-aed6-43a3-a2c4-c9b2cfdcf5aa admin admin] Authenticating user token {{(pid=101892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:05:34.999252 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9636862b-aed6-43a3-a2c4-c9b2cfdcf5aa admin admin] Validating token access rules against request {{(pid=101892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:05:35.062439 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-279e0eb7-a77f-48e2-a3c4-cbcbba83c042 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cec56f74b2fa4826a506dc7b919465be', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:05:35.063457 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279e0eb7-a77f-48e2-a3c4-cbcbba83c042 admin admin] REQUEST_METHOD: `POST` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:05:35.063766 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279e0eb7-a77f-48e2-a3c4-cbcbba83c042 admin admin] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:05:35.064052 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279e0eb7-a77f-48e2-a3c4-cbcbba83c042 admin admin] PATH_INFO: `/v3/users` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:05:35.064841 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-279e0eb7-a77f-48e2-a3c4-cbcbba83c042 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:05:35.066931 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-279e0eb7-a77f-48e2-a3c4-cbcbba83c042 admin admin] RBAC: Authorization granted {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:05:35.175760 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 1058/2141] 10.222.0.84 () {60 vars in 1143 bytes} [Wed May 25 15:05:34 2022] POST /identity/v3/users => generated 293 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 15:05:35.179732 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-affe2c77-114b-485c-b3da-ed1e8a8876d5 admin admin] Authenticating user token {{(pid=101893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:05:35.202982 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-affe2c77-114b-485c-b3da-ed1e8a8876d5 admin admin] Validating token access rules against request {{(pid=101893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:05:35.208835 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e8ef2d-d3de-40c3-80fe-a35fb83f4861 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cec56f74b2fa4826a506dc7b919465be', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:05:35.209850 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e8ef2d-d3de-40c3-80fe-a35fb83f4861 admin admin] REQUEST_METHOD: `GET` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:05:35.209850 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e8ef2d-d3de-40c3-80fe-a35fb83f4861 admin admin] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:05:35.210072 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e8ef2d-d3de-40c3-80fe-a35fb83f4861 admin admin] PATH_INFO: `/v3/roles` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:05:35.210792 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4e8ef2d-d3de-40c3-80fe-a35fb83f4861 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:05:35.213087 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4e8ef2d-d3de-40c3-80fe-a35fb83f4861 admin admin] RBAC: Authorization granted {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:05:35.232659 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 1084/2142] 10.222.0.84 () {58 vars in 1121 bytes} [Wed May 25 15:05:35 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 15:05:35.237372 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-279e0eb7-a77f-48e2-a3c4-cbcbba83c042 admin admin] Authenticating user token {{(pid=101892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:05:35.247405 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-279e0eb7-a77f-48e2-a3c4-cbcbba83c042 admin admin] Validating token access rules against request {{(pid=101892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:05:35.252267 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-987996e5-74dd-40f8-92b2-de91e260b9bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cec56f74b2fa4826a506dc7b919465be', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:05:35.253001 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-987996e5-74dd-40f8-92b2-de91e260b9bb admin admin] REQUEST_METHOD: `GET` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:05:35.253722 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-987996e5-74dd-40f8-92b2-de91e260b9bb admin admin] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:05:35.253722 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-987996e5-74dd-40f8-92b2-de91e260b9bb admin admin] PATH_INFO: `/v3/roles` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:05:35.254401 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-987996e5-74dd-40f8-92b2-de91e260b9bb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:05:35.256082 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-987996e5-74dd-40f8-92b2-de91e260b9bb admin admin] RBAC: Authorization granted {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:05:35.270018 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 1059/2143] 10.222.0.84 () {58 vars in 1121 bytes} [Wed May 25 15:05:35 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 15:05:35.271198 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e8ef2d-d3de-40c3-80fe-a35fb83f4861 admin admin] Authenticating user token {{(pid=101893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:05:35.282263 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e8ef2d-d3de-40c3-80fe-a35fb83f4861 admin admin] Validating token access rules against request {{(pid=101893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:05:35.287129 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47120792-8aad-4d03-94e4-66dcd753e0ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cec56f74b2fa4826a506dc7b919465be', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:05:35.288050 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47120792-8aad-4d03-94e4-66dcd753e0ae admin admin] REQUEST_METHOD: `PUT` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:05:35.288337 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47120792-8aad-4d03-94e4-66dcd753e0ae admin admin] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:05:35.288614 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47120792-8aad-4d03-94e4-66dcd753e0ae admin admin] PATH_INFO: `/v3/projects/1ac01cecc50b4a89a9b706e864a8aa8d/users/3ca005a5f1d64e6c856e4e4fae8b757d/roles/ff664fa0db7e4262a5accde96c3df4c3` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:05:35.309238 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47120792-8aad-4d03-94e4-66dcd753e0ae admin admin] RBAC: Authorizing `identity:create_grant(project_id=1ac01cecc50b4a89a9b706e864a8aa8d, user_id=3ca005a5f1d64e6c856e4e4fae8b757d, role_id=ff664fa0db7e4262a5accde96c3df4c3)` {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:05:35.313088 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47120792-8aad-4d03-94e4-66dcd753e0ae admin admin] RBAC: Authorization granted {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:05:35.416504 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 1085/2144] 10.222.0.84 () {60 vars in 1482 bytes} [Wed May 25 15:05:35 2022] PUT /identity/v3/projects/1ac01cecc50b4a89a9b706e864a8aa8d/users/3ca005a5f1d64e6c856e4e4fae8b757d/roles/ff664fa0db7e4262a5accde96c3df4c3 => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 15:05:35.421805 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4c3892-1481-4e17-9778-aac88d56f6b3 None None] REQUEST_METHOD: `POST` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:05:35.422102 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4c3892-1481-4e17-9778-aac88d56f6b3 None None] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:05:35.422385 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4c3892-1481-4e17-9778-aac88d56f6b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:05:35.441927 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.auth.core [None req-1e4c3892-1481-4e17-9778-aac88d56f6b3 None None] MFA Rules not processed for user `05d87e87798e429aa1c10b24391f915e`. Rule list: `[]` (Enabled: `True`). {{(pid=101892) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:05:35.443552 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.fernet_utils [None req-1e4c3892-1481-4e17-9778-aac88d56f6b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=101892) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:05:35.509531 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 1060/2145] 10.222.0.84 () {58 vars in 957 bytes} [Wed May 25 15:05:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 15:05:35.519722 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47120792-8aad-4d03-94e4-66dcd753e0ae admin admin] Authenticating user token {{(pid=101893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:05:35.522052 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.fernet_utils [None req-47120792-8aad-4d03-94e4-66dcd753e0ae admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=101893) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:05:35.581373 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47120792-8aad-4d03-94e4-66dcd753e0ae admin admin] Validating token access rules against request {{(pid=101893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:05:35.585163 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81c2b1d7-7bd1-4b69-abc4-1d2040c16dfe service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ce28b25b907473588ccb87dc4acc06a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a000829c658c4a7cab67f7b6353ba3fa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:05:35.585813 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c2b1d7-7bd1-4b69-abc4-1d2040c16dfe service neutron] REQUEST_METHOD: `GET` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:05:35.586097 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c2b1d7-7bd1-4b69-abc4-1d2040c16dfe service neutron] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:05:35.586374 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c2b1d7-7bd1-4b69-abc4-1d2040c16dfe service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:05:35.596749 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81c2b1d7-7bd1-4b69-abc4-1d2040c16dfe service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:05:35.598172 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81c2b1d7-7bd1-4b69-abc4-1d2040c16dfe service neutron] RBAC: Authorization granted {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:05:35.607624 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 1086/2146] 10.222.0.84 () {60 vars in 1365 bytes} [Wed May 25 15:05:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 15:05:38.361442 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e4c3892-1481-4e17-9778-aac88d56f6b3 None None] Authenticating user token {{(pid=101892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:05:38.363008 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.fernet_utils [None req-1e4c3892-1481-4e17-9778-aac88d56f6b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=101892) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:05:38.457651 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e4c3892-1481-4e17-9778-aac88d56f6b3 None None] Validating token access rules against request {{(pid=101892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:05:38.464564 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0bb5a98-29b5-4bf0-8f08-600e9e735b00 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd18c4a1d92b94c0087a203db4fed22f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a000829c658c4a7cab67f7b6353ba3fa', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:05:38.464564 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0bb5a98-29b5-4bf0-8f08-600e9e735b00 service placement] REQUEST_METHOD: `GET` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:05:38.464564 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0bb5a98-29b5-4bf0-8f08-600e9e735b00 service placement] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:05:38.464564 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0bb5a98-29b5-4bf0-8f08-600e9e735b00 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:05:38.466517 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.fernet_utils [None req-d0bb5a98-29b5-4bf0-8f08-600e9e735b00 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=101892) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:05:38.477166 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG dbcounter [-] [101892] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=101892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:05:38.480609 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0bb5a98-29b5-4bf0-8f08-600e9e735b00 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:05:38.482225 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0bb5a98-29b5-4bf0-8f08-600e9e735b00 service placement] RBAC: Authorization granted {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:05:38.493244 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 1061/2147] 10.222.0.84 () {60 vars in 1365 bytes} [Wed May 25 15:05:38 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 15:05:41.091555 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e6939b-edc9-4f03-9d09-e812878fb955 None None] REQUEST_METHOD: `POST` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:05:41.092035 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e6939b-edc9-4f03-9d09-e812878fb955 None None] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:05:41.092131 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e6939b-edc9-4f03-9d09-e812878fb955 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:05:41.121812 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.auth.core [None req-76e6939b-edc9-4f03-9d09-e812878fb955 None None] MFA Rules not processed for user `3ca005a5f1d64e6c856e4e4fae8b757d`. Rule list: `[]` (Enabled: `True`). {{(pid=101893) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:05:41.123050 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.fernet_utils [None req-76e6939b-edc9-4f03-9d09-e812878fb955 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=101893) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:05:41.188265 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG dbcounter [-] [101893] Writing DB stats keystone:SELECT=93,keystone:DELETE=4,keystone:INSERT=3 {{(pid=101893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:05:41.193656 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 1087/2148] 10.222.0.84 () {58 vars in 957 bytes} [Wed May 25 15:05:41 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 15:05:41.198275 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0bb5a98-29b5-4bf0-8f08-600e9e735b00 service placement] Authenticating user token {{(pid=101892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:05:41.209476 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0bb5a98-29b5-4bf0-8f08-600e9e735b00 service placement] Validating token access rules against request {{(pid=101892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:05:41.214486 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07378cc7-57d3-4185-a9d0-6dd4444f4714 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cec56f74b2fa4826a506dc7b919465be', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:05:41.215271 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07378cc7-57d3-4185-a9d0-6dd4444f4714 admin admin] REQUEST_METHOD: `POST` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:05:41.215598 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07378cc7-57d3-4185-a9d0-6dd4444f4714 admin admin] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:05:41.215867 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07378cc7-57d3-4185-a9d0-6dd4444f4714 admin admin] PATH_INFO: `/v3/projects` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:05:41.216572 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07378cc7-57d3-4185-a9d0-6dd4444f4714 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:05:41.218493 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07378cc7-57d3-4185-a9d0-6dd4444f4714 admin admin] RBAC: Authorization granted {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:05:41.319457 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 1062/2149] 10.222.0.84 () {60 vars in 1152 bytes} [Wed May 25 15:05:41 2022] POST /identity/v3/projects => generated 385 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 15:05:41.323617 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76e6939b-edc9-4f03-9d09-e812878fb955 None None] Authenticating user token {{(pid=101893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:05:41.336041 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76e6939b-edc9-4f03-9d09-e812878fb955 None None] Validating token access rules against request {{(pid=101893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:05:41.400915 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-012c76ac-97bd-4b03-9d59-f8af7fbaae29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cec56f74b2fa4826a506dc7b919465be', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:05:41.401745 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012c76ac-97bd-4b03-9d59-f8af7fbaae29 admin admin] REQUEST_METHOD: `POST` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:05:41.402030 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012c76ac-97bd-4b03-9d59-f8af7fbaae29 admin admin] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:05:41.402309 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012c76ac-97bd-4b03-9d59-f8af7fbaae29 admin admin] PATH_INFO: `/v3/users` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:05:41.403038 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-012c76ac-97bd-4b03-9d59-f8af7fbaae29 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:05:41.405079 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-012c76ac-97bd-4b03-9d59-f8af7fbaae29 admin admin] RBAC: Authorization granted {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:05:41.489346 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 1088/2150] 10.222.0.84 () {60 vars in 1143 bytes} [Wed May 25 15:05:41 2022] POST /identity/v3/users => generated 299 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 15:05:41.493317 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07378cc7-57d3-4185-a9d0-6dd4444f4714 admin admin] Authenticating user token {{(pid=101892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:05:41.503534 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07378cc7-57d3-4185-a9d0-6dd4444f4714 admin admin] Validating token access rules against request {{(pid=101892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:05:41.508406 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f13de9d2-fabb-4d6a-9ae3-788717dc1173 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cec56f74b2fa4826a506dc7b919465be', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:05:41.509068 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13de9d2-fabb-4d6a-9ae3-788717dc1173 admin admin] REQUEST_METHOD: `GET` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:05:41.509386 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13de9d2-fabb-4d6a-9ae3-788717dc1173 admin admin] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:05:41.509670 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13de9d2-fabb-4d6a-9ae3-788717dc1173 admin admin] PATH_INFO: `/v3/roles` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:05:41.510452 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f13de9d2-fabb-4d6a-9ae3-788717dc1173 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:05:41.512172 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f13de9d2-fabb-4d6a-9ae3-788717dc1173 admin admin] RBAC: Authorization granted {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:05:41.524233 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 1063/2151] 10.222.0.84 () {58 vars in 1121 bytes} [Wed May 25 15:05:41 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 15:05:41.528570 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-012c76ac-97bd-4b03-9d59-f8af7fbaae29 admin admin] Authenticating user token {{(pid=101893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:05:41.541152 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-012c76ac-97bd-4b03-9d59-f8af7fbaae29 admin admin] Validating token access rules against request {{(pid=101893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:05:41.545901 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0512001-1f7f-44b4-8eb4-9b9fcc5a1ecc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cec56f74b2fa4826a506dc7b919465be', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:05:41.546816 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0512001-1f7f-44b4-8eb4-9b9fcc5a1ecc admin admin] REQUEST_METHOD: `PUT` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:05:41.547138 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0512001-1f7f-44b4-8eb4-9b9fcc5a1ecc admin admin] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:05:41.547412 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0512001-1f7f-44b4-8eb4-9b9fcc5a1ecc admin admin] PATH_INFO: `/v3/projects/ef20405e4c814352ac532d4ac88b5889/users/9501a2cd5474458690dcaf16cafcf763/roles/a3b78e7d547d4d2d998b4c99a4396bba` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:05:41.563292 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0512001-1f7f-44b4-8eb4-9b9fcc5a1ecc admin admin] RBAC: Authorizing `identity:create_grant(project_id=ef20405e4c814352ac532d4ac88b5889, user_id=9501a2cd5474458690dcaf16cafcf763, role_id=a3b78e7d547d4d2d998b4c99a4396bba)` {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:05:41.566056 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0512001-1f7f-44b4-8eb4-9b9fcc5a1ecc admin admin] RBAC: Authorization granted {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:05:41.631974 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 1089/2152] 10.222.0.84 () {60 vars in 1482 bytes} [Wed May 25 15:05:41 2022] PUT /identity/v3/projects/ef20405e4c814352ac532d4ac88b5889/users/9501a2cd5474458690dcaf16cafcf763/roles/a3b78e7d547d4d2d998b4c99a4396bba => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 25 15:05:41.635895 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f13de9d2-fabb-4d6a-9ae3-788717dc1173 admin admin] Authenticating user token {{(pid=101892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:05:41.646348 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f13de9d2-fabb-4d6a-9ae3-788717dc1173 admin admin] Validating token access rules against request {{(pid=101892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:05:41.706606 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41b7a970-70c9-4b66-9e8c-abac2eae6fdb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cec56f74b2fa4826a506dc7b919465be', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:05:41.707276 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b7a970-70c9-4b66-9e8c-abac2eae6fdb admin admin] REQUEST_METHOD: `GET` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:05:41.707584 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b7a970-70c9-4b66-9e8c-abac2eae6fdb admin admin] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:05:41.707876 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b7a970-70c9-4b66-9e8c-abac2eae6fdb admin admin] PATH_INFO: `/v3/roles` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:05:41.708597 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41b7a970-70c9-4b66-9e8c-abac2eae6fdb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:05:41.710192 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41b7a970-70c9-4b66-9e8c-abac2eae6fdb admin admin] RBAC: Authorization granted {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:05:41.719956 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 1064/2153] 10.222.0.84 () {58 vars in 1121 bytes} [Wed May 25 15:05:41 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 15:05:41.724235 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0512001-1f7f-44b4-8eb4-9b9fcc5a1ecc admin admin] Authenticating user token {{(pid=101893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:05:41.734356 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0512001-1f7f-44b4-8eb4-9b9fcc5a1ecc admin admin] Validating token access rules against request {{(pid=101893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:05:41.738935 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7eec0d4-ace0-40c2-a800-af1eb88d5335 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cec56f74b2fa4826a506dc7b919465be', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:05:41.739848 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7eec0d4-ace0-40c2-a800-af1eb88d5335 admin admin] REQUEST_METHOD: `PUT` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:05:41.740128 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7eec0d4-ace0-40c2-a800-af1eb88d5335 admin admin] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:05:41.740399 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7eec0d4-ace0-40c2-a800-af1eb88d5335 admin admin] PATH_INFO: `/v3/projects/ef20405e4c814352ac532d4ac88b5889/users/9501a2cd5474458690dcaf16cafcf763/roles/a3b78e7d547d4d2d998b4c99a4396bba` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:05:41.742336 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7eec0d4-ace0-40c2-a800-af1eb88d5335 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ef20405e4c814352ac532d4ac88b5889, user_id=9501a2cd5474458690dcaf16cafcf763, role_id=a3b78e7d547d4d2d998b4c99a4396bba)` {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:05:41.745039 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7eec0d4-ace0-40c2-a800-af1eb88d5335 admin admin] RBAC: Authorization granted {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:05:41.756083 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 1090/2154] 10.222.0.84 () {60 vars in 1482 bytes} [Wed May 25 15:05:41 2022] PUT /identity/v3/projects/ef20405e4c814352ac532d4ac88b5889/users/9501a2cd5474458690dcaf16cafcf763/roles/a3b78e7d547d4d2d998b4c99a4396bba => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 15:05:47.711488 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce0c26f-22e8-4ed9-bc4c-6b2fdfa18a8d None None] REQUEST_METHOD: `POST` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:05:47.711488 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce0c26f-22e8-4ed9-bc4c-6b2fdfa18a8d None None] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:05:47.711488 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce0c26f-22e8-4ed9-bc4c-6b2fdfa18a8d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:05:47.745014 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.auth.core [None req-3ce0c26f-22e8-4ed9-bc4c-6b2fdfa18a8d None None] MFA Rules not processed for user `9501a2cd5474458690dcaf16cafcf763`. Rule list: `[]` (Enabled: `True`). {{(pid=101892) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:05:47.746668 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.fernet_utils [None req-3ce0c26f-22e8-4ed9-bc4c-6b2fdfa18a8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=101892) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:05:47.834872 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 1065/2155] 10.222.0.84 () {58 vars in 957 bytes} [Wed May 25 15:05:47 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 15:05:47.848622 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7eec0d4-ace0-40c2-a800-af1eb88d5335 admin admin] Authenticating user token {{(pid=101893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:05:47.851120 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.fernet_utils [None req-b7eec0d4-ace0-40c2-a800-af1eb88d5335 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=101893) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:05:47.941538 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7eec0d4-ace0-40c2-a800-af1eb88d5335 admin admin] Validating token access rules against request {{(pid=101893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:05:47.945288 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2441405-220d-4333-b712-770a213adf68 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '971542599734491aa112b815fc4cc5c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a000829c658c4a7cab67f7b6353ba3fa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:05:47.945941 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2441405-220d-4333-b712-770a213adf68 service glance] REQUEST_METHOD: `GET` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:05:47.946338 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2441405-220d-4333-b712-770a213adf68 service glance] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:05:47.946618 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2441405-220d-4333-b712-770a213adf68 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:05:48.008153 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG dbcounter [-] [101893] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=101893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:05:48.021180 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2441405-220d-4333-b712-770a213adf68 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:05:48.022743 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2441405-220d-4333-b712-770a213adf68 service glance] RBAC: Authorization granted {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:05:48.032121 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 1091/2156] 10.222.0.84 () {60 vars in 1365 bytes} [Wed May 25 15:05:47 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 184 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 15:05:48.346926 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd6d301-87a8-47b6-bde1-0de788b909a2 None None] REQUEST_METHOD: `POST` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:05:48.346926 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd6d301-87a8-47b6-bde1-0de788b909a2 None None] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:05:48.347243 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd6d301-87a8-47b6-bde1-0de788b909a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:05:48.379440 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.auth.core [None req-afd6d301-87a8-47b6-bde1-0de788b909a2 None None] MFA Rules not processed for user `049a7ab3f95f460e908f79cc321176fd`. Rule list: `[]` (Enabled: `True`). {{(pid=101892) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:05:48.380704 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.fernet_utils [None req-afd6d301-87a8-47b6-bde1-0de788b909a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=101892) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:05:48.427550 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG dbcounter [-] [101892] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=101892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:05:48.442847 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 1066/2157] 10.222.0.84 () {58 vars in 1009 bytes} [Wed May 25 15:05:48 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 15:05:48.455940 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2441405-220d-4333-b712-770a213adf68 service glance] Authenticating user token {{(pid=101893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:05:48.457734 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.fernet_utils [None req-f2441405-220d-4333-b712-770a213adf68 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=101893) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:05:48.546271 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2441405-220d-4333-b712-770a213adf68 service glance] Validating token access rules against request {{(pid=101893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:05:48.551967 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c7ae97f-6289-4ffc-85e7-62c54df3f022 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e196f0897b98455c9e164271d7d0070a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a000829c658c4a7cab67f7b6353ba3fa', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:05:48.552628 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7ae97f-6289-4ffc-85e7-62c54df3f022 service swift] REQUEST_METHOD: `GET` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:05:48.552912 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7ae97f-6289-4ffc-85e7-62c54df3f022 service swift] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:05:48.553215 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7ae97f-6289-4ffc-85e7-62c54df3f022 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:05:48.563613 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c7ae97f-6289-4ffc-85e7-62c54df3f022 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:05:48.563613 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c7ae97f-6289-4ffc-85e7-62c54df3f022 service swift] RBAC: Authorization granted {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:05:48.572510 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 1092/2158] 10.222.0.84 () {60 vars in 1384 bytes} [Wed May 25 15:05:48 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) May 25 15:05:57.642903 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc3cc93-d5a7-4b16-8567-fe5b2205fdc3 None None] REQUEST_METHOD: `POST` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:05:57.643420 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc3cc93-d5a7-4b16-8567-fe5b2205fdc3 None None] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:05:57.643420 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc3cc93-d5a7-4b16-8567-fe5b2205fdc3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:05:57.662880 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.auth.core [None req-0fc3cc93-d5a7-4b16-8567-fe5b2205fdc3 None None] MFA Rules not processed for user `7fa42494cb4549f295d23e08cf93d330`. Rule list: `[]` (Enabled: `True`). {{(pid=101892) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:05:57.664192 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.fernet_utils [None req-0fc3cc93-d5a7-4b16-8567-fe5b2205fdc3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=101892) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:05:57.730221 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 1067/2159] 10.222.0.84 () {58 vars in 957 bytes} [Wed May 25 15:05:57 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 15:05:58.568890 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG dbcounter [-] [101893] Writing DB stats keystone:SELECT=39 {{(pid=101893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:06:00.215253 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f08eb4-c6de-4952-bda0-1c911fef8870 None None] REQUEST_METHOD: `POST` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:06:00.215897 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f08eb4-c6de-4952-bda0-1c911fef8870 None None] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:06:00.215897 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f08eb4-c6de-4952-bda0-1c911fef8870 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:06:00.233406 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.auth.core [None req-32f08eb4-c6de-4952-bda0-1c911fef8870 None None] MFA Rules not processed for user `3ca005a5f1d64e6c856e4e4fae8b757d`. Rule list: `[]` (Enabled: `True`). {{(pid=101893) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:06:00.234615 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.fernet_utils [None req-32f08eb4-c6de-4952-bda0-1c911fef8870 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=101893) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:06:00.241607 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 1093/2160] 10.222.0.84 () {58 vars in 957 bytes} [Wed May 25 15:06:00 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 15:06:07.722168 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG dbcounter [-] [101892] Writing DB stats keystone:SELECT=30 {{(pid=101892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:06:08.617036 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7122173b-4e7b-426d-9e2e-c3366b488fac None None] REQUEST_METHOD: `POST` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:06:08.617294 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7122173b-4e7b-426d-9e2e-c3366b488fac None None] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:06:08.617572 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7122173b-4e7b-426d-9e2e-c3366b488fac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:06:08.635875 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.auth.core [None req-7122173b-4e7b-426d-9e2e-c3366b488fac None None] MFA Rules not processed for user `049a7ab3f95f460e908f79cc321176fd`. Rule list: `[]` (Enabled: `True`). {{(pid=101892) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:06:08.636988 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.fernet_utils [None req-7122173b-4e7b-426d-9e2e-c3366b488fac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=101892) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:06:08.644119 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 1068/2161] 10.222.0.84 () {58 vars in 1009 bytes} [Wed May 25 15:06:08 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 15:06:08.655956 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32f08eb4-c6de-4952-bda0-1c911fef8870 None None] Authenticating user token {{(pid=101893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:06:08.668818 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32f08eb4-c6de-4952-bda0-1c911fef8870 None None] Validating token access rules against request {{(pid=101893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:06:08.674379 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1166251-29aa-4806-a9d2-be66788e0048 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e196f0897b98455c9e164271d7d0070a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a000829c658c4a7cab67f7b6353ba3fa', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:06:08.675048 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1166251-29aa-4806-a9d2-be66788e0048 service swift] REQUEST_METHOD: `GET` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:06:08.675376 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1166251-29aa-4806-a9d2-be66788e0048 service swift] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:06:08.675693 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1166251-29aa-4806-a9d2-be66788e0048 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:06:08.683706 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1166251-29aa-4806-a9d2-be66788e0048 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:06:08.685285 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1166251-29aa-4806-a9d2-be66788e0048 service swift] RBAC: Authorization granted {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:06:08.693470 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 1094/2162] 10.222.0.84 () {60 vars in 1384 bytes} [Wed May 25 15:06:08 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 25 15:06:18.630495 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG dbcounter [-] [101892] Writing DB stats keystone:SELECT=3 {{(pid=101892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:06:18.690200 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG dbcounter [-] [101893] Writing DB stats keystone:SELECT=9 {{(pid=101893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:06:26.062897 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-940e8eef-5320-4297-a9e6-a18c8c891977 None None] REQUEST_METHOD: `POST` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:06:26.063446 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-940e8eef-5320-4297-a9e6-a18c8c891977 None None] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:06:26.063446 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-940e8eef-5320-4297-a9e6-a18c8c891977 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:06:26.082397 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.auth.core [None req-940e8eef-5320-4297-a9e6-a18c8c891977 None None] MFA Rules not processed for user `05d87e87798e429aa1c10b24391f915e`. Rule list: `[]` (Enabled: `True`). {{(pid=101892) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:06:26.083655 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.fernet_utils [None req-940e8eef-5320-4297-a9e6-a18c8c891977 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=101892) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:06:26.143590 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 1069/2163] 10.222.0.96 () {58 vars in 1016 bytes} [Wed May 25 15:06:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 15:06:26.169423 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1166251-29aa-4806-a9d2-be66788e0048 service swift] Authenticating user token {{(pid=101893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:06:26.170952 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.fernet_utils [None req-b1166251-29aa-4806-a9d2-be66788e0048 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=101893) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:06:26.265514 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1166251-29aa-4806-a9d2-be66788e0048 service swift] Validating token access rules against request {{(pid=101893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:06:26.271524 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-907333c3-5c7d-4757-ac73-76b34735f3b8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2aeb182e6a5b43cfb0cc347ec847c848', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a000829c658c4a7cab67f7b6353ba3fa', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:06:26.272203 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907333c3-5c7d-4757-ac73-76b34735f3b8 service nova] REQUEST_METHOD: `GET` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:06:26.272490 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907333c3-5c7d-4757-ac73-76b34735f3b8 service nova] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:06:26.272769 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907333c3-5c7d-4757-ac73-76b34735f3b8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:06:26.280907 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-907333c3-5c7d-4757-ac73-76b34735f3b8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:06:26.282500 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-907333c3-5c7d-4757-ac73-76b34735f3b8 service nova] RBAC: Authorization granted {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:06:26.292191 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 1095/2164] 10.222.0.84 () {60 vars in 1365 bytes} [Wed May 25 15:06:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 15:06:36.136057 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG dbcounter [-] [101892] Writing DB stats keystone:SELECT=27 {{(pid=101892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:06:36.287813 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG dbcounter [-] [101893] Writing DB stats keystone:SELECT=43 {{(pid=101893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:06:36.553147 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebdd3372-1cdb-4b3e-99b0-9e13e4dac6e1 None None] REQUEST_METHOD: `POST` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:06:36.553458 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebdd3372-1cdb-4b3e-99b0-9e13e4dac6e1 None None] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:06:36.553745 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebdd3372-1cdb-4b3e-99b0-9e13e4dac6e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:06:36.574276 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.auth.core [None req-ebdd3372-1cdb-4b3e-99b0-9e13e4dac6e1 None None] MFA Rules not processed for user `05d87e87798e429aa1c10b24391f915e`. Rule list: `[]` (Enabled: `True`). {{(pid=101892) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:06:36.576455 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.fernet_utils [None req-ebdd3372-1cdb-4b3e-99b0-9e13e4dac6e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=101892) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:06:36.586066 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 1070/2165] 10.222.0.96 () {58 vars in 1016 bytes} [Wed May 25 15:06:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 15:06:36.606303 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-907333c3-5c7d-4757-ac73-76b34735f3b8 service nova] Authenticating user token {{(pid=101893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:06:36.617498 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-907333c3-5c7d-4757-ac73-76b34735f3b8 service nova] Validating token access rules against request {{(pid=101893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:06:36.623511 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eedf85df-cfda-4c4a-9528-3113e5bec6af service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2aeb182e6a5b43cfb0cc347ec847c848', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a000829c658c4a7cab67f7b6353ba3fa', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:06:36.624200 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eedf85df-cfda-4c4a-9528-3113e5bec6af service nova] REQUEST_METHOD: `GET` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:06:36.624531 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eedf85df-cfda-4c4a-9528-3113e5bec6af service nova] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:06:36.624803 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eedf85df-cfda-4c4a-9528-3113e5bec6af service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:06:36.633706 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eedf85df-cfda-4c4a-9528-3113e5bec6af service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:06:36.635303 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eedf85df-cfda-4c4a-9528-3113e5bec6af service nova] RBAC: Authorization granted {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:06:36.645472 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 1096/2166] 10.222.0.84 () {60 vars in 1365 bytes} [Wed May 25 15:06:36 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 15:06:41.620494 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216bd6bf-5cff-463c-b3f0-cf685e09615d None None] REQUEST_METHOD: `POST` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:06:41.625798 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216bd6bf-5cff-463c-b3f0-cf685e09615d None None] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:06:41.625798 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216bd6bf-5cff-463c-b3f0-cf685e09615d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:06:41.639273 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.auth.core [None req-216bd6bf-5cff-463c-b3f0-cf685e09615d None None] MFA Rules not processed for user `049a7ab3f95f460e908f79cc321176fd`. Rule list: `[]` (Enabled: `True`). {{(pid=101892) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:06:41.640518 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.fernet_utils [None req-216bd6bf-5cff-463c-b3f0-cf685e09615d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=101892) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:06:41.648620 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 1071/2167] 10.222.0.84 () {58 vars in 1009 bytes} [Wed May 25 15:06:41 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 15:06:41.664728 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eedf85df-cfda-4c4a-9528-3113e5bec6af service nova] Authenticating user token {{(pid=101893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:06:41.676978 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eedf85df-cfda-4c4a-9528-3113e5bec6af service nova] Validating token access rules against request {{(pid=101893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:06:41.682020 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4caf2d98-4d04-46bd-a23f-a3c3f033d8b3 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e196f0897b98455c9e164271d7d0070a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a000829c658c4a7cab67f7b6353ba3fa', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:06:41.682732 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4caf2d98-4d04-46bd-a23f-a3c3f033d8b3 service swift] REQUEST_METHOD: `GET` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:06:41.683186 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4caf2d98-4d04-46bd-a23f-a3c3f033d8b3 service swift] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:06:41.688507 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4caf2d98-4d04-46bd-a23f-a3c3f033d8b3 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:06:41.692817 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4caf2d98-4d04-46bd-a23f-a3c3f033d8b3 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:06:41.694409 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4caf2d98-4d04-46bd-a23f-a3c3f033d8b3 service swift] RBAC: Authorization granted {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:06:41.702962 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 1097/2168] 10.222.0.84 () {60 vars in 1384 bytes} [Wed May 25 15:06:41 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) May 25 15:06:44.231143 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ee309e-f75a-41fe-8d8b-ffd8434b12a4 None None] REQUEST_METHOD: `POST` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:06:44.232140 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ee309e-f75a-41fe-8d8b-ffd8434b12a4 None None] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:06:44.232629 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ee309e-f75a-41fe-8d8b-ffd8434b12a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:06:44.257631 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.auth.core [None req-37ee309e-f75a-41fe-8d8b-ffd8434b12a4 None None] MFA Rules not processed for user `05d87e87798e429aa1c10b24391f915e`. Rule list: `[]` (Enabled: `True`). {{(pid=101892) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:06:44.258952 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.fernet_utils [None req-37ee309e-f75a-41fe-8d8b-ffd8434b12a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=101892) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:06:44.271437 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 1072/2169] 10.222.0.96 () {58 vars in 1016 bytes} [Wed May 25 15:06:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 15:06:44.295995 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4caf2d98-4d04-46bd-a23f-a3c3f033d8b3 service swift] Authenticating user token {{(pid=101893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:06:44.299286 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.fernet_utils [None req-4caf2d98-4d04-46bd-a23f-a3c3f033d8b3 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=101893) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:06:44.315732 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4caf2d98-4d04-46bd-a23f-a3c3f033d8b3 service swift] Validating token access rules against request {{(pid=101893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:06:44.322021 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3837b24c-6b8e-4955-b61e-de32b71f4d8c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2aeb182e6a5b43cfb0cc347ec847c848', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a000829c658c4a7cab67f7b6353ba3fa', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:06:44.322700 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3837b24c-6b8e-4955-b61e-de32b71f4d8c service nova] REQUEST_METHOD: `GET` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:06:44.322985 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3837b24c-6b8e-4955-b61e-de32b71f4d8c service nova] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:06:44.323262 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3837b24c-6b8e-4955-b61e-de32b71f4d8c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:06:44.334500 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3837b24c-6b8e-4955-b61e-de32b71f4d8c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:06:44.336263 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3837b24c-6b8e-4955-b61e-de32b71f4d8c service nova] RBAC: Authorization granted {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:06:44.347936 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 1098/2170] 10.222.0.84 () {60 vars in 1365 bytes} [Wed May 25 15:06:44 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 15:06:49.194727 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb033f7-4ed0-47f3-b035-36e49dfdb508 None None] REQUEST_METHOD: `POST` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:06:49.196023 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb033f7-4ed0-47f3-b035-36e49dfdb508 None None] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:06:49.200437 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb033f7-4ed0-47f3-b035-36e49dfdb508 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:06:49.223391 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.auth.core [None req-ddb033f7-4ed0-47f3-b035-36e49dfdb508 None None] MFA Rules not processed for user `05d87e87798e429aa1c10b24391f915e`. Rule list: `[]` (Enabled: `True`). {{(pid=101892) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:06:49.223391 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.fernet_utils [None req-ddb033f7-4ed0-47f3-b035-36e49dfdb508 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=101892) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:06:49.233551 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 1073/2171] 10.222.0.96 () {58 vars in 1016 bytes} [Wed May 25 15:06:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 15:06:49.269523 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3837b24c-6b8e-4955-b61e-de32b71f4d8c service nova] Authenticating user token {{(pid=101893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:06:49.282824 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3837b24c-6b8e-4955-b61e-de32b71f4d8c service nova] Validating token access rules against request {{(pid=101893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:06:49.290045 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7de3bff-e35f-41ee-8dc6-4077599b868a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2aeb182e6a5b43cfb0cc347ec847c848', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a000829c658c4a7cab67f7b6353ba3fa', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:06:49.291001 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7de3bff-e35f-41ee-8dc6-4077599b868a service nova] REQUEST_METHOD: `GET` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:06:49.291528 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7de3bff-e35f-41ee-8dc6-4077599b868a service nova] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:06:49.292053 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7de3bff-e35f-41ee-8dc6-4077599b868a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:06:49.308483 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7de3bff-e35f-41ee-8dc6-4077599b868a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:06:49.313132 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7de3bff-e35f-41ee-8dc6-4077599b868a service nova] RBAC: Authorization granted {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:06:49.335690 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 1099/2172] 10.222.0.84 () {60 vars in 1365 bytes} [Wed May 25 15:06:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 67 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 15:06:49.798531 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddb033f7-4ed0-47f3-b035-36e49dfdb508 None None] Authenticating user token {{(pid=101892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:06:49.800040 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.fernet_utils [None req-ddb033f7-4ed0-47f3-b035-36e49dfdb508 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=101892) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:06:49.868816 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddb033f7-4ed0-47f3-b035-36e49dfdb508 None None] Validating token access rules against request {{(pid=101892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:06:49.872586 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-843b1fd5-5640-4559-85a7-23cd9fe778f0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ce28b25b907473588ccb87dc4acc06a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a000829c658c4a7cab67f7b6353ba3fa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:06:49.873628 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843b1fd5-5640-4559-85a7-23cd9fe778f0 service neutron] REQUEST_METHOD: `GET` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:06:49.874117 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843b1fd5-5640-4559-85a7-23cd9fe778f0 service neutron] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:06:49.874561 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843b1fd5-5640-4559-85a7-23cd9fe778f0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:06:49.885804 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-843b1fd5-5640-4559-85a7-23cd9fe778f0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:06:49.888148 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-843b1fd5-5640-4559-85a7-23cd9fe778f0 service neutron] RBAC: Authorization granted {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:06:49.915781 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 1074/2173] 10.222.0.84 () {60 vars in 1365 bytes} [Wed May 25 15:06:49 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 15:06:54.551063 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac81b51-81d9-4296-b518-dbe0850128cc None None] REQUEST_METHOD: `POST` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:06:54.551586 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac81b51-81d9-4296-b518-dbe0850128cc None None] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:06:54.551689 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac81b51-81d9-4296-b518-dbe0850128cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:06:54.572388 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.auth.core [None req-9ac81b51-81d9-4296-b518-dbe0850128cc None None] MFA Rules not processed for user `05d87e87798e429aa1c10b24391f915e`. Rule list: `[]` (Enabled: `True`). {{(pid=101893) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:06:54.573606 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.fernet_utils [None req-9ac81b51-81d9-4296-b518-dbe0850128cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=101893) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:06:54.582657 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 1100/2174] 10.222.0.96 () {58 vars in 1016 bytes} [Wed May 25 15:06:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 15:06:54.607590 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-843b1fd5-5640-4559-85a7-23cd9fe778f0 service neutron] Authenticating user token {{(pid=101892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:06:54.621240 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-843b1fd5-5640-4559-85a7-23cd9fe778f0 service neutron] Validating token access rules against request {{(pid=101892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:06:54.626835 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a9ac3d8-abc9-4e08-adf6-24da2b78f7cb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2aeb182e6a5b43cfb0cc347ec847c848', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a000829c658c4a7cab67f7b6353ba3fa', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:06:54.627652 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a9ac3d8-abc9-4e08-adf6-24da2b78f7cb service nova] REQUEST_METHOD: `GET` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:06:54.627947 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a9ac3d8-abc9-4e08-adf6-24da2b78f7cb service nova] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:06:54.628231 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a9ac3d8-abc9-4e08-adf6-24da2b78f7cb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:06:54.637283 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a9ac3d8-abc9-4e08-adf6-24da2b78f7cb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:06:54.639003 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a9ac3d8-abc9-4e08-adf6-24da2b78f7cb service nova] RBAC: Authorization granted {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:06:54.650521 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 1075/2175] 10.222.0.84 () {60 vars in 1365 bytes} [Wed May 25 15:06:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 15:07:00.881245 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b494820-fb23-4036-93ec-dff56ad3ab0c None None] REQUEST_METHOD: `POST` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:07:00.881780 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b494820-fb23-4036-93ec-dff56ad3ab0c None None] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:07:00.881780 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b494820-fb23-4036-93ec-dff56ad3ab0c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:07:00.901096 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.auth.core [None req-8b494820-fb23-4036-93ec-dff56ad3ab0c None None] MFA Rules not processed for user `05d87e87798e429aa1c10b24391f915e`. Rule list: `[]` (Enabled: `True`). {{(pid=101893) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:07:00.902313 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.fernet_utils [None req-8b494820-fb23-4036-93ec-dff56ad3ab0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=101893) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:07:00.911331 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 1101/2176] 10.222.0.96 () {58 vars in 1016 bytes} [Wed May 25 15:07:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 15:07:00.933232 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a98d7e-8a1e-472d-8542-da7eb64d41da None None] REQUEST_METHOD: `GET` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:07:00.933853 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a98d7e-8a1e-472d-8542-da7eb64d41da None None] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:07:00.934059 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a98d7e-8a1e-472d-8542-da7eb64d41da None None] PATH_INFO: `/` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:07:00.935505 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 1076/2177] 10.222.0.84 () {54 vars in 921 bytes} [Wed May 25 15:07:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 25 15:07:00.942008 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b494820-fb23-4036-93ec-dff56ad3ab0c None None] Authenticating user token {{(pid=101893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:07:00.947331 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51331161-409f-4603-86be-ae322e29f16a None None] REQUEST_METHOD: `POST` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:07:00.947903 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51331161-409f-4603-86be-ae322e29f16a None None] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:07:00.948621 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51331161-409f-4603-86be-ae322e29f16a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:07:00.958080 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b494820-fb23-4036-93ec-dff56ad3ab0c None None] Validating token access rules against request {{(pid=101893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:07:00.965810 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-225b9ffd-84c5-473f-b211-6f30cc77a45f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2aeb182e6a5b43cfb0cc347ec847c848', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a000829c658c4a7cab67f7b6353ba3fa', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:07:00.966909 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225b9ffd-84c5-473f-b211-6f30cc77a45f service nova] REQUEST_METHOD: `GET` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:07:00.967394 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225b9ffd-84c5-473f-b211-6f30cc77a45f service nova] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:07:00.967918 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225b9ffd-84c5-473f-b211-6f30cc77a45f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:07:00.979513 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-225b9ffd-84c5-473f-b211-6f30cc77a45f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:07:00.982461 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-225b9ffd-84c5-473f-b211-6f30cc77a45f service nova] RBAC: Authorization granted {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:07:00.993441 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 1102/2178] 10.222.0.84 () {60 vars in 1365 bytes} [Wed May 25 15:07:00 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 15:07:00.998687 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.auth.core [None req-51331161-409f-4603-86be-ae322e29f16a None None] MFA Rules not processed for user `2aeb182e6a5b43cfb0cc347ec847c848`. Rule list: `[]` (Enabled: `True`). {{(pid=101892) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:07:01.000073 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.fernet_utils [None req-51331161-409f-4603-86be-ae322e29f16a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=101892) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:07:01.011266 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 1077/2179] 10.222.0.84 () {58 vars in 1018 bytes} [Wed May 25 15:07:00 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 65 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 25 15:07:01.027227 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-225b9ffd-84c5-473f-b211-6f30cc77a45f service nova] Authenticating user token {{(pid=101893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:07:01.027227 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.fernet_utils [None req-225b9ffd-84c5-473f-b211-6f30cc77a45f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=101893) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:07:01.037962 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-225b9ffd-84c5-473f-b211-6f30cc77a45f service nova] Validating token access rules against request {{(pid=101893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:07:01.041603 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccde9a31-6052-4cc0-86c4-8c81773f130c service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '971542599734491aa112b815fc4cc5c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a000829c658c4a7cab67f7b6353ba3fa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:07:01.042241 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccde9a31-6052-4cc0-86c4-8c81773f130c service glance] REQUEST_METHOD: `GET` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:07:01.042521 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccde9a31-6052-4cc0-86c4-8c81773f130c service glance] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:07:01.042841 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccde9a31-6052-4cc0-86c4-8c81773f130c service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:07:01.053659 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccde9a31-6052-4cc0-86c4-8c81773f130c service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:07:01.055133 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccde9a31-6052-4cc0-86c4-8c81773f130c service glance] RBAC: Authorization granted {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:07:01.066589 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 1103/2180] 10.222.0.84 () {60 vars in 1365 bytes} [Wed May 25 15:07:01 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 15:07:01.294477 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a223539-bdd3-4717-a5d9-86bc5adac159 None None] REQUEST_METHOD: `GET` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:07:01.294689 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a223539-bdd3-4717-a5d9-86bc5adac159 None None] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:07:01.294950 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a223539-bdd3-4717-a5d9-86bc5adac159 None None] PATH_INFO: `/` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:07:01.296359 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 1078/2181] 10.222.0.84 () {54 vars in 921 bytes} [Wed May 25 15:07:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 15:07:01.301227 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318e1785-6976-47ef-af06-52d92156d164 None None] REQUEST_METHOD: `POST` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:07:01.301524 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318e1785-6976-47ef-af06-52d92156d164 None None] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:07:01.301844 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318e1785-6976-47ef-af06-52d92156d164 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:07:01.320438 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.auth.core [None req-318e1785-6976-47ef-af06-52d92156d164 None None] MFA Rules not processed for user `9ce28b25b907473588ccb87dc4acc06a`. Rule list: `[]` (Enabled: `True`). {{(pid=101893) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:07:01.325237 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.fernet_utils [None req-318e1785-6976-47ef-af06-52d92156d164 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=101893) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:07:01.328528 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 1104/2182] 10.222.0.84 () {58 vars in 1018 bytes} [Wed May 25 15:07:01 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 15:07:01.340858 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a223539-bdd3-4717-a5d9-86bc5adac159 None None] Authenticating user token {{(pid=101892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:07:01.352408 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a223539-bdd3-4717-a5d9-86bc5adac159 None None] Validating token access rules against request {{(pid=101892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:07:01.355966 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0359907d-2981-4935-bcf2-f8c5a0039f98 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ce28b25b907473588ccb87dc4acc06a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a000829c658c4a7cab67f7b6353ba3fa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:07:01.356603 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0359907d-2981-4935-bcf2-f8c5a0039f98 service neutron] REQUEST_METHOD: `GET` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:07:01.356885 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0359907d-2981-4935-bcf2-f8c5a0039f98 service neutron] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:07:01.357185 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0359907d-2981-4935-bcf2-f8c5a0039f98 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:07:01.364203 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0359907d-2981-4935-bcf2-f8c5a0039f98 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:07:01.365674 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0359907d-2981-4935-bcf2-f8c5a0039f98 service neutron] RBAC: Authorization granted {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:07:01.373742 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 1079/2183] 10.222.0.84 () {60 vars in 1365 bytes} [Wed May 25 15:07:01 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 33 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 15:07:01.459911 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a6d36d-a753-49bc-af9c-e67303b32d86 None None] REQUEST_METHOD: `GET` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:07:01.460202 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a6d36d-a753-49bc-af9c-e67303b32d86 None None] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:07:01.460480 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a6d36d-a753-49bc-af9c-e67303b32d86 None None] PATH_INFO: `/` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:07:01.461878 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 1105/2184] 10.222.0.84 () {54 vars in 921 bytes} [Wed May 25 15:07:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 15:07:01.467693 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e562ae8f-7a3c-49aa-8f0b-33e03e2cadcf None None] REQUEST_METHOD: `POST` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:07:01.467986 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e562ae8f-7a3c-49aa-8f0b-33e03e2cadcf None None] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:07:01.468267 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e562ae8f-7a3c-49aa-8f0b-33e03e2cadcf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:07:01.487034 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.auth.core [None req-e562ae8f-7a3c-49aa-8f0b-33e03e2cadcf None None] MFA Rules not processed for user `2aeb182e6a5b43cfb0cc347ec847c848`. Rule list: `[]` (Enabled: `True`). {{(pid=101892) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:07:01.488248 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.fernet_utils [None req-e562ae8f-7a3c-49aa-8f0b-33e03e2cadcf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=101892) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:07:01.497856 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 1080/2185] 10.222.0.84 () {58 vars in 1018 bytes} [Wed May 25 15:07:01 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 15:07:01.508722 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a6d36d-a753-49bc-af9c-e67303b32d86 None None] Authenticating user token {{(pid=101893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:07:01.519371 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a6d36d-a753-49bc-af9c-e67303b32d86 None None] Validating token access rules against request {{(pid=101893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:07:01.522870 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e2216eb-9ae9-4fc1-a3f1-4b30a4428e81 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ce28b25b907473588ccb87dc4acc06a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a000829c658c4a7cab67f7b6353ba3fa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:07:01.523492 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2216eb-9ae9-4fc1-a3f1-4b30a4428e81 service neutron] REQUEST_METHOD: `GET` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:07:01.523814 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2216eb-9ae9-4fc1-a3f1-4b30a4428e81 service neutron] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:07:01.524201 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2216eb-9ae9-4fc1-a3f1-4b30a4428e81 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:07:01.534824 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e2216eb-9ae9-4fc1-a3f1-4b30a4428e81 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:07:01.536278 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e2216eb-9ae9-4fc1-a3f1-4b30a4428e81 service neutron] RBAC: Authorization granted {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:07:01.546913 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 1106/2186] 10.222.0.84 () {60 vars in 1365 bytes} [Wed May 25 15:07:01 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 15:07:07.766063 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f6855e-a5e9-4616-83f0-719438b17beb None None] REQUEST_METHOD: `POST` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:07:07.766553 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f6855e-a5e9-4616-83f0-719438b17beb None None] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:07:07.766672 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f6855e-a5e9-4616-83f0-719438b17beb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:07:07.772881 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG dbcounter [-] [101892] Writing DB stats keystone:SELECT=63 {{(pid=101892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:07:07.787661 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.auth.core [None req-32f6855e-a5e9-4616-83f0-719438b17beb None None] MFA Rules not processed for user `049a7ab3f95f460e908f79cc321176fd`. Rule list: `[]` (Enabled: `True`). {{(pid=101892) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:07:07.789069 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.fernet_utils [None req-32f6855e-a5e9-4616-83f0-719438b17beb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=101892) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:07:07.796318 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 1081/2187] 10.222.0.84 () {58 vars in 1009 bytes} [Wed May 25 15:07:07 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 15:07:07.821460 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e2216eb-9ae9-4fc1-a3f1-4b30a4428e81 service neutron] Authenticating user token {{(pid=101893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:07:07.827503 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG dbcounter [-] [101893] Writing DB stats keystone:SELECT=52 {{(pid=101893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:07:07.833778 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e2216eb-9ae9-4fc1-a3f1-4b30a4428e81 service neutron] Validating token access rules against request {{(pid=101893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:07:07.838824 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87c6edb3-2f97-4d35-9aaa-511a9825dcc4 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e196f0897b98455c9e164271d7d0070a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a000829c658c4a7cab67f7b6353ba3fa', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:07:07.839474 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c6edb3-2f97-4d35-9aaa-511a9825dcc4 service swift] REQUEST_METHOD: `GET` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:07:07.839797 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c6edb3-2f97-4d35-9aaa-511a9825dcc4 service swift] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:07:07.840276 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c6edb3-2f97-4d35-9aaa-511a9825dcc4 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:07:07.849572 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87c6edb3-2f97-4d35-9aaa-511a9825dcc4 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:07:07.851184 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87c6edb3-2f97-4d35-9aaa-511a9825dcc4 service swift] RBAC: Authorization granted {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:07:07.859592 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 1107/2188] 10.222.0.84 () {60 vars in 1384 bytes} [Wed May 25 15:07:07 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 25 15:07:17.819132 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG dbcounter [-] [101892] Writing DB stats keystone:SELECT=2 {{(pid=101892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:07:17.865398 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG dbcounter [-] [101893] Writing DB stats keystone:SELECT=5 {{(pid=101893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:07:37.569605 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c53eb7-b614-4b5a-8dc4-7741bd8149d2 None None] REQUEST_METHOD: `POST` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:07:37.570470 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c53eb7-b614-4b5a-8dc4-7741bd8149d2 None None] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:07:37.570470 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c53eb7-b614-4b5a-8dc4-7741bd8149d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:07:37.589782 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.auth.core [None req-a9c53eb7-b614-4b5a-8dc4-7741bd8149d2 None None] MFA Rules not processed for user `81783c1018864448aaf753c7c2da4c84`. Rule list: `[]` (Enabled: `True`). {{(pid=101892) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:07:37.591010 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.fernet_utils [None req-a9c53eb7-b614-4b5a-8dc4-7741bd8149d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=101892) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:07:37.648747 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 1082/2189] 10.222.0.84 () {58 vars in 957 bytes} [Wed May 25 15:07:37 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 15:07:38.952501 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47292c9a-9f50-4902-825f-9e29c6cfe816 None None] REQUEST_METHOD: `POST` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:07:38.953028 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47292c9a-9f50-4902-825f-9e29c6cfe816 None None] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:07:38.953126 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47292c9a-9f50-4902-825f-9e29c6cfe816 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:07:38.980441 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.auth.core [None req-47292c9a-9f50-4902-825f-9e29c6cfe816 None None] MFA Rules not processed for user `049a7ab3f95f460e908f79cc321176fd`. Rule list: `[]` (Enabled: `True`). {{(pid=101893) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:07:38.981859 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.fernet_utils [None req-47292c9a-9f50-4902-825f-9e29c6cfe816 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=101893) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:07:38.990706 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 1108/2190] 10.222.0.84 () {58 vars in 967 bytes} [Wed May 25 15:07:38 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 15:07:39.005958 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c53eb7-b614-4b5a-8dc4-7741bd8149d2 None None] Authenticating user token {{(pid=101892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:07:39.018492 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c53eb7-b614-4b5a-8dc4-7741bd8149d2 None None] Validating token access rules against request {{(pid=101892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:07:39.024380 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b377dcc6-bb97-40fa-b496-66905f494cb6 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e196f0897b98455c9e164271d7d0070a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a000829c658c4a7cab67f7b6353ba3fa', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:07:39.025039 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b377dcc6-bb97-40fa-b496-66905f494cb6 service swift] REQUEST_METHOD: `GET` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:07:39.025334 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b377dcc6-bb97-40fa-b496-66905f494cb6 service swift] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:07:39.025614 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b377dcc6-bb97-40fa-b496-66905f494cb6 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:07:39.034431 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b377dcc6-bb97-40fa-b496-66905f494cb6 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:07:39.036173 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b377dcc6-bb97-40fa-b496-66905f494cb6 service swift] RBAC: Authorization granted {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:07:39.044987 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 1083/2191] 10.222.0.84 () {60 vars in 1384 bytes} [Wed May 25 15:07:39 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 25 15:07:41.455100 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5218d5bc-09f3-4776-9b10-2e815a7881f3 None None] REQUEST_METHOD: `POST` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:07:41.455642 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5218d5bc-09f3-4776-9b10-2e815a7881f3 None None] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:07:41.455800 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5218d5bc-09f3-4776-9b10-2e815a7881f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:07:41.476431 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.auth.core [None req-5218d5bc-09f3-4776-9b10-2e815a7881f3 None None] MFA Rules not processed for user `4f0e5c26a69548dfb71b4be306977caf`. Rule list: `[]` (Enabled: `True`). {{(pid=101893) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:07:41.476431 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.fernet_utils [None req-5218d5bc-09f3-4776-9b10-2e815a7881f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=101893) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:07:41.532101 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 1109/2192] 10.222.0.84 () {58 vars in 957 bytes} [Wed May 25 15:07:41 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 25 15:07:48.026982 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b377dcc6-bb97-40fa-b496-66905f494cb6 service swift] Authenticating user token {{(pid=101892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:07:48.036403 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b377dcc6-bb97-40fa-b496-66905f494cb6 service swift] Validating token access rules against request {{(pid=101892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:07:48.040691 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39fff128-5a37-47ca-a1f6-869fdc700ce3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ce28b25b907473588ccb87dc4acc06a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a000829c658c4a7cab67f7b6353ba3fa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:07:48.041327 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39fff128-5a37-47ca-a1f6-869fdc700ce3 service neutron] REQUEST_METHOD: `GET` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:07:48.041614 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39fff128-5a37-47ca-a1f6-869fdc700ce3 service neutron] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:07:48.041944 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39fff128-5a37-47ca-a1f6-869fdc700ce3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:07:48.043714 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.fernet_utils [None req-39fff128-5a37-47ca-a1f6-869fdc700ce3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=101892) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:07:48.057436 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39fff128-5a37-47ca-a1f6-869fdc700ce3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:07:48.059157 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39fff128-5a37-47ca-a1f6-869fdc700ce3 service neutron] RBAC: Authorization granted {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:07:48.070030 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 1084/2193] 10.222.0.84 () {60 vars in 1365 bytes} [Wed May 25 15:07:48 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 15:07:50.424928 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5218d5bc-09f3-4776-9b10-2e815a7881f3 None None] Authenticating user token {{(pid=101893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:07:50.434410 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5218d5bc-09f3-4776-9b10-2e815a7881f3 None None] Validating token access rules against request {{(pid=101893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:07:50.438003 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba39266d-f4aa-4cc0-860f-8a153af2c952 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ce28b25b907473588ccb87dc4acc06a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a000829c658c4a7cab67f7b6353ba3fa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:07:50.438642 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba39266d-f4aa-4cc0-860f-8a153af2c952 service neutron] REQUEST_METHOD: `GET` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:07:50.438928 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba39266d-f4aa-4cc0-860f-8a153af2c952 service neutron] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:07:50.439210 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba39266d-f4aa-4cc0-860f-8a153af2c952 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:07:50.441027 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.fernet_utils [None req-ba39266d-f4aa-4cc0-860f-8a153af2c952 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=101893) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:07:50.455277 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba39266d-f4aa-4cc0-860f-8a153af2c952 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:07:50.456586 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba39266d-f4aa-4cc0-860f-8a153af2c952 service neutron] RBAC: Authorization granted {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:07:50.468703 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 1110/2194] 10.222.0.84 () {60 vars in 1365 bytes} [Wed May 25 15:07:50 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 15:07:55.314904 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39fff128-5a37-47ca-a1f6-869fdc700ce3 service neutron] Authenticating user token {{(pid=101892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:07:55.327050 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39fff128-5a37-47ca-a1f6-869fdc700ce3 service neutron] Validating token access rules against request {{(pid=101892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:07:55.332591 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38acb06a-e20c-4357-a51b-13dc326ad8e6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2aeb182e6a5b43cfb0cc347ec847c848', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a000829c658c4a7cab67f7b6353ba3fa', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:07:55.333235 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38acb06a-e20c-4357-a51b-13dc326ad8e6 service nova] REQUEST_METHOD: `GET` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:07:55.333523 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38acb06a-e20c-4357-a51b-13dc326ad8e6 service nova] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:07:55.333805 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38acb06a-e20c-4357-a51b-13dc326ad8e6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:07:55.335789 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.fernet_utils [None req-38acb06a-e20c-4357-a51b-13dc326ad8e6 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=101892) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:07:55.394426 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38acb06a-e20c-4357-a51b-13dc326ad8e6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:07:55.396115 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38acb06a-e20c-4357-a51b-13dc326ad8e6 service nova] RBAC: Authorization granted {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:07:55.405790 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 1085/2195] 10.222.0.84 () {60 vars in 1365 bytes} [Wed May 25 15:07:55 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 15:08:00.463417 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG dbcounter [-] [101893] Writing DB stats keystone:SELECT=34 {{(pid=101893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:08:01.245197 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d9c650-88d1-47d4-876b-ef82e1187955 None None] REQUEST_METHOD: `POST` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:08:01.245488 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d9c650-88d1-47d4-876b-ef82e1187955 None None] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:08:01.245794 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d9c650-88d1-47d4-876b-ef82e1187955 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:08:01.264455 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.auth.core [None req-19d9c650-88d1-47d4-876b-ef82e1187955 None None] MFA Rules not processed for user `05d87e87798e429aa1c10b24391f915e`. Rule list: `[]` (Enabled: `True`). {{(pid=101893) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:08:01.265744 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.fernet_utils [None req-19d9c650-88d1-47d4-876b-ef82e1187955 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=101893) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:08:01.273935 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 1111/2196] 10.222.0.96 () {58 vars in 1016 bytes} [Wed May 25 15:08:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 15:08:01.293477 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38acb06a-e20c-4357-a51b-13dc326ad8e6 service nova] Authenticating user token {{(pid=101892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:08:01.299338 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG dbcounter [-] [101892] Writing DB stats keystone:SELECT=66 {{(pid=101892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:08:01.305732 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38acb06a-e20c-4357-a51b-13dc326ad8e6 service nova] Validating token access rules against request {{(pid=101892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:08:01.311159 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa84e2d9-d6af-4003-af40-99f29f0e2b3d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2aeb182e6a5b43cfb0cc347ec847c848', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a000829c658c4a7cab67f7b6353ba3fa', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:08:01.311838 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa84e2d9-d6af-4003-af40-99f29f0e2b3d service nova] REQUEST_METHOD: `GET` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:08:01.312120 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa84e2d9-d6af-4003-af40-99f29f0e2b3d service nova] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:08:01.316359 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa84e2d9-d6af-4003-af40-99f29f0e2b3d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:08:01.321956 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa84e2d9-d6af-4003-af40-99f29f0e2b3d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:08:01.323868 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa84e2d9-d6af-4003-af40-99f29f0e2b3d service nova] RBAC: Authorization granted {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:08:01.334341 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 1086/2197] 10.222.0.84 () {60 vars in 1365 bytes} [Wed May 25 15:08:01 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 15:08:05.766973 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da86909-83a2-4597-a8c6-0e47947d09d1 None None] REQUEST_METHOD: `POST` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:08:05.767524 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da86909-83a2-4597-a8c6-0e47947d09d1 None None] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:08:05.767524 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da86909-83a2-4597-a8c6-0e47947d09d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:08:05.786026 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.auth.core [None req-2da86909-83a2-4597-a8c6-0e47947d09d1 None None] MFA Rules not processed for user `05d87e87798e429aa1c10b24391f915e`. Rule list: `[]` (Enabled: `True`). {{(pid=101893) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:08:05.789798 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.fernet_utils [None req-2da86909-83a2-4597-a8c6-0e47947d09d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=101893) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:08:05.795467 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 1112/2198] 10.222.0.96 () {58 vars in 1016 bytes} [Wed May 25 15:08:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 15:08:05.825488 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa84e2d9-d6af-4003-af40-99f29f0e2b3d service nova] Authenticating user token {{(pid=101892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:08:05.836665 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa84e2d9-d6af-4003-af40-99f29f0e2b3d service nova] Validating token access rules against request {{(pid=101892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:08:05.842232 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7b06312-ea4b-4912-9107-4b7b80a451d8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2aeb182e6a5b43cfb0cc347ec847c848', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a000829c658c4a7cab67f7b6353ba3fa', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:08:05.842867 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b06312-ea4b-4912-9107-4b7b80a451d8 service nova] REQUEST_METHOD: `GET` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:08:05.843154 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b06312-ea4b-4912-9107-4b7b80a451d8 service nova] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:08:05.843433 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b06312-ea4b-4912-9107-4b7b80a451d8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:08:05.851491 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7b06312-ea4b-4912-9107-4b7b80a451d8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:08:05.853097 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7b06312-ea4b-4912-9107-4b7b80a451d8 service nova] RBAC: Authorization granted {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:08:05.862419 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 1087/2199] 10.222.0.84 () {60 vars in 1365 bytes} [Wed May 25 15:08:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 15:08:09.657308 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c46fa10-5466-4eea-904e-9bae4be36bcc None None] REQUEST_METHOD: `POST` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:08:09.657787 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c46fa10-5466-4eea-904e-9bae4be36bcc None None] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:08:09.657887 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c46fa10-5466-4eea-904e-9bae4be36bcc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:08:09.676398 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.auth.core [None req-8c46fa10-5466-4eea-904e-9bae4be36bcc None None] MFA Rules not processed for user `05d87e87798e429aa1c10b24391f915e`. Rule list: `[]` (Enabled: `True`). {{(pid=101893) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:08:09.677671 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.fernet_utils [None req-8c46fa10-5466-4eea-904e-9bae4be36bcc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=101893) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:08:09.686237 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 1113/2200] 10.222.0.96 () {58 vars in 1016 bytes} [Wed May 25 15:08:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 25 15:08:09.713095 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7b06312-ea4b-4912-9107-4b7b80a451d8 service nova] Authenticating user token {{(pid=101892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:08:09.724312 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7b06312-ea4b-4912-9107-4b7b80a451d8 service nova] Validating token access rules against request {{(pid=101892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:08:09.730357 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9434730e-ecc1-4e34-bb37-5deebc27a9e9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2aeb182e6a5b43cfb0cc347ec847c848', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a000829c658c4a7cab67f7b6353ba3fa', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:08:09.730984 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9434730e-ecc1-4e34-bb37-5deebc27a9e9 service nova] REQUEST_METHOD: `GET` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:08:09.731271 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9434730e-ecc1-4e34-bb37-5deebc27a9e9 service nova] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:08:09.731541 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9434730e-ecc1-4e34-bb37-5deebc27a9e9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:08:09.739751 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9434730e-ecc1-4e34-bb37-5deebc27a9e9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:08:09.741467 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9434730e-ecc1-4e34-bb37-5deebc27a9e9 service nova] RBAC: Authorization granted {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:08:09.751489 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 1088/2201] 10.222.0.84 () {60 vars in 1365 bytes} [Wed May 25 15:08:09 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 25 15:08:10.946853 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c46fa10-5466-4eea-904e-9bae4be36bcc None None] Authenticating user token {{(pid=101893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:08:10.957392 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c46fa10-5466-4eea-904e-9bae4be36bcc None None] Validating token access rules against request {{(pid=101893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:08:10.960896 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca7a7b35-10c9-491b-9f32-628f4a6c17bc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ce28b25b907473588ccb87dc4acc06a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a000829c658c4a7cab67f7b6353ba3fa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:08:10.961536 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7a7b35-10c9-491b-9f32-628f4a6c17bc service neutron] REQUEST_METHOD: `GET` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:08:10.961870 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7a7b35-10c9-491b-9f32-628f4a6c17bc service neutron] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:08:10.962155 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7a7b35-10c9-491b-9f32-628f4a6c17bc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:08:10.963929 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.fernet_utils [None req-ca7a7b35-10c9-491b-9f32-628f4a6c17bc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=101893) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:08:10.973805 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca7a7b35-10c9-491b-9f32-628f4a6c17bc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:08:10.975293 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca7a7b35-10c9-491b-9f32-628f4a6c17bc service neutron] RBAC: Authorization granted {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:08:10.983623 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 1114/2202] 10.222.0.84 () {60 vars in 1365 bytes} [Wed May 25 15:08:10 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 15:08:13.905635 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87b6a20-838c-4279-b1ec-5049a14a6522 None None] REQUEST_METHOD: `POST` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:08:13.906170 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87b6a20-838c-4279-b1ec-5049a14a6522 None None] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:08:13.906270 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87b6a20-838c-4279-b1ec-5049a14a6522 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:08:13.924621 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.auth.core [None req-f87b6a20-838c-4279-b1ec-5049a14a6522 None None] MFA Rules not processed for user `05d87e87798e429aa1c10b24391f915e`. Rule list: `[]` (Enabled: `True`). {{(pid=101892) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:08:13.925821 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.fernet_utils [None req-f87b6a20-838c-4279-b1ec-5049a14a6522 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=101892) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:08:13.934668 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 1089/2203] 10.222.0.96 () {58 vars in 1016 bytes} [Wed May 25 15:08:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 15:08:13.964606 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca7a7b35-10c9-491b-9f32-628f4a6c17bc service neutron] Authenticating user token {{(pid=101893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:08:13.977529 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca7a7b35-10c9-491b-9f32-628f4a6c17bc service neutron] Validating token access rules against request {{(pid=101893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:08:13.983011 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d89539e8-aa3f-4bee-9e7d-c45bab26871f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2aeb182e6a5b43cfb0cc347ec847c848', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a000829c658c4a7cab67f7b6353ba3fa', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:08:13.984700 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89539e8-aa3f-4bee-9e7d-c45bab26871f service nova] REQUEST_METHOD: `GET` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:08:13.984700 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89539e8-aa3f-4bee-9e7d-c45bab26871f service nova] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:08:13.984700 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89539e8-aa3f-4bee-9e7d-c45bab26871f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:08:13.992913 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d89539e8-aa3f-4bee-9e7d-c45bab26871f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:08:13.994521 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d89539e8-aa3f-4bee-9e7d-c45bab26871f service nova] RBAC: Authorization granted {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:08:14.004799 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 1115/2204] 10.222.0.84 () {60 vars in 1365 bytes} [Wed May 25 15:08:13 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 15:08:14.200429 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f87b6a20-838c-4279-b1ec-5049a14a6522 None None] Authenticating user token {{(pid=101892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:08:14.212753 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f87b6a20-838c-4279-b1ec-5049a14a6522 None None] Validating token access rules against request {{(pid=101892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:08:14.218484 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04e18eaf-73e1-47b0-82b2-bb8f01f1b97e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2aeb182e6a5b43cfb0cc347ec847c848', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a000829c658c4a7cab67f7b6353ba3fa', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:08:14.223361 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e18eaf-73e1-47b0-82b2-bb8f01f1b97e service nova] REQUEST_METHOD: `GET` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:08:14.223361 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e18eaf-73e1-47b0-82b2-bb8f01f1b97e service nova] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:08:14.223361 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e18eaf-73e1-47b0-82b2-bb8f01f1b97e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:08:14.223361 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.fernet_utils [None req-04e18eaf-73e1-47b0-82b2-bb8f01f1b97e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=101892) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:08:14.232887 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04e18eaf-73e1-47b0-82b2-bb8f01f1b97e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:08:14.234477 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04e18eaf-73e1-47b0-82b2-bb8f01f1b97e service nova] RBAC: Authorization granted {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:08:14.243472 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 1090/2205] 10.222.0.84 () {60 vars in 1365 bytes} [Wed May 25 15:08:14 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 15:08:19.141839 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d89539e8-aa3f-4bee-9e7d-c45bab26871f service nova] Authenticating user token {{(pid=101893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:08:19.152891 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d89539e8-aa3f-4bee-9e7d-c45bab26871f service nova] Validating token access rules against request {{(pid=101893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:08:19.161903 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed540dd-e1b2-4800-badd-876e577aff24 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2aeb182e6a5b43cfb0cc347ec847c848', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a000829c658c4a7cab67f7b6353ba3fa', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:08:19.161903 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed540dd-e1b2-4800-badd-876e577aff24 service nova] REQUEST_METHOD: `GET` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:08:19.161903 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed540dd-e1b2-4800-badd-876e577aff24 service nova] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:08:19.161903 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed540dd-e1b2-4800-badd-876e577aff24 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:08:19.162604 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.fernet_utils [None req-9ed540dd-e1b2-4800-badd-876e577aff24 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=101893) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:08:19.177017 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ed540dd-e1b2-4800-badd-876e577aff24 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:08:19.178630 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ed540dd-e1b2-4800-badd-876e577aff24 service nova] RBAC: Authorization granted {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:08:19.190941 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 1116/2206] 10.222.0.84 () {60 vars in 1365 bytes} [Wed May 25 15:08:19 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 15:08:19.208307 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9ce8b9-de83-4865-bf0b-cd378bec42e7 None None] REQUEST_METHOD: `POST` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:08:19.214075 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9ce8b9-de83-4865-bf0b-cd378bec42e7 None None] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:08:19.214075 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9ce8b9-de83-4865-bf0b-cd378bec42e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:08:19.236306 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.auth.core [None req-cd9ce8b9-de83-4865-bf0b-cd378bec42e7 None None] MFA Rules not processed for user `05d87e87798e429aa1c10b24391f915e`. Rule list: `[]` (Enabled: `True`). {{(pid=101892) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:08:19.246011 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.fernet_utils [None req-cd9ce8b9-de83-4865-bf0b-cd378bec42e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=101892) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:08:19.257507 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 1091/2207] 10.222.0.96 () {58 vars in 1016 bytes} [Wed May 25 15:08:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 25 15:08:19.277245 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed540dd-e1b2-4800-badd-876e577aff24 service nova] Authenticating user token {{(pid=101893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:08:19.290950 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed540dd-e1b2-4800-badd-876e577aff24 service nova] Validating token access rules against request {{(pid=101893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:08:19.297846 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fbec44c-e2ce-4615-b80a-ae06349312fe service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2aeb182e6a5b43cfb0cc347ec847c848', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a000829c658c4a7cab67f7b6353ba3fa', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:08:19.298502 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fbec44c-e2ce-4615-b80a-ae06349312fe service nova] REQUEST_METHOD: `GET` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:08:19.298789 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fbec44c-e2ce-4615-b80a-ae06349312fe service nova] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:08:19.299067 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fbec44c-e2ce-4615-b80a-ae06349312fe service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:08:19.308261 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fbec44c-e2ce-4615-b80a-ae06349312fe service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:08:19.310439 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fbec44c-e2ce-4615-b80a-ae06349312fe service nova] RBAC: Authorization granted {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:08:19.320457 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 1117/2208] 10.222.0.84 () {60 vars in 1365 bytes} [Wed May 25 15:08:19 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 15:08:29.228960 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG dbcounter [-] [101892] Writing DB stats keystone:SELECT=29 {{(pid=101892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:08:29.315926 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG dbcounter [-] [101893] Writing DB stats keystone:SELECT=33 {{(pid=101893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:08:33.477454 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd9ce8b9-de83-4865-bf0b-cd378bec42e7 None None] Authenticating user token {{(pid=101892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:08:33.493179 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd9ce8b9-de83-4865-bf0b-cd378bec42e7 None None] Validating token access rules against request {{(pid=101892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:08:33.500209 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8c3af09-1b83-45c6-96c7-268fb199645b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2aeb182e6a5b43cfb0cc347ec847c848', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a000829c658c4a7cab67f7b6353ba3fa', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:08:33.500878 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c3af09-1b83-45c6-96c7-268fb199645b service nova] REQUEST_METHOD: `GET` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:08:33.501166 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c3af09-1b83-45c6-96c7-268fb199645b service nova] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:08:33.501444 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c3af09-1b83-45c6-96c7-268fb199645b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:08:33.513379 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.fernet_utils [None req-f8c3af09-1b83-45c6-96c7-268fb199645b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=101892) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:08:33.529986 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8c3af09-1b83-45c6-96c7-268fb199645b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:08:33.531695 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8c3af09-1b83-45c6-96c7-268fb199645b service nova] RBAC: Authorization granted {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:08:33.552176 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 1092/2209] 10.222.0.84 () {60 vars in 1365 bytes} [Wed May 25 15:08:33 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 71 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 15:08:38.446325 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90a0d94-bd5d-435a-a78b-13015682b666 None None] REQUEST_METHOD: `POST` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:08:38.446827 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90a0d94-bd5d-435a-a78b-13015682b666 None None] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:08:38.446932 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90a0d94-bd5d-435a-a78b-13015682b666 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:08:38.465415 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.auth.core [None req-f90a0d94-bd5d-435a-a78b-13015682b666 None None] MFA Rules not processed for user `7fa42494cb4549f295d23e08cf93d330`. Rule list: `[]` (Enabled: `True`). {{(pid=101893) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:08:38.466551 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.fernet_utils [None req-f90a0d94-bd5d-435a-a78b-13015682b666 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=101893) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:08:38.474138 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 1118/2210] 10.222.0.84 () {58 vars in 957 bytes} [Wed May 25 15:08:38 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 15:08:38.796018 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8c3af09-1b83-45c6-96c7-268fb199645b service nova] Authenticating user token {{(pid=101892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:08:38.808243 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8c3af09-1b83-45c6-96c7-268fb199645b service nova] Validating token access rules against request {{(pid=101892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:08:38.813533 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c31f6bb0-3d15-44ec-a3ef-62ce38175b63 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ce28b25b907473588ccb87dc4acc06a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a000829c658c4a7cab67f7b6353ba3fa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:08:38.814468 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31f6bb0-3d15-44ec-a3ef-62ce38175b63 service neutron] REQUEST_METHOD: `GET` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:08:38.814788 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31f6bb0-3d15-44ec-a3ef-62ce38175b63 service neutron] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:08:38.815075 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31f6bb0-3d15-44ec-a3ef-62ce38175b63 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:08:38.816930 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.fernet_utils [None req-c31f6bb0-3d15-44ec-a3ef-62ce38175b63 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=101892) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:08:38.828380 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c31f6bb0-3d15-44ec-a3ef-62ce38175b63 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:08:38.830208 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c31f6bb0-3d15-44ec-a3ef-62ce38175b63 service neutron] RBAC: Authorization granted {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:08:38.840108 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 1093/2211] 10.222.0.84 () {60 vars in 1365 bytes} [Wed May 25 15:08:38 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 15:08:39.340150 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f90a0d94-bd5d-435a-a78b-13015682b666 None None] Authenticating user token {{(pid=101893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:08:39.341586 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.fernet_utils [None req-f90a0d94-bd5d-435a-a78b-13015682b666 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=101893) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:08:39.422585 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f90a0d94-bd5d-435a-a78b-13015682b666 None None] Validating token access rules against request {{(pid=101893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:08:39.428548 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2789ea3a-3d3f-4f9a-931d-7c8603ef36b5 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd18c4a1d92b94c0087a203db4fed22f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a000829c658c4a7cab67f7b6353ba3fa', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:08:39.429207 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2789ea3a-3d3f-4f9a-931d-7c8603ef36b5 service placement] REQUEST_METHOD: `GET` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:08:39.429588 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2789ea3a-3d3f-4f9a-931d-7c8603ef36b5 service placement] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:08:39.429791 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2789ea3a-3d3f-4f9a-931d-7c8603ef36b5 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:08:39.431687 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.fernet_utils [None req-2789ea3a-3d3f-4f9a-931d-7c8603ef36b5 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=101893) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:08:39.444030 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2789ea3a-3d3f-4f9a-931d-7c8603ef36b5 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:08:39.445629 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2789ea3a-3d3f-4f9a-931d-7c8603ef36b5 service placement] RBAC: Authorization granted {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:08:39.456659 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 1119/2212] 10.222.0.84 () {60 vars in 1365 bytes} [Wed May 25 15:08:39 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 15:08:48.836597 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG dbcounter [-] [101892] Writing DB stats keystone:SELECT=12 {{(pid=101892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:08:49.274152 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c31f6bb0-3d15-44ec-a3ef-62ce38175b63 service neutron] Authenticating user token {{(pid=101892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:08:49.287512 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c31f6bb0-3d15-44ec-a3ef-62ce38175b63 service neutron] Validating token access rules against request {{(pid=101892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:08:49.292983 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-095f18bc-a516-42f7-a2a3-9df3c66a5621 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2aeb182e6a5b43cfb0cc347ec847c848', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a000829c658c4a7cab67f7b6353ba3fa', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:08:49.293656 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-095f18bc-a516-42f7-a2a3-9df3c66a5621 service nova] REQUEST_METHOD: `GET` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:08:49.293905 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-095f18bc-a516-42f7-a2a3-9df3c66a5621 service nova] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:08:49.294177 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-095f18bc-a516-42f7-a2a3-9df3c66a5621 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:08:49.296119 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.fernet_utils [None req-095f18bc-a516-42f7-a2a3-9df3c66a5621 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=101892) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:08:49.354166 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-095f18bc-a516-42f7-a2a3-9df3c66a5621 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:08:49.355804 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-095f18bc-a516-42f7-a2a3-9df3c66a5621 service nova] RBAC: Authorization granted {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:08:49.366351 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 1094/2213] 10.222.0.84 () {60 vars in 1365 bytes} [Wed May 25 15:08:49 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 15:08:49.451789 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG dbcounter [-] [101893] Writing DB stats keystone:SELECT=35 {{(pid=101893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:08:49.492034 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2789ea3a-3d3f-4f9a-931d-7c8603ef36b5 service placement] Authenticating user token {{(pid=101893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:08:49.505538 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2789ea3a-3d3f-4f9a-931d-7c8603ef36b5 service placement] Validating token access rules against request {{(pid=101893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:08:49.511262 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cde7540-6349-48d9-9cf8-26d297a103fb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2aeb182e6a5b43cfb0cc347ec847c848', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a000829c658c4a7cab67f7b6353ba3fa', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:08:49.512022 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cde7540-6349-48d9-9cf8-26d297a103fb service nova] REQUEST_METHOD: `GET` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:08:49.512308 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cde7540-6349-48d9-9cf8-26d297a103fb service nova] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:08:49.512588 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cde7540-6349-48d9-9cf8-26d297a103fb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:08:49.514400 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.fernet_utils [None req-1cde7540-6349-48d9-9cf8-26d297a103fb service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=101893) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:08:49.527159 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cde7540-6349-48d9-9cf8-26d297a103fb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:08:49.531373 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cde7540-6349-48d9-9cf8-26d297a103fb service nova] RBAC: Authorization granted {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:08:49.543743 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 1120/2214] 10.222.0.84 () {60 vars in 1365 bytes} [Wed May 25 15:08:49 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 15:08:52.138439 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-095f18bc-a516-42f7-a2a3-9df3c66a5621 service nova] Authenticating user token {{(pid=101892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:08:52.140304 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.fernet_utils [None req-095f18bc-a516-42f7-a2a3-9df3c66a5621 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=101892) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:08:52.208259 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-095f18bc-a516-42f7-a2a3-9df3c66a5621 service nova] Validating token access rules against request {{(pid=101892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:08:52.212026 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-593a0729-5e04-40b5-bb2f-b6e69e6f5569 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e079f89a5e524ab6ad4183e4f690de07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a000829c658c4a7cab67f7b6353ba3fa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:08:52.212673 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593a0729-5e04-40b5-bb2f-b6e69e6f5569 service cinder] REQUEST_METHOD: `GET` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:08:52.212952 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593a0729-5e04-40b5-bb2f-b6e69e6f5569 service cinder] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:08:52.213229 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593a0729-5e04-40b5-bb2f-b6e69e6f5569 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:08:52.215050 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.fernet_utils [None req-593a0729-5e04-40b5-bb2f-b6e69e6f5569 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=101892) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:08:52.228940 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-593a0729-5e04-40b5-bb2f-b6e69e6f5569 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:08:52.228940 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-593a0729-5e04-40b5-bb2f-b6e69e6f5569 service cinder] RBAC: Authorization granted {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:08:52.237759 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 1095/2215] 10.222.0.84 () {60 vars in 1365 bytes} [Wed May 25 15:08:52 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 15:08:58.165408 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cde7540-6349-48d9-9cf8-26d297a103fb service nova] Authenticating user token {{(pid=101893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:08:58.167237 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.fernet_utils [None req-1cde7540-6349-48d9-9cf8-26d297a103fb service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=101893) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:08:58.181663 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cde7540-6349-48d9-9cf8-26d297a103fb service nova] Validating token access rules against request {{(pid=101893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:08:58.186327 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-455435a5-d3d9-4fbd-bba3-7eb7ea9675c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cec56f74b2fa4826a506dc7b919465be', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:08:58.187197 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455435a5-d3d9-4fbd-bba3-7eb7ea9675c7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:08:58.187486 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455435a5-d3d9-4fbd-bba3-7eb7ea9675c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:08:58.187804 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455435a5-d3d9-4fbd-bba3-7eb7ea9675c7 admin admin] PATH_INFO: `/v3/users/4f0e5c26a69548dfb71b4be306977caf` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:08:58.188993 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-455435a5-d3d9-4fbd-bba3-7eb7ea9675c7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4f0e5c26a69548dfb71b4be306977caf)` {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:08:58.190959 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-455435a5-d3d9-4fbd-bba3-7eb7ea9675c7 admin admin] RBAC: Authorization granted {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:08:58.361309 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.notifications [None req-455435a5-d3d9-4fbd-bba3-7eb7ea9675c7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4f0e5c26a69548dfb71b4be306977caf'} {{(pid=101893) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:08:58.368207 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.notifications [None req-455435a5-d3d9-4fbd-bba3-7eb7ea9675c7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4f0e5c26a69548dfb71b4be306977caf'} {{(pid=101893) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:08:58.379843 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.notifications [None req-455435a5-d3d9-4fbd-bba3-7eb7ea9675c7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4f0e5c26a69548dfb71b4be306977caf'} {{(pid=101893) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:08:58.380536 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.notifications [None req-455435a5-d3d9-4fbd-bba3-7eb7ea9675c7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4f0e5c26a69548dfb71b4be306977caf'} {{(pid=101893) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:08:58.381145 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.notifications [None req-455435a5-d3d9-4fbd-bba3-7eb7ea9675c7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4f0e5c26a69548dfb71b4be306977caf'} {{(pid=101893) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:08:58.454648 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 1121/2216] 10.222.0.84 () {58 vars in 1223 bytes} [Wed May 25 15:08:58 2022] DELETE /identity/v3/users/4f0e5c26a69548dfb71b4be306977caf => generated 0 bytes in 290 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 15:08:58.680518 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-593a0729-5e04-40b5-bb2f-b6e69e6f5569 service cinder] Authenticating user token {{(pid=101892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:08:58.691437 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-593a0729-5e04-40b5-bb2f-b6e69e6f5569 service cinder] Validating token access rules against request {{(pid=101892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:08:58.749726 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf7151d5-12c1-4cfb-aeb0-d6147d9e06b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cec56f74b2fa4826a506dc7b919465be', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:08:58.750563 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7151d5-12c1-4cfb-aeb0-d6147d9e06b1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:08:58.750852 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7151d5-12c1-4cfb-aeb0-d6147d9e06b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:08:58.751211 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7151d5-12c1-4cfb-aeb0-d6147d9e06b1 admin admin] PATH_INFO: `/v3/projects/f77740dd66aa4729a3a5003c84e4feeb` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:08:58.752353 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf7151d5-12c1-4cfb-aeb0-d6147d9e06b1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f77740dd66aa4729a3a5003c84e4feeb)` {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:08:58.754277 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf7151d5-12c1-4cfb-aeb0-d6147d9e06b1 admin admin] RBAC: Authorization granted {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:08:58.841727 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG dbcounter [-] [101892] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=101892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:08:58.845371 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.notifications [None req-cf7151d5-12c1-4cfb-aeb0-d6147d9e06b1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f77740dd66aa4729a3a5003c84e4feeb', 'request_id': 'req-cf7151d5-12c1-4cfb-aeb0-d6147d9e06b1'} {{(pid=101892) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:08:58.852148 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.notifications [None req-cf7151d5-12c1-4cfb-aeb0-d6147d9e06b1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f77740dd66aa4729a3a5003c84e4feeb', 'request_id': 'req-cf7151d5-12c1-4cfb-aeb0-d6147d9e06b1'} {{(pid=101892) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:08:58.859090 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.notifications [None req-cf7151d5-12c1-4cfb-aeb0-d6147d9e06b1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f77740dd66aa4729a3a5003c84e4feeb', 'request_id': 'req-cf7151d5-12c1-4cfb-aeb0-d6147d9e06b1'} {{(pid=101892) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:08:58.923207 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.notifications [None req-cf7151d5-12c1-4cfb-aeb0-d6147d9e06b1 admin admin] The token cache is being invalidate because project f77740dd66aa4729a3a5003c84e4feeb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=101892) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 25 15:08:58.923765 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.notifications [None req-cf7151d5-12c1-4cfb-aeb0-d6147d9e06b1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=101892) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:08:58.924882 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.notifications [None req-cf7151d5-12c1-4cfb-aeb0-d6147d9e06b1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=101892) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:08:58.926499 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 1096/2217] 10.222.0.84 () {58 vars in 1232 bytes} [Wed May 25 15:08:58 2022] DELETE /identity/v3/projects/f77740dd66aa4729a3a5003c84e4feeb => generated 0 bytes in 247 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 15:09:04.943469 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7ac8f4-6d87-4e81-9c94-e292a5235716 None None] REQUEST_METHOD: `POST` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:09:04.944027 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7ac8f4-6d87-4e81-9c94-e292a5235716 None None] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:09:04.944135 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7ac8f4-6d87-4e81-9c94-e292a5235716 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:09:04.962692 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.auth.core [None req-ed7ac8f4-6d87-4e81-9c94-e292a5235716 None None] MFA Rules not processed for user `43dce6e81a7c43819d2041bd6c2ad783`. Rule list: `[]` (Enabled: `True`). {{(pid=101893) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:09:04.967391 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.fernet_utils [None req-ed7ac8f4-6d87-4e81-9c94-e292a5235716 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=101893) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:09:05.020561 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 1122/2218] 10.222.0.84 () {58 vars in 957 bytes} [Wed May 25 15:09:04 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 15:09:05.333125 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf7151d5-12c1-4cfb-aeb0-d6147d9e06b1 admin admin] Authenticating user token {{(pid=101892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:09:05.334923 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.fernet_utils [None req-cf7151d5-12c1-4cfb-aeb0-d6147d9e06b1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=101892) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:09:05.392810 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf7151d5-12c1-4cfb-aeb0-d6147d9e06b1 admin admin] Validating token access rules against request {{(pid=101892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:09:05.396693 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38d52846-7c32-4136-bb97-b090dbfcdf5f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ce28b25b907473588ccb87dc4acc06a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a000829c658c4a7cab67f7b6353ba3fa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:09:05.397348 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d52846-7c32-4136-bb97-b090dbfcdf5f service neutron] REQUEST_METHOD: `GET` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:09:05.397667 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d52846-7c32-4136-bb97-b090dbfcdf5f service neutron] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:09:05.397978 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d52846-7c32-4136-bb97-b090dbfcdf5f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:09:05.399800 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.fernet_utils [None req-38d52846-7c32-4136-bb97-b090dbfcdf5f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=101892) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:09:05.409884 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38d52846-7c32-4136-bb97-b090dbfcdf5f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:09:05.411316 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38d52846-7c32-4136-bb97-b090dbfcdf5f service neutron] RBAC: Authorization granted {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:09:05.419652 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 1097/2219] 10.222.0.84 () {60 vars in 1365 bytes} [Wed May 25 15:09:05 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 15:09:15.013639 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG dbcounter [-] [101893] Writing DB stats keystone:SELECT=60,keystone:DELETE=10,keystone:INSERT=1 {{(pid=101893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:09:15.415897 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG dbcounter [-] [101892] Writing DB stats keystone:SELECT=34,keystone:DELETE=4,keystone:INSERT=1 {{(pid=101892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:09:19.608206 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed7ac8f4-6d87-4e81-9c94-e292a5235716 None None] Authenticating user token {{(pid=101893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:09:19.622594 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed7ac8f4-6d87-4e81-9c94-e292a5235716 None None] Validating token access rules against request {{(pid=101893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:09:19.626430 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee82739-bd4a-4fad-9079-86c41177f91a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ce28b25b907473588ccb87dc4acc06a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a000829c658c4a7cab67f7b6353ba3fa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:09:19.627098 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee82739-bd4a-4fad-9079-86c41177f91a service neutron] REQUEST_METHOD: `GET` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:09:19.627383 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee82739-bd4a-4fad-9079-86c41177f91a service neutron] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:09:19.627875 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee82739-bd4a-4fad-9079-86c41177f91a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:09:19.629700 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.fernet_utils [None req-eee82739-bd4a-4fad-9079-86c41177f91a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=101893) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:09:19.707406 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eee82739-bd4a-4fad-9079-86c41177f91a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:09:19.709796 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eee82739-bd4a-4fad-9079-86c41177f91a service neutron] RBAC: Authorization granted {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:09:19.724056 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 1123/2220] 10.222.0.84 () {60 vars in 1365 bytes} [Wed May 25 15:09:19 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 15:09:24.595707 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38d52846-7c32-4136-bb97-b090dbfcdf5f service neutron] Authenticating user token {{(pid=101892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:09:24.597282 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.fernet_utils [None req-38d52846-7c32-4136-bb97-b090dbfcdf5f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=101892) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:09:24.617240 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38d52846-7c32-4136-bb97-b090dbfcdf5f service neutron] Validating token access rules against request {{(pid=101892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:09:24.624051 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea35bf90-7795-44a4-9041-b3f69a0ca6e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cec56f74b2fa4826a506dc7b919465be', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:09:24.625106 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea35bf90-7795-44a4-9041-b3f69a0ca6e0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:09:24.625486 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea35bf90-7795-44a4-9041-b3f69a0ca6e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:09:24.626461 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea35bf90-7795-44a4-9041-b3f69a0ca6e0 admin admin] PATH_INFO: `/v3/users/81783c1018864448aaf753c7c2da4c84` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:09:24.628413 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea35bf90-7795-44a4-9041-b3f69a0ca6e0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=81783c1018864448aaf753c7c2da4c84)` {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:09:24.630646 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea35bf90-7795-44a4-9041-b3f69a0ca6e0 admin admin] RBAC: Authorization granted {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:09:24.847440 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.notifications [None req-ea35bf90-7795-44a4-9041-b3f69a0ca6e0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '81783c1018864448aaf753c7c2da4c84'} {{(pid=101892) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:09:24.858328 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.notifications [None req-ea35bf90-7795-44a4-9041-b3f69a0ca6e0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '81783c1018864448aaf753c7c2da4c84'} {{(pid=101892) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:09:24.872642 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.notifications [None req-ea35bf90-7795-44a4-9041-b3f69a0ca6e0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '81783c1018864448aaf753c7c2da4c84'} {{(pid=101892) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:09:24.873301 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.notifications [None req-ea35bf90-7795-44a4-9041-b3f69a0ca6e0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '81783c1018864448aaf753c7c2da4c84'} {{(pid=101892) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:09:24.940956 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.notifications [None req-ea35bf90-7795-44a4-9041-b3f69a0ca6e0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '81783c1018864448aaf753c7c2da4c84'} {{(pid=101892) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:09:24.953095 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 1098/2221] 10.222.0.84 () {58 vars in 1223 bytes} [Wed May 25 15:09:24 2022] DELETE /identity/v3/users/81783c1018864448aaf753c7c2da4c84 => generated 0 bytes in 355 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 15:09:25.201083 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee82739-bd4a-4fad-9079-86c41177f91a service neutron] Authenticating user token {{(pid=101893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:09:25.227833 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee82739-bd4a-4fad-9079-86c41177f91a service neutron] Validating token access rules against request {{(pid=101893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:09:25.336238 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e0bcbd3-0834-4ecc-afcc-9caad76d5b75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cec56f74b2fa4826a506dc7b919465be', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:09:25.337689 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0bcbd3-0834-4ecc-afcc-9caad76d5b75 admin admin] REQUEST_METHOD: `DELETE` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:09:25.338497 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0bcbd3-0834-4ecc-afcc-9caad76d5b75 admin admin] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:09:25.339220 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0bcbd3-0834-4ecc-afcc-9caad76d5b75 admin admin] PATH_INFO: `/v3/projects/970ef0402e6f466084887abf4f428e09` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:09:25.340724 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e0bcbd3-0834-4ecc-afcc-9caad76d5b75 admin admin] RBAC: Authorizing `identity:delete_project(project_id=970ef0402e6f466084887abf4f428e09)` {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:09:25.343169 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e0bcbd3-0834-4ecc-afcc-9caad76d5b75 admin admin] RBAC: Authorization granted {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:09:25.467214 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.notifications [None req-8e0bcbd3-0834-4ecc-afcc-9caad76d5b75 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '970ef0402e6f466084887abf4f428e09', 'request_id': 'req-8e0bcbd3-0834-4ecc-afcc-9caad76d5b75'} {{(pid=101893) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:09:25.477559 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.notifications [None req-8e0bcbd3-0834-4ecc-afcc-9caad76d5b75 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '970ef0402e6f466084887abf4f428e09', 'request_id': 'req-8e0bcbd3-0834-4ecc-afcc-9caad76d5b75'} {{(pid=101893) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:09:25.484634 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.notifications [None req-8e0bcbd3-0834-4ecc-afcc-9caad76d5b75 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '970ef0402e6f466084887abf4f428e09', 'request_id': 'req-8e0bcbd3-0834-4ecc-afcc-9caad76d5b75'} {{(pid=101893) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:09:25.566465 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.notifications [None req-8e0bcbd3-0834-4ecc-afcc-9caad76d5b75 admin admin] The token cache is being invalidate because project 970ef0402e6f466084887abf4f428e09 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=101893) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 25 15:09:25.567034 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.notifications [None req-8e0bcbd3-0834-4ecc-afcc-9caad76d5b75 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=101893) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:09:25.568518 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.notifications [None req-8e0bcbd3-0834-4ecc-afcc-9caad76d5b75 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=101893) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:09:25.571264 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 1124/2222] 10.222.0.84 () {58 vars in 1232 bytes} [Wed May 25 15:09:25 2022] DELETE /identity/v3/projects/970ef0402e6f466084887abf4f428e09 => generated 0 bytes in 371 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 15:09:25.576687 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cbdf53e-121d-47b7-a971-214290586a29 None None] REQUEST_METHOD: `POST` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:09:25.576978 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cbdf53e-121d-47b7-a971-214290586a29 None None] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:09:25.577260 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cbdf53e-121d-47b7-a971-214290586a29 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:09:25.598420 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.auth.core [None req-2cbdf53e-121d-47b7-a971-214290586a29 None None] MFA Rules not processed for user `05d87e87798e429aa1c10b24391f915e`. Rule list: `[]` (Enabled: `True`). {{(pid=101892) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:09:25.600745 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.fernet_utils [None req-2cbdf53e-121d-47b7-a971-214290586a29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=101892) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:09:25.680902 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 1099/2223] 10.222.0.84 () {58 vars in 957 bytes} [Wed May 25 15:09:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 25 15:09:25.688640 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72a8f19-ced3-4e22-8cd5-56d945d4a5c8 None None] REQUEST_METHOD: `POST` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:09:25.689034 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72a8f19-ced3-4e22-8cd5-56d945d4a5c8 None None] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:09:25.689412 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72a8f19-ced3-4e22-8cd5-56d945d4a5c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:09:25.711904 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.auth.core [None req-a72a8f19-ced3-4e22-8cd5-56d945d4a5c8 None None] MFA Rules not processed for user `05d87e87798e429aa1c10b24391f915e`. Rule list: `[]` (Enabled: `True`). {{(pid=101893) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:09:25.713237 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.fernet_utils [None req-a72a8f19-ced3-4e22-8cd5-56d945d4a5c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=101893) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:09:25.727345 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cbdf53e-121d-47b7-a971-214290586a29 None None] Authenticating user token {{(pid=101892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:09:25.728689 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 1125/2224] 10.222.0.84 () {58 vars in 957 bytes} [Wed May 25 15:09:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 25 15:09:25.737951 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cbdf53e-121d-47b7-a971-214290586a29 None None] Validating token access rules against request {{(pid=101892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:09:25.743979 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7269a82-356f-42d8-bc6b-ba939a58635a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cec56f74b2fa4826a506dc7b919465be', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:09:25.744659 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7269a82-356f-42d8-bc6b-ba939a58635a admin admin] REQUEST_METHOD: `GET` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:09:25.744934 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7269a82-356f-42d8-bc6b-ba939a58635a admin admin] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:09:25.745382 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7269a82-356f-42d8-bc6b-ba939a58635a admin admin] PATH_INFO: `/v3/domains` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:09:25.746272 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7269a82-356f-42d8-bc6b-ba939a58635a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=101892) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 15:09:25.746590 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7269a82-356f-42d8-bc6b-ba939a58635a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:09:25.748253 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7269a82-356f-42d8-bc6b-ba939a58635a admin admin] RBAC: Authorization granted {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:09:25.760637 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 1100/2225] 10.222.0.84 () {58 vars in 1152 bytes} [Wed May 25 15:09:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 15:09:25.766645 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a72a8f19-ced3-4e22-8cd5-56d945d4a5c8 None None] Authenticating user token {{(pid=101893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:09:25.776677 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a72a8f19-ced3-4e22-8cd5-56d945d4a5c8 None None] Validating token access rules against request {{(pid=101893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:09:25.781504 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5149e38e-aa5c-4e45-ac8b-57ea10954785 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cec56f74b2fa4826a506dc7b919465be', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:09:25.782251 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5149e38e-aa5c-4e45-ac8b-57ea10954785 admin admin] REQUEST_METHOD: `POST` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:09:25.782609 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5149e38e-aa5c-4e45-ac8b-57ea10954785 admin admin] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:09:25.782951 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5149e38e-aa5c-4e45-ac8b-57ea10954785 admin admin] PATH_INFO: `/v3/projects` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:09:25.783808 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5149e38e-aa5c-4e45-ac8b-57ea10954785 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:09:25.785797 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5149e38e-aa5c-4e45-ac8b-57ea10954785 admin admin] RBAC: Authorization granted {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:09:25.800474 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG dbcounter [-] [101893] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=101893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:09:25.902922 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 1126/2226] 10.222.0.84 () {60 vars in 1152 bytes} [Wed May 25 15:09:25 2022] POST /identity/v3/projects => generated 373 bytes in 137 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 15:09:25.907725 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7269a82-356f-42d8-bc6b-ba939a58635a admin admin] Authenticating user token {{(pid=101892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:09:25.920220 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7269a82-356f-42d8-bc6b-ba939a58635a admin admin] Validating token access rules against request {{(pid=101892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:09:25.982475 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b8421c-061f-4565-b772-72f1a4b64589 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cec56f74b2fa4826a506dc7b919465be', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:09:25.983157 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b8421c-061f-4565-b772-72f1a4b64589 admin admin] REQUEST_METHOD: `POST` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:09:25.984069 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b8421c-061f-4565-b772-72f1a4b64589 admin admin] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:09:25.984069 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b8421c-061f-4565-b772-72f1a4b64589 admin admin] PATH_INFO: `/v3/users` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:09:25.984488 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4b8421c-061f-4565-b772-72f1a4b64589 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:09:25.986468 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4b8421c-061f-4565-b772-72f1a4b64589 admin admin] RBAC: Authorization granted {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:09:25.998184 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG dbcounter [-] [101892] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=101892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:09:26.078518 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 1101/2227] 10.222.0.84 () {60 vars in 1143 bytes} [Wed May 25 15:09:25 2022] POST /identity/v3/users => generated 287 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 25 15:09:26.082710 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5149e38e-aa5c-4e45-ac8b-57ea10954785 admin admin] Authenticating user token {{(pid=101893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:09:26.093698 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5149e38e-aa5c-4e45-ac8b-57ea10954785 admin admin] Validating token access rules against request {{(pid=101893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:09:26.098337 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22b0bb81-9e54-4da5-98ea-794061fd3653 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cec56f74b2fa4826a506dc7b919465be', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:09:26.099009 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b0bb81-9e54-4da5-98ea-794061fd3653 admin admin] REQUEST_METHOD: `GET` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:09:26.099294 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b0bb81-9e54-4da5-98ea-794061fd3653 admin admin] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:09:26.099618 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b0bb81-9e54-4da5-98ea-794061fd3653 admin admin] PATH_INFO: `/v3/roles` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:09:26.100334 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22b0bb81-9e54-4da5-98ea-794061fd3653 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:09:26.101956 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22b0bb81-9e54-4da5-98ea-794061fd3653 admin admin] RBAC: Authorization granted {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:09:26.112606 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 1127/2228] 10.222.0.84 () {58 vars in 1121 bytes} [Wed May 25 15:09:26 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 25 15:09:26.116581 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b8421c-061f-4565-b772-72f1a4b64589 admin admin] Authenticating user token {{(pid=101892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:09:26.126811 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b8421c-061f-4565-b772-72f1a4b64589 admin admin] Validating token access rules against request {{(pid=101892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:09:26.132470 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5200795a-fda2-4486-bde4-e34744845ca0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cec56f74b2fa4826a506dc7b919465be', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:09:26.135257 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5200795a-fda2-4486-bde4-e34744845ca0 admin admin] REQUEST_METHOD: `GET` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:09:26.135257 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5200795a-fda2-4486-bde4-e34744845ca0 admin admin] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:09:26.135257 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5200795a-fda2-4486-bde4-e34744845ca0 admin admin] PATH_INFO: `/v3/roles` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:09:26.135257 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5200795a-fda2-4486-bde4-e34744845ca0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:09:26.136069 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5200795a-fda2-4486-bde4-e34744845ca0 admin admin] RBAC: Authorization granted {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:09:26.147062 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 1102/2229] 10.222.0.84 () {58 vars in 1121 bytes} [Wed May 25 15:09:26 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 15:09:26.151706 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22b0bb81-9e54-4da5-98ea-794061fd3653 admin admin] Authenticating user token {{(pid=101893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:09:26.164956 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22b0bb81-9e54-4da5-98ea-794061fd3653 admin admin] Validating token access rules against request {{(pid=101893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:09:26.169785 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d08da462-f6c6-4a1d-9f95-c0378397afcf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cec56f74b2fa4826a506dc7b919465be', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:09:26.170735 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d08da462-f6c6-4a1d-9f95-c0378397afcf admin admin] REQUEST_METHOD: `PUT` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:09:26.171015 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d08da462-f6c6-4a1d-9f95-c0378397afcf admin admin] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:09:26.171287 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d08da462-f6c6-4a1d-9f95-c0378397afcf admin admin] PATH_INFO: `/v3/projects/d8ed8a57ebb54e29b17fb5980bf6a4e7/users/3c76d8f0907b4ab0a33664b5d532ecaf/roles/ff664fa0db7e4262a5accde96c3df4c3` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:09:26.186950 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d08da462-f6c6-4a1d-9f95-c0378397afcf admin admin] RBAC: Authorizing `identity:create_grant(project_id=d8ed8a57ebb54e29b17fb5980bf6a4e7, user_id=3c76d8f0907b4ab0a33664b5d532ecaf, role_id=ff664fa0db7e4262a5accde96c3df4c3)` {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:09:26.189686 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d08da462-f6c6-4a1d-9f95-c0378397afcf admin admin] RBAC: Authorization granted {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:09:26.280553 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 1128/2230] 10.222.0.84 () {60 vars in 1482 bytes} [Wed May 25 15:09:26 2022] PUT /identity/v3/projects/d8ed8a57ebb54e29b17fb5980bf6a4e7/users/3c76d8f0907b4ab0a33664b5d532ecaf/roles/ff664fa0db7e4262a5accde96c3df4c3 => generated 0 bytes in 129 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 15:09:26.290725 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95ad652-b2ae-455f-9167-f517405bed17 None None] REQUEST_METHOD: `POST` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:09:26.291021 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95ad652-b2ae-455f-9167-f517405bed17 None None] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:09:26.291296 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95ad652-b2ae-455f-9167-f517405bed17 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:09:26.328932 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.auth.core [None req-c95ad652-b2ae-455f-9167-f517405bed17 None None] MFA Rules not processed for user `3c76d8f0907b4ab0a33664b5d532ecaf`. Rule list: `[]` (Enabled: `True`). {{(pid=101892) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:09:26.331099 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.fernet_utils [None req-c95ad652-b2ae-455f-9167-f517405bed17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=101892) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:09:26.412440 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 1103/2231] 10.222.0.84 () {58 vars in 957 bytes} [Wed May 25 15:09:26 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 15:09:26.427176 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d08da462-f6c6-4a1d-9f95-c0378397afcf admin admin] Authenticating user token {{(pid=101893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:09:26.429648 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.fernet_utils [None req-d08da462-f6c6-4a1d-9f95-c0378397afcf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=101893) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:09:26.521349 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d08da462-f6c6-4a1d-9f95-c0378397afcf admin admin] Validating token access rules against request {{(pid=101893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:09:26.528679 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1dab414-61fd-4014-be48-dc0a38614ea9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2aeb182e6a5b43cfb0cc347ec847c848', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a000829c658c4a7cab67f7b6353ba3fa', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:09:26.529429 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1dab414-61fd-4014-be48-dc0a38614ea9 service nova] REQUEST_METHOD: `GET` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:09:26.529780 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1dab414-61fd-4014-be48-dc0a38614ea9 service nova] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:09:26.530126 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1dab414-61fd-4014-be48-dc0a38614ea9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:09:26.541369 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1dab414-61fd-4014-be48-dc0a38614ea9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:09:26.544870 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1dab414-61fd-4014-be48-dc0a38614ea9 service nova] RBAC: Authorization granted {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:09:26.559084 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 1129/2232] 10.222.0.84 () {60 vars in 1365 bytes} [Wed May 25 15:09:26 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 15:09:29.708495 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a04160-6d0f-4385-a303-b7ecda2320de None None] REQUEST_METHOD: `POST` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:09:29.708993 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a04160-6d0f-4385-a303-b7ecda2320de None None] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:09:29.709087 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a04160-6d0f-4385-a303-b7ecda2320de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:09:29.727972 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.auth.core [None req-f2a04160-6d0f-4385-a303-b7ecda2320de None None] MFA Rules not processed for user `4e9f463e2bfc4c86a07d530ac112b893`. Rule list: `[]` (Enabled: `True`). {{(pid=101892) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:09:29.729179 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.fernet_utils [None req-f2a04160-6d0f-4385-a303-b7ecda2320de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=101892) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:09:29.783305 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 1104/2233] 10.222.0.84 () {58 vars in 957 bytes} [Wed May 25 15:09:29 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 15:09:29.823217 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1dab414-61fd-4014-be48-dc0a38614ea9 service nova] Authenticating user token {{(pid=101893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:09:29.888190 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1dab414-61fd-4014-be48-dc0a38614ea9 service nova] Validating token access rules against request {{(pid=101893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:09:29.892855 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed717dd-a94e-4377-940d-6a3bd430f488 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cec56f74b2fa4826a506dc7b919465be', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:09:29.893725 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed717dd-a94e-4377-940d-6a3bd430f488 admin admin] REQUEST_METHOD: `DELETE` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:09:29.894009 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed717dd-a94e-4377-940d-6a3bd430f488 admin admin] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:09:29.894284 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed717dd-a94e-4377-940d-6a3bd430f488 admin admin] PATH_INFO: `/v3/users/3c76d8f0907b4ab0a33664b5d532ecaf` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:09:29.895602 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ed717dd-a94e-4377-940d-6a3bd430f488 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3c76d8f0907b4ab0a33664b5d532ecaf)` {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:09:29.898097 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ed717dd-a94e-4377-940d-6a3bd430f488 admin admin] RBAC: Authorization granted {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:09:30.057935 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG dbcounter [-] [101893] Writing DB stats keystone:SELECT=93,keystone:INSERT=2,keystone:DELETE=5 {{(pid=101893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:09:30.064974 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.notifications [None req-2ed717dd-a94e-4377-940d-6a3bd430f488 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3c76d8f0907b4ab0a33664b5d532ecaf'} {{(pid=101893) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:09:30.072852 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.notifications [None req-2ed717dd-a94e-4377-940d-6a3bd430f488 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3c76d8f0907b4ab0a33664b5d532ecaf'} {{(pid=101893) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:09:30.085110 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.notifications [None req-2ed717dd-a94e-4377-940d-6a3bd430f488 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3c76d8f0907b4ab0a33664b5d532ecaf'} {{(pid=101893) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:09:30.085827 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.notifications [None req-2ed717dd-a94e-4377-940d-6a3bd430f488 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3c76d8f0907b4ab0a33664b5d532ecaf'} {{(pid=101893) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:09:30.086415 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.notifications [None req-2ed717dd-a94e-4377-940d-6a3bd430f488 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3c76d8f0907b4ab0a33664b5d532ecaf'} {{(pid=101893) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:09:30.203765 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 1130/2234] 10.222.0.84 () {58 vars in 1223 bytes} [Wed May 25 15:09:29 2022] DELETE /identity/v3/users/3c76d8f0907b4ab0a33664b5d532ecaf => generated 0 bytes in 381 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 15:09:30.208418 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3824ab33-4569-47c0-8cff-508b790d3f6e None None] REQUEST_METHOD: `POST` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:09:30.208766 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3824ab33-4569-47c0-8cff-508b790d3f6e None None] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:09:30.209025 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3824ab33-4569-47c0-8cff-508b790d3f6e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:09:30.228358 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.auth.core [None req-3824ab33-4569-47c0-8cff-508b790d3f6e None None] MFA Rules not processed for user `05d87e87798e429aa1c10b24391f915e`. Rule list: `[]` (Enabled: `True`). {{(pid=101892) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:09:30.229566 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.fernet_utils [None req-3824ab33-4569-47c0-8cff-508b790d3f6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=101892) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:09:30.291680 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 1105/2235] 10.222.0.84 () {58 vars in 957 bytes} [Wed May 25 15:09:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 15:09:30.304521 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed717dd-a94e-4377-940d-6a3bd430f488 admin admin] Authenticating user token {{(pid=101893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:09:30.305980 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.fernet_utils [None req-2ed717dd-a94e-4377-940d-6a3bd430f488 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=101893) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:09:30.364155 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed717dd-a94e-4377-940d-6a3bd430f488 admin admin] Validating token access rules against request {{(pid=101893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:09:30.368567 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f35f6dd-95eb-4809-b757-4c5ed816027c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ce28b25b907473588ccb87dc4acc06a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a000829c658c4a7cab67f7b6353ba3fa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:09:30.369209 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f35f6dd-95eb-4809-b757-4c5ed816027c service neutron] REQUEST_METHOD: `GET` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:09:30.369492 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f35f6dd-95eb-4809-b757-4c5ed816027c service neutron] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:09:30.369767 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f35f6dd-95eb-4809-b757-4c5ed816027c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:09:30.378671 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f35f6dd-95eb-4809-b757-4c5ed816027c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:09:30.380154 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f35f6dd-95eb-4809-b757-4c5ed816027c service neutron] RBAC: Authorization granted {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:09:30.389761 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 1131/2236] 10.222.0.84 () {60 vars in 1365 bytes} [Wed May 25 15:09:30 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 15:09:30.816665 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3824ab33-4569-47c0-8cff-508b790d3f6e None None] Authenticating user token {{(pid=101892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:09:30.818257 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.fernet_utils [None req-3824ab33-4569-47c0-8cff-508b790d3f6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=101892) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:09:30.841410 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3824ab33-4569-47c0-8cff-508b790d3f6e None None] Validating token access rules against request {{(pid=101892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:09:30.848551 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83572c5c-1fea-4cba-b7db-3832845cfeee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cec56f74b2fa4826a506dc7b919465be', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:09:30.848551 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83572c5c-1fea-4cba-b7db-3832845cfeee admin admin] REQUEST_METHOD: `DELETE` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:09:30.848551 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83572c5c-1fea-4cba-b7db-3832845cfeee admin admin] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:09:30.849040 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83572c5c-1fea-4cba-b7db-3832845cfeee admin admin] PATH_INFO: `/v3/projects/d8ed8a57ebb54e29b17fb5980bf6a4e7` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:09:30.849865 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83572c5c-1fea-4cba-b7db-3832845cfeee admin admin] RBAC: Authorizing `identity:delete_project(project_id=d8ed8a57ebb54e29b17fb5980bf6a4e7)` {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:09:30.852500 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83572c5c-1fea-4cba-b7db-3832845cfeee admin admin] RBAC: Authorization granted {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:09:30.861078 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG dbcounter [-] [101892] Writing DB stats keystone:INSERT=3,keystone:SELECT=97 {{(pid=101892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:09:30.969824 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.notifications [None req-83572c5c-1fea-4cba-b7db-3832845cfeee admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd8ed8a57ebb54e29b17fb5980bf6a4e7', 'request_id': 'req-83572c5c-1fea-4cba-b7db-3832845cfeee'} {{(pid=101892) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:09:30.976781 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.notifications [None req-83572c5c-1fea-4cba-b7db-3832845cfeee admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd8ed8a57ebb54e29b17fb5980bf6a4e7', 'request_id': 'req-83572c5c-1fea-4cba-b7db-3832845cfeee'} {{(pid=101892) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:09:30.982629 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.notifications [None req-83572c5c-1fea-4cba-b7db-3832845cfeee admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd8ed8a57ebb54e29b17fb5980bf6a4e7', 'request_id': 'req-83572c5c-1fea-4cba-b7db-3832845cfeee'} {{(pid=101892) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:09:31.077713 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.notifications [None req-83572c5c-1fea-4cba-b7db-3832845cfeee admin admin] The token cache is being invalidate because project d8ed8a57ebb54e29b17fb5980bf6a4e7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=101892) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 25 15:09:31.078008 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.notifications [None req-83572c5c-1fea-4cba-b7db-3832845cfeee admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=101892) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:09:31.078632 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.notifications [None req-83572c5c-1fea-4cba-b7db-3832845cfeee admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=101892) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:09:31.080244 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 1106/2237] 10.222.0.84 () {58 vars in 1232 bytes} [Wed May 25 15:09:30 2022] DELETE /identity/v3/projects/d8ed8a57ebb54e29b17fb5980bf6a4e7 => generated 0 bytes in 264 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 15:09:31.085624 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d32c9a-347a-401e-872c-0866d0842262 None None] REQUEST_METHOD: `POST` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:09:31.086098 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d32c9a-347a-401e-872c-0866d0842262 None None] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:09:31.086197 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d32c9a-347a-401e-872c-0866d0842262 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:09:31.103579 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.auth.core [None req-f5d32c9a-347a-401e-872c-0866d0842262 None None] MFA Rules not processed for user `05d87e87798e429aa1c10b24391f915e`. Rule list: `[]` (Enabled: `True`). {{(pid=101893) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:09:31.104787 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.fernet_utils [None req-f5d32c9a-347a-401e-872c-0866d0842262 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=101893) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:09:31.163095 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 1132/2238] 10.222.0.84 () {58 vars in 957 bytes} [Wed May 25 15:09:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 15:09:31.171228 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa57298-0519-4e01-b020-17f6bdc640d5 None None] REQUEST_METHOD: `POST` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:09:31.171534 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa57298-0519-4e01-b020-17f6bdc640d5 None None] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:09:31.171866 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa57298-0519-4e01-b020-17f6bdc640d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:09:31.189712 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.auth.core [None req-ffa57298-0519-4e01-b020-17f6bdc640d5 None None] MFA Rules not processed for user `05d87e87798e429aa1c10b24391f915e`. Rule list: `[]` (Enabled: `True`). {{(pid=101892) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:09:31.190886 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.fernet_utils [None req-ffa57298-0519-4e01-b020-17f6bdc640d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=101892) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:09:31.199463 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 1107/2239] 10.222.0.84 () {58 vars in 957 bytes} [Wed May 25 15:09:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 15:09:31.203827 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5d32c9a-347a-401e-872c-0866d0842262 None None] Authenticating user token {{(pid=101893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:09:31.214380 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5d32c9a-347a-401e-872c-0866d0842262 None None] Validating token access rules against request {{(pid=101893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:09:31.219016 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ace7fa9-406a-405d-94d1-4c56687ccca2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cec56f74b2fa4826a506dc7b919465be', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:09:31.219704 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ace7fa9-406a-405d-94d1-4c56687ccca2 admin admin] REQUEST_METHOD: `GET` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:09:31.220013 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ace7fa9-406a-405d-94d1-4c56687ccca2 admin admin] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:09:31.220275 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ace7fa9-406a-405d-94d1-4c56687ccca2 admin admin] PATH_INFO: `/v3/domains` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:09:31.221008 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ace7fa9-406a-405d-94d1-4c56687ccca2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=101893) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 15:09:31.221323 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ace7fa9-406a-405d-94d1-4c56687ccca2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:09:31.223037 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ace7fa9-406a-405d-94d1-4c56687ccca2 admin admin] RBAC: Authorization granted {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:09:31.234566 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 1133/2240] 10.222.0.84 () {58 vars in 1152 bytes} [Wed May 25 15:09:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 15:09:31.238662 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffa57298-0519-4e01-b020-17f6bdc640d5 None None] Authenticating user token {{(pid=101892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:09:31.247613 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffa57298-0519-4e01-b020-17f6bdc640d5 None None] Validating token access rules against request {{(pid=101892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:09:31.252189 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0299b062-72b3-44cb-8b20-3631eebd4998 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cec56f74b2fa4826a506dc7b919465be', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:09:31.252828 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0299b062-72b3-44cb-8b20-3631eebd4998 admin admin] REQUEST_METHOD: `POST` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:09:31.253108 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0299b062-72b3-44cb-8b20-3631eebd4998 admin admin] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:09:31.253380 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0299b062-72b3-44cb-8b20-3631eebd4998 admin admin] PATH_INFO: `/v3/projects` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:09:31.254055 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0299b062-72b3-44cb-8b20-3631eebd4998 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:09:31.255974 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0299b062-72b3-44cb-8b20-3631eebd4998 admin admin] RBAC: Authorization granted {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:09:31.370889 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 1108/2241] 10.222.0.84 () {60 vars in 1152 bytes} [Wed May 25 15:09:31 2022] POST /identity/v3/projects => generated 365 bytes in 133 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 15:09:31.375105 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ace7fa9-406a-405d-94d1-4c56687ccca2 admin admin] Authenticating user token {{(pid=101893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:09:31.395301 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ace7fa9-406a-405d-94d1-4c56687ccca2 admin admin] Validating token access rules against request {{(pid=101893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:09:31.441586 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG dbcounter [-] [101893] Writing DB stats keystone:DELETE=5,keystone:SELECT=94,keystone:INSERT=1 {{(pid=101893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:09:31.454909 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14aa7e61-eb34-4444-8ab9-f3f6be5994ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cec56f74b2fa4826a506dc7b919465be', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:09:31.455605 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14aa7e61-eb34-4444-8ab9-f3f6be5994ef admin admin] REQUEST_METHOD: `POST` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:09:31.455898 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14aa7e61-eb34-4444-8ab9-f3f6be5994ef admin admin] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:09:31.456178 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14aa7e61-eb34-4444-8ab9-f3f6be5994ef admin admin] PATH_INFO: `/v3/users` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:09:31.456860 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14aa7e61-eb34-4444-8ab9-f3f6be5994ef admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:09:31.458799 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14aa7e61-eb34-4444-8ab9-f3f6be5994ef admin admin] RBAC: Authorization granted {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:09:31.535364 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 1134/2242] 10.222.0.84 () {60 vars in 1143 bytes} [Wed May 25 15:09:31 2022] POST /identity/v3/users => generated 283 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 15:09:31.539800 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0299b062-72b3-44cb-8b20-3631eebd4998 admin admin] Authenticating user token {{(pid=101892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:09:31.550914 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0299b062-72b3-44cb-8b20-3631eebd4998 admin admin] Validating token access rules against request {{(pid=101892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:09:31.557248 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b3be24-cf09-4e89-b43f-e86ac793ad40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cec56f74b2fa4826a506dc7b919465be', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:09:31.557925 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b3be24-cf09-4e89-b43f-e86ac793ad40 admin admin] REQUEST_METHOD: `GET` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:09:31.558366 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b3be24-cf09-4e89-b43f-e86ac793ad40 admin admin] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:09:31.558933 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b3be24-cf09-4e89-b43f-e86ac793ad40 admin admin] PATH_INFO: `/v3/roles` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:09:31.559721 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7b3be24-cf09-4e89-b43f-e86ac793ad40 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:09:31.561658 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7b3be24-cf09-4e89-b43f-e86ac793ad40 admin admin] RBAC: Authorization granted {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:09:31.573391 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 1109/2243] 10.222.0.84 () {58 vars in 1121 bytes} [Wed May 25 15:09:31 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 15:09:31.578173 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14aa7e61-eb34-4444-8ab9-f3f6be5994ef admin admin] Authenticating user token {{(pid=101893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:09:31.588696 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14aa7e61-eb34-4444-8ab9-f3f6be5994ef admin admin] Validating token access rules against request {{(pid=101893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:09:31.594014 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdd752ee-30d0-4de7-8c88-d5b6c3af4ba1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cec56f74b2fa4826a506dc7b919465be', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:09:31.597513 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd752ee-30d0-4de7-8c88-d5b6c3af4ba1 admin admin] REQUEST_METHOD: `GET` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:09:31.597513 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd752ee-30d0-4de7-8c88-d5b6c3af4ba1 admin admin] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:09:31.597513 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd752ee-30d0-4de7-8c88-d5b6c3af4ba1 admin admin] PATH_INFO: `/v3/roles` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:09:31.597513 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdd752ee-30d0-4de7-8c88-d5b6c3af4ba1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:09:31.598061 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdd752ee-30d0-4de7-8c88-d5b6c3af4ba1 admin admin] RBAC: Authorization granted {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:09:31.608966 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 1135/2244] 10.222.0.84 () {58 vars in 1121 bytes} [Wed May 25 15:09:31 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 15:09:31.613105 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b3be24-cf09-4e89-b43f-e86ac793ad40 admin admin] Authenticating user token {{(pid=101892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:09:31.624306 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b3be24-cf09-4e89-b43f-e86ac793ad40 admin admin] Validating token access rules against request {{(pid=101892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:09:31.629826 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0cf925e-25bc-40f7-aa4a-2e9f40817cac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cec56f74b2fa4826a506dc7b919465be', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:09:31.630413 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0cf925e-25bc-40f7-aa4a-2e9f40817cac admin admin] REQUEST_METHOD: `PUT` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:09:31.630704 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0cf925e-25bc-40f7-aa4a-2e9f40817cac admin admin] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:09:31.630986 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0cf925e-25bc-40f7-aa4a-2e9f40817cac admin admin] PATH_INFO: `/v3/projects/a197a182fe7c4f0da669ebcb629fe060/users/54ec6715d1ff4c10bdf2286a4dba826a/roles/ff664fa0db7e4262a5accde96c3df4c3` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:09:31.647897 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0cf925e-25bc-40f7-aa4a-2e9f40817cac admin admin] RBAC: Authorizing `identity:create_grant(project_id=a197a182fe7c4f0da669ebcb629fe060, user_id=54ec6715d1ff4c10bdf2286a4dba826a, role_id=ff664fa0db7e4262a5accde96c3df4c3)` {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:09:31.650718 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0cf925e-25bc-40f7-aa4a-2e9f40817cac admin admin] RBAC: Authorization granted {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:09:31.702353 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 1110/2245] 10.222.0.84 () {60 vars in 1482 bytes} [Wed May 25 15:09:31 2022] PUT /identity/v3/projects/a197a182fe7c4f0da669ebcb629fe060/users/54ec6715d1ff4c10bdf2286a4dba826a/roles/ff664fa0db7e4262a5accde96c3df4c3 => generated 0 bytes in 90 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 25 15:09:31.713770 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79712f9-c491-4cb4-855f-ace0298a07c7 None None] REQUEST_METHOD: `POST` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:09:31.714066 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79712f9-c491-4cb4-855f-ace0298a07c7 None None] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:09:31.714346 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79712f9-c491-4cb4-855f-ace0298a07c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:09:31.741025 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.auth.core [None req-a79712f9-c491-4cb4-855f-ace0298a07c7 None None] MFA Rules not processed for user `54ec6715d1ff4c10bdf2286a4dba826a`. Rule list: `[]` (Enabled: `True`). {{(pid=101893) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:09:31.742860 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.fernet_utils [None req-a79712f9-c491-4cb4-855f-ace0298a07c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=101893) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:09:31.812116 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 1136/2246] 10.222.0.84 () {58 vars in 957 bytes} [Wed May 25 15:09:31 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 15:09:31.817135 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0cf925e-25bc-40f7-aa4a-2e9f40817cac admin admin] Authenticating user token {{(pid=101892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:09:31.879902 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0cf925e-25bc-40f7-aa4a-2e9f40817cac admin admin] Validating token access rules against request {{(pid=101892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:09:31.884714 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5faf2279-181e-4ab2-b9fe-cfed308ff728 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cec56f74b2fa4826a506dc7b919465be', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:09:31.885382 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5faf2279-181e-4ab2-b9fe-cfed308ff728 admin admin] REQUEST_METHOD: `POST` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:09:31.885669 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5faf2279-181e-4ab2-b9fe-cfed308ff728 admin admin] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:09:31.885951 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5faf2279-181e-4ab2-b9fe-cfed308ff728 admin admin] PATH_INFO: `/v3/projects` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:09:31.886644 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5faf2279-181e-4ab2-b9fe-cfed308ff728 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:09:31.888667 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5faf2279-181e-4ab2-b9fe-cfed308ff728 admin admin] RBAC: Authorization granted {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:09:31.970149 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 1111/2247] 10.222.0.84 () {60 vars in 1152 bytes} [Wed May 25 15:09:31 2022] POST /identity/v3/projects => generated 365 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 25 15:09:31.974059 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a79712f9-c491-4cb4-855f-ace0298a07c7 None None] Authenticating user token {{(pid=101893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:09:31.985434 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a79712f9-c491-4cb4-855f-ace0298a07c7 None None] Validating token access rules against request {{(pid=101893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:09:32.045101 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3270a4f-dc39-4d58-9177-3402dbae1f98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cec56f74b2fa4826a506dc7b919465be', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:09:32.045765 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3270a4f-dc39-4d58-9177-3402dbae1f98 admin admin] REQUEST_METHOD: `POST` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:09:32.046050 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3270a4f-dc39-4d58-9177-3402dbae1f98 admin admin] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:09:32.046321 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3270a4f-dc39-4d58-9177-3402dbae1f98 admin admin] PATH_INFO: `/v3/users` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:09:32.046999 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3270a4f-dc39-4d58-9177-3402dbae1f98 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:09:32.048992 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3270a4f-dc39-4d58-9177-3402dbae1f98 admin admin] RBAC: Authorization granted {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:09:32.124607 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 1137/2248] 10.222.0.84 () {60 vars in 1143 bytes} [Wed May 25 15:09:31 2022] POST /identity/v3/users => generated 289 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 15:09:32.129034 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5faf2279-181e-4ab2-b9fe-cfed308ff728 admin admin] Authenticating user token {{(pid=101892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:09:32.139763 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5faf2279-181e-4ab2-b9fe-cfed308ff728 admin admin] Validating token access rules against request {{(pid=101892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:09:32.144364 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd215093-e4e8-462f-883f-2e4e2c7a154b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cec56f74b2fa4826a506dc7b919465be', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:09:32.145030 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd215093-e4e8-462f-883f-2e4e2c7a154b admin admin] REQUEST_METHOD: `GET` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:09:32.145310 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd215093-e4e8-462f-883f-2e4e2c7a154b admin admin] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:09:32.145585 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd215093-e4e8-462f-883f-2e4e2c7a154b admin admin] PATH_INFO: `/v3/roles` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:09:32.146309 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd215093-e4e8-462f-883f-2e4e2c7a154b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:09:32.148440 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd215093-e4e8-462f-883f-2e4e2c7a154b admin admin] RBAC: Authorization granted {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:09:32.160108 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 1112/2249] 10.222.0.84 () {58 vars in 1121 bytes} [Wed May 25 15:09:32 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 15:09:32.165079 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3270a4f-dc39-4d58-9177-3402dbae1f98 admin admin] Authenticating user token {{(pid=101893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:09:32.175637 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3270a4f-dc39-4d58-9177-3402dbae1f98 admin admin] Validating token access rules against request {{(pid=101893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:09:32.180415 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3415782c-0053-458c-97fa-0b4610b1793c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cec56f74b2fa4826a506dc7b919465be', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:09:32.181362 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3415782c-0053-458c-97fa-0b4610b1793c admin admin] REQUEST_METHOD: `PUT` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:09:32.181797 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3415782c-0053-458c-97fa-0b4610b1793c admin admin] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:09:32.182075 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3415782c-0053-458c-97fa-0b4610b1793c admin admin] PATH_INFO: `/v3/projects/c812de11883041baae43bde3e857c348/users/71a2df36c0c446b2bb100cb37c53f4c5/roles/a3b78e7d547d4d2d998b4c99a4396bba` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:09:32.199206 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3415782c-0053-458c-97fa-0b4610b1793c admin admin] RBAC: Authorizing `identity:create_grant(project_id=c812de11883041baae43bde3e857c348, user_id=71a2df36c0c446b2bb100cb37c53f4c5, role_id=a3b78e7d547d4d2d998b4c99a4396bba)` {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:09:32.202912 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3415782c-0053-458c-97fa-0b4610b1793c admin admin] RBAC: Authorization granted {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:09:32.261600 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 1138/2250] 10.222.0.84 () {60 vars in 1482 bytes} [Wed May 25 15:09:32 2022] PUT /identity/v3/projects/c812de11883041baae43bde3e857c348/users/71a2df36c0c446b2bb100cb37c53f4c5/roles/a3b78e7d547d4d2d998b4c99a4396bba => generated 0 bytes in 97 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 15:09:32.265502 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd215093-e4e8-462f-883f-2e4e2c7a154b admin admin] Authenticating user token {{(pid=101892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:09:32.277948 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd215093-e4e8-462f-883f-2e4e2c7a154b admin admin] Validating token access rules against request {{(pid=101892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:09:32.281877 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG dbcounter [-] [101892] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=101892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:09:32.339020 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26aa538f-0ea5-483e-a5f8-66376e0e56e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cec56f74b2fa4826a506dc7b919465be', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:09:32.339728 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26aa538f-0ea5-483e-a5f8-66376e0e56e0 admin admin] REQUEST_METHOD: `GET` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:09:32.340017 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26aa538f-0ea5-483e-a5f8-66376e0e56e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:09:32.340297 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26aa538f-0ea5-483e-a5f8-66376e0e56e0 admin admin] PATH_INFO: `/v3/roles` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:09:32.341188 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26aa538f-0ea5-483e-a5f8-66376e0e56e0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:09:32.344109 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26aa538f-0ea5-483e-a5f8-66376e0e56e0 admin admin] RBAC: Authorization granted {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:09:32.355045 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 1113/2251] 10.222.0.84 () {58 vars in 1121 bytes} [Wed May 25 15:09:32 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 15:09:32.359274 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3415782c-0053-458c-97fa-0b4610b1793c admin admin] Authenticating user token {{(pid=101893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:09:32.373212 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3415782c-0053-458c-97fa-0b4610b1793c admin admin] Validating token access rules against request {{(pid=101893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:09:32.378339 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96ea31b9-6389-4477-83cd-d4205b92f5f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cec56f74b2fa4826a506dc7b919465be', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:09:32.379291 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ea31b9-6389-4477-83cd-d4205b92f5f5 admin admin] REQUEST_METHOD: `PUT` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:09:32.379591 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ea31b9-6389-4477-83cd-d4205b92f5f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:09:32.379877 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ea31b9-6389-4477-83cd-d4205b92f5f5 admin admin] PATH_INFO: `/v3/projects/c812de11883041baae43bde3e857c348/users/71a2df36c0c446b2bb100cb37c53f4c5/roles/a3b78e7d547d4d2d998b4c99a4396bba` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:09:32.387668 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96ea31b9-6389-4477-83cd-d4205b92f5f5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c812de11883041baae43bde3e857c348, user_id=71a2df36c0c446b2bb100cb37c53f4c5, role_id=a3b78e7d547d4d2d998b4c99a4396bba)` {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:09:32.390738 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96ea31b9-6389-4477-83cd-d4205b92f5f5 admin admin] RBAC: Authorization granted {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:09:32.403388 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 1139/2252] 10.222.0.84 () {60 vars in 1482 bytes} [Wed May 25 15:09:32 2022] PUT /identity/v3/projects/c812de11883041baae43bde3e857c348/users/71a2df36c0c446b2bb100cb37c53f4c5/roles/a3b78e7d547d4d2d998b4c99a4396bba => generated 0 bytes in 45 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 15:09:32.415537 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262bd9aa-1954-4424-bec6-c8cefca6f594 None None] REQUEST_METHOD: `POST` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:09:32.415951 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262bd9aa-1954-4424-bec6-c8cefca6f594 None None] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:09:32.416245 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262bd9aa-1954-4424-bec6-c8cefca6f594 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:09:32.447099 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.auth.core [None req-262bd9aa-1954-4424-bec6-c8cefca6f594 None None] MFA Rules not processed for user `71a2df36c0c446b2bb100cb37c53f4c5`. Rule list: `[]` (Enabled: `True`). {{(pid=101892) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:09:32.448836 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.fernet_utils [None req-262bd9aa-1954-4424-bec6-c8cefca6f594 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=101892) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:09:32.532811 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 1114/2253] 10.222.0.84 () {58 vars in 957 bytes} [Wed May 25 15:09:32 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 15:09:32.544729 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96ea31b9-6389-4477-83cd-d4205b92f5f5 admin admin] Authenticating user token {{(pid=101893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:09:32.546605 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.fernet_utils [None req-96ea31b9-6389-4477-83cd-d4205b92f5f5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=101893) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:09:32.564054 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG dbcounter [-] [101893] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=101893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:09:32.618287 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96ea31b9-6389-4477-83cd-d4205b92f5f5 admin admin] Validating token access rules against request {{(pid=101893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:09:32.622829 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-625a889a-535d-4e55-8b6d-75e9ef10178d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e079f89a5e524ab6ad4183e4f690de07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a000829c658c4a7cab67f7b6353ba3fa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:09:32.623593 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625a889a-535d-4e55-8b6d-75e9ef10178d service cinder] REQUEST_METHOD: `GET` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:09:32.623593 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625a889a-535d-4e55-8b6d-75e9ef10178d service cinder] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:09:32.623593 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625a889a-535d-4e55-8b6d-75e9ef10178d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:09:32.636359 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-625a889a-535d-4e55-8b6d-75e9ef10178d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:09:32.637985 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-625a889a-535d-4e55-8b6d-75e9ef10178d service cinder] RBAC: Authorization granted {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:09:32.653635 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 1140/2254] 10.222.0.84 () {60 vars in 1365 bytes} [Wed May 25 15:09:32 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 15:09:33.506544 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-262bd9aa-1954-4424-bec6-c8cefca6f594 None None] Authenticating user token {{(pid=101892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:09:33.575221 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-262bd9aa-1954-4424-bec6-c8cefca6f594 None None] Validating token access rules against request {{(pid=101892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:09:33.580051 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a00e633c-b485-44e1-9c46-c4be2394f0b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cec56f74b2fa4826a506dc7b919465be', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:09:33.580929 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00e633c-b485-44e1-9c46-c4be2394f0b5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:09:33.581212 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00e633c-b485-44e1-9c46-c4be2394f0b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:09:33.581495 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00e633c-b485-44e1-9c46-c4be2394f0b5 admin admin] PATH_INFO: `/v3/users/54ec6715d1ff4c10bdf2286a4dba826a` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:09:33.582694 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a00e633c-b485-44e1-9c46-c4be2394f0b5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=54ec6715d1ff4c10bdf2286a4dba826a)` {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:09:33.584682 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a00e633c-b485-44e1-9c46-c4be2394f0b5 admin admin] RBAC: Authorization granted {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:09:33.775637 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG dbcounter [-] [101892] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=101892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:09:33.788353 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.notifications [None req-a00e633c-b485-44e1-9c46-c4be2394f0b5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '54ec6715d1ff4c10bdf2286a4dba826a'} {{(pid=101892) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:09:33.795316 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.notifications [None req-a00e633c-b485-44e1-9c46-c4be2394f0b5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '54ec6715d1ff4c10bdf2286a4dba826a'} {{(pid=101892) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:09:33.807577 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.notifications [None req-a00e633c-b485-44e1-9c46-c4be2394f0b5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '54ec6715d1ff4c10bdf2286a4dba826a'} {{(pid=101892) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:09:33.808273 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.notifications [None req-a00e633c-b485-44e1-9c46-c4be2394f0b5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '54ec6715d1ff4c10bdf2286a4dba826a'} {{(pid=101892) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:09:33.873078 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.notifications [None req-a00e633c-b485-44e1-9c46-c4be2394f0b5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '54ec6715d1ff4c10bdf2286a4dba826a'} {{(pid=101892) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:09:33.883237 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 1115/2255] 10.222.0.84 () {58 vars in 1223 bytes} [Wed May 25 15:09:33 2022] DELETE /identity/v3/users/54ec6715d1ff4c10bdf2286a4dba826a => generated 0 bytes in 377 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 15:09:33.887849 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e50c5ee-3344-4749-91b7-8baf6677c937 None None] REQUEST_METHOD: `POST` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:09:33.888323 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e50c5ee-3344-4749-91b7-8baf6677c937 None None] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:09:33.888515 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e50c5ee-3344-4749-91b7-8baf6677c937 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:09:33.912934 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.auth.core [None req-9e50c5ee-3344-4749-91b7-8baf6677c937 None None] MFA Rules not processed for user `05d87e87798e429aa1c10b24391f915e`. Rule list: `[]` (Enabled: `True`). {{(pid=101893) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:09:33.914783 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.fernet_utils [None req-9e50c5ee-3344-4749-91b7-8baf6677c937 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=101893) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:09:33.987615 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 1141/2256] 10.222.0.84 () {58 vars in 957 bytes} [Wed May 25 15:09:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 25 15:09:33.994544 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a00e633c-b485-44e1-9c46-c4be2394f0b5 admin admin] Authenticating user token {{(pid=101892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:09:33.996100 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.fernet_utils [None req-a00e633c-b485-44e1-9c46-c4be2394f0b5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=101892) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:09:34.072141 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a00e633c-b485-44e1-9c46-c4be2394f0b5 admin admin] Validating token access rules against request {{(pid=101892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:09:34.075873 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b79fbd-4780-4917-8dc6-f5846436d959 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ce28b25b907473588ccb87dc4acc06a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a000829c658c4a7cab67f7b6353ba3fa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:09:34.076719 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b79fbd-4780-4917-8dc6-f5846436d959 service neutron] REQUEST_METHOD: `GET` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:09:34.077008 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b79fbd-4780-4917-8dc6-f5846436d959 service neutron] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:09:34.077289 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b79fbd-4780-4917-8dc6-f5846436d959 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:09:34.087733 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1b79fbd-4780-4917-8dc6-f5846436d959 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:09:34.089185 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1b79fbd-4780-4917-8dc6-f5846436d959 service neutron] RBAC: Authorization granted {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:09:34.100305 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 1116/2257] 10.222.0.84 () {60 vars in 1365 bytes} [Wed May 25 15:09:33 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 15:09:35.004195 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e50c5ee-3344-4749-91b7-8baf6677c937 None None] Authenticating user token {{(pid=101893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:09:35.005731 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.fernet_utils [None req-9e50c5ee-3344-4749-91b7-8baf6677c937 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=101893) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:09:35.019907 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e50c5ee-3344-4749-91b7-8baf6677c937 None None] Validating token access rules against request {{(pid=101893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:09:35.025565 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b94680a-4d9a-47b9-a3b2-f0a746e7df90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cec56f74b2fa4826a506dc7b919465be', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:09:35.027101 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b94680a-4d9a-47b9-a3b2-f0a746e7df90 admin admin] REQUEST_METHOD: `DELETE` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:09:35.027792 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b94680a-4d9a-47b9-a3b2-f0a746e7df90 admin admin] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:09:35.031485 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b94680a-4d9a-47b9-a3b2-f0a746e7df90 admin admin] PATH_INFO: `/v3/projects/a197a182fe7c4f0da669ebcb629fe060` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:09:35.031485 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b94680a-4d9a-47b9-a3b2-f0a746e7df90 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a197a182fe7c4f0da669ebcb629fe060)` {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:09:35.031485 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b94680a-4d9a-47b9-a3b2-f0a746e7df90 admin admin] RBAC: Authorization granted {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:09:35.176849 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.notifications [None req-5b94680a-4d9a-47b9-a3b2-f0a746e7df90 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a197a182fe7c4f0da669ebcb629fe060', 'request_id': 'req-5b94680a-4d9a-47b9-a3b2-f0a746e7df90'} {{(pid=101893) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:09:35.184637 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.notifications [None req-5b94680a-4d9a-47b9-a3b2-f0a746e7df90 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a197a182fe7c4f0da669ebcb629fe060', 'request_id': 'req-5b94680a-4d9a-47b9-a3b2-f0a746e7df90'} {{(pid=101893) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:09:35.189416 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.notifications [None req-5b94680a-4d9a-47b9-a3b2-f0a746e7df90 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a197a182fe7c4f0da669ebcb629fe060', 'request_id': 'req-5b94680a-4d9a-47b9-a3b2-f0a746e7df90'} {{(pid=101893) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:09:35.260451 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.notifications [None req-5b94680a-4d9a-47b9-a3b2-f0a746e7df90 admin admin] The token cache is being invalidate because project a197a182fe7c4f0da669ebcb629fe060 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=101893) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 25 15:09:35.260737 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.notifications [None req-5b94680a-4d9a-47b9-a3b2-f0a746e7df90 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=101893) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:09:35.261364 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.notifications [None req-5b94680a-4d9a-47b9-a3b2-f0a746e7df90 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=101893) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:09:35.262941 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 1142/2258] 10.222.0.84 () {58 vars in 1232 bytes} [Wed May 25 15:09:35 2022] DELETE /identity/v3/projects/a197a182fe7c4f0da669ebcb629fe060 => generated 0 bytes in 259 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 15:09:35.267098 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b79fbd-4780-4917-8dc6-f5846436d959 service neutron] Authenticating user token {{(pid=101892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:09:35.277350 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b79fbd-4780-4917-8dc6-f5846436d959 service neutron] Validating token access rules against request {{(pid=101892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:09:35.334339 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e9ba22-0df5-4017-9281-a84b833d6beb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cec56f74b2fa4826a506dc7b919465be', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:09:35.335864 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e9ba22-0df5-4017-9281-a84b833d6beb admin admin] REQUEST_METHOD: `DELETE` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:09:35.336550 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e9ba22-0df5-4017-9281-a84b833d6beb admin admin] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:09:35.336550 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e9ba22-0df5-4017-9281-a84b833d6beb admin admin] PATH_INFO: `/v3/users/71a2df36c0c446b2bb100cb37c53f4c5` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:09:35.337630 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9e9ba22-0df5-4017-9281-a84b833d6beb admin admin] RBAC: Authorizing `identity:delete_user(user_id=71a2df36c0c446b2bb100cb37c53f4c5)` {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:09:35.339554 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9e9ba22-0df5-4017-9281-a84b833d6beb admin admin] RBAC: Authorization granted {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:09:35.553992 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.notifications [None req-a9e9ba22-0df5-4017-9281-a84b833d6beb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '71a2df36c0c446b2bb100cb37c53f4c5'} {{(pid=101892) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:09:35.559088 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG dbcounter [-] [101892] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=101892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:09:35.562091 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.notifications [None req-a9e9ba22-0df5-4017-9281-a84b833d6beb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '71a2df36c0c446b2bb100cb37c53f4c5'} {{(pid=101892) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:09:35.574818 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.notifications [None req-a9e9ba22-0df5-4017-9281-a84b833d6beb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '71a2df36c0c446b2bb100cb37c53f4c5'} {{(pid=101892) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:09:35.578343 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.notifications [None req-a9e9ba22-0df5-4017-9281-a84b833d6beb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '71a2df36c0c446b2bb100cb37c53f4c5'} {{(pid=101892) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:09:35.671592 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.notifications [None req-a9e9ba22-0df5-4017-9281-a84b833d6beb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '71a2df36c0c446b2bb100cb37c53f4c5'} {{(pid=101892) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:09:35.677938 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 1117/2259] 10.222.0.84 () {58 vars in 1223 bytes} [Wed May 25 15:09:35 2022] DELETE /identity/v3/users/71a2df36c0c446b2bb100cb37c53f4c5 => generated 0 bytes in 411 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 15:09:36.165957 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b94680a-4d9a-47b9-a3b2-f0a746e7df90 admin admin] Authenticating user token {{(pid=101893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:09:36.167464 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.fernet_utils [None req-5b94680a-4d9a-47b9-a3b2-f0a746e7df90 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=101893) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:09:36.183258 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b94680a-4d9a-47b9-a3b2-f0a746e7df90 admin admin] Validating token access rules against request {{(pid=101893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:09:36.220558 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG dbcounter [-] [101893] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=101893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:09:36.249189 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1535c026-547f-45f7-b0db-7eb08d355ab3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cec56f74b2fa4826a506dc7b919465be', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:09:36.250075 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1535c026-547f-45f7-b0db-7eb08d355ab3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:09:36.251539 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1535c026-547f-45f7-b0db-7eb08d355ab3 admin admin] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:09:36.251804 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1535c026-547f-45f7-b0db-7eb08d355ab3 admin admin] PATH_INFO: `/v3/projects/c812de11883041baae43bde3e857c348` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:09:36.253203 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1535c026-547f-45f7-b0db-7eb08d355ab3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c812de11883041baae43bde3e857c348)` {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:09:36.255156 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1535c026-547f-45f7-b0db-7eb08d355ab3 admin admin] RBAC: Authorization granted {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:09:36.357799 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.notifications [None req-1535c026-547f-45f7-b0db-7eb08d355ab3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c812de11883041baae43bde3e857c348', 'request_id': 'req-1535c026-547f-45f7-b0db-7eb08d355ab3'} {{(pid=101893) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:09:36.364112 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.notifications [None req-1535c026-547f-45f7-b0db-7eb08d355ab3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c812de11883041baae43bde3e857c348', 'request_id': 'req-1535c026-547f-45f7-b0db-7eb08d355ab3'} {{(pid=101893) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:09:36.369715 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.notifications [None req-1535c026-547f-45f7-b0db-7eb08d355ab3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c812de11883041baae43bde3e857c348', 'request_id': 'req-1535c026-547f-45f7-b0db-7eb08d355ab3'} {{(pid=101893) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:09:36.461243 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.notifications [None req-1535c026-547f-45f7-b0db-7eb08d355ab3 admin admin] The token cache is being invalidate because project c812de11883041baae43bde3e857c348 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=101893) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 25 15:09:36.461537 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.notifications [None req-1535c026-547f-45f7-b0db-7eb08d355ab3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=101893) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:09:36.462139 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.notifications [None req-1535c026-547f-45f7-b0db-7eb08d355ab3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=101893) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:09:36.463705 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 1143/2260] 10.222.0.84 () {58 vars in 1232 bytes} [Wed May 25 15:09:36 2022] DELETE /identity/v3/projects/c812de11883041baae43bde3e857c348 => generated 0 bytes in 299 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 15:09:36.468764 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4358ddb8-4afd-44c5-a8ab-bf249ffc5379 None None] REQUEST_METHOD: `POST` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:09:36.469264 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4358ddb8-4afd-44c5-a8ab-bf249ffc5379 None None] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:09:36.469381 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4358ddb8-4afd-44c5-a8ab-bf249ffc5379 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:09:36.487238 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.auth.core [None req-4358ddb8-4afd-44c5-a8ab-bf249ffc5379 None None] MFA Rules not processed for user `05d87e87798e429aa1c10b24391f915e`. Rule list: `[]` (Enabled: `True`). {{(pid=101892) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:09:36.488455 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.fernet_utils [None req-4358ddb8-4afd-44c5-a8ab-bf249ffc5379 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=101892) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:09:36.547442 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 1118/2261] 10.222.0.84 () {58 vars in 957 bytes} [Wed May 25 15:09:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 15:09:36.556484 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e87ba2e-c822-4ee8-af06-06022720d7f2 None None] REQUEST_METHOD: `POST` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:09:36.556779 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e87ba2e-c822-4ee8-af06-06022720d7f2 None None] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:09:36.557073 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e87ba2e-c822-4ee8-af06-06022720d7f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:09:36.575905 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.auth.core [None req-4e87ba2e-c822-4ee8-af06-06022720d7f2 None None] MFA Rules not processed for user `05d87e87798e429aa1c10b24391f915e`. Rule list: `[]` (Enabled: `True`). {{(pid=101893) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:09:36.577113 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.fernet_utils [None req-4e87ba2e-c822-4ee8-af06-06022720d7f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=101893) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:09:36.586063 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 1144/2262] 10.222.0.84 () {58 vars in 957 bytes} [Wed May 25 15:09:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 15:09:36.590322 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4358ddb8-4afd-44c5-a8ab-bf249ffc5379 None None] Authenticating user token {{(pid=101892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:09:36.599904 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4358ddb8-4afd-44c5-a8ab-bf249ffc5379 None None] Validating token access rules against request {{(pid=101892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:09:36.604410 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fedad87c-f912-40f1-9f51-31d1b3283fbf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cec56f74b2fa4826a506dc7b919465be', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:09:36.605058 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fedad87c-f912-40f1-9f51-31d1b3283fbf admin admin] REQUEST_METHOD: `GET` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:09:36.605348 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fedad87c-f912-40f1-9f51-31d1b3283fbf admin admin] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:09:36.605626 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fedad87c-f912-40f1-9f51-31d1b3283fbf admin admin] PATH_INFO: `/v3/domains` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:09:36.606349 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fedad87c-f912-40f1-9f51-31d1b3283fbf admin admin] RBAC: Adding query filter params (name=Default) {{(pid=101892) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 15:09:36.606656 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fedad87c-f912-40f1-9f51-31d1b3283fbf admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:09:36.608318 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fedad87c-f912-40f1-9f51-31d1b3283fbf admin admin] RBAC: Authorization granted {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:09:36.619825 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 1119/2263] 10.222.0.84 () {58 vars in 1152 bytes} [Wed May 25 15:09:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 15:09:36.623947 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e87ba2e-c822-4ee8-af06-06022720d7f2 None None] Authenticating user token {{(pid=101893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:09:36.633756 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e87ba2e-c822-4ee8-af06-06022720d7f2 None None] Validating token access rules against request {{(pid=101893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:09:36.638461 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3be4b65-804a-442f-88e3-c45804c6968e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cec56f74b2fa4826a506dc7b919465be', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:09:36.639110 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3be4b65-804a-442f-88e3-c45804c6968e admin admin] REQUEST_METHOD: `POST` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:09:36.639400 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3be4b65-804a-442f-88e3-c45804c6968e admin admin] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:09:36.639724 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3be4b65-804a-442f-88e3-c45804c6968e admin admin] PATH_INFO: `/v3/projects` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:09:36.640415 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3be4b65-804a-442f-88e3-c45804c6968e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:09:36.642331 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3be4b65-804a-442f-88e3-c45804c6968e admin admin] RBAC: Authorization granted {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:09:36.748368 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 1145/2264] 10.222.0.84 () {60 vars in 1152 bytes} [Wed May 25 15:09:36 2022] POST /identity/v3/projects => generated 377 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 15:09:36.752506 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fedad87c-f912-40f1-9f51-31d1b3283fbf admin admin] Authenticating user token {{(pid=101892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:09:36.763187 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fedad87c-f912-40f1-9f51-31d1b3283fbf admin admin] Validating token access rules against request {{(pid=101892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:09:36.818070 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05902f88-63d4-4a9a-9229-b1a8a2c5adb9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cec56f74b2fa4826a506dc7b919465be', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:09:36.818734 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05902f88-63d4-4a9a-9229-b1a8a2c5adb9 admin admin] REQUEST_METHOD: `POST` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:09:36.819733 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05902f88-63d4-4a9a-9229-b1a8a2c5adb9 admin admin] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:09:36.820008 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05902f88-63d4-4a9a-9229-b1a8a2c5adb9 admin admin] PATH_INFO: `/v3/users` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:09:36.820700 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05902f88-63d4-4a9a-9229-b1a8a2c5adb9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:09:36.822869 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05902f88-63d4-4a9a-9229-b1a8a2c5adb9 admin admin] RBAC: Authorization granted {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:09:36.883527 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 1120/2265] 10.222.0.84 () {60 vars in 1143 bytes} [Wed May 25 15:09:36 2022] POST /identity/v3/users => generated 289 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 25 15:09:36.887499 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3be4b65-804a-442f-88e3-c45804c6968e admin admin] Authenticating user token {{(pid=101893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:09:36.898086 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3be4b65-804a-442f-88e3-c45804c6968e admin admin] Validating token access rules against request {{(pid=101893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:09:36.902833 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e32ab42f-2f9a-4415-bcbc-935b14bb9d1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cec56f74b2fa4826a506dc7b919465be', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:09:36.903498 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32ab42f-2f9a-4415-bcbc-935b14bb9d1f admin admin] REQUEST_METHOD: `GET` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:09:36.903822 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32ab42f-2f9a-4415-bcbc-935b14bb9d1f admin admin] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:09:36.904113 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32ab42f-2f9a-4415-bcbc-935b14bb9d1f admin admin] PATH_INFO: `/v3/roles` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:09:36.904835 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e32ab42f-2f9a-4415-bcbc-935b14bb9d1f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:09:36.906451 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e32ab42f-2f9a-4415-bcbc-935b14bb9d1f admin admin] RBAC: Authorization granted {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:09:36.918175 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 1146/2266] 10.222.0.84 () {58 vars in 1121 bytes} [Wed May 25 15:09:36 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 15:09:36.921783 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05902f88-63d4-4a9a-9229-b1a8a2c5adb9 admin admin] Authenticating user token {{(pid=101892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:09:36.932481 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05902f88-63d4-4a9a-9229-b1a8a2c5adb9 admin admin] Validating token access rules against request {{(pid=101892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:09:36.937085 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22edc0be-e776-4ef4-907f-d3573fd60e4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cec56f74b2fa4826a506dc7b919465be', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:09:36.937740 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22edc0be-e776-4ef4-907f-d3573fd60e4c admin admin] REQUEST_METHOD: `GET` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:09:36.938023 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22edc0be-e776-4ef4-907f-d3573fd60e4c admin admin] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:09:36.938300 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22edc0be-e776-4ef4-907f-d3573fd60e4c admin admin] PATH_INFO: `/v3/roles` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:09:36.939020 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22edc0be-e776-4ef4-907f-d3573fd60e4c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:09:36.940645 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22edc0be-e776-4ef4-907f-d3573fd60e4c admin admin] RBAC: Authorization granted {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:09:36.951193 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 1121/2267] 10.222.0.84 () {58 vars in 1121 bytes} [Wed May 25 15:09:36 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 15:09:36.955000 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e32ab42f-2f9a-4415-bcbc-935b14bb9d1f admin admin] Authenticating user token {{(pid=101893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:09:36.964680 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e32ab42f-2f9a-4415-bcbc-935b14bb9d1f admin admin] Validating token access rules against request {{(pid=101893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:09:36.969448 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36753541-2f7c-4c51-bfaa-3d66115ee5c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cec56f74b2fa4826a506dc7b919465be', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:09:36.970322 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36753541-2f7c-4c51-bfaa-3d66115ee5c1 admin admin] REQUEST_METHOD: `PUT` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:09:36.970606 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36753541-2f7c-4c51-bfaa-3d66115ee5c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:09:36.971071 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36753541-2f7c-4c51-bfaa-3d66115ee5c1 admin admin] PATH_INFO: `/v3/projects/002db5734c6d455eb6c46150d780dc47/users/82798876421548029069bca5319f142b/roles/ff664fa0db7e4262a5accde96c3df4c3` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:09:36.985609 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36753541-2f7c-4c51-bfaa-3d66115ee5c1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=002db5734c6d455eb6c46150d780dc47, user_id=82798876421548029069bca5319f142b, role_id=ff664fa0db7e4262a5accde96c3df4c3)` {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:09:36.988345 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36753541-2f7c-4c51-bfaa-3d66115ee5c1 admin admin] RBAC: Authorization granted {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:09:37.066013 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 1147/2268] 10.222.0.84 () {60 vars in 1482 bytes} [Wed May 25 15:09:36 2022] PUT /identity/v3/projects/002db5734c6d455eb6c46150d780dc47/users/82798876421548029069bca5319f142b/roles/ff664fa0db7e4262a5accde96c3df4c3 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 25 15:09:37.076687 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6ed635-5c67-4bc2-a1ab-9fe4eb0471d1 None None] REQUEST_METHOD: `POST` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:09:37.076978 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6ed635-5c67-4bc2-a1ab-9fe4eb0471d1 None None] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:09:37.077260 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6ed635-5c67-4bc2-a1ab-9fe4eb0471d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:09:37.103671 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.auth.core [None req-4f6ed635-5c67-4bc2-a1ab-9fe4eb0471d1 None None] MFA Rules not processed for user `82798876421548029069bca5319f142b`. Rule list: `[]` (Enabled: `True`). {{(pid=101892) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:09:37.104894 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.fernet_utils [None req-4f6ed635-5c67-4bc2-a1ab-9fe4eb0471d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=101892) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:09:37.128730 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG dbcounter [-] [101892] Writing DB stats keystone:SELECT=93,keystone:DELETE=3,keystone:INSERT=4 {{(pid=101892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:09:37.174356 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 1122/2269] 10.222.0.84 () {58 vars in 957 bytes} [Wed May 25 15:09:37 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 15:09:37.178318 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36753541-2f7c-4c51-bfaa-3d66115ee5c1 admin admin] Authenticating user token {{(pid=101893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:09:37.240563 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36753541-2f7c-4c51-bfaa-3d66115ee5c1 admin admin] Validating token access rules against request {{(pid=101893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:09:37.245794 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ace4496d-0fa9-4209-a302-9a6f5d9dba0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cec56f74b2fa4826a506dc7b919465be', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:09:37.246440 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace4496d-0fa9-4209-a302-9a6f5d9dba0f admin admin] REQUEST_METHOD: `POST` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:09:37.246722 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace4496d-0fa9-4209-a302-9a6f5d9dba0f admin admin] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:09:37.246997 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace4496d-0fa9-4209-a302-9a6f5d9dba0f admin admin] PATH_INFO: `/v3/projects` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:09:37.247762 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ace4496d-0fa9-4209-a302-9a6f5d9dba0f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:09:37.249664 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ace4496d-0fa9-4209-a302-9a6f5d9dba0f admin admin] RBAC: Authorization granted {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:09:37.252843 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG dbcounter [-] [101893] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=101893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:09:37.333530 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 1148/2270] 10.222.0.84 () {60 vars in 1152 bytes} [Wed May 25 15:09:37 2022] POST /identity/v3/projects => generated 379 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 25 15:09:37.334701 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f6ed635-5c67-4bc2-a1ab-9fe4eb0471d1 None None] Authenticating user token {{(pid=101892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:09:37.345444 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f6ed635-5c67-4bc2-a1ab-9fe4eb0471d1 None None] Validating token access rules against request {{(pid=101892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:09:37.404233 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7242cfc2-e213-45a4-ac82-fbb331a1d816 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cec56f74b2fa4826a506dc7b919465be', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:09:37.404921 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7242cfc2-e213-45a4-ac82-fbb331a1d816 admin admin] REQUEST_METHOD: `POST` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:09:37.405208 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7242cfc2-e213-45a4-ac82-fbb331a1d816 admin admin] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:09:37.405926 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7242cfc2-e213-45a4-ac82-fbb331a1d816 admin admin] PATH_INFO: `/v3/users` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:09:37.406310 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7242cfc2-e213-45a4-ac82-fbb331a1d816 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:09:37.408471 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7242cfc2-e213-45a4-ac82-fbb331a1d816 admin admin] RBAC: Authorization granted {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:09:37.484032 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 1123/2271] 10.222.0.84 () {60 vars in 1143 bytes} [Wed May 25 15:09:37 2022] POST /identity/v3/users => generated 296 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 15:09:37.487988 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ace4496d-0fa9-4209-a302-9a6f5d9dba0f admin admin] Authenticating user token {{(pid=101893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:09:37.498409 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ace4496d-0fa9-4209-a302-9a6f5d9dba0f admin admin] Validating token access rules against request {{(pid=101893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:09:37.503549 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc1d4732-0039-4294-8a75-92410ccfa6eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cec56f74b2fa4826a506dc7b919465be', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:09:37.504417 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1d4732-0039-4294-8a75-92410ccfa6eb admin admin] REQUEST_METHOD: `GET` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:09:37.504798 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1d4732-0039-4294-8a75-92410ccfa6eb admin admin] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:09:37.505175 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1d4732-0039-4294-8a75-92410ccfa6eb admin admin] PATH_INFO: `/v3/roles` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:09:37.506004 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc1d4732-0039-4294-8a75-92410ccfa6eb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:09:37.507771 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc1d4732-0039-4294-8a75-92410ccfa6eb admin admin] RBAC: Authorization granted {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:09:37.518793 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 1149/2272] 10.222.0.84 () {58 vars in 1121 bytes} [Wed May 25 15:09:37 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 15:09:37.523658 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7242cfc2-e213-45a4-ac82-fbb331a1d816 admin admin] Authenticating user token {{(pid=101892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:09:37.533958 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7242cfc2-e213-45a4-ac82-fbb331a1d816 admin admin] Validating token access rules against request {{(pid=101892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:09:37.539163 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4128a68d-df31-4bb4-8500-74b3ad66dcee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cec56f74b2fa4826a506dc7b919465be', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:09:37.540098 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4128a68d-df31-4bb4-8500-74b3ad66dcee admin admin] REQUEST_METHOD: `PUT` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:09:37.540386 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4128a68d-df31-4bb4-8500-74b3ad66dcee admin admin] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:09:37.540665 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4128a68d-df31-4bb4-8500-74b3ad66dcee admin admin] PATH_INFO: `/v3/projects/91f69bfb9cd046699b221af1ecbc6048/users/3ffd61a4d41244c3aa65826144e1b8d0/roles/a3b78e7d547d4d2d998b4c99a4396bba` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:09:37.555652 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4128a68d-df31-4bb4-8500-74b3ad66dcee admin admin] RBAC: Authorizing `identity:create_grant(project_id=91f69bfb9cd046699b221af1ecbc6048, user_id=3ffd61a4d41244c3aa65826144e1b8d0, role_id=a3b78e7d547d4d2d998b4c99a4396bba)` {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:09:37.558493 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4128a68d-df31-4bb4-8500-74b3ad66dcee admin admin] RBAC: Authorization granted {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:09:37.608711 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 1124/2273] 10.222.0.84 () {60 vars in 1482 bytes} [Wed May 25 15:09:37 2022] PUT /identity/v3/projects/91f69bfb9cd046699b221af1ecbc6048/users/3ffd61a4d41244c3aa65826144e1b8d0/roles/a3b78e7d547d4d2d998b4c99a4396bba => generated 0 bytes in 86 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 15:09:37.612672 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc1d4732-0039-4294-8a75-92410ccfa6eb admin admin] Authenticating user token {{(pid=101893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:09:37.622690 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc1d4732-0039-4294-8a75-92410ccfa6eb admin admin] Validating token access rules against request {{(pid=101893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:09:37.678914 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf4a102e-9291-4223-abc0-e7057e4bd851 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cec56f74b2fa4826a506dc7b919465be', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:09:37.679615 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf4a102e-9291-4223-abc0-e7057e4bd851 admin admin] REQUEST_METHOD: `GET` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:09:37.679907 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf4a102e-9291-4223-abc0-e7057e4bd851 admin admin] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:09:37.680186 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf4a102e-9291-4223-abc0-e7057e4bd851 admin admin] PATH_INFO: `/v3/roles` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:09:37.680910 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf4a102e-9291-4223-abc0-e7057e4bd851 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:09:37.682527 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf4a102e-9291-4223-abc0-e7057e4bd851 admin admin] RBAC: Authorization granted {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:09:37.692285 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 1150/2274] 10.222.0.84 () {58 vars in 1121 bytes} [Wed May 25 15:09:37 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 15:09:37.696748 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4128a68d-df31-4bb4-8500-74b3ad66dcee admin admin] Authenticating user token {{(pid=101892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:09:37.706789 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4128a68d-df31-4bb4-8500-74b3ad66dcee admin admin] Validating token access rules against request {{(pid=101892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:09:37.711924 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32afcd6e-151f-4155-93b5-5ddc9946a86a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cec56f74b2fa4826a506dc7b919465be', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:09:37.712800 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32afcd6e-151f-4155-93b5-5ddc9946a86a admin admin] REQUEST_METHOD: `PUT` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:09:37.713086 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32afcd6e-151f-4155-93b5-5ddc9946a86a admin admin] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:09:37.713363 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32afcd6e-151f-4155-93b5-5ddc9946a86a admin admin] PATH_INFO: `/v3/projects/91f69bfb9cd046699b221af1ecbc6048/users/3ffd61a4d41244c3aa65826144e1b8d0/roles/a3b78e7d547d4d2d998b4c99a4396bba` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:09:37.715383 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32afcd6e-151f-4155-93b5-5ddc9946a86a admin admin] RBAC: Authorizing `identity:create_grant(project_id=91f69bfb9cd046699b221af1ecbc6048, user_id=3ffd61a4d41244c3aa65826144e1b8d0, role_id=a3b78e7d547d4d2d998b4c99a4396bba)` {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:09:37.718021 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32afcd6e-151f-4155-93b5-5ddc9946a86a admin admin] RBAC: Authorization granted {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:09:37.728113 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 1125/2275] 10.222.0.84 () {60 vars in 1482 bytes} [Wed May 25 15:09:37 2022] PUT /identity/v3/projects/91f69bfb9cd046699b221af1ecbc6048/users/3ffd61a4d41244c3aa65826144e1b8d0/roles/a3b78e7d547d4d2d998b4c99a4396bba => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 15:09:37.738170 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd9dd9e-d7de-4e1c-907f-60efa1d95bc3 None None] REQUEST_METHOD: `POST` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:09:37.738459 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd9dd9e-d7de-4e1c-907f-60efa1d95bc3 None None] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:09:37.738737 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd9dd9e-d7de-4e1c-907f-60efa1d95bc3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:09:37.765412 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.auth.core [None req-1bd9dd9e-d7de-4e1c-907f-60efa1d95bc3 None None] MFA Rules not processed for user `3ffd61a4d41244c3aa65826144e1b8d0`. Rule list: `[]` (Enabled: `True`). {{(pid=101893) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:09:37.766596 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.fernet_utils [None req-1bd9dd9e-d7de-4e1c-907f-60efa1d95bc3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=101893) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:09:37.854003 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 1151/2276] 10.222.0.84 () {58 vars in 957 bytes} [Wed May 25 15:09:37 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 15:09:37.865504 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32afcd6e-151f-4155-93b5-5ddc9946a86a admin admin] Authenticating user token {{(pid=101892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:09:37.868960 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.fernet_utils [None req-32afcd6e-151f-4155-93b5-5ddc9946a86a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=101892) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:09:37.924803 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32afcd6e-151f-4155-93b5-5ddc9946a86a admin admin] Validating token access rules against request {{(pid=101892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:09:37.928502 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8043ef9a-d34f-4161-8ad2-f1e8c01ae516 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e079f89a5e524ab6ad4183e4f690de07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a000829c658c4a7cab67f7b6353ba3fa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:09:37.929733 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8043ef9a-d34f-4161-8ad2-f1e8c01ae516 service cinder] REQUEST_METHOD: `GET` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:09:37.930017 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8043ef9a-d34f-4161-8ad2-f1e8c01ae516 service cinder] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:09:37.930290 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8043ef9a-d34f-4161-8ad2-f1e8c01ae516 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:09:37.959519 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG dbcounter [-] [101892] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=101892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:09:37.985855 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8043ef9a-d34f-4161-8ad2-f1e8c01ae516 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:09:37.987231 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8043ef9a-d34f-4161-8ad2-f1e8c01ae516 service cinder] RBAC: Authorization granted {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:09:37.997348 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 1126/2277] 10.222.0.84 () {60 vars in 1365 bytes} [Wed May 25 15:09:37 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 15:09:39.602200 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bd9dd9e-d7de-4e1c-907f-60efa1d95bc3 None None] Authenticating user token {{(pid=101893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:09:39.603679 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.fernet_utils [None req-1bd9dd9e-d7de-4e1c-907f-60efa1d95bc3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=101893) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:09:39.615712 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bd9dd9e-d7de-4e1c-907f-60efa1d95bc3 None None] Validating token access rules against request {{(pid=101893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:09:39.619538 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d51f34a-533e-45ea-921b-4898ba1398b5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e079f89a5e524ab6ad4183e4f690de07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a000829c658c4a7cab67f7b6353ba3fa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:09:39.620240 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d51f34a-533e-45ea-921b-4898ba1398b5 service cinder] REQUEST_METHOD: `GET` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:09:39.620543 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d51f34a-533e-45ea-921b-4898ba1398b5 service cinder] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:09:39.620823 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d51f34a-533e-45ea-921b-4898ba1398b5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:09:39.630330 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d51f34a-533e-45ea-921b-4898ba1398b5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:09:39.633276 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d51f34a-533e-45ea-921b-4898ba1398b5 service cinder] RBAC: Authorization granted {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:09:39.645400 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 1152/2278] 10.222.0.84 () {60 vars in 1365 bytes} [Wed May 25 15:09:39 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 15:09:43.865175 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8043ef9a-d34f-4161-8ad2-f1e8c01ae516 service cinder] Authenticating user token {{(pid=101892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:09:43.927257 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8043ef9a-d34f-4161-8ad2-f1e8c01ae516 service cinder] Validating token access rules against request {{(pid=101892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:09:43.931807 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d4fd4ef-1410-4d2c-ac7c-0ef3f328d8f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cec56f74b2fa4826a506dc7b919465be', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:09:43.932712 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4fd4ef-1410-4d2c-ac7c-0ef3f328d8f9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:09:43.932996 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4fd4ef-1410-4d2c-ac7c-0ef3f328d8f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:09:43.933274 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4fd4ef-1410-4d2c-ac7c-0ef3f328d8f9 admin admin] PATH_INFO: `/v3/users/82798876421548029069bca5319f142b` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:09:43.934457 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d4fd4ef-1410-4d2c-ac7c-0ef3f328d8f9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=82798876421548029069bca5319f142b)` {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:09:43.936413 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d4fd4ef-1410-4d2c-ac7c-0ef3f328d8f9 admin admin] RBAC: Authorization granted {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:09:44.185518 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.notifications [None req-4d4fd4ef-1410-4d2c-ac7c-0ef3f328d8f9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '82798876421548029069bca5319f142b'} {{(pid=101892) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:09:44.193952 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.notifications [None req-4d4fd4ef-1410-4d2c-ac7c-0ef3f328d8f9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '82798876421548029069bca5319f142b'} {{(pid=101892) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:09:44.208023 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.notifications [None req-4d4fd4ef-1410-4d2c-ac7c-0ef3f328d8f9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '82798876421548029069bca5319f142b'} {{(pid=101892) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:09:44.208740 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.notifications [None req-4d4fd4ef-1410-4d2c-ac7c-0ef3f328d8f9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '82798876421548029069bca5319f142b'} {{(pid=101892) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:09:44.271539 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.notifications [None req-4d4fd4ef-1410-4d2c-ac7c-0ef3f328d8f9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '82798876421548029069bca5319f142b'} {{(pid=101892) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:09:44.278102 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 1127/2279] 10.222.0.84 () {58 vars in 1223 bytes} [Wed May 25 15:09:43 2022] DELETE /identity/v3/users/82798876421548029069bca5319f142b => generated 0 bytes in 413 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 15:09:44.282941 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939e29ba-a8b5-404b-8408-79d2cbe148fd None None] REQUEST_METHOD: `POST` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:09:44.283459 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939e29ba-a8b5-404b-8408-79d2cbe148fd None None] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:09:44.283612 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939e29ba-a8b5-404b-8408-79d2cbe148fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:09:44.300982 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.auth.core [None req-939e29ba-a8b5-404b-8408-79d2cbe148fd None None] MFA Rules not processed for user `05d87e87798e429aa1c10b24391f915e`. Rule list: `[]` (Enabled: `True`). {{(pid=101893) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:09:44.302324 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.fernet_utils [None req-939e29ba-a8b5-404b-8408-79d2cbe148fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=101893) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:09:44.342441 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG dbcounter [-] [101893] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=101893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:09:44.362792 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 1153/2280] 10.222.0.84 () {58 vars in 957 bytes} [Wed May 25 15:09:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 25 15:09:44.373076 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d4fd4ef-1410-4d2c-ac7c-0ef3f328d8f9 admin admin] Authenticating user token {{(pid=101892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:09:44.374513 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.fernet_utils [None req-4d4fd4ef-1410-4d2c-ac7c-0ef3f328d8f9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=101892) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:09:44.433607 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d4fd4ef-1410-4d2c-ac7c-0ef3f328d8f9 admin admin] Validating token access rules against request {{(pid=101892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:09:44.442731 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd869217-5263-484a-a9aa-d1d2702c6bbc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ce28b25b907473588ccb87dc4acc06a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a000829c658c4a7cab67f7b6353ba3fa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:09:44.442731 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd869217-5263-484a-a9aa-d1d2702c6bbc service neutron] REQUEST_METHOD: `GET` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:09:44.442731 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd869217-5263-484a-a9aa-d1d2702c6bbc service neutron] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:09:44.442731 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd869217-5263-484a-a9aa-d1d2702c6bbc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:09:44.444805 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG dbcounter [-] [101892] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=101892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:09:44.449022 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd869217-5263-484a-a9aa-d1d2702c6bbc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:09:44.450492 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd869217-5263-484a-a9aa-d1d2702c6bbc service neutron] RBAC: Authorization granted {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:09:44.460309 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 1128/2281] 10.222.0.84 () {60 vars in 1365 bytes} [Wed May 25 15:09:44 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 25 15:09:44.959472 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-939e29ba-a8b5-404b-8408-79d2cbe148fd None None] Authenticating user token {{(pid=101893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:09:44.961749 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.fernet_utils [None req-939e29ba-a8b5-404b-8408-79d2cbe148fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=101893) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:09:44.974706 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-939e29ba-a8b5-404b-8408-79d2cbe148fd None None] Validating token access rules against request {{(pid=101893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:09:44.980392 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26804470-fecb-486f-8e2d-d51c3b1376dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cec56f74b2fa4826a506dc7b919465be', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:09:44.981367 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26804470-fecb-486f-8e2d-d51c3b1376dc admin admin] REQUEST_METHOD: `DELETE` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:09:44.981656 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26804470-fecb-486f-8e2d-d51c3b1376dc admin admin] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:09:44.981935 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26804470-fecb-486f-8e2d-d51c3b1376dc admin admin] PATH_INFO: `/v3/projects/002db5734c6d455eb6c46150d780dc47` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:09:44.983818 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26804470-fecb-486f-8e2d-d51c3b1376dc admin admin] RBAC: Authorizing `identity:delete_project(project_id=002db5734c6d455eb6c46150d780dc47)` {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:09:44.985776 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26804470-fecb-486f-8e2d-d51c3b1376dc admin admin] RBAC: Authorization granted {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:09:45.080263 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.notifications [None req-26804470-fecb-486f-8e2d-d51c3b1376dc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '002db5734c6d455eb6c46150d780dc47', 'request_id': 'req-26804470-fecb-486f-8e2d-d51c3b1376dc'} {{(pid=101893) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:09:45.087274 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.notifications [None req-26804470-fecb-486f-8e2d-d51c3b1376dc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '002db5734c6d455eb6c46150d780dc47', 'request_id': 'req-26804470-fecb-486f-8e2d-d51c3b1376dc'} {{(pid=101893) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:09:45.093155 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.notifications [None req-26804470-fecb-486f-8e2d-d51c3b1376dc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '002db5734c6d455eb6c46150d780dc47', 'request_id': 'req-26804470-fecb-486f-8e2d-d51c3b1376dc'} {{(pid=101893) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:09:45.169273 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.notifications [None req-26804470-fecb-486f-8e2d-d51c3b1376dc admin admin] The token cache is being invalidate because project 002db5734c6d455eb6c46150d780dc47 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=101893) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 25 15:09:45.169572 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.notifications [None req-26804470-fecb-486f-8e2d-d51c3b1376dc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=101893) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:09:45.170203 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.notifications [None req-26804470-fecb-486f-8e2d-d51c3b1376dc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=101893) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:09:45.171779 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 1154/2282] 10.222.0.84 () {58 vars in 1232 bytes} [Wed May 25 15:09:44 2022] DELETE /identity/v3/projects/002db5734c6d455eb6c46150d780dc47 => generated 0 bytes in 213 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 15:09:45.175762 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd869217-5263-484a-a9aa-d1d2702c6bbc service neutron] Authenticating user token {{(pid=101892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:09:45.185365 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd869217-5263-484a-a9aa-d1d2702c6bbc service neutron] Validating token access rules against request {{(pid=101892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:09:45.242536 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d52d1dc7-5048-4090-a799-eeb8be128bd7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cec56f74b2fa4826a506dc7b919465be', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:09:45.243421 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52d1dc7-5048-4090-a799-eeb8be128bd7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:09:45.243737 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52d1dc7-5048-4090-a799-eeb8be128bd7 admin admin] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:09:45.244027 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52d1dc7-5048-4090-a799-eeb8be128bd7 admin admin] PATH_INFO: `/v3/users/3ffd61a4d41244c3aa65826144e1b8d0` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:09:45.245228 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d52d1dc7-5048-4090-a799-eeb8be128bd7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3ffd61a4d41244c3aa65826144e1b8d0)` {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:09:45.247249 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d52d1dc7-5048-4090-a799-eeb8be128bd7 admin admin] RBAC: Authorization granted {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:09:45.423943 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.notifications [None req-d52d1dc7-5048-4090-a799-eeb8be128bd7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3ffd61a4d41244c3aa65826144e1b8d0'} {{(pid=101892) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:09:45.430894 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.notifications [None req-d52d1dc7-5048-4090-a799-eeb8be128bd7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3ffd61a4d41244c3aa65826144e1b8d0'} {{(pid=101892) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:09:45.443137 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.notifications [None req-d52d1dc7-5048-4090-a799-eeb8be128bd7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3ffd61a4d41244c3aa65826144e1b8d0'} {{(pid=101892) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:09:45.443883 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.notifications [None req-d52d1dc7-5048-4090-a799-eeb8be128bd7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3ffd61a4d41244c3aa65826144e1b8d0'} {{(pid=101892) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:09:45.535026 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.notifications [None req-d52d1dc7-5048-4090-a799-eeb8be128bd7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3ffd61a4d41244c3aa65826144e1b8d0'} {{(pid=101892) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:09:45.542890 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 1129/2283] 10.222.0.84 () {58 vars in 1223 bytes} [Wed May 25 15:09:45 2022] DELETE /identity/v3/users/3ffd61a4d41244c3aa65826144e1b8d0 => generated 0 bytes in 368 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 15:09:46.000921 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26804470-fecb-486f-8e2d-d51c3b1376dc admin admin] Authenticating user token {{(pid=101893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:09:46.007289 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.fernet_utils [None req-26804470-fecb-486f-8e2d-d51c3b1376dc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=101893) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:09:46.029407 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26804470-fecb-486f-8e2d-d51c3b1376dc admin admin] Validating token access rules against request {{(pid=101893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:09:46.091683 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62d6d3e0-fdfa-46c7-936f-31609bec9140 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cec56f74b2fa4826a506dc7b919465be', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:09:46.092942 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d6d3e0-fdfa-46c7-936f-31609bec9140 admin admin] REQUEST_METHOD: `DELETE` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:09:46.092942 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d6d3e0-fdfa-46c7-936f-31609bec9140 admin admin] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:09:46.093155 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d6d3e0-fdfa-46c7-936f-31609bec9140 admin admin] PATH_INFO: `/v3/projects/91f69bfb9cd046699b221af1ecbc6048` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:09:46.094967 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62d6d3e0-fdfa-46c7-936f-31609bec9140 admin admin] RBAC: Authorizing `identity:delete_project(project_id=91f69bfb9cd046699b221af1ecbc6048)` {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:09:46.096662 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62d6d3e0-fdfa-46c7-936f-31609bec9140 admin admin] RBAC: Authorization granted {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:09:46.240681 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.notifications [None req-62d6d3e0-fdfa-46c7-936f-31609bec9140 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '91f69bfb9cd046699b221af1ecbc6048', 'request_id': 'req-62d6d3e0-fdfa-46c7-936f-31609bec9140'} {{(pid=101893) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:09:46.248971 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.notifications [None req-62d6d3e0-fdfa-46c7-936f-31609bec9140 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '91f69bfb9cd046699b221af1ecbc6048', 'request_id': 'req-62d6d3e0-fdfa-46c7-936f-31609bec9140'} {{(pid=101893) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:09:46.255234 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.notifications [None req-62d6d3e0-fdfa-46c7-936f-31609bec9140 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '91f69bfb9cd046699b221af1ecbc6048', 'request_id': 'req-62d6d3e0-fdfa-46c7-936f-31609bec9140'} {{(pid=101893) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:09:46.260179 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG dbcounter [-] [101893] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=101893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:09:46.324221 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.notifications [None req-62d6d3e0-fdfa-46c7-936f-31609bec9140 admin admin] The token cache is being invalidate because project 91f69bfb9cd046699b221af1ecbc6048 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=101893) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 25 15:09:46.324601 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.notifications [None req-62d6d3e0-fdfa-46c7-936f-31609bec9140 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=101893) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:09:46.325347 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.notifications [None req-62d6d3e0-fdfa-46c7-936f-31609bec9140 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=101893) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:09:46.327007 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 1155/2284] 10.222.0.84 () {58 vars in 1232 bytes} [Wed May 25 15:09:45 2022] DELETE /identity/v3/projects/91f69bfb9cd046699b221af1ecbc6048 => generated 0 bytes in 327 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 15:09:46.332296 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-367fba40-ec75-4a80-ae58-2a18c7ae2969 None None] REQUEST_METHOD: `POST` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:09:46.332806 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-367fba40-ec75-4a80-ae58-2a18c7ae2969 None None] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:09:46.332893 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-367fba40-ec75-4a80-ae58-2a18c7ae2969 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:09:46.354671 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.auth.core [None req-367fba40-ec75-4a80-ae58-2a18c7ae2969 None None] MFA Rules not processed for user `05d87e87798e429aa1c10b24391f915e`. Rule list: `[]` (Enabled: `True`). {{(pid=101892) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:09:46.356740 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.fernet_utils [None req-367fba40-ec75-4a80-ae58-2a18c7ae2969 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=101892) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:09:46.431686 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 1130/2285] 10.222.0.84 () {58 vars in 957 bytes} [Wed May 25 15:09:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 15:09:46.440280 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f392b0dd-a7e8-42fe-bc56-6757d3a8b89f None None] REQUEST_METHOD: `POST` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:09:46.440572 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f392b0dd-a7e8-42fe-bc56-6757d3a8b89f None None] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:09:46.440854 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f392b0dd-a7e8-42fe-bc56-6757d3a8b89f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:09:46.462219 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.auth.core [None req-f392b0dd-a7e8-42fe-bc56-6757d3a8b89f None None] MFA Rules not processed for user `05d87e87798e429aa1c10b24391f915e`. Rule list: `[]` (Enabled: `True`). {{(pid=101893) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:09:46.463332 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.fernet_utils [None req-f392b0dd-a7e8-42fe-bc56-6757d3a8b89f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=101893) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:09:46.475412 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 1156/2286] 10.222.0.84 () {58 vars in 957 bytes} [Wed May 25 15:09:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 15:09:46.477210 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-367fba40-ec75-4a80-ae58-2a18c7ae2969 None None] Authenticating user token {{(pid=101892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:09:46.487265 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-367fba40-ec75-4a80-ae58-2a18c7ae2969 None None] Validating token access rules against request {{(pid=101892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:09:46.492156 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b567e1-5f25-4f4a-9713-9d2446bbcadc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cec56f74b2fa4826a506dc7b919465be', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:09:46.492768 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b567e1-5f25-4f4a-9713-9d2446bbcadc admin admin] REQUEST_METHOD: `GET` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:09:46.493124 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b567e1-5f25-4f4a-9713-9d2446bbcadc admin admin] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:09:46.493319 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b567e1-5f25-4f4a-9713-9d2446bbcadc admin admin] PATH_INFO: `/v3/domains` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:09:46.494187 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38b567e1-5f25-4f4a-9713-9d2446bbcadc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=101892) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 15:09:46.494506 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38b567e1-5f25-4f4a-9713-9d2446bbcadc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:09:46.496206 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38b567e1-5f25-4f4a-9713-9d2446bbcadc admin admin] RBAC: Authorization granted {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:09:46.506073 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG dbcounter [-] [101892] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=101892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:09:46.510193 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 1131/2287] 10.222.0.84 () {58 vars in 1152 bytes} [Wed May 25 15:09:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 15:09:46.520520 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f392b0dd-a7e8-42fe-bc56-6757d3a8b89f None None] Authenticating user token {{(pid=101893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:09:46.530830 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f392b0dd-a7e8-42fe-bc56-6757d3a8b89f None None] Validating token access rules against request {{(pid=101893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:09:46.536435 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bd3e927-75d3-4418-a533-38102e1809dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cec56f74b2fa4826a506dc7b919465be', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:09:46.537117 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd3e927-75d3-4418-a533-38102e1809dc admin admin] REQUEST_METHOD: `POST` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:09:46.537402 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd3e927-75d3-4418-a533-38102e1809dc admin admin] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:09:46.537679 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd3e927-75d3-4418-a533-38102e1809dc admin admin] PATH_INFO: `/v3/projects` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:09:46.539331 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bd3e927-75d3-4418-a533-38102e1809dc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:09:46.540925 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bd3e927-75d3-4418-a533-38102e1809dc admin admin] RBAC: Authorization granted {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:09:46.616761 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 1157/2288] 10.222.0.84 () {60 vars in 1152 bytes} [Wed May 25 15:09:46 2022] POST /identity/v3/projects => generated 387 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 15:09:46.620939 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b567e1-5f25-4f4a-9713-9d2446bbcadc admin admin] Authenticating user token {{(pid=101892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:09:46.631283 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b567e1-5f25-4f4a-9713-9d2446bbcadc admin admin] Validating token access rules against request {{(pid=101892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:09:46.690515 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e97f98c4-5637-4edc-9f7c-01199cb179e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cec56f74b2fa4826a506dc7b919465be', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:09:46.691190 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97f98c4-5637-4edc-9f7c-01199cb179e7 admin admin] REQUEST_METHOD: `POST` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:09:46.691476 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97f98c4-5637-4edc-9f7c-01199cb179e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:09:46.691910 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97f98c4-5637-4edc-9f7c-01199cb179e7 admin admin] PATH_INFO: `/v3/users` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:09:46.692600 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e97f98c4-5637-4edc-9f7c-01199cb179e7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:09:46.694523 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e97f98c4-5637-4edc-9f7c-01199cb179e7 admin admin] RBAC: Authorization granted {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:09:46.800327 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 1132/2289] 10.222.0.84 () {60 vars in 1143 bytes} [Wed May 25 15:09:46 2022] POST /identity/v3/users => generated 294 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 15:09:46.801932 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bd3e927-75d3-4418-a533-38102e1809dc admin admin] Authenticating user token {{(pid=101893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:09:46.812429 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bd3e927-75d3-4418-a533-38102e1809dc admin admin] Validating token access rules against request {{(pid=101893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:09:46.817106 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06bc7eff-ad09-4a24-9f48-2d3943654fa5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cec56f74b2fa4826a506dc7b919465be', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:09:46.817772 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06bc7eff-ad09-4a24-9f48-2d3943654fa5 admin admin] REQUEST_METHOD: `GET` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:09:46.818084 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06bc7eff-ad09-4a24-9f48-2d3943654fa5 admin admin] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:09:46.818359 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06bc7eff-ad09-4a24-9f48-2d3943654fa5 admin admin] PATH_INFO: `/v3/roles` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:09:46.819113 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06bc7eff-ad09-4a24-9f48-2d3943654fa5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:09:46.821592 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06bc7eff-ad09-4a24-9f48-2d3943654fa5 admin admin] RBAC: Authorization granted {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:09:46.832231 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 1158/2290] 10.222.0.84 () {58 vars in 1121 bytes} [Wed May 25 15:09:46 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 15:09:46.836853 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e97f98c4-5637-4edc-9f7c-01199cb179e7 admin admin] Authenticating user token {{(pid=101892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:09:46.847222 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e97f98c4-5637-4edc-9f7c-01199cb179e7 admin admin] Validating token access rules against request {{(pid=101892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:09:46.851996 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4977592c-69b4-460e-a0ec-c7d47ef3fb06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cec56f74b2fa4826a506dc7b919465be', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:09:46.852715 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4977592c-69b4-460e-a0ec-c7d47ef3fb06 admin admin] REQUEST_METHOD: `GET` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:09:46.852997 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4977592c-69b4-460e-a0ec-c7d47ef3fb06 admin admin] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:09:46.853275 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4977592c-69b4-460e-a0ec-c7d47ef3fb06 admin admin] PATH_INFO: `/v3/roles` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:09:46.854001 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4977592c-69b4-460e-a0ec-c7d47ef3fb06 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:09:46.855617 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4977592c-69b4-460e-a0ec-c7d47ef3fb06 admin admin] RBAC: Authorization granted {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:09:46.865551 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 1133/2291] 10.222.0.84 () {58 vars in 1121 bytes} [Wed May 25 15:09:46 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 15:09:46.869705 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06bc7eff-ad09-4a24-9f48-2d3943654fa5 admin admin] Authenticating user token {{(pid=101893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:09:46.879644 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06bc7eff-ad09-4a24-9f48-2d3943654fa5 admin admin] Validating token access rules against request {{(pid=101893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:09:46.884783 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6adb1813-a358-4dd8-88e3-88e0d9232ade admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cec56f74b2fa4826a506dc7b919465be', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:09:46.885659 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6adb1813-a358-4dd8-88e3-88e0d9232ade admin admin] REQUEST_METHOD: `PUT` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:09:46.885940 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6adb1813-a358-4dd8-88e3-88e0d9232ade admin admin] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:09:46.886214 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6adb1813-a358-4dd8-88e3-88e0d9232ade admin admin] PATH_INFO: `/v3/projects/c3639cbd364d48dd841a205ec32d8ac0/users/a18012611a2246aca45cf07a997354a8/roles/ff664fa0db7e4262a5accde96c3df4c3` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:09:46.901251 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6adb1813-a358-4dd8-88e3-88e0d9232ade admin admin] RBAC: Authorizing `identity:create_grant(project_id=c3639cbd364d48dd841a205ec32d8ac0, user_id=a18012611a2246aca45cf07a997354a8, role_id=ff664fa0db7e4262a5accde96c3df4c3)` {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:09:46.903959 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6adb1813-a358-4dd8-88e3-88e0d9232ade admin admin] RBAC: Authorization granted {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:09:47.010306 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 1159/2292] 10.222.0.84 () {60 vars in 1482 bytes} [Wed May 25 15:09:46 2022] PUT /identity/v3/projects/c3639cbd364d48dd841a205ec32d8ac0/users/a18012611a2246aca45cf07a997354a8/roles/ff664fa0db7e4262a5accde96c3df4c3 => generated 0 bytes in 141 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 25 15:09:47.020767 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53498b8e-7b2c-4e79-b4f7-947e30f086bc None None] REQUEST_METHOD: `POST` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:09:47.021064 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53498b8e-7b2c-4e79-b4f7-947e30f086bc None None] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:09:47.021375 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53498b8e-7b2c-4e79-b4f7-947e30f086bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:09:47.047916 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.auth.core [None req-53498b8e-7b2c-4e79-b4f7-947e30f086bc None None] MFA Rules not processed for user `a18012611a2246aca45cf07a997354a8`. Rule list: `[]` (Enabled: `True`). {{(pid=101892) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:09:47.049125 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.fernet_utils [None req-53498b8e-7b2c-4e79-b4f7-947e30f086bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=101892) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:09:47.111853 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 1134/2293] 10.222.0.84 () {58 vars in 957 bytes} [Wed May 25 15:09:47 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 15:09:47.117006 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6adb1813-a358-4dd8-88e3-88e0d9232ade admin admin] Authenticating user token {{(pid=101893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:09:47.175733 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6adb1813-a358-4dd8-88e3-88e0d9232ade admin admin] Validating token access rules against request {{(pid=101893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:09:47.180904 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c31074a3-8423-4986-8216-8af53650118b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cec56f74b2fa4826a506dc7b919465be', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:09:47.181547 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31074a3-8423-4986-8216-8af53650118b admin admin] REQUEST_METHOD: `POST` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:09:47.181828 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31074a3-8423-4986-8216-8af53650118b admin admin] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:09:47.182102 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31074a3-8423-4986-8216-8af53650118b admin admin] PATH_INFO: `/v3/projects` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:09:47.182776 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c31074a3-8423-4986-8216-8af53650118b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:09:47.184714 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c31074a3-8423-4986-8216-8af53650118b admin admin] RBAC: Authorization granted {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:09:47.255211 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 1160/2294] 10.222.0.84 () {60 vars in 1152 bytes} [Wed May 25 15:09:47 2022] POST /identity/v3/projects => generated 389 bytes in 139 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 25 15:09:47.259995 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53498b8e-7b2c-4e79-b4f7-947e30f086bc None None] Authenticating user token {{(pid=101892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:09:47.270616 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53498b8e-7b2c-4e79-b4f7-947e30f086bc None None] Validating token access rules against request {{(pid=101892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:09:47.328136 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59231bc3-c2b3-421a-93ed-2bdc2a31feb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cec56f74b2fa4826a506dc7b919465be', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:09:47.328913 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59231bc3-c2b3-421a-93ed-2bdc2a31feb8 admin admin] REQUEST_METHOD: `POST` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:09:47.329198 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59231bc3-c2b3-421a-93ed-2bdc2a31feb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:09:47.329477 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59231bc3-c2b3-421a-93ed-2bdc2a31feb8 admin admin] PATH_INFO: `/v3/users` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:09:47.330173 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59231bc3-c2b3-421a-93ed-2bdc2a31feb8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:09:47.332154 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59231bc3-c2b3-421a-93ed-2bdc2a31feb8 admin admin] RBAC: Authorization granted {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:09:47.409205 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG dbcounter [-] [101892] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=101892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:09:47.415367 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 1135/2295] 10.222.0.84 () {60 vars in 1143 bytes} [Wed May 25 15:09:47 2022] POST /identity/v3/users => generated 301 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 25 15:09:47.419252 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c31074a3-8423-4986-8216-8af53650118b admin admin] Authenticating user token {{(pid=101893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:09:47.430074 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c31074a3-8423-4986-8216-8af53650118b admin admin] Validating token access rules against request {{(pid=101893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:09:47.434708 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b04bcc76-3ba6-4751-ae88-8977dfd377f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cec56f74b2fa4826a506dc7b919465be', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:09:47.435363 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04bcc76-3ba6-4751-ae88-8977dfd377f1 admin admin] REQUEST_METHOD: `GET` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:09:47.435733 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04bcc76-3ba6-4751-ae88-8977dfd377f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:09:47.436008 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04bcc76-3ba6-4751-ae88-8977dfd377f1 admin admin] PATH_INFO: `/v3/roles` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:09:47.436730 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b04bcc76-3ba6-4751-ae88-8977dfd377f1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:09:47.438318 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b04bcc76-3ba6-4751-ae88-8977dfd377f1 admin admin] RBAC: Authorization granted {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:09:47.449621 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 1161/2296] 10.222.0.84 () {58 vars in 1121 bytes} [Wed May 25 15:09:47 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 15:09:47.453672 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59231bc3-c2b3-421a-93ed-2bdc2a31feb8 admin admin] Authenticating user token {{(pid=101892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:09:47.463485 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59231bc3-c2b3-421a-93ed-2bdc2a31feb8 admin admin] Validating token access rules against request {{(pid=101892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:09:47.468677 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfc10153-257e-42cd-8d37-956188322faf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cec56f74b2fa4826a506dc7b919465be', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:09:47.469544 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc10153-257e-42cd-8d37-956188322faf admin admin] REQUEST_METHOD: `PUT` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:09:47.469827 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc10153-257e-42cd-8d37-956188322faf admin admin] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:09:47.470158 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc10153-257e-42cd-8d37-956188322faf admin admin] PATH_INFO: `/v3/projects/648ba959b83f4629b0a668426fd610fc/users/b48902b4d3e845a787a1ea1d8155cfa4/roles/a3b78e7d547d4d2d998b4c99a4396bba` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:09:47.484743 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfc10153-257e-42cd-8d37-956188322faf admin admin] RBAC: Authorizing `identity:create_grant(project_id=648ba959b83f4629b0a668426fd610fc, user_id=b48902b4d3e845a787a1ea1d8155cfa4, role_id=a3b78e7d547d4d2d998b4c99a4396bba)` {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:09:47.487634 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfc10153-257e-42cd-8d37-956188322faf admin admin] RBAC: Authorization granted {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:09:47.546556 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 1136/2297] 10.222.0.84 () {60 vars in 1482 bytes} [Wed May 25 15:09:47 2022] PUT /identity/v3/projects/648ba959b83f4629b0a668426fd610fc/users/b48902b4d3e845a787a1ea1d8155cfa4/roles/a3b78e7d547d4d2d998b4c99a4396bba => generated 0 bytes in 93 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 15:09:47.550489 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b04bcc76-3ba6-4751-ae88-8977dfd377f1 admin admin] Authenticating user token {{(pid=101893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:09:47.561662 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b04bcc76-3ba6-4751-ae88-8977dfd377f1 admin admin] Validating token access rules against request {{(pid=101893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:09:47.618166 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-452ce351-114a-4387-9a6e-931ced96a98b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cec56f74b2fa4826a506dc7b919465be', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:09:47.618832 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452ce351-114a-4387-9a6e-931ced96a98b admin admin] REQUEST_METHOD: `GET` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:09:47.619116 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452ce351-114a-4387-9a6e-931ced96a98b admin admin] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:09:47.619395 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452ce351-114a-4387-9a6e-931ced96a98b admin admin] PATH_INFO: `/v3/roles` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:09:47.620166 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-452ce351-114a-4387-9a6e-931ced96a98b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:09:47.621766 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-452ce351-114a-4387-9a6e-931ced96a98b admin admin] RBAC: Authorization granted {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:09:47.631349 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 1162/2298] 10.222.0.84 () {58 vars in 1121 bytes} [Wed May 25 15:09:47 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 15:09:47.636057 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfc10153-257e-42cd-8d37-956188322faf admin admin] Authenticating user token {{(pid=101892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:09:47.646322 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfc10153-257e-42cd-8d37-956188322faf admin admin] Validating token access rules against request {{(pid=101892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:09:47.651428 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-023ec66f-0c99-4bcd-bfc9-e7bcbb75f608 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cec56f74b2fa4826a506dc7b919465be', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:09:47.652332 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023ec66f-0c99-4bcd-bfc9-e7bcbb75f608 admin admin] REQUEST_METHOD: `PUT` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:09:47.652618 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023ec66f-0c99-4bcd-bfc9-e7bcbb75f608 admin admin] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:09:47.652896 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023ec66f-0c99-4bcd-bfc9-e7bcbb75f608 admin admin] PATH_INFO: `/v3/projects/648ba959b83f4629b0a668426fd610fc/users/b48902b4d3e845a787a1ea1d8155cfa4/roles/a3b78e7d547d4d2d998b4c99a4396bba` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:09:47.654839 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-023ec66f-0c99-4bcd-bfc9-e7bcbb75f608 admin admin] RBAC: Authorizing `identity:create_grant(project_id=648ba959b83f4629b0a668426fd610fc, user_id=b48902b4d3e845a787a1ea1d8155cfa4, role_id=a3b78e7d547d4d2d998b4c99a4396bba)` {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:09:47.657521 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-023ec66f-0c99-4bcd-bfc9-e7bcbb75f608 admin admin] RBAC: Authorization granted {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:09:47.667720 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 1137/2299] 10.222.0.84 () {60 vars in 1482 bytes} [Wed May 25 15:09:47 2022] PUT /identity/v3/projects/648ba959b83f4629b0a668426fd610fc/users/b48902b4d3e845a787a1ea1d8155cfa4/roles/a3b78e7d547d4d2d998b4c99a4396bba => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 15:09:47.684078 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d22c6ca-f7d2-4d69-ad3f-e83d7fd2b19b None None] REQUEST_METHOD: `POST` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:09:47.684384 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d22c6ca-f7d2-4d69-ad3f-e83d7fd2b19b None None] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:09:47.684636 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d22c6ca-f7d2-4d69-ad3f-e83d7fd2b19b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:09:47.690404 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG dbcounter [-] [101893] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=101893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:09:47.712229 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.auth.core [None req-1d22c6ca-f7d2-4d69-ad3f-e83d7fd2b19b None None] MFA Rules not processed for user `b48902b4d3e845a787a1ea1d8155cfa4`. Rule list: `[]` (Enabled: `True`). {{(pid=101893) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:09:47.713435 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.fernet_utils [None req-1d22c6ca-f7d2-4d69-ad3f-e83d7fd2b19b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=101893) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:09:47.782930 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 1163/2300] 10.222.0.84 () {58 vars in 957 bytes} [Wed May 25 15:09:47 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 15:09:47.793504 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-023ec66f-0c99-4bcd-bfc9-e7bcbb75f608 admin admin] Authenticating user token {{(pid=101892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:09:47.795220 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.fernet_utils [None req-023ec66f-0c99-4bcd-bfc9-e7bcbb75f608 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=101892) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:09:47.853518 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-023ec66f-0c99-4bcd-bfc9-e7bcbb75f608 admin admin] Validating token access rules against request {{(pid=101892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:09:47.857189 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1b32f9f-f44b-4c47-a8e6-2792d637c76a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e079f89a5e524ab6ad4183e4f690de07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a000829c658c4a7cab67f7b6353ba3fa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:09:47.857831 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b32f9f-f44b-4c47-a8e6-2792d637c76a service cinder] REQUEST_METHOD: `GET` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:09:47.858114 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b32f9f-f44b-4c47-a8e6-2792d637c76a service cinder] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:09:47.858391 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b32f9f-f44b-4c47-a8e6-2792d637c76a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:09:47.867937 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1b32f9f-f44b-4c47-a8e6-2792d637c76a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:09:47.869394 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1b32f9f-f44b-4c47-a8e6-2792d637c76a service cinder] RBAC: Authorization granted {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:09:47.878854 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 1138/2301] 10.222.0.84 () {60 vars in 1365 bytes} [Wed May 25 15:09:47 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 15:09:48.006182 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d22c6ca-f7d2-4d69-ad3f-e83d7fd2b19b None None] Authenticating user token {{(pid=101893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:09:48.069402 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d22c6ca-f7d2-4d69-ad3f-e83d7fd2b19b None None] Validating token access rules against request {{(pid=101893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:09:48.074288 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a025fbb0-44d1-40c4-a3d9-8edd9c6ba29f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cec56f74b2fa4826a506dc7b919465be', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:09:48.075158 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a025fbb0-44d1-40c4-a3d9-8edd9c6ba29f admin admin] REQUEST_METHOD: `DELETE` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:09:48.075470 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a025fbb0-44d1-40c4-a3d9-8edd9c6ba29f admin admin] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:09:48.075792 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a025fbb0-44d1-40c4-a3d9-8edd9c6ba29f admin admin] PATH_INFO: `/v3/users/a18012611a2246aca45cf07a997354a8` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:09:48.077004 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a025fbb0-44d1-40c4-a3d9-8edd9c6ba29f admin admin] RBAC: Authorizing `identity:delete_user(user_id=a18012611a2246aca45cf07a997354a8)` {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:09:48.078947 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a025fbb0-44d1-40c4-a3d9-8edd9c6ba29f admin admin] RBAC: Authorization granted {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:09:48.234084 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.notifications [None req-a025fbb0-44d1-40c4-a3d9-8edd9c6ba29f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a18012611a2246aca45cf07a997354a8'} {{(pid=101893) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:09:48.240874 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.notifications [None req-a025fbb0-44d1-40c4-a3d9-8edd9c6ba29f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a18012611a2246aca45cf07a997354a8'} {{(pid=101893) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:09:48.252743 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.notifications [None req-a025fbb0-44d1-40c4-a3d9-8edd9c6ba29f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a18012611a2246aca45cf07a997354a8'} {{(pid=101893) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:09:48.253408 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.notifications [None req-a025fbb0-44d1-40c4-a3d9-8edd9c6ba29f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a18012611a2246aca45cf07a997354a8'} {{(pid=101893) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:09:48.254029 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.notifications [None req-a025fbb0-44d1-40c4-a3d9-8edd9c6ba29f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a18012611a2246aca45cf07a997354a8'} {{(pid=101893) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:09:48.340083 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 1164/2302] 10.222.0.84 () {58 vars in 1223 bytes} [Wed May 25 15:09:48 2022] DELETE /identity/v3/users/a18012611a2246aca45cf07a997354a8 => generated 0 bytes in 334 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 15:09:48.344604 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7308d151-61be-4f77-b345-ea2d91540598 None None] REQUEST_METHOD: `POST` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:09:48.345448 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7308d151-61be-4f77-b345-ea2d91540598 None None] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:09:48.345448 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7308d151-61be-4f77-b345-ea2d91540598 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:09:48.362776 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.auth.core [None req-7308d151-61be-4f77-b345-ea2d91540598 None None] MFA Rules not processed for user `05d87e87798e429aa1c10b24391f915e`. Rule list: `[]` (Enabled: `True`). {{(pid=101892) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:09:48.364038 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.fernet_utils [None req-7308d151-61be-4f77-b345-ea2d91540598 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=101892) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:09:48.422858 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 1139/2303] 10.222.0.84 () {58 vars in 957 bytes} [Wed May 25 15:09:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 15:09:48.432483 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a025fbb0-44d1-40c4-a3d9-8edd9c6ba29f admin admin] Authenticating user token {{(pid=101893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:09:48.433884 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.fernet_utils [None req-a025fbb0-44d1-40c4-a3d9-8edd9c6ba29f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=101893) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:09:48.443633 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG dbcounter [-] [101893] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=101893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:09:48.491949 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a025fbb0-44d1-40c4-a3d9-8edd9c6ba29f admin admin] Validating token access rules against request {{(pid=101893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:09:48.495464 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad7590fb-7003-4231-88dd-4cb9c1cf0074 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ce28b25b907473588ccb87dc4acc06a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a000829c658c4a7cab67f7b6353ba3fa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:09:48.496173 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7590fb-7003-4231-88dd-4cb9c1cf0074 service neutron] REQUEST_METHOD: `GET` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:09:48.496461 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7590fb-7003-4231-88dd-4cb9c1cf0074 service neutron] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:09:48.496741 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7590fb-7003-4231-88dd-4cb9c1cf0074 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:09:48.505837 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad7590fb-7003-4231-88dd-4cb9c1cf0074 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:09:48.508261 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad7590fb-7003-4231-88dd-4cb9c1cf0074 service neutron] RBAC: Authorization granted {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:09:48.517614 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 1165/2304] 10.222.0.84 () {60 vars in 1365 bytes} [Wed May 25 15:09:48 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 15:09:48.975647 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7308d151-61be-4f77-b345-ea2d91540598 None None] Authenticating user token {{(pid=101892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:09:48.980564 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.fernet_utils [None req-7308d151-61be-4f77-b345-ea2d91540598 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=101892) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:09:48.991388 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7308d151-61be-4f77-b345-ea2d91540598 None None] Validating token access rules against request {{(pid=101892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:09:48.996718 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2299e77-17a6-4db4-ba81-3f619f4e67d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cec56f74b2fa4826a506dc7b919465be', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:09:48.998283 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2299e77-17a6-4db4-ba81-3f619f4e67d2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:09:48.998578 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2299e77-17a6-4db4-ba81-3f619f4e67d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:09:48.999471 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2299e77-17a6-4db4-ba81-3f619f4e67d2 admin admin] PATH_INFO: `/v3/projects/c3639cbd364d48dd841a205ec32d8ac0` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:09:49.000146 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2299e77-17a6-4db4-ba81-3f619f4e67d2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c3639cbd364d48dd841a205ec32d8ac0)` {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:09:49.002098 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2299e77-17a6-4db4-ba81-3f619f4e67d2 admin admin] RBAC: Authorization granted {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:09:49.118578 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.notifications [None req-a2299e77-17a6-4db4-ba81-3f619f4e67d2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c3639cbd364d48dd841a205ec32d8ac0', 'request_id': 'req-a2299e77-17a6-4db4-ba81-3f619f4e67d2'} {{(pid=101892) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:09:49.124771 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.notifications [None req-a2299e77-17a6-4db4-ba81-3f619f4e67d2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c3639cbd364d48dd841a205ec32d8ac0', 'request_id': 'req-a2299e77-17a6-4db4-ba81-3f619f4e67d2'} {{(pid=101892) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:09:49.128643 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG dbcounter [-] [101892] Writing DB stats keystone:SELECT=93,keystone:INSERT=2,keystone:DELETE=5 {{(pid=101892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:09:49.130775 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.notifications [None req-a2299e77-17a6-4db4-ba81-3f619f4e67d2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c3639cbd364d48dd841a205ec32d8ac0', 'request_id': 'req-a2299e77-17a6-4db4-ba81-3f619f4e67d2'} {{(pid=101892) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:09:49.196251 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.notifications [None req-a2299e77-17a6-4db4-ba81-3f619f4e67d2 admin admin] The token cache is being invalidate because project c3639cbd364d48dd841a205ec32d8ac0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=101892) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 25 15:09:49.196526 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.notifications [None req-a2299e77-17a6-4db4-ba81-3f619f4e67d2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=101892) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:09:49.197151 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.notifications [None req-a2299e77-17a6-4db4-ba81-3f619f4e67d2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=101892) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:09:49.198730 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 1140/2305] 10.222.0.84 () {58 vars in 1232 bytes} [Wed May 25 15:09:48 2022] DELETE /identity/v3/projects/c3639cbd364d48dd841a205ec32d8ac0 => generated 0 bytes in 224 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 15:09:49.202785 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad7590fb-7003-4231-88dd-4cb9c1cf0074 service neutron] Authenticating user token {{(pid=101893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:09:49.213266 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad7590fb-7003-4231-88dd-4cb9c1cf0074 service neutron] Validating token access rules against request {{(pid=101893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:09:49.269894 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65bc00c0-890a-4044-a4b6-d59b9ee98d24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cec56f74b2fa4826a506dc7b919465be', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:09:49.270774 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65bc00c0-890a-4044-a4b6-d59b9ee98d24 admin admin] REQUEST_METHOD: `DELETE` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:09:49.271058 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65bc00c0-890a-4044-a4b6-d59b9ee98d24 admin admin] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:09:49.271335 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65bc00c0-890a-4044-a4b6-d59b9ee98d24 admin admin] PATH_INFO: `/v3/users/b48902b4d3e845a787a1ea1d8155cfa4` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:09:49.272597 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65bc00c0-890a-4044-a4b6-d59b9ee98d24 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b48902b4d3e845a787a1ea1d8155cfa4)` {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:09:49.274564 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65bc00c0-890a-4044-a4b6-d59b9ee98d24 admin admin] RBAC: Authorization granted {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:09:49.423049 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.notifications [None req-65bc00c0-890a-4044-a4b6-d59b9ee98d24 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b48902b4d3e845a787a1ea1d8155cfa4'} {{(pid=101893) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:09:49.430161 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.notifications [None req-65bc00c0-890a-4044-a4b6-d59b9ee98d24 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b48902b4d3e845a787a1ea1d8155cfa4'} {{(pid=101893) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:09:49.441905 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.notifications [None req-65bc00c0-890a-4044-a4b6-d59b9ee98d24 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b48902b4d3e845a787a1ea1d8155cfa4'} {{(pid=101893) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:09:49.442575 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.notifications [None req-65bc00c0-890a-4044-a4b6-d59b9ee98d24 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b48902b4d3e845a787a1ea1d8155cfa4'} {{(pid=101893) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:09:49.443178 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.notifications [None req-65bc00c0-890a-4044-a4b6-d59b9ee98d24 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b48902b4d3e845a787a1ea1d8155cfa4'} {{(pid=101893) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:09:49.505372 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 1166/2306] 10.222.0.84 () {58 vars in 1223 bytes} [Wed May 25 15:09:49 2022] DELETE /identity/v3/users/b48902b4d3e845a787a1ea1d8155cfa4 => generated 0 bytes in 303 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 15:09:49.930575 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2299e77-17a6-4db4-ba81-3f619f4e67d2 admin admin] Authenticating user token {{(pid=101892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:09:49.932049 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.fernet_utils [None req-a2299e77-17a6-4db4-ba81-3f619f4e67d2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=101892) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:09:49.946504 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2299e77-17a6-4db4-ba81-3f619f4e67d2 admin admin] Validating token access rules against request {{(pid=101892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:09:50.006097 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd30f804-5109-48d1-b86b-136d7f359fc9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cec56f74b2fa4826a506dc7b919465be', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:09:50.006970 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd30f804-5109-48d1-b86b-136d7f359fc9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:09:50.007285 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd30f804-5109-48d1-b86b-136d7f359fc9 admin admin] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:09:50.007588 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd30f804-5109-48d1-b86b-136d7f359fc9 admin admin] PATH_INFO: `/v3/projects/648ba959b83f4629b0a668426fd610fc` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:09:50.009297 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd30f804-5109-48d1-b86b-136d7f359fc9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=648ba959b83f4629b0a668426fd610fc)` {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:09:50.011255 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd30f804-5109-48d1-b86b-136d7f359fc9 admin admin] RBAC: Authorization granted {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:09:50.123398 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.notifications [None req-bd30f804-5109-48d1-b86b-136d7f359fc9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '648ba959b83f4629b0a668426fd610fc', 'request_id': 'req-bd30f804-5109-48d1-b86b-136d7f359fc9'} {{(pid=101892) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:09:50.129519 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.notifications [None req-bd30f804-5109-48d1-b86b-136d7f359fc9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '648ba959b83f4629b0a668426fd610fc', 'request_id': 'req-bd30f804-5109-48d1-b86b-136d7f359fc9'} {{(pid=101892) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:09:50.135644 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.notifications [None req-bd30f804-5109-48d1-b86b-136d7f359fc9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '648ba959b83f4629b0a668426fd610fc', 'request_id': 'req-bd30f804-5109-48d1-b86b-136d7f359fc9'} {{(pid=101892) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:09:50.202362 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.notifications [None req-bd30f804-5109-48d1-b86b-136d7f359fc9 admin admin] The token cache is being invalidate because project 648ba959b83f4629b0a668426fd610fc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=101892) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 25 15:09:50.202622 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.notifications [None req-bd30f804-5109-48d1-b86b-136d7f359fc9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=101892) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:09:50.203246 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.notifications [None req-bd30f804-5109-48d1-b86b-136d7f359fc9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=101892) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:09:50.204845 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 1141/2307] 10.222.0.84 () {58 vars in 1232 bytes} [Wed May 25 15:09:49 2022] DELETE /identity/v3/projects/648ba959b83f4629b0a668426fd610fc => generated 0 bytes in 275 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 15:09:50.209669 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83ff6c1-09a8-4749-871d-10655dfde7d8 None None] REQUEST_METHOD: `POST` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:09:50.210140 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83ff6c1-09a8-4749-871d-10655dfde7d8 None None] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:09:50.210240 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83ff6c1-09a8-4749-871d-10655dfde7d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:09:50.227833 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.auth.core [None req-f83ff6c1-09a8-4749-871d-10655dfde7d8 None None] MFA Rules not processed for user `05d87e87798e429aa1c10b24391f915e`. Rule list: `[]` (Enabled: `True`). {{(pid=101893) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:09:50.232218 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.fernet_utils [None req-f83ff6c1-09a8-4749-871d-10655dfde7d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=101893) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:09:50.254370 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG dbcounter [-] [101893] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=101893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:09:50.288622 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 1167/2308] 10.222.0.84 () {58 vars in 957 bytes} [Wed May 25 15:09:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 15:09:50.296789 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d012192-88ee-46a9-a10b-42296ec94743 None None] REQUEST_METHOD: `POST` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:09:50.297305 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d012192-88ee-46a9-a10b-42296ec94743 None None] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:09:50.297751 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d012192-88ee-46a9-a10b-42296ec94743 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:09:50.316653 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.auth.core [None req-0d012192-88ee-46a9-a10b-42296ec94743 None None] MFA Rules not processed for user `05d87e87798e429aa1c10b24391f915e`. Rule list: `[]` (Enabled: `True`). {{(pid=101892) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:09:50.317869 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.fernet_utils [None req-0d012192-88ee-46a9-a10b-42296ec94743 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=101892) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:09:50.326424 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 1142/2309] 10.222.0.84 () {58 vars in 957 bytes} [Wed May 25 15:09:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 15:09:50.335378 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f83ff6c1-09a8-4749-871d-10655dfde7d8 None None] Authenticating user token {{(pid=101893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:09:50.344967 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f83ff6c1-09a8-4749-871d-10655dfde7d8 None None] Validating token access rules against request {{(pid=101893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:09:50.349428 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da5cdfd0-be0a-4938-b2b0-38f43fda3878 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cec56f74b2fa4826a506dc7b919465be', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:09:50.350132 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da5cdfd0-be0a-4938-b2b0-38f43fda3878 admin admin] REQUEST_METHOD: `GET` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:09:50.350513 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da5cdfd0-be0a-4938-b2b0-38f43fda3878 admin admin] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:09:50.350989 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da5cdfd0-be0a-4938-b2b0-38f43fda3878 admin admin] PATH_INFO: `/v3/domains` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:09:50.351940 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da5cdfd0-be0a-4938-b2b0-38f43fda3878 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=101893) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 15:09:50.352577 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da5cdfd0-be0a-4938-b2b0-38f43fda3878 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:09:50.354165 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da5cdfd0-be0a-4938-b2b0-38f43fda3878 admin admin] RBAC: Authorization granted {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:09:50.365480 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 1168/2310] 10.222.0.84 () {58 vars in 1152 bytes} [Wed May 25 15:09:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 15:09:50.370225 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d012192-88ee-46a9-a10b-42296ec94743 None None] Authenticating user token {{(pid=101892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:09:50.379517 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d012192-88ee-46a9-a10b-42296ec94743 None None] Validating token access rules against request {{(pid=101892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:09:50.385110 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a2282d4-8dcf-4e2e-8836-e3fd994333d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cec56f74b2fa4826a506dc7b919465be', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:09:50.385847 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2282d4-8dcf-4e2e-8836-e3fd994333d0 admin admin] REQUEST_METHOD: `POST` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:09:50.386151 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2282d4-8dcf-4e2e-8836-e3fd994333d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:09:50.386454 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2282d4-8dcf-4e2e-8836-e3fd994333d0 admin admin] PATH_INFO: `/v3/projects` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:09:50.387211 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a2282d4-8dcf-4e2e-8836-e3fd994333d0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:09:50.389372 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a2282d4-8dcf-4e2e-8836-e3fd994333d0 admin admin] RBAC: Authorization granted {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:09:50.490279 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 1143/2311] 10.222.0.84 () {60 vars in 1152 bytes} [Wed May 25 15:09:50 2022] POST /identity/v3/projects => generated 373 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 15:09:50.494926 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da5cdfd0-be0a-4938-b2b0-38f43fda3878 admin admin] Authenticating user token {{(pid=101893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:09:50.505217 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da5cdfd0-be0a-4938-b2b0-38f43fda3878 admin admin] Validating token access rules against request {{(pid=101893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:09:50.562448 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92853374-5d66-48e3-8ea0-eb9621a3ff0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cec56f74b2fa4826a506dc7b919465be', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:09:50.563125 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92853374-5d66-48e3-8ea0-eb9621a3ff0a admin admin] REQUEST_METHOD: `POST` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:09:50.563410 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92853374-5d66-48e3-8ea0-eb9621a3ff0a admin admin] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:09:50.563731 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92853374-5d66-48e3-8ea0-eb9621a3ff0a admin admin] PATH_INFO: `/v3/users` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:09:50.564433 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92853374-5d66-48e3-8ea0-eb9621a3ff0a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:09:50.566371 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92853374-5d66-48e3-8ea0-eb9621a3ff0a admin admin] RBAC: Authorization granted {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:09:50.672332 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 1169/2312] 10.222.0.84 () {60 vars in 1143 bytes} [Wed May 25 15:09:50 2022] POST /identity/v3/users => generated 287 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 15:09:50.676462 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a2282d4-8dcf-4e2e-8836-e3fd994333d0 admin admin] Authenticating user token {{(pid=101892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:09:50.687178 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a2282d4-8dcf-4e2e-8836-e3fd994333d0 admin admin] Validating token access rules against request {{(pid=101892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:09:50.691738 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e883d43-11f3-40f9-9341-4364fa5b270f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cec56f74b2fa4826a506dc7b919465be', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:09:50.692388 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e883d43-11f3-40f9-9341-4364fa5b270f admin admin] REQUEST_METHOD: `GET` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:09:50.692681 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e883d43-11f3-40f9-9341-4364fa5b270f admin admin] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:09:50.692938 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e883d43-11f3-40f9-9341-4364fa5b270f admin admin] PATH_INFO: `/v3/roles` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:09:50.693653 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e883d43-11f3-40f9-9341-4364fa5b270f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:09:50.695225 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e883d43-11f3-40f9-9341-4364fa5b270f admin admin] RBAC: Authorization granted {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:09:50.705489 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 1144/2313] 10.222.0.84 () {58 vars in 1121 bytes} [Wed May 25 15:09:50 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 15:09:50.709426 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92853374-5d66-48e3-8ea0-eb9621a3ff0a admin admin] Authenticating user token {{(pid=101893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:09:50.719325 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92853374-5d66-48e3-8ea0-eb9621a3ff0a admin admin] Validating token access rules against request {{(pid=101893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:09:50.723960 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0969e4c6-2354-4d14-852c-ece256862afb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cec56f74b2fa4826a506dc7b919465be', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:09:50.724608 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0969e4c6-2354-4d14-852c-ece256862afb admin admin] REQUEST_METHOD: `GET` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:09:50.724893 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0969e4c6-2354-4d14-852c-ece256862afb admin admin] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:09:50.725167 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0969e4c6-2354-4d14-852c-ece256862afb admin admin] PATH_INFO: `/v3/roles` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:09:50.725880 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0969e4c6-2354-4d14-852c-ece256862afb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:09:50.728018 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0969e4c6-2354-4d14-852c-ece256862afb admin admin] RBAC: Authorization granted {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:09:50.737934 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 1170/2314] 10.222.0.84 () {58 vars in 1121 bytes} [Wed May 25 15:09:50 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 15:09:50.741895 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e883d43-11f3-40f9-9341-4364fa5b270f admin admin] Authenticating user token {{(pid=101892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:09:50.752168 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e883d43-11f3-40f9-9341-4364fa5b270f admin admin] Validating token access rules against request {{(pid=101892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:09:50.756723 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46566b1a-e068-4318-9c49-2824ef06ffbe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cec56f74b2fa4826a506dc7b919465be', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:09:50.757587 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46566b1a-e068-4318-9c49-2824ef06ffbe admin admin] REQUEST_METHOD: `PUT` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:09:50.757868 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46566b1a-e068-4318-9c49-2824ef06ffbe admin admin] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:09:50.758143 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46566b1a-e068-4318-9c49-2824ef06ffbe admin admin] PATH_INFO: `/v3/projects/77cbba13d1564779b2de301eea83d8ac/users/be09bd1653ae41bf8f74e20adac09257/roles/ff664fa0db7e4262a5accde96c3df4c3` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:09:50.772382 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46566b1a-e068-4318-9c49-2824ef06ffbe admin admin] RBAC: Authorizing `identity:create_grant(project_id=77cbba13d1564779b2de301eea83d8ac, user_id=be09bd1653ae41bf8f74e20adac09257, role_id=ff664fa0db7e4262a5accde96c3df4c3)` {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:09:50.775122 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46566b1a-e068-4318-9c49-2824ef06ffbe admin admin] RBAC: Authorization granted {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:09:50.838024 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 1145/2315] 10.222.0.84 () {60 vars in 1482 bytes} [Wed May 25 15:09:50 2022] PUT /identity/v3/projects/77cbba13d1564779b2de301eea83d8ac/users/be09bd1653ae41bf8f74e20adac09257/roles/ff664fa0db7e4262a5accde96c3df4c3 => generated 0 bytes in 97 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 15:09:50.848027 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0faf77-4842-4f38-bff3-7b88a9f2c9fa None None] REQUEST_METHOD: `POST` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:09:50.848319 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0faf77-4842-4f38-bff3-7b88a9f2c9fa None None] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:09:50.848604 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0faf77-4842-4f38-bff3-7b88a9f2c9fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:09:50.875977 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.auth.core [None req-aa0faf77-4842-4f38-bff3-7b88a9f2c9fa None None] MFA Rules not processed for user `be09bd1653ae41bf8f74e20adac09257`. Rule list: `[]` (Enabled: `True`). {{(pid=101893) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:09:50.877183 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.fernet_utils [None req-aa0faf77-4842-4f38-bff3-7b88a9f2c9fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=101893) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:09:50.939669 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 1171/2316] 10.222.0.84 () {58 vars in 957 bytes} [Wed May 25 15:09:50 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 15:09:50.944150 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46566b1a-e068-4318-9c49-2824ef06ffbe admin admin] Authenticating user token {{(pid=101892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:09:50.957829 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG dbcounter [-] [101892] Writing DB stats keystone:DELETE=9,keystone:SELECT=87,keystone:INSERT=4 {{(pid=101892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:09:51.005987 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46566b1a-e068-4318-9c49-2824ef06ffbe admin admin] Validating token access rules against request {{(pid=101892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:09:51.010712 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6837ae5-aaf0-4a09-afba-dfdd27c55005 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cec56f74b2fa4826a506dc7b919465be', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:09:51.011368 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6837ae5-aaf0-4a09-afba-dfdd27c55005 admin admin] REQUEST_METHOD: `POST` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:09:51.011686 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6837ae5-aaf0-4a09-afba-dfdd27c55005 admin admin] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:09:51.011963 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6837ae5-aaf0-4a09-afba-dfdd27c55005 admin admin] PATH_INFO: `/v3/projects` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:09:51.012651 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6837ae5-aaf0-4a09-afba-dfdd27c55005 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:09:51.014664 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6837ae5-aaf0-4a09-afba-dfdd27c55005 admin admin] RBAC: Authorization granted {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:09:51.123687 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 1146/2317] 10.222.0.84 () {60 vars in 1152 bytes} [Wed May 25 15:09:50 2022] POST /identity/v3/projects => generated 373 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 15:09:51.127751 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa0faf77-4842-4f38-bff3-7b88a9f2c9fa None None] Authenticating user token {{(pid=101893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:09:51.138881 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa0faf77-4842-4f38-bff3-7b88a9f2c9fa None None] Validating token access rules against request {{(pid=101893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:09:51.158836 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG dbcounter [-] [101893] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=101893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:09:51.194793 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df9dcb61-e050-404d-b7e6-75fcc3c1b659 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cec56f74b2fa4826a506dc7b919465be', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:09:51.195452 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9dcb61-e050-404d-b7e6-75fcc3c1b659 admin admin] REQUEST_METHOD: `POST` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:09:51.196638 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9dcb61-e050-404d-b7e6-75fcc3c1b659 admin admin] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:09:51.196950 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9dcb61-e050-404d-b7e6-75fcc3c1b659 admin admin] PATH_INFO: `/v3/users` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:09:51.197607 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df9dcb61-e050-404d-b7e6-75fcc3c1b659 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:09:51.199528 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df9dcb61-e050-404d-b7e6-75fcc3c1b659 admin admin] RBAC: Authorization granted {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:09:51.294694 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 1172/2318] 10.222.0.84 () {60 vars in 1143 bytes} [Wed May 25 15:09:51 2022] POST /identity/v3/users => generated 293 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 15:09:51.298483 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6837ae5-aaf0-4a09-afba-dfdd27c55005 admin admin] Authenticating user token {{(pid=101892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:09:51.309848 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6837ae5-aaf0-4a09-afba-dfdd27c55005 admin admin] Validating token access rules against request {{(pid=101892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:09:51.314769 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91217e8d-8d54-4f37-a32c-2eda08751139 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cec56f74b2fa4826a506dc7b919465be', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:09:51.315487 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91217e8d-8d54-4f37-a32c-2eda08751139 admin admin] REQUEST_METHOD: `GET` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:09:51.315839 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91217e8d-8d54-4f37-a32c-2eda08751139 admin admin] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:09:51.316122 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91217e8d-8d54-4f37-a32c-2eda08751139 admin admin] PATH_INFO: `/v3/roles` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:09:51.316860 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91217e8d-8d54-4f37-a32c-2eda08751139 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:09:51.318455 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91217e8d-8d54-4f37-a32c-2eda08751139 admin admin] RBAC: Authorization granted {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:09:51.330510 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 1147/2319] 10.222.0.84 () {58 vars in 1121 bytes} [Wed May 25 15:09:51 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 15:09:51.334710 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df9dcb61-e050-404d-b7e6-75fcc3c1b659 admin admin] Authenticating user token {{(pid=101893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:09:51.345308 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df9dcb61-e050-404d-b7e6-75fcc3c1b659 admin admin] Validating token access rules against request {{(pid=101893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:09:51.349867 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a7c45e9-18e1-422c-a27a-7ddaea2f302e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cec56f74b2fa4826a506dc7b919465be', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:09:51.350828 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a7c45e9-18e1-422c-a27a-7ddaea2f302e admin admin] REQUEST_METHOD: `PUT` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:09:51.351024 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a7c45e9-18e1-422c-a27a-7ddaea2f302e admin admin] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:09:51.351302 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a7c45e9-18e1-422c-a27a-7ddaea2f302e admin admin] PATH_INFO: `/v3/projects/f7bc6a7376364b3ab37ced18253fa603/users/09dbcb0812e24589bc08e77b20431cfc/roles/a3b78e7d547d4d2d998b4c99a4396bba` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:09:51.365896 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a7c45e9-18e1-422c-a27a-7ddaea2f302e admin admin] RBAC: Authorizing `identity:create_grant(project_id=f7bc6a7376364b3ab37ced18253fa603, user_id=09dbcb0812e24589bc08e77b20431cfc, role_id=a3b78e7d547d4d2d998b4c99a4396bba)` {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:09:51.368711 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a7c45e9-18e1-422c-a27a-7ddaea2f302e admin admin] RBAC: Authorization granted {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:09:51.419665 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 1173/2320] 10.222.0.84 () {60 vars in 1482 bytes} [Wed May 25 15:09:51 2022] PUT /identity/v3/projects/f7bc6a7376364b3ab37ced18253fa603/users/09dbcb0812e24589bc08e77b20431cfc/roles/a3b78e7d547d4d2d998b4c99a4396bba => generated 0 bytes in 85 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 25 15:09:51.429125 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91217e8d-8d54-4f37-a32c-2eda08751139 admin admin] Authenticating user token {{(pid=101892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:09:51.439099 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91217e8d-8d54-4f37-a32c-2eda08751139 admin admin] Validating token access rules against request {{(pid=101892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:09:51.494310 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6d36faa-cfff-4f3d-b97a-f42a686d1a7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cec56f74b2fa4826a506dc7b919465be', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:09:51.494974 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d36faa-cfff-4f3d-b97a-f42a686d1a7f admin admin] REQUEST_METHOD: `GET` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:09:51.495260 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d36faa-cfff-4f3d-b97a-f42a686d1a7f admin admin] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:09:51.495538 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d36faa-cfff-4f3d-b97a-f42a686d1a7f admin admin] PATH_INFO: `/v3/roles` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:09:51.496320 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6d36faa-cfff-4f3d-b97a-f42a686d1a7f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:09:51.497945 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6d36faa-cfff-4f3d-b97a-f42a686d1a7f admin admin] RBAC: Authorization granted {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:09:51.507482 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 1148/2321] 10.222.0.84 () {58 vars in 1121 bytes} [Wed May 25 15:09:51 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 15:09:51.512252 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a7c45e9-18e1-422c-a27a-7ddaea2f302e admin admin] Authenticating user token {{(pid=101893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:09:51.522625 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a7c45e9-18e1-422c-a27a-7ddaea2f302e admin admin] Validating token access rules against request {{(pid=101893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:09:51.529543 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cbf956f-db1f-4741-845c-a2dc9f30f6eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cec56f74b2fa4826a506dc7b919465be', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:09:51.530462 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cbf956f-db1f-4741-845c-a2dc9f30f6eb admin admin] REQUEST_METHOD: `PUT` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:09:51.530919 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cbf956f-db1f-4741-845c-a2dc9f30f6eb admin admin] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:09:51.531230 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cbf956f-db1f-4741-845c-a2dc9f30f6eb admin admin] PATH_INFO: `/v3/projects/f7bc6a7376364b3ab37ced18253fa603/users/09dbcb0812e24589bc08e77b20431cfc/roles/a3b78e7d547d4d2d998b4c99a4396bba` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:09:51.533423 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cbf956f-db1f-4741-845c-a2dc9f30f6eb admin admin] RBAC: Authorizing `identity:create_grant(project_id=f7bc6a7376364b3ab37ced18253fa603, user_id=09dbcb0812e24589bc08e77b20431cfc, role_id=a3b78e7d547d4d2d998b4c99a4396bba)` {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:09:51.536366 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cbf956f-db1f-4741-845c-a2dc9f30f6eb admin admin] RBAC: Authorization granted {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:09:51.547366 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 1174/2322] 10.222.0.84 () {60 vars in 1482 bytes} [Wed May 25 15:09:51 2022] PUT /identity/v3/projects/f7bc6a7376364b3ab37ced18253fa603/users/09dbcb0812e24589bc08e77b20431cfc/roles/a3b78e7d547d4d2d998b4c99a4396bba => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 15:09:51.558459 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286a114a-7a9b-4c75-9e26-8790c31cd013 None None] REQUEST_METHOD: `POST` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:09:51.558723 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286a114a-7a9b-4c75-9e26-8790c31cd013 None None] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:09:51.559004 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286a114a-7a9b-4c75-9e26-8790c31cd013 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:09:51.585711 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.auth.core [None req-286a114a-7a9b-4c75-9e26-8790c31cd013 None None] MFA Rules not processed for user `09dbcb0812e24589bc08e77b20431cfc`. Rule list: `[]` (Enabled: `True`). {{(pid=101892) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:09:51.587618 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.fernet_utils [None req-286a114a-7a9b-4c75-9e26-8790c31cd013 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=101892) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:09:51.665655 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 1149/2323] 10.222.0.84 () {58 vars in 957 bytes} [Wed May 25 15:09:51 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 15:09:51.677629 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cbf956f-db1f-4741-845c-a2dc9f30f6eb admin admin] Authenticating user token {{(pid=101893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:09:51.679304 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.fernet_utils [None req-5cbf956f-db1f-4741-845c-a2dc9f30f6eb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=101893) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:09:51.736051 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cbf956f-db1f-4741-845c-a2dc9f30f6eb admin admin] Validating token access rules against request {{(pid=101893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:09:51.739840 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a7d3d6-b710-42c0-b0d0-6efe87f931ad service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e079f89a5e524ab6ad4183e4f690de07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a000829c658c4a7cab67f7b6353ba3fa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:09:51.740477 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a7d3d6-b710-42c0-b0d0-6efe87f931ad service cinder] REQUEST_METHOD: `GET` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:09:51.740764 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a7d3d6-b710-42c0-b0d0-6efe87f931ad service cinder] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:09:51.741039 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a7d3d6-b710-42c0-b0d0-6efe87f931ad service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:09:51.797513 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43a7d3d6-b710-42c0-b0d0-6efe87f931ad service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:09:51.798881 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43a7d3d6-b710-42c0-b0d0-6efe87f931ad service cinder] RBAC: Authorization granted {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:09:51.807835 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 1175/2324] 10.222.0.84 () {60 vars in 1365 bytes} [Wed May 25 15:09:51 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 131 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 15:09:54.709609 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-286a114a-7a9b-4c75-9e26-8790c31cd013 None None] Authenticating user token {{(pid=101892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:09:54.720130 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG dbcounter [-] [101892] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=101892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:09:54.784828 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-286a114a-7a9b-4c75-9e26-8790c31cd013 None None] Validating token access rules against request {{(pid=101892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:09:54.793860 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8024cb16-37ad-43f7-a03e-f483c128e696 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cec56f74b2fa4826a506dc7b919465be', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:09:54.795509 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8024cb16-37ad-43f7-a03e-f483c128e696 admin admin] REQUEST_METHOD: `DELETE` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:09:54.795971 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8024cb16-37ad-43f7-a03e-f483c128e696 admin admin] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:09:54.796392 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8024cb16-37ad-43f7-a03e-f483c128e696 admin admin] PATH_INFO: `/v3/users/be09bd1653ae41bf8f74e20adac09257` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:09:54.798432 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8024cb16-37ad-43f7-a03e-f483c128e696 admin admin] RBAC: Authorizing `identity:delete_user(user_id=be09bd1653ae41bf8f74e20adac09257)` {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:09:54.801534 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8024cb16-37ad-43f7-a03e-f483c128e696 admin admin] RBAC: Authorization granted {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:09:55.006787 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.notifications [None req-8024cb16-37ad-43f7-a03e-f483c128e696 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'be09bd1653ae41bf8f74e20adac09257'} {{(pid=101892) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:09:55.014109 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.notifications [None req-8024cb16-37ad-43f7-a03e-f483c128e696 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'be09bd1653ae41bf8f74e20adac09257'} {{(pid=101892) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:09:55.026876 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.notifications [None req-8024cb16-37ad-43f7-a03e-f483c128e696 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'be09bd1653ae41bf8f74e20adac09257'} {{(pid=101892) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:09:55.027664 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.notifications [None req-8024cb16-37ad-43f7-a03e-f483c128e696 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'be09bd1653ae41bf8f74e20adac09257'} {{(pid=101892) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:09:55.101092 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.notifications [None req-8024cb16-37ad-43f7-a03e-f483c128e696 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'be09bd1653ae41bf8f74e20adac09257'} {{(pid=101892) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:09:55.112143 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 1150/2325] 10.222.0.84 () {58 vars in 1223 bytes} [Wed May 25 15:09:54 2022] DELETE /identity/v3/users/be09bd1653ae41bf8f74e20adac09257 => generated 0 bytes in 403 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 15:09:55.116554 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-306f1c43-e1a0-420e-b181-a33db685a645 None None] REQUEST_METHOD: `POST` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:09:55.117102 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-306f1c43-e1a0-420e-b181-a33db685a645 None None] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:09:55.117313 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-306f1c43-e1a0-420e-b181-a33db685a645 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:09:55.137673 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.auth.core [None req-306f1c43-e1a0-420e-b181-a33db685a645 None None] MFA Rules not processed for user `05d87e87798e429aa1c10b24391f915e`. Rule list: `[]` (Enabled: `True`). {{(pid=101893) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:09:55.139011 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.fernet_utils [None req-306f1c43-e1a0-420e-b181-a33db685a645 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=101893) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:09:55.167820 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG dbcounter [-] [101893] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=101893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:09:55.202070 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 1176/2326] 10.222.0.84 () {58 vars in 957 bytes} [Wed May 25 15:09:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 25 15:09:55.212603 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8024cb16-37ad-43f7-a03e-f483c128e696 admin admin] Authenticating user token {{(pid=101892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:09:55.214624 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.fernet_utils [None req-8024cb16-37ad-43f7-a03e-f483c128e696 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=101892) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:09:55.275656 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8024cb16-37ad-43f7-a03e-f483c128e696 admin admin] Validating token access rules against request {{(pid=101892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:09:55.280059 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52ed74c0-e63e-4737-98d4-ef8e994b0126 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ce28b25b907473588ccb87dc4acc06a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a000829c658c4a7cab67f7b6353ba3fa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:09:55.280714 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ed74c0-e63e-4737-98d4-ef8e994b0126 service neutron] REQUEST_METHOD: `GET` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:09:55.280999 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ed74c0-e63e-4737-98d4-ef8e994b0126 service neutron] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:09:55.281296 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ed74c0-e63e-4737-98d4-ef8e994b0126 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:09:55.290628 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52ed74c0-e63e-4737-98d4-ef8e994b0126 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:09:55.292148 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52ed74c0-e63e-4737-98d4-ef8e994b0126 service neutron] RBAC: Authorization granted {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:09:55.301918 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 1151/2327] 10.222.0.84 () {60 vars in 1365 bytes} [Wed May 25 15:09:55 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 25 15:09:55.725887 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-306f1c43-e1a0-420e-b181-a33db685a645 None None] Authenticating user token {{(pid=101893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:09:55.725887 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.fernet_utils [None req-306f1c43-e1a0-420e-b181-a33db685a645 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=101893) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:09:55.734675 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-306f1c43-e1a0-420e-b181-a33db685a645 None None] Validating token access rules against request {{(pid=101893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:09:55.739742 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f458a61a-316f-4c55-b4e8-5bdb6d598d5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cec56f74b2fa4826a506dc7b919465be', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:09:55.740627 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f458a61a-316f-4c55-b4e8-5bdb6d598d5f admin admin] REQUEST_METHOD: `DELETE` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:09:55.740909 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f458a61a-316f-4c55-b4e8-5bdb6d598d5f admin admin] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:09:55.741182 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f458a61a-316f-4c55-b4e8-5bdb6d598d5f admin admin] PATH_INFO: `/v3/projects/77cbba13d1564779b2de301eea83d8ac` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:09:55.742411 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f458a61a-316f-4c55-b4e8-5bdb6d598d5f admin admin] RBAC: Authorizing `identity:delete_project(project_id=77cbba13d1564779b2de301eea83d8ac)` {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:09:55.744422 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f458a61a-316f-4c55-b4e8-5bdb6d598d5f admin admin] RBAC: Authorization granted {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:09:55.856993 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.notifications [None req-f458a61a-316f-4c55-b4e8-5bdb6d598d5f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '77cbba13d1564779b2de301eea83d8ac', 'request_id': 'req-f458a61a-316f-4c55-b4e8-5bdb6d598d5f'} {{(pid=101893) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:09:55.863189 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.notifications [None req-f458a61a-316f-4c55-b4e8-5bdb6d598d5f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '77cbba13d1564779b2de301eea83d8ac', 'request_id': 'req-f458a61a-316f-4c55-b4e8-5bdb6d598d5f'} {{(pid=101893) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:09:55.868911 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.notifications [None req-f458a61a-316f-4c55-b4e8-5bdb6d598d5f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '77cbba13d1564779b2de301eea83d8ac', 'request_id': 'req-f458a61a-316f-4c55-b4e8-5bdb6d598d5f'} {{(pid=101893) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:09:55.946242 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.notifications [None req-f458a61a-316f-4c55-b4e8-5bdb6d598d5f admin admin] The token cache is being invalidate because project 77cbba13d1564779b2de301eea83d8ac was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=101893) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 25 15:09:55.946647 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.notifications [None req-f458a61a-316f-4c55-b4e8-5bdb6d598d5f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=101893) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:09:55.947390 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.notifications [None req-f458a61a-316f-4c55-b4e8-5bdb6d598d5f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=101893) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:09:55.949616 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 1177/2328] 10.222.0.84 () {58 vars in 1232 bytes} [Wed May 25 15:09:55 2022] DELETE /identity/v3/projects/77cbba13d1564779b2de301eea83d8ac => generated 0 bytes in 229 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 15:09:55.953580 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52ed74c0-e63e-4737-98d4-ef8e994b0126 service neutron] Authenticating user token {{(pid=101892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:09:55.963428 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52ed74c0-e63e-4737-98d4-ef8e994b0126 service neutron] Validating token access rules against request {{(pid=101892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:09:55.995913 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG dbcounter [-] [101892] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=101892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:09:56.034948 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-873d6863-0912-472f-830f-50e7546c8772 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cec56f74b2fa4826a506dc7b919465be', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:09:56.036493 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873d6863-0912-472f-830f-50e7546c8772 admin admin] REQUEST_METHOD: `DELETE` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:09:56.036784 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873d6863-0912-472f-830f-50e7546c8772 admin admin] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:09:56.037070 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873d6863-0912-472f-830f-50e7546c8772 admin admin] PATH_INFO: `/v3/users/09dbcb0812e24589bc08e77b20431cfc` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:09:56.039454 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-873d6863-0912-472f-830f-50e7546c8772 admin admin] RBAC: Authorizing `identity:delete_user(user_id=09dbcb0812e24589bc08e77b20431cfc)` {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:09:56.044527 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-873d6863-0912-472f-830f-50e7546c8772 admin admin] RBAC: Authorization granted {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:09:56.308635 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.notifications [None req-873d6863-0912-472f-830f-50e7546c8772 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '09dbcb0812e24589bc08e77b20431cfc'} {{(pid=101892) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:09:56.315792 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.notifications [None req-873d6863-0912-472f-830f-50e7546c8772 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '09dbcb0812e24589bc08e77b20431cfc'} {{(pid=101892) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:09:56.330154 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.notifications [None req-873d6863-0912-472f-830f-50e7546c8772 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '09dbcb0812e24589bc08e77b20431cfc'} {{(pid=101892) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:09:56.330154 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.notifications [None req-873d6863-0912-472f-830f-50e7546c8772 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '09dbcb0812e24589bc08e77b20431cfc'} {{(pid=101892) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:09:56.397861 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.notifications [None req-873d6863-0912-472f-830f-50e7546c8772 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '09dbcb0812e24589bc08e77b20431cfc'} {{(pid=101892) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:09:56.405812 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 1152/2329] 10.222.0.84 () {58 vars in 1223 bytes} [Wed May 25 15:09:55 2022] DELETE /identity/v3/users/09dbcb0812e24589bc08e77b20431cfc => generated 0 bytes in 453 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 15:09:56.776029 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f458a61a-316f-4c55-b4e8-5bdb6d598d5f admin admin] Authenticating user token {{(pid=101893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:09:56.778895 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.fernet_utils [None req-f458a61a-316f-4c55-b4e8-5bdb6d598d5f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=101893) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:09:56.795182 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f458a61a-316f-4c55-b4e8-5bdb6d598d5f admin admin] Validating token access rules against request {{(pid=101893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:09:56.857937 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf204c08-5229-4aca-92a3-642289c6daf3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cec56f74b2fa4826a506dc7b919465be', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:09:56.858803 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf204c08-5229-4aca-92a3-642289c6daf3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:09:56.859090 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf204c08-5229-4aca-92a3-642289c6daf3 admin admin] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:09:56.859367 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf204c08-5229-4aca-92a3-642289c6daf3 admin admin] PATH_INFO: `/v3/projects/f7bc6a7376364b3ab37ced18253fa603` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:09:56.860576 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf204c08-5229-4aca-92a3-642289c6daf3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f7bc6a7376364b3ab37ced18253fa603)` {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:09:56.862491 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf204c08-5229-4aca-92a3-642289c6daf3 admin admin] RBAC: Authorization granted {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:09:56.956372 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.notifications [None req-cf204c08-5229-4aca-92a3-642289c6daf3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f7bc6a7376364b3ab37ced18253fa603', 'request_id': 'req-cf204c08-5229-4aca-92a3-642289c6daf3'} {{(pid=101893) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:09:56.962728 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.notifications [None req-cf204c08-5229-4aca-92a3-642289c6daf3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f7bc6a7376364b3ab37ced18253fa603', 'request_id': 'req-cf204c08-5229-4aca-92a3-642289c6daf3'} {{(pid=101893) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:09:56.965625 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG dbcounter [-] [101893] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=101893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:09:56.970295 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.notifications [None req-cf204c08-5229-4aca-92a3-642289c6daf3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f7bc6a7376364b3ab37ced18253fa603', 'request_id': 'req-cf204c08-5229-4aca-92a3-642289c6daf3'} {{(pid=101893) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:09:57.036280 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.notifications [None req-cf204c08-5229-4aca-92a3-642289c6daf3 admin admin] The token cache is being invalidate because project f7bc6a7376364b3ab37ced18253fa603 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=101893) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 25 15:09:57.036849 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.notifications [None req-cf204c08-5229-4aca-92a3-642289c6daf3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=101893) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:09:57.037975 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.notifications [None req-cf204c08-5229-4aca-92a3-642289c6daf3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=101893) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:09:57.039622 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 1178/2330] 10.222.0.84 () {58 vars in 1232 bytes} [Wed May 25 15:09:56 2022] DELETE /identity/v3/projects/f7bc6a7376364b3ab37ced18253fa603 => generated 0 bytes in 264 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 15:09:57.045021 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1f4d75-c7fa-4488-9ca8-ebfef396baef None None] REQUEST_METHOD: `POST` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:09:57.045866 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1f4d75-c7fa-4488-9ca8-ebfef396baef None None] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:09:57.046320 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1f4d75-c7fa-4488-9ca8-ebfef396baef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:09:57.064493 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.auth.core [None req-3b1f4d75-c7fa-4488-9ca8-ebfef396baef None None] MFA Rules not processed for user `05d87e87798e429aa1c10b24391f915e`. Rule list: `[]` (Enabled: `True`). {{(pid=101892) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:09:57.065713 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.fernet_utils [None req-3b1f4d75-c7fa-4488-9ca8-ebfef396baef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=101892) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:09:57.133611 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 1153/2331] 10.222.0.84 () {58 vars in 957 bytes} [Wed May 25 15:09:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 25 15:09:57.149046 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff72673-9cc8-42a9-a49f-a4bdc7f76259 None None] REQUEST_METHOD: `POST` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:09:57.149424 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff72673-9cc8-42a9-a49f-a4bdc7f76259 None None] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:09:57.149775 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff72673-9cc8-42a9-a49f-a4bdc7f76259 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:09:57.170633 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.auth.core [None req-8ff72673-9cc8-42a9-a49f-a4bdc7f76259 None None] MFA Rules not processed for user `05d87e87798e429aa1c10b24391f915e`. Rule list: `[]` (Enabled: `True`). {{(pid=101893) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:09:57.172152 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.fernet_utils [None req-8ff72673-9cc8-42a9-a49f-a4bdc7f76259 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=101893) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:09:57.180698 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 1179/2332] 10.222.0.84 () {58 vars in 957 bytes} [Wed May 25 15:09:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 15:09:57.185086 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b1f4d75-c7fa-4488-9ca8-ebfef396baef None None] Authenticating user token {{(pid=101892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:09:57.195069 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b1f4d75-c7fa-4488-9ca8-ebfef396baef None None] Validating token access rules against request {{(pid=101892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:09:57.201387 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80838590-2619-4033-9120-d478c1e75f55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cec56f74b2fa4826a506dc7b919465be', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:09:57.201695 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80838590-2619-4033-9120-d478c1e75f55 admin admin] REQUEST_METHOD: `GET` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:09:57.202146 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80838590-2619-4033-9120-d478c1e75f55 admin admin] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:09:57.202146 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80838590-2619-4033-9120-d478c1e75f55 admin admin] PATH_INFO: `/v3/domains` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:09:57.202891 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80838590-2619-4033-9120-d478c1e75f55 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=101892) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 15:09:57.203199 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80838590-2619-4033-9120-d478c1e75f55 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:09:57.204853 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80838590-2619-4033-9120-d478c1e75f55 admin admin] RBAC: Authorization granted {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:09:57.217999 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 1154/2333] 10.222.0.84 () {58 vars in 1152 bytes} [Wed May 25 15:09:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 15:09:57.222260 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ff72673-9cc8-42a9-a49f-a4bdc7f76259 None None] Authenticating user token {{(pid=101893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:09:57.233121 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ff72673-9cc8-42a9-a49f-a4bdc7f76259 None None] Validating token access rules against request {{(pid=101893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:09:57.238206 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f56c917c-e302-4583-bb95-3a62e1c7216a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cec56f74b2fa4826a506dc7b919465be', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:09:57.238881 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f56c917c-e302-4583-bb95-3a62e1c7216a admin admin] REQUEST_METHOD: `POST` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:09:57.239309 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f56c917c-e302-4583-bb95-3a62e1c7216a admin admin] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:09:57.239618 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f56c917c-e302-4583-bb95-3a62e1c7216a admin admin] PATH_INFO: `/v3/projects` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:09:57.240327 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f56c917c-e302-4583-bb95-3a62e1c7216a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:09:57.242336 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f56c917c-e302-4583-bb95-3a62e1c7216a admin admin] RBAC: Authorization granted {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:09:57.360153 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 1180/2334] 10.222.0.84 () {60 vars in 1152 bytes} [Wed May 25 15:09:57 2022] POST /identity/v3/projects => generated 377 bytes in 138 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 15:09:57.364422 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80838590-2619-4033-9120-d478c1e75f55 admin admin] Authenticating user token {{(pid=101892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:09:57.375059 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80838590-2619-4033-9120-d478c1e75f55 admin admin] Validating token access rules against request {{(pid=101892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:09:57.408110 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG dbcounter [-] [101892] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=101892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:09:57.431621 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03fbd415-f888-4f5f-9f73-4fedd6eb674b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cec56f74b2fa4826a506dc7b919465be', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:09:57.432290 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03fbd415-f888-4f5f-9f73-4fedd6eb674b admin admin] REQUEST_METHOD: `POST` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:09:57.433154 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03fbd415-f888-4f5f-9f73-4fedd6eb674b admin admin] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:09:57.433432 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03fbd415-f888-4f5f-9f73-4fedd6eb674b admin admin] PATH_INFO: `/v3/users` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:09:57.434130 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03fbd415-f888-4f5f-9f73-4fedd6eb674b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:09:57.436093 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03fbd415-f888-4f5f-9f73-4fedd6eb674b admin admin] RBAC: Authorization granted {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:09:57.529528 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 1155/2335] 10.222.0.84 () {60 vars in 1143 bytes} [Wed May 25 15:09:57 2022] POST /identity/v3/users => generated 289 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 15:09:57.533826 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f56c917c-e302-4583-bb95-3a62e1c7216a admin admin] Authenticating user token {{(pid=101893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:09:57.543931 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f56c917c-e302-4583-bb95-3a62e1c7216a admin admin] Validating token access rules against request {{(pid=101893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:09:57.548542 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f10a6caa-5d4a-4018-afe7-0c587b66ed57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cec56f74b2fa4826a506dc7b919465be', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:09:57.549211 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10a6caa-5d4a-4018-afe7-0c587b66ed57 admin admin] REQUEST_METHOD: `GET` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:09:57.549492 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10a6caa-5d4a-4018-afe7-0c587b66ed57 admin admin] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:09:57.549766 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10a6caa-5d4a-4018-afe7-0c587b66ed57 admin admin] PATH_INFO: `/v3/roles` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:09:57.550496 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f10a6caa-5d4a-4018-afe7-0c587b66ed57 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:09:57.552217 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f10a6caa-5d4a-4018-afe7-0c587b66ed57 admin admin] RBAC: Authorization granted {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:09:57.563437 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 1181/2336] 10.222.0.84 () {58 vars in 1121 bytes} [Wed May 25 15:09:57 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 15:09:57.567513 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03fbd415-f888-4f5f-9f73-4fedd6eb674b admin admin] Authenticating user token {{(pid=101892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:09:57.578628 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03fbd415-f888-4f5f-9f73-4fedd6eb674b admin admin] Validating token access rules against request {{(pid=101892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:09:57.583412 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1038ad4e-e300-41f7-93bb-af61ac9a5d22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cec56f74b2fa4826a506dc7b919465be', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:09:57.584138 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1038ad4e-e300-41f7-93bb-af61ac9a5d22 admin admin] REQUEST_METHOD: `GET` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:09:57.584424 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1038ad4e-e300-41f7-93bb-af61ac9a5d22 admin admin] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:09:57.584721 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1038ad4e-e300-41f7-93bb-af61ac9a5d22 admin admin] PATH_INFO: `/v3/roles` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:09:57.585497 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1038ad4e-e300-41f7-93bb-af61ac9a5d22 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:09:57.587136 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1038ad4e-e300-41f7-93bb-af61ac9a5d22 admin admin] RBAC: Authorization granted {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:09:57.599116 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 1156/2337] 10.222.0.84 () {58 vars in 1121 bytes} [Wed May 25 15:09:57 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 15:09:57.603371 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f10a6caa-5d4a-4018-afe7-0c587b66ed57 admin admin] Authenticating user token {{(pid=101893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:09:57.613974 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f10a6caa-5d4a-4018-afe7-0c587b66ed57 admin admin] Validating token access rules against request {{(pid=101893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:09:57.618516 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d95ec725-8964-4475-9244-91e3cb177d11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cec56f74b2fa4826a506dc7b919465be', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:09:57.619448 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95ec725-8964-4475-9244-91e3cb177d11 admin admin] REQUEST_METHOD: `PUT` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:09:57.619765 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95ec725-8964-4475-9244-91e3cb177d11 admin admin] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:09:57.620836 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95ec725-8964-4475-9244-91e3cb177d11 admin admin] PATH_INFO: `/v3/projects/dcca62aabbda48aabbe86a20317e212b/users/540b857c87f84c4f987e79a707e902e8/roles/ff664fa0db7e4262a5accde96c3df4c3` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:09:57.635026 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d95ec725-8964-4475-9244-91e3cb177d11 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dcca62aabbda48aabbe86a20317e212b, user_id=540b857c87f84c4f987e79a707e902e8, role_id=ff664fa0db7e4262a5accde96c3df4c3)` {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:09:57.638327 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d95ec725-8964-4475-9244-91e3cb177d11 admin admin] RBAC: Authorization granted {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:09:57.717505 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 1182/2338] 10.222.0.84 () {60 vars in 1482 bytes} [Wed May 25 15:09:57 2022] PUT /identity/v3/projects/dcca62aabbda48aabbe86a20317e212b/users/540b857c87f84c4f987e79a707e902e8/roles/ff664fa0db7e4262a5accde96c3df4c3 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 15:09:57.728062 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b213f43e-e821-407e-93dc-dfdb7a66ca36 None None] REQUEST_METHOD: `POST` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:09:57.728352 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b213f43e-e821-407e-93dc-dfdb7a66ca36 None None] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:09:57.734313 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b213f43e-e821-407e-93dc-dfdb7a66ca36 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:09:57.754996 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.auth.core [None req-b213f43e-e821-407e-93dc-dfdb7a66ca36 None None] MFA Rules not processed for user `540b857c87f84c4f987e79a707e902e8`. Rule list: `[]` (Enabled: `True`). {{(pid=101892) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:09:57.756209 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.fernet_utils [None req-b213f43e-e821-407e-93dc-dfdb7a66ca36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=101892) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:09:57.821499 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 1157/2339] 10.222.0.84 () {58 vars in 957 bytes} [Wed May 25 15:09:57 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 25 15:09:57.833715 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d95ec725-8964-4475-9244-91e3cb177d11 admin admin] Authenticating user token {{(pid=101893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:09:57.835408 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.fernet_utils [None req-d95ec725-8964-4475-9244-91e3cb177d11 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=101893) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:09:57.892195 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d95ec725-8964-4475-9244-91e3cb177d11 admin admin] Validating token access rules against request {{(pid=101893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:09:57.895802 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04fcaa9a-1563-4a0e-9f44-2744f261848e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e079f89a5e524ab6ad4183e4f690de07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a000829c658c4a7cab67f7b6353ba3fa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:09:57.896445 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04fcaa9a-1563-4a0e-9f44-2744f261848e service cinder] REQUEST_METHOD: `GET` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:09:57.896731 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04fcaa9a-1563-4a0e-9f44-2744f261848e service cinder] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:09:57.897009 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04fcaa9a-1563-4a0e-9f44-2744f261848e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:09:57.905777 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04fcaa9a-1563-4a0e-9f44-2744f261848e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:09:57.907212 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04fcaa9a-1563-4a0e-9f44-2744f261848e service cinder] RBAC: Authorization granted {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:09:57.915931 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 1183/2340] 10.222.0.84 () {60 vars in 1365 bytes} [Wed May 25 15:09:57 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 15:10:04.664682 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c095e7-a35c-4601-91e0-77609e87d731 None None] REQUEST_METHOD: `POST` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:10:04.665179 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c095e7-a35c-4601-91e0-77609e87d731 None None] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:10:04.665276 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c095e7-a35c-4601-91e0-77609e87d731 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:10:04.683773 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.auth.core [None req-f9c095e7-a35c-4601-91e0-77609e87d731 None None] MFA Rules not processed for user `049a7ab3f95f460e908f79cc321176fd`. Rule list: `[]` (Enabled: `True`). {{(pid=101892) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:10:04.684972 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.fernet_utils [None req-f9c095e7-a35c-4601-91e0-77609e87d731 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=101892) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:10:04.739458 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 1158/2341] 10.222.0.84 () {58 vars in 967 bytes} [Wed May 25 15:10:04 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 15:10:04.903463 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04fcaa9a-1563-4a0e-9f44-2744f261848e service cinder] Authenticating user token {{(pid=101893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:10:04.905031 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.fernet_utils [None req-04fcaa9a-1563-4a0e-9f44-2744f261848e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=101893) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:10:04.975831 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04fcaa9a-1563-4a0e-9f44-2744f261848e service cinder] Validating token access rules against request {{(pid=101893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:10:04.981013 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5691e41c-c953-49cf-932a-5dfe5034e49a service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e196f0897b98455c9e164271d7d0070a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a000829c658c4a7cab67f7b6353ba3fa', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:10:04.981694 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5691e41c-c953-49cf-932a-5dfe5034e49a service swift] REQUEST_METHOD: `GET` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:10:04.981979 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5691e41c-c953-49cf-932a-5dfe5034e49a service swift] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:10:04.982255 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5691e41c-c953-49cf-932a-5dfe5034e49a service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:10:04.991203 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5691e41c-c953-49cf-932a-5dfe5034e49a service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:10:04.992907 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5691e41c-c953-49cf-932a-5dfe5034e49a service swift] RBAC: Authorization granted {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:10:05.001072 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 1184/2342] 10.222.0.84 () {60 vars in 1384 bytes} [Wed May 25 15:10:04 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 25 15:10:10.033748 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c095e7-a35c-4601-91e0-77609e87d731 None None] Authenticating user token {{(pid=101892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:10:10.033748 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.fernet_utils [None req-f9c095e7-a35c-4601-91e0-77609e87d731 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=101892) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:10:10.106256 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG dbcounter [-] [101892] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=101892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:10:10.127834 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c095e7-a35c-4601-91e0-77609e87d731 None None] Validating token access rules against request {{(pid=101892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:10:10.133028 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1249d12f-b886-4e41-96ed-812058654019 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd18c4a1d92b94c0087a203db4fed22f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a000829c658c4a7cab67f7b6353ba3fa', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:10:10.133686 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1249d12f-b886-4e41-96ed-812058654019 service placement] REQUEST_METHOD: `GET` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:10:10.133959 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1249d12f-b886-4e41-96ed-812058654019 service placement] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:10:10.134231 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1249d12f-b886-4e41-96ed-812058654019 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:10:10.136497 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.fernet_utils [None req-1249d12f-b886-4e41-96ed-812058654019 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=101892) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:10:10.152246 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1249d12f-b886-4e41-96ed-812058654019 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:10:10.153893 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1249d12f-b886-4e41-96ed-812058654019 service placement] RBAC: Authorization granted {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:10:10.165967 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 1159/2343] 10.222.0.84 () {60 vars in 1365 bytes} [Wed May 25 15:10:10 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 139 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 15:10:13.908599 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5691e41c-c953-49cf-932a-5dfe5034e49a service swift] Authenticating user token {{(pid=101893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:10:13.910740 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.fernet_utils [None req-5691e41c-c953-49cf-932a-5dfe5034e49a service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=101893) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:10:13.926804 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG dbcounter [-] [101893] Writing DB stats keystone:SELECT=95,keystone:DELETE=2,keystone:INSERT=3 {{(pid=101893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:10:13.978489 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5691e41c-c953-49cf-932a-5dfe5034e49a service swift] Validating token access rules against request {{(pid=101893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:10:13.983052 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60350811-2ccf-44be-974c-ddb8f0282fe2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cec56f74b2fa4826a506dc7b919465be', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:10:13.983947 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60350811-2ccf-44be-974c-ddb8f0282fe2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:10:13.984255 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60350811-2ccf-44be-974c-ddb8f0282fe2 admin admin] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:10:13.984651 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60350811-2ccf-44be-974c-ddb8f0282fe2 admin admin] PATH_INFO: `/v3/users/3ca005a5f1d64e6c856e4e4fae8b757d` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:10:13.985840 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60350811-2ccf-44be-974c-ddb8f0282fe2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3ca005a5f1d64e6c856e4e4fae8b757d)` {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:10:13.987787 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60350811-2ccf-44be-974c-ddb8f0282fe2 admin admin] RBAC: Authorization granted {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:10:14.149794 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.notifications [None req-60350811-2ccf-44be-974c-ddb8f0282fe2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3ca005a5f1d64e6c856e4e4fae8b757d'} {{(pid=101893) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:10:14.156813 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.notifications [None req-60350811-2ccf-44be-974c-ddb8f0282fe2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3ca005a5f1d64e6c856e4e4fae8b757d'} {{(pid=101893) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:10:14.168628 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.notifications [None req-60350811-2ccf-44be-974c-ddb8f0282fe2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3ca005a5f1d64e6c856e4e4fae8b757d'} {{(pid=101893) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:10:14.169312 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.notifications [None req-60350811-2ccf-44be-974c-ddb8f0282fe2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3ca005a5f1d64e6c856e4e4fae8b757d'} {{(pid=101893) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:10:14.169922 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.notifications [None req-60350811-2ccf-44be-974c-ddb8f0282fe2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3ca005a5f1d64e6c856e4e4fae8b757d'} {{(pid=101893) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:10:14.246673 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 1185/2344] 10.222.0.84 () {58 vars in 1223 bytes} [Wed May 25 15:10:13 2022] DELETE /identity/v3/users/3ca005a5f1d64e6c856e4e4fae8b757d => generated 0 bytes in 340 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 15:10:14.490587 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1249d12f-b886-4e41-96ed-812058654019 service placement] Authenticating user token {{(pid=101892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:10:14.506280 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1249d12f-b886-4e41-96ed-812058654019 service placement] Validating token access rules against request {{(pid=101892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:10:14.583514 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58f57aa2-6196-4600-bbb0-753623e5f670 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cec56f74b2fa4826a506dc7b919465be', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:10:14.584498 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f57aa2-6196-4600-bbb0-753623e5f670 admin admin] REQUEST_METHOD: `DELETE` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:10:14.584851 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f57aa2-6196-4600-bbb0-753623e5f670 admin admin] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:10:14.585193 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f57aa2-6196-4600-bbb0-753623e5f670 admin admin] PATH_INFO: `/v3/projects/1ac01cecc50b4a89a9b706e864a8aa8d` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:10:14.586577 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58f57aa2-6196-4600-bbb0-753623e5f670 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1ac01cecc50b4a89a9b706e864a8aa8d)` {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:10:14.588993 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58f57aa2-6196-4600-bbb0-753623e5f670 admin admin] RBAC: Authorization granted {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:10:14.691007 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.notifications [None req-58f57aa2-6196-4600-bbb0-753623e5f670 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1ac01cecc50b4a89a9b706e864a8aa8d', 'request_id': 'req-58f57aa2-6196-4600-bbb0-753623e5f670'} {{(pid=101892) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:10:14.698026 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.notifications [None req-58f57aa2-6196-4600-bbb0-753623e5f670 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1ac01cecc50b4a89a9b706e864a8aa8d', 'request_id': 'req-58f57aa2-6196-4600-bbb0-753623e5f670'} {{(pid=101892) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:10:14.704142 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.notifications [None req-58f57aa2-6196-4600-bbb0-753623e5f670 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1ac01cecc50b4a89a9b706e864a8aa8d', 'request_id': 'req-58f57aa2-6196-4600-bbb0-753623e5f670'} {{(pid=101892) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:10:14.780463 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.notifications [None req-58f57aa2-6196-4600-bbb0-753623e5f670 admin admin] The token cache is being invalidate because project 1ac01cecc50b4a89a9b706e864a8aa8d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=101892) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 25 15:10:14.780679 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.notifications [None req-58f57aa2-6196-4600-bbb0-753623e5f670 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=101892) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:10:14.782867 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.notifications [None req-58f57aa2-6196-4600-bbb0-753623e5f670 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=101892) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:10:14.783031 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 1160/2345] 10.222.0.84 () {58 vars in 1232 bytes} [Wed May 25 15:10:14 2022] DELETE /identity/v3/projects/1ac01cecc50b4a89a9b706e864a8aa8d => generated 0 bytes in 293 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 15:10:14.787601 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60350811-2ccf-44be-974c-ddb8f0282fe2 admin admin] Authenticating user token {{(pid=101893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:10:14.789056 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.fernet_utils [None req-60350811-2ccf-44be-974c-ddb8f0282fe2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=101893) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:10:14.802258 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60350811-2ccf-44be-974c-ddb8f0282fe2 admin admin] Validating token access rules against request {{(pid=101893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:10:14.866904 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e99dc5-e35c-4d7f-985b-326c6ce31c8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cec56f74b2fa4826a506dc7b919465be', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:10:14.867824 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e99dc5-e35c-4d7f-985b-326c6ce31c8a admin admin] REQUEST_METHOD: `DELETE` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:10:14.868113 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e99dc5-e35c-4d7f-985b-326c6ce31c8a admin admin] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:10:14.868391 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e99dc5-e35c-4d7f-985b-326c6ce31c8a admin admin] PATH_INFO: `/v3/users/9501a2cd5474458690dcaf16cafcf763` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:10:14.869585 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1e99dc5-e35c-4d7f-985b-326c6ce31c8a admin admin] RBAC: Authorizing `identity:delete_user(user_id=9501a2cd5474458690dcaf16cafcf763)` {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:10:14.871708 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1e99dc5-e35c-4d7f-985b-326c6ce31c8a admin admin] RBAC: Authorization granted {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:10:15.064859 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG dbcounter [-] [101893] Writing DB stats keystone:SELECT=84,keystone:DELETE=15,keystone:INSERT=1 {{(pid=101893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:10:15.074534 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.notifications [None req-a1e99dc5-e35c-4d7f-985b-326c6ce31c8a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9501a2cd5474458690dcaf16cafcf763'} {{(pid=101893) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:10:15.081403 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.notifications [None req-a1e99dc5-e35c-4d7f-985b-326c6ce31c8a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9501a2cd5474458690dcaf16cafcf763'} {{(pid=101893) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:10:15.092955 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.notifications [None req-a1e99dc5-e35c-4d7f-985b-326c6ce31c8a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9501a2cd5474458690dcaf16cafcf763'} {{(pid=101893) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:10:15.093630 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.notifications [None req-a1e99dc5-e35c-4d7f-985b-326c6ce31c8a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9501a2cd5474458690dcaf16cafcf763'} {{(pid=101893) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:10:15.094247 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.notifications [None req-a1e99dc5-e35c-4d7f-985b-326c6ce31c8a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9501a2cd5474458690dcaf16cafcf763'} {{(pid=101893) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:10:15.236784 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 1186/2346] 10.222.0.84 () {58 vars in 1223 bytes} [Wed May 25 15:10:14 2022] DELETE /identity/v3/users/9501a2cd5474458690dcaf16cafcf763 => generated 0 bytes in 450 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 15:10:15.478976 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58f57aa2-6196-4600-bbb0-753623e5f670 admin admin] Authenticating user token {{(pid=101892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:10:15.482886 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.fernet_utils [None req-58f57aa2-6196-4600-bbb0-753623e5f670 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=101892) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:10:15.494079 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58f57aa2-6196-4600-bbb0-753623e5f670 admin admin] Validating token access rules against request {{(pid=101892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:10:15.552095 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87791b5b-2d69-4435-bdc5-9e8e16765443 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cec56f74b2fa4826a506dc7b919465be', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:10:15.552968 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87791b5b-2d69-4435-bdc5-9e8e16765443 admin admin] REQUEST_METHOD: `DELETE` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:10:15.553255 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87791b5b-2d69-4435-bdc5-9e8e16765443 admin admin] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:10:15.553533 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87791b5b-2d69-4435-bdc5-9e8e16765443 admin admin] PATH_INFO: `/v3/projects/ef20405e4c814352ac532d4ac88b5889` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:10:15.558090 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87791b5b-2d69-4435-bdc5-9e8e16765443 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ef20405e4c814352ac532d4ac88b5889)` {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:10:15.560089 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87791b5b-2d69-4435-bdc5-9e8e16765443 admin admin] RBAC: Authorization granted {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:10:15.573150 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG dbcounter [-] [101892] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=101892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:10:15.660545 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.notifications [None req-87791b5b-2d69-4435-bdc5-9e8e16765443 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ef20405e4c814352ac532d4ac88b5889', 'request_id': 'req-87791b5b-2d69-4435-bdc5-9e8e16765443'} {{(pid=101892) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:10:15.666741 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.notifications [None req-87791b5b-2d69-4435-bdc5-9e8e16765443 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ef20405e4c814352ac532d4ac88b5889', 'request_id': 'req-87791b5b-2d69-4435-bdc5-9e8e16765443'} {{(pid=101892) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:10:15.672159 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.notifications [None req-87791b5b-2d69-4435-bdc5-9e8e16765443 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ef20405e4c814352ac532d4ac88b5889', 'request_id': 'req-87791b5b-2d69-4435-bdc5-9e8e16765443'} {{(pid=101892) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:10:15.750678 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.notifications [None req-87791b5b-2d69-4435-bdc5-9e8e16765443 admin admin] The token cache is being invalidate because project ef20405e4c814352ac532d4ac88b5889 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=101892) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 25 15:10:15.750963 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.notifications [None req-87791b5b-2d69-4435-bdc5-9e8e16765443 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=101892) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:10:15.751709 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.notifications [None req-87791b5b-2d69-4435-bdc5-9e8e16765443 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=101892) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:10:15.753290 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 1161/2347] 10.222.0.84 () {58 vars in 1232 bytes} [Wed May 25 15:10:15 2022] DELETE /identity/v3/projects/ef20405e4c814352ac532d4ac88b5889 => generated 0 bytes in 275 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 15:10:16.011128 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e99dc5-e35c-4d7f-985b-326c6ce31c8a admin admin] Authenticating user token {{(pid=101893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:10:16.012599 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.fernet_utils [None req-a1e99dc5-e35c-4d7f-985b-326c6ce31c8a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=101893) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:10:16.026083 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e99dc5-e35c-4d7f-985b-326c6ce31c8a admin admin] Validating token access rules against request {{(pid=101893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:10:16.082965 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46497d84-3923-45fb-acfa-f547a0facf45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cec56f74b2fa4826a506dc7b919465be', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:10:16.083877 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46497d84-3923-45fb-acfa-f547a0facf45 admin admin] REQUEST_METHOD: `DELETE` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:10:16.084191 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46497d84-3923-45fb-acfa-f547a0facf45 admin admin] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:10:16.084487 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46497d84-3923-45fb-acfa-f547a0facf45 admin admin] PATH_INFO: `/v3/users/540b857c87f84c4f987e79a707e902e8` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:10:16.085714 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46497d84-3923-45fb-acfa-f547a0facf45 admin admin] RBAC: Authorizing `identity:delete_user(user_id=540b857c87f84c4f987e79a707e902e8)` {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:10:16.087697 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46497d84-3923-45fb-acfa-f547a0facf45 admin admin] RBAC: Authorization granted {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:10:16.245516 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.notifications [None req-46497d84-3923-45fb-acfa-f547a0facf45 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '540b857c87f84c4f987e79a707e902e8'} {{(pid=101893) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:10:16.252397 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.notifications [None req-46497d84-3923-45fb-acfa-f547a0facf45 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '540b857c87f84c4f987e79a707e902e8'} {{(pid=101893) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:10:16.263975 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.notifications [None req-46497d84-3923-45fb-acfa-f547a0facf45 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '540b857c87f84c4f987e79a707e902e8'} {{(pid=101893) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:10:16.264640 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.notifications [None req-46497d84-3923-45fb-acfa-f547a0facf45 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '540b857c87f84c4f987e79a707e902e8'} {{(pid=101893) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:10:16.265242 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.notifications [None req-46497d84-3923-45fb-acfa-f547a0facf45 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '540b857c87f84c4f987e79a707e902e8'} {{(pid=101893) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:10:16.338988 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 1187/2348] 10.222.0.84 () {58 vars in 1223 bytes} [Wed May 25 15:10:16 2022] DELETE /identity/v3/users/540b857c87f84c4f987e79a707e902e8 => generated 0 bytes in 328 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 15:10:16.343448 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1b4a8c-d0b1-4ebd-871b-98086f0bc414 None None] REQUEST_METHOD: `POST` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:10:16.343765 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1b4a8c-d0b1-4ebd-871b-98086f0bc414 None None] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:10:16.344565 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1b4a8c-d0b1-4ebd-871b-98086f0bc414 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:10:16.362583 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.auth.core [None req-2a1b4a8c-d0b1-4ebd-871b-98086f0bc414 None None] MFA Rules not processed for user `05d87e87798e429aa1c10b24391f915e`. Rule list: `[]` (Enabled: `True`). {{(pid=101892) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:10:16.363816 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.fernet_utils [None req-2a1b4a8c-d0b1-4ebd-871b-98086f0bc414 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=101892) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:10:16.421076 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 1162/2349] 10.222.0.84 () {58 vars in 957 bytes} [Wed May 25 15:10:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 15:10:16.431340 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46497d84-3923-45fb-acfa-f547a0facf45 admin admin] Authenticating user token {{(pid=101893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:10:16.433112 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.fernet_utils [None req-46497d84-3923-45fb-acfa-f547a0facf45 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=101893) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:10:16.469477 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG dbcounter [-] [101893] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=101893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:10:16.491773 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46497d84-3923-45fb-acfa-f547a0facf45 admin admin] Validating token access rules against request {{(pid=101893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:10:16.495493 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad3f804-f79e-42b4-9e2b-09ac7a0eb400 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ce28b25b907473588ccb87dc4acc06a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a000829c658c4a7cab67f7b6353ba3fa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:10:16.496224 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad3f804-f79e-42b4-9e2b-09ac7a0eb400 service neutron] REQUEST_METHOD: `GET` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:10:16.496452 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad3f804-f79e-42b4-9e2b-09ac7a0eb400 service neutron] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:10:16.496728 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad3f804-f79e-42b4-9e2b-09ac7a0eb400 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:10:16.506925 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ad3f804-f79e-42b4-9e2b-09ac7a0eb400 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:10:16.510214 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ad3f804-f79e-42b4-9e2b-09ac7a0eb400 service neutron] RBAC: Authorization granted {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:10:16.518589 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 1188/2350] 10.222.0.84 () {60 vars in 1365 bytes} [Wed May 25 15:10:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 15:10:16.912750 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a1b4a8c-d0b1-4ebd-871b-98086f0bc414 None None] Authenticating user token {{(pid=101892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:10:16.914211 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.fernet_utils [None req-2a1b4a8c-d0b1-4ebd-871b-98086f0bc414 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=101892) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:10:16.926564 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a1b4a8c-d0b1-4ebd-871b-98086f0bc414 None None] Validating token access rules against request {{(pid=101892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:10:16.931983 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e72211-361c-4af6-bb7f-a7fb785404c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cec56f74b2fa4826a506dc7b919465be', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:10:16.932858 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e72211-361c-4af6-bb7f-a7fb785404c5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:10:16.933140 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e72211-361c-4af6-bb7f-a7fb785404c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:10:16.933417 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e72211-361c-4af6-bb7f-a7fb785404c5 admin admin] PATH_INFO: `/v3/projects/dcca62aabbda48aabbe86a20317e212b` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:10:16.934702 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9e72211-361c-4af6-bb7f-a7fb785404c5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=dcca62aabbda48aabbe86a20317e212b)` {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:10:16.936824 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9e72211-361c-4af6-bb7f-a7fb785404c5 admin admin] RBAC: Authorization granted {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:10:17.054612 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.notifications [None req-d9e72211-361c-4af6-bb7f-a7fb785404c5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dcca62aabbda48aabbe86a20317e212b', 'request_id': 'req-d9e72211-361c-4af6-bb7f-a7fb785404c5'} {{(pid=101892) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:10:17.060750 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.notifications [None req-d9e72211-361c-4af6-bb7f-a7fb785404c5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dcca62aabbda48aabbe86a20317e212b', 'request_id': 'req-d9e72211-361c-4af6-bb7f-a7fb785404c5'} {{(pid=101892) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:10:17.066320 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.notifications [None req-d9e72211-361c-4af6-bb7f-a7fb785404c5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dcca62aabbda48aabbe86a20317e212b', 'request_id': 'req-d9e72211-361c-4af6-bb7f-a7fb785404c5'} {{(pid=101892) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:10:17.150279 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.notifications [None req-d9e72211-361c-4af6-bb7f-a7fb785404c5 admin admin] The token cache is being invalidate because project dcca62aabbda48aabbe86a20317e212b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=101892) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 25 15:10:17.150567 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.notifications [None req-d9e72211-361c-4af6-bb7f-a7fb785404c5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=101892) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:10:17.151235 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.notifications [None req-d9e72211-361c-4af6-bb7f-a7fb785404c5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=101892) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:10:17.152794 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 1163/2351] 10.222.0.84 () {58 vars in 1232 bytes} [Wed May 25 15:10:16 2022] DELETE /identity/v3/projects/dcca62aabbda48aabbe86a20317e212b => generated 0 bytes in 241 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 15:10:17.158245 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79842f9-c54f-41a2-9e31-981add5818ad None None] REQUEST_METHOD: `POST` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:10:17.158708 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79842f9-c54f-41a2-9e31-981add5818ad None None] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:10:17.158824 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79842f9-c54f-41a2-9e31-981add5818ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:10:17.176628 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.auth.core [None req-d79842f9-c54f-41a2-9e31-981add5818ad None None] MFA Rules not processed for user `05d87e87798e429aa1c10b24391f915e`. Rule list: `[]` (Enabled: `True`). {{(pid=101893) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:10:17.177807 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.fernet_utils [None req-d79842f9-c54f-41a2-9e31-981add5818ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=101893) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:10:17.235970 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 1189/2352] 10.222.0.84 () {58 vars in 957 bytes} [Wed May 25 15:10:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 15:10:17.244573 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eefd4dd-af64-40e2-ad62-7075cfcf7058 None None] REQUEST_METHOD: `POST` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:10:17.244861 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eefd4dd-af64-40e2-ad62-7075cfcf7058 None None] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:10:17.245141 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eefd4dd-af64-40e2-ad62-7075cfcf7058 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:10:17.263024 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.auth.core [None req-3eefd4dd-af64-40e2-ad62-7075cfcf7058 None None] MFA Rules not processed for user `05d87e87798e429aa1c10b24391f915e`. Rule list: `[]` (Enabled: `True`). {{(pid=101892) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:10:17.264252 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.fernet_utils [None req-3eefd4dd-af64-40e2-ad62-7075cfcf7058 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=101892) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:10:17.272540 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 1164/2353] 10.222.0.84 () {58 vars in 957 bytes} [Wed May 25 15:10:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 15:10:17.276487 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d79842f9-c54f-41a2-9e31-981add5818ad None None] Authenticating user token {{(pid=101893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:10:17.286561 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d79842f9-c54f-41a2-9e31-981add5818ad None None] Validating token access rules against request {{(pid=101893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:10:17.291180 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78c93b58-7b45-44fb-8182-f16a0dd7b522 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cec56f74b2fa4826a506dc7b919465be', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:10:17.291937 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c93b58-7b45-44fb-8182-f16a0dd7b522 admin admin] REQUEST_METHOD: `GET` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:10:17.292219 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c93b58-7b45-44fb-8182-f16a0dd7b522 admin admin] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:10:17.292493 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c93b58-7b45-44fb-8182-f16a0dd7b522 admin admin] PATH_INFO: `/v3/domains` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:10:17.293211 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78c93b58-7b45-44fb-8182-f16a0dd7b522 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=101893) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 15:10:17.293520 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78c93b58-7b45-44fb-8182-f16a0dd7b522 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:10:17.295120 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78c93b58-7b45-44fb-8182-f16a0dd7b522 admin admin] RBAC: Authorization granted {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:10:17.306481 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 1190/2354] 10.222.0.84 () {58 vars in 1152 bytes} [Wed May 25 15:10:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 15:10:17.310501 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eefd4dd-af64-40e2-ad62-7075cfcf7058 None None] Authenticating user token {{(pid=101892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:10:17.319496 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eefd4dd-af64-40e2-ad62-7075cfcf7058 None None] Validating token access rules against request {{(pid=101892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:10:17.324365 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d030065-cee9-4bdf-8b0f-6da9c6cf021d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cec56f74b2fa4826a506dc7b919465be', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:10:17.325006 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d030065-cee9-4bdf-8b0f-6da9c6cf021d admin admin] REQUEST_METHOD: `POST` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:10:17.325291 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d030065-cee9-4bdf-8b0f-6da9c6cf021d admin admin] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:10:17.325567 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d030065-cee9-4bdf-8b0f-6da9c6cf021d admin admin] PATH_INFO: `/v3/projects` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:10:17.326255 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d030065-cee9-4bdf-8b0f-6da9c6cf021d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:10:17.328691 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d030065-cee9-4bdf-8b0f-6da9c6cf021d admin admin] RBAC: Authorization granted {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:10:17.342228 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG dbcounter [-] [101892] Writing DB stats keystone:SELECT=83,keystone:DELETE=14,keystone:INSERT=3 {{(pid=101892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:10:17.455666 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 1165/2355] 10.222.0.84 () {60 vars in 1152 bytes} [Wed May 25 15:10:17 2022] POST /identity/v3/projects => generated 367 bytes in 146 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 15:10:17.460212 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78c93b58-7b45-44fb-8182-f16a0dd7b522 admin admin] Authenticating user token {{(pid=101893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:10:17.470184 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78c93b58-7b45-44fb-8182-f16a0dd7b522 admin admin] Validating token access rules against request {{(pid=101893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:10:17.525785 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-209ad94e-c76b-4106-8a08-4fa9e0e034d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cec56f74b2fa4826a506dc7b919465be', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:10:17.526449 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209ad94e-c76b-4106-8a08-4fa9e0e034d0 admin admin] REQUEST_METHOD: `POST` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:10:17.526735 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209ad94e-c76b-4106-8a08-4fa9e0e034d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:10:17.527012 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209ad94e-c76b-4106-8a08-4fa9e0e034d0 admin admin] PATH_INFO: `/v3/users` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:10:17.527727 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-209ad94e-c76b-4106-8a08-4fa9e0e034d0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:10:17.529690 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-209ad94e-c76b-4106-8a08-4fa9e0e034d0 admin admin] RBAC: Authorization granted {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:10:17.615112 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 1191/2356] 10.222.0.84 () {60 vars in 1143 bytes} [Wed May 25 15:10:17 2022] POST /identity/v3/users => generated 284 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 15:10:17.619153 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d030065-cee9-4bdf-8b0f-6da9c6cf021d admin admin] Authenticating user token {{(pid=101892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:10:17.630331 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d030065-cee9-4bdf-8b0f-6da9c6cf021d admin admin] Validating token access rules against request {{(pid=101892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:10:17.634937 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9b5a13e-ced2-4cbe-949d-e1b5e7385e12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cec56f74b2fa4826a506dc7b919465be', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:10:17.635615 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b5a13e-ced2-4cbe-949d-e1b5e7385e12 admin admin] REQUEST_METHOD: `GET` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:10:17.635913 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b5a13e-ced2-4cbe-949d-e1b5e7385e12 admin admin] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:10:17.636196 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b5a13e-ced2-4cbe-949d-e1b5e7385e12 admin admin] PATH_INFO: `/v3/roles` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:10:17.636921 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9b5a13e-ced2-4cbe-949d-e1b5e7385e12 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:10:17.638551 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9b5a13e-ced2-4cbe-949d-e1b5e7385e12 admin admin] RBAC: Authorization granted {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:10:17.649824 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 1166/2357] 10.222.0.84 () {58 vars in 1121 bytes} [Wed May 25 15:10:17 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 15:10:17.653584 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-209ad94e-c76b-4106-8a08-4fa9e0e034d0 admin admin] Authenticating user token {{(pid=101893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:10:17.663936 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-209ad94e-c76b-4106-8a08-4fa9e0e034d0 admin admin] Validating token access rules against request {{(pid=101893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:10:17.668511 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1c8a7e8-d526-4dd0-9def-9a5abe15f8b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cec56f74b2fa4826a506dc7b919465be', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:10:17.669164 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c8a7e8-d526-4dd0-9def-9a5abe15f8b7 admin admin] REQUEST_METHOD: `GET` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:10:17.669448 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c8a7e8-d526-4dd0-9def-9a5abe15f8b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:10:17.669724 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c8a7e8-d526-4dd0-9def-9a5abe15f8b7 admin admin] PATH_INFO: `/v3/roles` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:10:17.670442 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1c8a7e8-d526-4dd0-9def-9a5abe15f8b7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:10:17.672680 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1c8a7e8-d526-4dd0-9def-9a5abe15f8b7 admin admin] RBAC: Authorization granted {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:10:17.682375 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 1192/2358] 10.222.0.84 () {58 vars in 1121 bytes} [Wed May 25 15:10:17 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 25 15:10:17.686460 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9b5a13e-ced2-4cbe-949d-e1b5e7385e12 admin admin] Authenticating user token {{(pid=101892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:10:17.696571 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9b5a13e-ced2-4cbe-949d-e1b5e7385e12 admin admin] Validating token access rules against request {{(pid=101892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:10:17.701100 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d0cdc79-c879-4bc4-b835-b89442c9ce40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cec56f74b2fa4826a506dc7b919465be', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:10:17.701971 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0cdc79-c879-4bc4-b835-b89442c9ce40 admin admin] REQUEST_METHOD: `PUT` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:10:17.702259 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0cdc79-c879-4bc4-b835-b89442c9ce40 admin admin] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:10:17.702536 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0cdc79-c879-4bc4-b835-b89442c9ce40 admin admin] PATH_INFO: `/v3/projects/e3f757f521444c5bbc84010d59a2e423/users/9e9bbc0458a04c3aa15dd82d845cefb7/roles/ff664fa0db7e4262a5accde96c3df4c3` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:10:17.716874 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d0cdc79-c879-4bc4-b835-b89442c9ce40 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e3f757f521444c5bbc84010d59a2e423, user_id=9e9bbc0458a04c3aa15dd82d845cefb7, role_id=ff664fa0db7e4262a5accde96c3df4c3)` {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:10:17.720158 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d0cdc79-c879-4bc4-b835-b89442c9ce40 admin admin] RBAC: Authorization granted {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:10:17.773797 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 1167/2359] 10.222.0.84 () {60 vars in 1482 bytes} [Wed May 25 15:10:17 2022] PUT /identity/v3/projects/e3f757f521444c5bbc84010d59a2e423/users/9e9bbc0458a04c3aa15dd82d845cefb7/roles/ff664fa0db7e4262a5accde96c3df4c3 => generated 0 bytes in 88 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 15:10:17.783852 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4578ea-bb24-46f7-95e0-b93374a8fd6b None None] REQUEST_METHOD: `POST` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:10:17.784170 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4578ea-bb24-46f7-95e0-b93374a8fd6b None None] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:10:17.784455 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4578ea-bb24-46f7-95e0-b93374a8fd6b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:10:17.811062 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.auth.core [None req-de4578ea-bb24-46f7-95e0-b93374a8fd6b None None] MFA Rules not processed for user `9e9bbc0458a04c3aa15dd82d845cefb7`. Rule list: `[]` (Enabled: `True`). {{(pid=101893) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:10:17.812239 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.fernet_utils [None req-de4578ea-bb24-46f7-95e0-b93374a8fd6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=101893) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:10:17.845953 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG dbcounter [-] [101893] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=101893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:10:17.883999 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 1193/2360] 10.222.0.84 () {58 vars in 957 bytes} [Wed May 25 15:10:17 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 15:10:17.895949 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d0cdc79-c879-4bc4-b835-b89442c9ce40 admin admin] Authenticating user token {{(pid=101892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:10:17.897949 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.fernet_utils [None req-5d0cdc79-c879-4bc4-b835-b89442c9ce40 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=101892) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:10:17.955693 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d0cdc79-c879-4bc4-b835-b89442c9ce40 admin admin] Validating token access rules against request {{(pid=101892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:10:17.959544 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36d9aee1-05da-442a-86bb-d6ba70e6cb12 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '971542599734491aa112b815fc4cc5c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a000829c658c4a7cab67f7b6353ba3fa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:10:17.962484 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d9aee1-05da-442a-86bb-d6ba70e6cb12 service glance] REQUEST_METHOD: `GET` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:10:17.962484 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d9aee1-05da-442a-86bb-d6ba70e6cb12 service glance] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:10:17.962484 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d9aee1-05da-442a-86bb-d6ba70e6cb12 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:10:17.969938 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36d9aee1-05da-442a-86bb-d6ba70e6cb12 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:10:17.971372 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36d9aee1-05da-442a-86bb-d6ba70e6cb12 service glance] RBAC: Authorization granted {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:10:17.980222 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 1168/2361] 10.222.0.84 () {60 vars in 1365 bytes} [Wed May 25 15:10:17 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 15:10:27.927178 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG dbcounter [-] [101893] Writing DB stats keystone:SELECT=14 {{(pid=101893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:10:27.976257 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG dbcounter [-] [101892] Writing DB stats keystone:SELECT=43,keystone:INSERT=1 {{(pid=101892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:10:36.996833 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43eab11d-4447-40a8-a85a-ed89c20f85f3 None None] REQUEST_METHOD: `POST` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:10:36.997395 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43eab11d-4447-40a8-a85a-ed89c20f85f3 None None] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:10:36.997395 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43eab11d-4447-40a8-a85a-ed89c20f85f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:10:37.015358 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.auth.core [None req-43eab11d-4447-40a8-a85a-ed89c20f85f3 None None] MFA Rules not processed for user `7fa42494cb4549f295d23e08cf93d330`. Rule list: `[]` (Enabled: `True`). {{(pid=101893) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:10:37.016688 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.fernet_utils [None req-43eab11d-4447-40a8-a85a-ed89c20f85f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=101893) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:10:37.076420 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 1194/2362] 10.222.0.84 () {58 vars in 957 bytes} [Wed May 25 15:10:36 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 15:10:38.456862 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36d9aee1-05da-442a-86bb-d6ba70e6cb12 service glance] Authenticating user token {{(pid=101892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:10:38.458322 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.fernet_utils [None req-36d9aee1-05da-442a-86bb-d6ba70e6cb12 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=101892) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:10:38.527777 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36d9aee1-05da-442a-86bb-d6ba70e6cb12 service glance] Validating token access rules against request {{(pid=101892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:10:38.532840 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc5174d-f081-4f81-9a58-e86d279e1585 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd18c4a1d92b94c0087a203db4fed22f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a000829c658c4a7cab67f7b6353ba3fa', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:10:38.533489 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc5174d-f081-4f81-9a58-e86d279e1585 service placement] REQUEST_METHOD: `GET` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:10:38.533775 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc5174d-f081-4f81-9a58-e86d279e1585 service placement] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:10:38.534058 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc5174d-f081-4f81-9a58-e86d279e1585 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:10:38.536429 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.fernet_utils [None req-5fc5174d-f081-4f81-9a58-e86d279e1585 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=101892) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:10:38.547720 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fc5174d-f081-4f81-9a58-e86d279e1585 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:10:38.549330 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fc5174d-f081-4f81-9a58-e86d279e1585 service placement] RBAC: Authorization granted {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:10:38.562488 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 1169/2363] 10.222.0.84 () {60 vars in 1365 bytes} [Wed May 25 15:10:38 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 15:10:47.068905 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG dbcounter [-] [101893] Writing DB stats keystone:SELECT=25 {{(pid=101893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:10:48.556368 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG dbcounter [-] [101892] Writing DB stats keystone:SELECT=32 {{(pid=101892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:10:52.917510 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43eab11d-4447-40a8-a85a-ed89c20f85f3 None None] Authenticating user token {{(pid=101893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:10:52.985875 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43eab11d-4447-40a8-a85a-ed89c20f85f3 None None] Validating token access rules against request {{(pid=101893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:10:52.990367 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aed5f25-f6a7-458f-b222-933b0219cdb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cec56f74b2fa4826a506dc7b919465be', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:10:52.991873 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aed5f25-f6a7-458f-b222-933b0219cdb7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:10:52.992154 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aed5f25-f6a7-458f-b222-933b0219cdb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:10:52.992424 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aed5f25-f6a7-458f-b222-933b0219cdb7 admin admin] PATH_INFO: `/v3/users/9e9bbc0458a04c3aa15dd82d845cefb7` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:10:52.993612 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aed5f25-f6a7-458f-b222-933b0219cdb7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9e9bbc0458a04c3aa15dd82d845cefb7)` {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:10:52.995541 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aed5f25-f6a7-458f-b222-933b0219cdb7 admin admin] RBAC: Authorization granted {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:10:53.131285 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.notifications [None req-9aed5f25-f6a7-458f-b222-933b0219cdb7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9e9bbc0458a04c3aa15dd82d845cefb7'} {{(pid=101893) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:10:53.139430 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.notifications [None req-9aed5f25-f6a7-458f-b222-933b0219cdb7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9e9bbc0458a04c3aa15dd82d845cefb7'} {{(pid=101893) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:10:53.152052 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.notifications [None req-9aed5f25-f6a7-458f-b222-933b0219cdb7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9e9bbc0458a04c3aa15dd82d845cefb7'} {{(pid=101893) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:10:53.152800 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.notifications [None req-9aed5f25-f6a7-458f-b222-933b0219cdb7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9e9bbc0458a04c3aa15dd82d845cefb7'} {{(pid=101893) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:10:53.153420 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.notifications [None req-9aed5f25-f6a7-458f-b222-933b0219cdb7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9e9bbc0458a04c3aa15dd82d845cefb7'} {{(pid=101893) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:10:53.208254 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 1195/2364] 10.222.0.84 () {58 vars in 1223 bytes} [Wed May 25 15:10:52 2022] DELETE /identity/v3/users/9e9bbc0458a04c3aa15dd82d845cefb7 => generated 0 bytes in 291 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 15:10:53.217206 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392f46e1-7c65-44d1-b3d8-008d90f28e2b None None] REQUEST_METHOD: `POST` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:10:53.217778 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392f46e1-7c65-44d1-b3d8-008d90f28e2b None None] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:10:53.218448 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392f46e1-7c65-44d1-b3d8-008d90f28e2b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:10:53.237876 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.auth.core [None req-392f46e1-7c65-44d1-b3d8-008d90f28e2b None None] MFA Rules not processed for user `05d87e87798e429aa1c10b24391f915e`. Rule list: `[]` (Enabled: `True`). {{(pid=101892) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:10:53.238997 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.fernet_utils [None req-392f46e1-7c65-44d1-b3d8-008d90f28e2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=101892) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:10:53.298735 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 1170/2365] 10.222.0.84 () {58 vars in 957 bytes} [Wed May 25 15:10:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 15:10:53.309767 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aed5f25-f6a7-458f-b222-933b0219cdb7 admin admin] Authenticating user token {{(pid=101893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:10:53.311321 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.fernet_utils [None req-9aed5f25-f6a7-458f-b222-933b0219cdb7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=101893) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:10:53.372961 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aed5f25-f6a7-458f-b222-933b0219cdb7 admin admin] Validating token access rules against request {{(pid=101893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:10:53.376723 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbcab1ca-097c-4d60-a1f6-807206767a5e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ce28b25b907473588ccb87dc4acc06a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a000829c658c4a7cab67f7b6353ba3fa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:10:53.377375 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbcab1ca-097c-4d60-a1f6-807206767a5e service neutron] REQUEST_METHOD: `GET` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:10:53.377654 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbcab1ca-097c-4d60-a1f6-807206767a5e service neutron] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:10:53.377927 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbcab1ca-097c-4d60-a1f6-807206767a5e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:10:53.387163 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbcab1ca-097c-4d60-a1f6-807206767a5e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:10:53.388654 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbcab1ca-097c-4d60-a1f6-807206767a5e service neutron] RBAC: Authorization granted {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:10:53.398993 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 1196/2366] 10.222.0.84 () {60 vars in 1365 bytes} [Wed May 25 15:10:53 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 15:10:53.924433 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-392f46e1-7c65-44d1-b3d8-008d90f28e2b None None] Authenticating user token {{(pid=101892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:10:53.925908 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.fernet_utils [None req-392f46e1-7c65-44d1-b3d8-008d90f28e2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=101892) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:10:53.939097 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-392f46e1-7c65-44d1-b3d8-008d90f28e2b None None] Validating token access rules against request {{(pid=101892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:10:53.955458 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84013686-936e-4451-8029-2056cc152ab7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cec56f74b2fa4826a506dc7b919465be', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:10:53.956766 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84013686-936e-4451-8029-2056cc152ab7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:10:53.957436 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84013686-936e-4451-8029-2056cc152ab7 admin admin] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:10:53.957780 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84013686-936e-4451-8029-2056cc152ab7 admin admin] PATH_INFO: `/v3/projects/e3f757f521444c5bbc84010d59a2e423` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:10:53.960346 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84013686-936e-4451-8029-2056cc152ab7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e3f757f521444c5bbc84010d59a2e423)` {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:10:53.962377 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84013686-936e-4451-8029-2056cc152ab7 admin admin] RBAC: Authorization granted {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:10:54.143456 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.notifications [None req-84013686-936e-4451-8029-2056cc152ab7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e3f757f521444c5bbc84010d59a2e423', 'request_id': 'req-84013686-936e-4451-8029-2056cc152ab7'} {{(pid=101892) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:10:54.155271 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.notifications [None req-84013686-936e-4451-8029-2056cc152ab7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e3f757f521444c5bbc84010d59a2e423', 'request_id': 'req-84013686-936e-4451-8029-2056cc152ab7'} {{(pid=101892) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:10:54.162561 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.notifications [None req-84013686-936e-4451-8029-2056cc152ab7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e3f757f521444c5bbc84010d59a2e423', 'request_id': 'req-84013686-936e-4451-8029-2056cc152ab7'} {{(pid=101892) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:10:54.294748 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.notifications [None req-84013686-936e-4451-8029-2056cc152ab7 admin admin] The token cache is being invalidate because project e3f757f521444c5bbc84010d59a2e423 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=101892) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 25 15:10:54.295417 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.notifications [None req-84013686-936e-4451-8029-2056cc152ab7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=101892) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:10:54.295977 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.notifications [None req-84013686-936e-4451-8029-2056cc152ab7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=101892) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:10:54.298014 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 1171/2367] 10.222.0.84 () {58 vars in 1232 bytes} [Wed May 25 15:10:53 2022] DELETE /identity/v3/projects/e3f757f521444c5bbc84010d59a2e423 => generated 0 bytes in 374 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 15:10:54.302920 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf3c2cb-2ccf-4541-b81b-7edea4ccb813 None None] REQUEST_METHOD: `POST` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:10:54.303461 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf3c2cb-2ccf-4541-b81b-7edea4ccb813 None None] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:10:54.303822 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf3c2cb-2ccf-4541-b81b-7edea4ccb813 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:10:54.325130 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.auth.core [None req-baf3c2cb-2ccf-4541-b81b-7edea4ccb813 None None] MFA Rules not processed for user `05d87e87798e429aa1c10b24391f915e`. Rule list: `[]` (Enabled: `True`). {{(pid=101893) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:10:54.326379 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.fernet_utils [None req-baf3c2cb-2ccf-4541-b81b-7edea4ccb813 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=101893) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:10:54.346561 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG dbcounter [-] [101893] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=101893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:10:54.407618 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 1197/2368] 10.222.0.84 () {58 vars in 957 bytes} [Wed May 25 15:10:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 25 15:10:54.413898 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62da4cd2-4c15-43db-a6d5-af103fd46d58 None None] REQUEST_METHOD: `POST` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:10:54.414185 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62da4cd2-4c15-43db-a6d5-af103fd46d58 None None] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:10:54.414466 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62da4cd2-4c15-43db-a6d5-af103fd46d58 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:10:54.437110 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.auth.core [None req-62da4cd2-4c15-43db-a6d5-af103fd46d58 None None] MFA Rules not processed for user `05d87e87798e429aa1c10b24391f915e`. Rule list: `[]` (Enabled: `True`). {{(pid=101892) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:10:54.438314 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.fernet_utils [None req-62da4cd2-4c15-43db-a6d5-af103fd46d58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=101892) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:10:54.448274 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 1172/2369] 10.222.0.84 () {58 vars in 957 bytes} [Wed May 25 15:10:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 15:10:54.452068 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baf3c2cb-2ccf-4541-b81b-7edea4ccb813 None None] Authenticating user token {{(pid=101893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:10:54.462555 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baf3c2cb-2ccf-4541-b81b-7edea4ccb813 None None] Validating token access rules against request {{(pid=101893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:10:54.467443 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f0efea0-2edc-453f-8f4e-4762331c5258 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cec56f74b2fa4826a506dc7b919465be', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:10:54.468201 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f0efea0-2edc-453f-8f4e-4762331c5258 admin admin] REQUEST_METHOD: `GET` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:10:54.468554 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f0efea0-2edc-453f-8f4e-4762331c5258 admin admin] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:10:54.468897 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f0efea0-2edc-453f-8f4e-4762331c5258 admin admin] PATH_INFO: `/v3/domains` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:10:54.469718 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f0efea0-2edc-453f-8f4e-4762331c5258 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=101893) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 15:10:54.470092 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f0efea0-2edc-453f-8f4e-4762331c5258 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:10:54.472182 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f0efea0-2edc-453f-8f4e-4762331c5258 admin admin] RBAC: Authorization granted {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:10:54.485755 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 1198/2370] 10.222.0.84 () {58 vars in 1152 bytes} [Wed May 25 15:10:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 15:10:54.556070 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62da4cd2-4c15-43db-a6d5-af103fd46d58 None None] Authenticating user token {{(pid=101892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:10:54.567078 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62da4cd2-4c15-43db-a6d5-af103fd46d58 None None] Validating token access rules against request {{(pid=101892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:10:54.573958 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c4191d-9cbb-4358-b064-5590aa586e10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cec56f74b2fa4826a506dc7b919465be', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:10:54.574793 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c4191d-9cbb-4358-b064-5590aa586e10 admin admin] REQUEST_METHOD: `POST` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:10:54.575077 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c4191d-9cbb-4358-b064-5590aa586e10 admin admin] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:10:54.575421 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c4191d-9cbb-4358-b064-5590aa586e10 admin admin] PATH_INFO: `/v3/projects` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:10:54.576243 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61c4191d-9cbb-4358-b064-5590aa586e10 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:10:54.579219 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61c4191d-9cbb-4358-b064-5590aa586e10 admin admin] RBAC: Authorization granted {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:10:54.657180 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 1173/2371] 10.222.0.84 () {60 vars in 1152 bytes} [Wed May 25 15:10:54 2022] POST /identity/v3/projects => generated 389 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 15:10:54.661253 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f0efea0-2edc-453f-8f4e-4762331c5258 admin admin] Authenticating user token {{(pid=101893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:10:54.672325 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f0efea0-2edc-453f-8f4e-4762331c5258 admin admin] Validating token access rules against request {{(pid=101893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:10:54.741918 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d8f3dae-7652-462c-a91f-da8963b7210d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cec56f74b2fa4826a506dc7b919465be', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:10:54.742605 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8f3dae-7652-462c-a91f-da8963b7210d admin admin] REQUEST_METHOD: `POST` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:10:54.743320 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8f3dae-7652-462c-a91f-da8963b7210d admin admin] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:10:54.743320 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8f3dae-7652-462c-a91f-da8963b7210d admin admin] PATH_INFO: `/v3/users` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:10:54.744423 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d8f3dae-7652-462c-a91f-da8963b7210d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:10:54.748115 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d8f3dae-7652-462c-a91f-da8963b7210d admin admin] RBAC: Authorization granted {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:10:54.827004 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 1199/2372] 10.222.0.84 () {60 vars in 1143 bytes} [Wed May 25 15:10:54 2022] POST /identity/v3/users => generated 295 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 15:10:54.831040 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c4191d-9cbb-4358-b064-5590aa586e10 admin admin] Authenticating user token {{(pid=101892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:10:54.842150 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c4191d-9cbb-4358-b064-5590aa586e10 admin admin] Validating token access rules against request {{(pid=101892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:10:54.847076 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f90bb9a-5f58-4126-b3d5-9b5ed47650f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cec56f74b2fa4826a506dc7b919465be', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:10:54.851814 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f90bb9a-5f58-4126-b3d5-9b5ed47650f5 admin admin] REQUEST_METHOD: `GET` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:10:54.851814 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f90bb9a-5f58-4126-b3d5-9b5ed47650f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:10:54.851814 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f90bb9a-5f58-4126-b3d5-9b5ed47650f5 admin admin] PATH_INFO: `/v3/roles` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:10:54.851814 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f90bb9a-5f58-4126-b3d5-9b5ed47650f5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:10:54.851814 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f90bb9a-5f58-4126-b3d5-9b5ed47650f5 admin admin] RBAC: Authorization granted {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:10:54.861342 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 1174/2373] 10.222.0.84 () {58 vars in 1121 bytes} [Wed May 25 15:10:54 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 15:10:54.866173 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d8f3dae-7652-462c-a91f-da8963b7210d admin admin] Authenticating user token {{(pid=101893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:10:54.876649 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d8f3dae-7652-462c-a91f-da8963b7210d admin admin] Validating token access rules against request {{(pid=101893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:10:54.882120 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e03a1423-e096-4d3d-b3ce-6963bed29648 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cec56f74b2fa4826a506dc7b919465be', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:10:54.882756 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03a1423-e096-4d3d-b3ce-6963bed29648 admin admin] REQUEST_METHOD: `GET` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:10:54.883090 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03a1423-e096-4d3d-b3ce-6963bed29648 admin admin] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:10:54.883375 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03a1423-e096-4d3d-b3ce-6963bed29648 admin admin] PATH_INFO: `/v3/roles` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:10:54.884144 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e03a1423-e096-4d3d-b3ce-6963bed29648 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:10:54.885835 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e03a1423-e096-4d3d-b3ce-6963bed29648 admin admin] RBAC: Authorization granted {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:10:54.897130 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 1200/2374] 10.222.0.84 () {58 vars in 1121 bytes} [Wed May 25 15:10:54 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 15:10:54.903028 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f90bb9a-5f58-4126-b3d5-9b5ed47650f5 admin admin] Authenticating user token {{(pid=101892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:10:54.918465 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f90bb9a-5f58-4126-b3d5-9b5ed47650f5 admin admin] Validating token access rules against request {{(pid=101892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:10:54.923647 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d428f3e2-a56a-41c0-92c7-43ed8228f70b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cec56f74b2fa4826a506dc7b919465be', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:10:54.924547 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d428f3e2-a56a-41c0-92c7-43ed8228f70b admin admin] REQUEST_METHOD: `PUT` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:10:54.924838 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d428f3e2-a56a-41c0-92c7-43ed8228f70b admin admin] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:10:54.925120 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d428f3e2-a56a-41c0-92c7-43ed8228f70b admin admin] PATH_INFO: `/v3/projects/6c39b7561a604c6e8ca27d5d6d32e8b8/users/1ff217092a4e48d7bb45f1379d57530f/roles/ff664fa0db7e4262a5accde96c3df4c3` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:10:54.944845 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d428f3e2-a56a-41c0-92c7-43ed8228f70b admin admin] RBAC: Authorizing `identity:create_grant(project_id=6c39b7561a604c6e8ca27d5d6d32e8b8, user_id=1ff217092a4e48d7bb45f1379d57530f, role_id=ff664fa0db7e4262a5accde96c3df4c3)` {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:10:54.947601 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d428f3e2-a56a-41c0-92c7-43ed8228f70b admin admin] RBAC: Authorization granted {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:10:55.025882 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 1175/2375] 10.222.0.84 () {60 vars in 1482 bytes} [Wed May 25 15:10:54 2022] PUT /identity/v3/projects/6c39b7561a604c6e8ca27d5d6d32e8b8/users/1ff217092a4e48d7bb45f1379d57530f/roles/ff664fa0db7e4262a5accde96c3df4c3 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 15:10:55.035968 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c07910-23b5-46b7-a9ac-d057305557b1 None None] REQUEST_METHOD: `POST` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:10:55.036338 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c07910-23b5-46b7-a9ac-d057305557b1 None None] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:10:55.036694 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c07910-23b5-46b7-a9ac-d057305557b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:10:55.065961 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.auth.core [None req-a5c07910-23b5-46b7-a9ac-d057305557b1 None None] MFA Rules not processed for user `1ff217092a4e48d7bb45f1379d57530f`. Rule list: `[]` (Enabled: `True`). {{(pid=101893) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:10:55.067209 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.fernet_utils [None req-a5c07910-23b5-46b7-a9ac-d057305557b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=101893) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:10:55.136044 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 1201/2376] 10.222.0.84 () {58 vars in 957 bytes} [Wed May 25 15:10:55 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 15:10:55.147368 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d428f3e2-a56a-41c0-92c7-43ed8228f70b admin admin] Authenticating user token {{(pid=101892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:10:55.149219 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.fernet_utils [None req-d428f3e2-a56a-41c0-92c7-43ed8228f70b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=101892) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:10:55.174448 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG dbcounter [-] [101892] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=101892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:10:55.215701 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d428f3e2-a56a-41c0-92c7-43ed8228f70b admin admin] Validating token access rules against request {{(pid=101892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:10:55.219395 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f87e5a8-7790-43b9-804f-c1b4ddccf7a8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e079f89a5e524ab6ad4183e4f690de07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a000829c658c4a7cab67f7b6353ba3fa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:10:55.219985 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f87e5a8-7790-43b9-804f-c1b4ddccf7a8 service cinder] REQUEST_METHOD: `GET` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:10:55.220305 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f87e5a8-7790-43b9-804f-c1b4ddccf7a8 service cinder] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:10:55.220592 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f87e5a8-7790-43b9-804f-c1b4ddccf7a8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:10:55.232359 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f87e5a8-7790-43b9-804f-c1b4ddccf7a8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:10:55.233832 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f87e5a8-7790-43b9-804f-c1b4ddccf7a8 service cinder] RBAC: Authorization granted {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:10:55.244340 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 1176/2377] 10.222.0.84 () {60 vars in 1365 bytes} [Wed May 25 15:10:55 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 15:11:05.132804 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG dbcounter [-] [101893] Writing DB stats keystone:SELECT=89,keystone:INSERT=3 {{(pid=101893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:11:05.297600 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG dbcounter [-] [101892] Writing DB stats keystone:SELECT=17 {{(pid=101892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:11:06.889800 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5c07910-23b5-46b7-a9ac-d057305557b1 None None] Authenticating user token {{(pid=101893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:11:06.953924 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5c07910-23b5-46b7-a9ac-d057305557b1 None None] Validating token access rules against request {{(pid=101893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:11:06.958572 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f7a281-864a-4aa8-9302-02a747b438da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cec56f74b2fa4826a506dc7b919465be', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:11:06.959445 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f7a281-864a-4aa8-9302-02a747b438da admin admin] REQUEST_METHOD: `DELETE` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:11:06.959759 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f7a281-864a-4aa8-9302-02a747b438da admin admin] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:11:06.960034 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f7a281-864a-4aa8-9302-02a747b438da admin admin] PATH_INFO: `/v3/users/1ff217092a4e48d7bb45f1379d57530f` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:11:06.961247 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41f7a281-864a-4aa8-9302-02a747b438da admin admin] RBAC: Authorizing `identity:delete_user(user_id=1ff217092a4e48d7bb45f1379d57530f)` {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:11:06.963218 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41f7a281-864a-4aa8-9302-02a747b438da admin admin] RBAC: Authorization granted {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:11:07.181500 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.notifications [None req-41f7a281-864a-4aa8-9302-02a747b438da admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1ff217092a4e48d7bb45f1379d57530f'} {{(pid=101893) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:11:07.188310 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.notifications [None req-41f7a281-864a-4aa8-9302-02a747b438da admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1ff217092a4e48d7bb45f1379d57530f'} {{(pid=101893) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:11:07.200299 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.notifications [None req-41f7a281-864a-4aa8-9302-02a747b438da admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1ff217092a4e48d7bb45f1379d57530f'} {{(pid=101893) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:11:07.200982 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.notifications [None req-41f7a281-864a-4aa8-9302-02a747b438da admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1ff217092a4e48d7bb45f1379d57530f'} {{(pid=101893) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:11:07.201587 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.notifications [None req-41f7a281-864a-4aa8-9302-02a747b438da admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1ff217092a4e48d7bb45f1379d57530f'} {{(pid=101893) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:11:07.270459 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 1202/2378] 10.222.0.84 () {58 vars in 1223 bytes} [Wed May 25 15:11:06 2022] DELETE /identity/v3/users/1ff217092a4e48d7bb45f1379d57530f => generated 0 bytes in 381 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 25 15:11:07.275756 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2aa52c-58ab-4c3b-ad94-8b1a2fbdc31d None None] REQUEST_METHOD: `POST` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:11:07.276253 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2aa52c-58ab-4c3b-ad94-8b1a2fbdc31d None None] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:11:07.276365 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2aa52c-58ab-4c3b-ad94-8b1a2fbdc31d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:11:07.293777 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.auth.core [None req-2c2aa52c-58ab-4c3b-ad94-8b1a2fbdc31d None None] MFA Rules not processed for user `05d87e87798e429aa1c10b24391f915e`. Rule list: `[]` (Enabled: `True`). {{(pid=101892) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:11:07.294971 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.fernet_utils [None req-2c2aa52c-58ab-4c3b-ad94-8b1a2fbdc31d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=101892) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:11:07.353126 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 1177/2379] 10.222.0.84 () {58 vars in 957 bytes} [Wed May 25 15:11:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 15:11:07.362829 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f7a281-864a-4aa8-9302-02a747b438da admin admin] Authenticating user token {{(pid=101893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:11:07.364267 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.fernet_utils [None req-41f7a281-864a-4aa8-9302-02a747b438da admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=101893) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:11:07.425268 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f7a281-864a-4aa8-9302-02a747b438da admin admin] Validating token access rules against request {{(pid=101893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:11:07.428943 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f6a550e-ded6-42e8-b343-1623e2423d89 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ce28b25b907473588ccb87dc4acc06a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a000829c658c4a7cab67f7b6353ba3fa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:11:07.432680 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6a550e-ded6-42e8-b343-1623e2423d89 service neutron] REQUEST_METHOD: `GET` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:11:07.432680 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6a550e-ded6-42e8-b343-1623e2423d89 service neutron] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:11:07.432680 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6a550e-ded6-42e8-b343-1623e2423d89 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:11:07.439600 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f6a550e-ded6-42e8-b343-1623e2423d89 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:11:07.441039 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f6a550e-ded6-42e8-b343-1623e2423d89 service neutron] RBAC: Authorization granted {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:11:07.450853 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 1203/2380] 10.222.0.84 () {60 vars in 1365 bytes} [Wed May 25 15:11:07 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 15:11:07.847296 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c2aa52c-58ab-4c3b-ad94-8b1a2fbdc31d None None] Authenticating user token {{(pid=101892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:11:07.848746 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.fernet_utils [None req-2c2aa52c-58ab-4c3b-ad94-8b1a2fbdc31d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=101892) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:11:07.861740 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c2aa52c-58ab-4c3b-ad94-8b1a2fbdc31d None None] Validating token access rules against request {{(pid=101892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:11:07.866493 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62b6df47-bcd7-4ed6-b0dc-e567718cc16d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cec56f74b2fa4826a506dc7b919465be', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:11:07.868090 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b6df47-bcd7-4ed6-b0dc-e567718cc16d admin admin] REQUEST_METHOD: `DELETE` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:11:07.868564 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b6df47-bcd7-4ed6-b0dc-e567718cc16d admin admin] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:11:07.868848 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b6df47-bcd7-4ed6-b0dc-e567718cc16d admin admin] PATH_INFO: `/v3/projects/6c39b7561a604c6e8ca27d5d6d32e8b8` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:11:07.870055 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62b6df47-bcd7-4ed6-b0dc-e567718cc16d admin admin] RBAC: Authorizing `identity:delete_project(project_id=6c39b7561a604c6e8ca27d5d6d32e8b8)` {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:11:07.872024 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62b6df47-bcd7-4ed6-b0dc-e567718cc16d admin admin] RBAC: Authorization granted {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:11:07.994942 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.notifications [None req-62b6df47-bcd7-4ed6-b0dc-e567718cc16d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6c39b7561a604c6e8ca27d5d6d32e8b8', 'request_id': 'req-62b6df47-bcd7-4ed6-b0dc-e567718cc16d'} {{(pid=101892) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:11:08.001153 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.notifications [None req-62b6df47-bcd7-4ed6-b0dc-e567718cc16d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6c39b7561a604c6e8ca27d5d6d32e8b8', 'request_id': 'req-62b6df47-bcd7-4ed6-b0dc-e567718cc16d'} {{(pid=101892) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:11:08.006777 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.notifications [None req-62b6df47-bcd7-4ed6-b0dc-e567718cc16d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6c39b7561a604c6e8ca27d5d6d32e8b8', 'request_id': 'req-62b6df47-bcd7-4ed6-b0dc-e567718cc16d'} {{(pid=101892) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:11:08.074463 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.notifications [None req-62b6df47-bcd7-4ed6-b0dc-e567718cc16d admin admin] The token cache is being invalidate because project 6c39b7561a604c6e8ca27d5d6d32e8b8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=101892) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 25 15:11:08.074757 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.notifications [None req-62b6df47-bcd7-4ed6-b0dc-e567718cc16d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=101892) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:11:08.075459 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.notifications [None req-62b6df47-bcd7-4ed6-b0dc-e567718cc16d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=101892) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:11:08.077156 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 1178/2381] 10.222.0.84 () {58 vars in 1232 bytes} [Wed May 25 15:11:07 2022] DELETE /identity/v3/projects/6c39b7561a604c6e8ca27d5d6d32e8b8 => generated 0 bytes in 230 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 15:11:17.447156 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG dbcounter [-] [101893] Writing DB stats keystone:SELECT=79,keystone:DELETE=10,keystone:INSERT=1 {{(pid=101893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:11:18.070471 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG dbcounter [-] [101892] Writing DB stats keystone:SELECT=54,keystone:DELETE=7,keystone:INSERT=1 {{(pid=101892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:11:21.441775 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4dbdb16-0c3b-4509-806b-5f9afa889bdc None None] REQUEST_METHOD: `POST` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:11:21.442267 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4dbdb16-0c3b-4509-806b-5f9afa889bdc None None] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:11:21.442381 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4dbdb16-0c3b-4509-806b-5f9afa889bdc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:11:21.459693 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.auth.core [None req-e4dbdb16-0c3b-4509-806b-5f9afa889bdc None None] MFA Rules not processed for user `049a7ab3f95f460e908f79cc321176fd`. Rule list: `[]` (Enabled: `True`). {{(pid=101893) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:11:21.460891 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.fernet_utils [None req-e4dbdb16-0c3b-4509-806b-5f9afa889bdc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=101893) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:11:21.515459 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 1204/2382] 10.222.0.84 () {58 vars in 1009 bytes} [Wed May 25 15:11:21 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 15:11:21.649188 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62b6df47-bcd7-4ed6-b0dc-e567718cc16d admin admin] Authenticating user token {{(pid=101892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:11:21.650580 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.fernet_utils [None req-62b6df47-bcd7-4ed6-b0dc-e567718cc16d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=101892) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:11:21.720665 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62b6df47-bcd7-4ed6-b0dc-e567718cc16d admin admin] Validating token access rules against request {{(pid=101892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:11:21.725473 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18d796a4-8cd9-4c45-922f-d5a32b50edbf service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e196f0897b98455c9e164271d7d0070a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a000829c658c4a7cab67f7b6353ba3fa', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:11:21.726197 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d796a4-8cd9-4c45-922f-d5a32b50edbf service swift] REQUEST_METHOD: `GET` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:11:21.726507 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d796a4-8cd9-4c45-922f-d5a32b50edbf service swift] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:11:21.726782 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d796a4-8cd9-4c45-922f-d5a32b50edbf service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:11:21.735361 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18d796a4-8cd9-4c45-922f-d5a32b50edbf service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:11:21.737077 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18d796a4-8cd9-4c45-922f-d5a32b50edbf service swift] RBAC: Authorization granted {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:11:21.745025 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 1179/2383] 10.222.0.84 () {60 vars in 1384 bytes} [Wed May 25 15:11:21 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 25 15:11:31.511667 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG dbcounter [-] [101893] Writing DB stats keystone:SELECT=25 {{(pid=101893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:11:31.741866 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG dbcounter [-] [101892] Writing DB stats keystone:SELECT=32 {{(pid=101892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:11:43.209364 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4dbdb16-0c3b-4509-806b-5f9afa889bdc None None] Authenticating user token {{(pid=101893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:11:43.210821 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.fernet_utils [None req-e4dbdb16-0c3b-4509-806b-5f9afa889bdc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=101893) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:11:43.267996 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4dbdb16-0c3b-4509-806b-5f9afa889bdc None None] Validating token access rules against request {{(pid=101893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:11:43.271692 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a700d08-b118-48b4-9b5a-c935e033b337 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ce28b25b907473588ccb87dc4acc06a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a000829c658c4a7cab67f7b6353ba3fa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:11:43.272348 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a700d08-b118-48b4-9b5a-c935e033b337 service neutron] REQUEST_METHOD: `GET` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:11:43.272636 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a700d08-b118-48b4-9b5a-c935e033b337 service neutron] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:11:43.272922 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a700d08-b118-48b4-9b5a-c935e033b337 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:11:43.274718 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.fernet_utils [None req-6a700d08-b118-48b4-9b5a-c935e033b337 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=101893) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:11:43.342827 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a700d08-b118-48b4-9b5a-c935e033b337 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:11:43.344314 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a700d08-b118-48b4-9b5a-c935e033b337 service neutron] RBAC: Authorization granted {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:11:43.357140 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 1205/2384] 10.222.0.84 () {60 vars in 1365 bytes} [Wed May 25 15:11:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 148 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 15:11:43.436055 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db51dc16-4c4e-442b-84c2-c406eee781cb None None] REQUEST_METHOD: `POST` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:11:43.436565 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db51dc16-4c4e-442b-84c2-c406eee781cb None None] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:11:43.436565 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db51dc16-4c4e-442b-84c2-c406eee781cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:11:43.455855 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.auth.core [None req-db51dc16-4c4e-442b-84c2-c406eee781cb None None] MFA Rules not processed for user `049a7ab3f95f460e908f79cc321176fd`. Rule list: `[]` (Enabled: `True`). {{(pid=101892) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:11:43.457472 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.fernet_utils [None req-db51dc16-4c4e-442b-84c2-c406eee781cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=101892) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:11:43.464481 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 1180/2385] 10.222.0.84 () {58 vars in 1009 bytes} [Wed May 25 15:11:43 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 15:11:43.476986 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a700d08-b118-48b4-9b5a-c935e033b337 service neutron] Authenticating user token {{(pid=101893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:11:43.489008 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a700d08-b118-48b4-9b5a-c935e033b337 service neutron] Validating token access rules against request {{(pid=101893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:11:43.494417 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1baa490f-4392-4064-9474-a7ff9ff84b3a service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e196f0897b98455c9e164271d7d0070a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a000829c658c4a7cab67f7b6353ba3fa', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:11:43.495070 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1baa490f-4392-4064-9474-a7ff9ff84b3a service swift] REQUEST_METHOD: `GET` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:11:43.495356 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1baa490f-4392-4064-9474-a7ff9ff84b3a service swift] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:11:43.495670 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1baa490f-4392-4064-9474-a7ff9ff84b3a service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:11:43.504138 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1baa490f-4392-4064-9474-a7ff9ff84b3a service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:11:43.505725 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1baa490f-4392-4064-9474-a7ff9ff84b3a service swift] RBAC: Authorization granted {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:11:43.514492 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 1206/2386] 10.222.0.84 () {60 vars in 1384 bytes} [Wed May 25 15:11:43 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 25 15:11:47.153208 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db51dc16-4c4e-442b-84c2-c406eee781cb None None] Authenticating user token {{(pid=101892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:11:47.155985 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.fernet_utils [None req-db51dc16-4c4e-442b-84c2-c406eee781cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=101892) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:11:47.242263 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db51dc16-4c4e-442b-84c2-c406eee781cb None None] Validating token access rules against request {{(pid=101892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:11:47.247869 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81c8f06d-1c2e-44a9-b166-0fc8d0408656 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd18c4a1d92b94c0087a203db4fed22f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a000829c658c4a7cab67f7b6353ba3fa', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:11:47.248532 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c8f06d-1c2e-44a9-b166-0fc8d0408656 service placement] REQUEST_METHOD: `GET` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:11:47.248847 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c8f06d-1c2e-44a9-b166-0fc8d0408656 service placement] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:11:47.249337 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c8f06d-1c2e-44a9-b166-0fc8d0408656 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:11:47.251303 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.fernet_utils [None req-81c8f06d-1c2e-44a9-b166-0fc8d0408656 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=101892) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:11:47.269082 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81c8f06d-1c2e-44a9-b166-0fc8d0408656 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:11:47.270691 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81c8f06d-1c2e-44a9-b166-0fc8d0408656 service placement] RBAC: Authorization granted {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:11:47.282270 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 1181/2387] 10.222.0.84 () {60 vars in 1365 bytes} [Wed May 25 15:11:47 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 129 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 15:11:47.299961 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1baa490f-4392-4064-9474-a7ff9ff84b3a service swift] Authenticating user token {{(pid=101893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:11:47.301405 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.fernet_utils [None req-1baa490f-4392-4064-9474-a7ff9ff84b3a service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=101893) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:11:47.320732 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1baa490f-4392-4064-9474-a7ff9ff84b3a service swift] Validating token access rules against request {{(pid=101893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:11:47.330632 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f374da82-69a5-44db-8945-b7f8f6ff3950 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cec56f74b2fa4826a506dc7b919465be', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:11:47.332127 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f374da82-69a5-44db-8945-b7f8f6ff3950 admin admin] REQUEST_METHOD: `DELETE` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:11:47.332496 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f374da82-69a5-44db-8945-b7f8f6ff3950 admin admin] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:11:47.332847 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f374da82-69a5-44db-8945-b7f8f6ff3950 admin admin] PATH_INFO: `/v3/users/4e9f463e2bfc4c86a07d530ac112b893` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:11:47.334286 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f374da82-69a5-44db-8945-b7f8f6ff3950 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4e9f463e2bfc4c86a07d530ac112b893)` {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:11:47.336374 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f374da82-69a5-44db-8945-b7f8f6ff3950 admin admin] RBAC: Authorization granted {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:11:47.561027 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.notifications [None req-f374da82-69a5-44db-8945-b7f8f6ff3950 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4e9f463e2bfc4c86a07d530ac112b893'} {{(pid=101893) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:11:47.568905 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.notifications [None req-f374da82-69a5-44db-8945-b7f8f6ff3950 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4e9f463e2bfc4c86a07d530ac112b893'} {{(pid=101893) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:11:47.581899 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.notifications [None req-f374da82-69a5-44db-8945-b7f8f6ff3950 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4e9f463e2bfc4c86a07d530ac112b893'} {{(pid=101893) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:11:47.587538 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.notifications [None req-f374da82-69a5-44db-8945-b7f8f6ff3950 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4e9f463e2bfc4c86a07d530ac112b893'} {{(pid=101893) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:11:47.587538 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.notifications [None req-f374da82-69a5-44db-8945-b7f8f6ff3950 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4e9f463e2bfc4c86a07d530ac112b893'} {{(pid=101893) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:11:47.671705 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 1207/2388] 10.222.0.84 () {58 vars in 1223 bytes} [Wed May 25 15:11:47 2022] DELETE /identity/v3/users/4e9f463e2bfc4c86a07d530ac112b893 => generated 0 bytes in 372 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 15:11:48.049696 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81c8f06d-1c2e-44a9-b166-0fc8d0408656 service placement] Authenticating user token {{(pid=101892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:11:48.065201 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81c8f06d-1c2e-44a9-b166-0fc8d0408656 service placement] Validating token access rules against request {{(pid=101892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:11:48.151092 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43ec0fa2-df67-47ad-95a2-c8d68df3fdec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cec56f74b2fa4826a506dc7b919465be', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:11:48.152285 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ec0fa2-df67-47ad-95a2-c8d68df3fdec admin admin] REQUEST_METHOD: `DELETE` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:11:48.152568 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ec0fa2-df67-47ad-95a2-c8d68df3fdec admin admin] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:11:48.152905 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ec0fa2-df67-47ad-95a2-c8d68df3fdec admin admin] PATH_INFO: `/v3/projects/13283d741db04e3abd9f4a259e6ccb13` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:11:48.154327 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43ec0fa2-df67-47ad-95a2-c8d68df3fdec admin admin] RBAC: Authorizing `identity:delete_project(project_id=13283d741db04e3abd9f4a259e6ccb13)` {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:11:48.156538 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43ec0fa2-df67-47ad-95a2-c8d68df3fdec admin admin] RBAC: Authorization granted {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:11:48.273507 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.notifications [None req-43ec0fa2-df67-47ad-95a2-c8d68df3fdec admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '13283d741db04e3abd9f4a259e6ccb13', 'request_id': 'req-43ec0fa2-df67-47ad-95a2-c8d68df3fdec'} {{(pid=101892) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:11:48.280170 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.notifications [None req-43ec0fa2-df67-47ad-95a2-c8d68df3fdec admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '13283d741db04e3abd9f4a259e6ccb13', 'request_id': 'req-43ec0fa2-df67-47ad-95a2-c8d68df3fdec'} {{(pid=101892) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:11:48.285744 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.notifications [None req-43ec0fa2-df67-47ad-95a2-c8d68df3fdec admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '13283d741db04e3abd9f4a259e6ccb13', 'request_id': 'req-43ec0fa2-df67-47ad-95a2-c8d68df3fdec'} {{(pid=101892) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:11:48.361655 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.notifications [None req-43ec0fa2-df67-47ad-95a2-c8d68df3fdec admin admin] The token cache is being invalidate because project 13283d741db04e3abd9f4a259e6ccb13 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=101892) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 25 15:11:48.362039 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.notifications [None req-43ec0fa2-df67-47ad-95a2-c8d68df3fdec admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=101892) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:11:48.362637 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.notifications [None req-43ec0fa2-df67-47ad-95a2-c8d68df3fdec admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=101892) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:11:48.367460 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 1182/2389] 10.222.0.84 () {58 vars in 1232 bytes} [Wed May 25 15:11:48 2022] DELETE /identity/v3/projects/13283d741db04e3abd9f4a259e6ccb13 => generated 0 bytes in 315 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 15:11:48.369509 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f5784c1-f534-411b-b272-e41a9cc580bb None None] REQUEST_METHOD: `POST` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:11:48.370014 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f5784c1-f534-411b-b272-e41a9cc580bb None None] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:11:48.370122 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f5784c1-f534-411b-b272-e41a9cc580bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:11:48.390644 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.auth.core [None req-9f5784c1-f534-411b-b272-e41a9cc580bb None None] MFA Rules not processed for user `05d87e87798e429aa1c10b24391f915e`. Rule list: `[]` (Enabled: `True`). {{(pid=101893) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:11:48.391933 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.fernet_utils [None req-9f5784c1-f534-411b-b272-e41a9cc580bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=101893) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:11:48.396522 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG dbcounter [-] [101893] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=101893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:11:48.460460 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 1208/2390] 10.222.0.84 () {58 vars in 957 bytes} [Wed May 25 15:11:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 15:11:48.469662 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3965407b-d9c4-4a00-a5b0-a91216a94eef None None] REQUEST_METHOD: `POST` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:11:48.472762 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3965407b-d9c4-4a00-a5b0-a91216a94eef None None] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:11:48.472762 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3965407b-d9c4-4a00-a5b0-a91216a94eef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:11:48.489907 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.auth.core [None req-3965407b-d9c4-4a00-a5b0-a91216a94eef None None] MFA Rules not processed for user `05d87e87798e429aa1c10b24391f915e`. Rule list: `[]` (Enabled: `True`). {{(pid=101892) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:11:48.491129 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.fernet_utils [None req-3965407b-d9c4-4a00-a5b0-a91216a94eef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=101892) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:11:48.499669 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 1183/2391] 10.222.0.84 () {58 vars in 957 bytes} [Wed May 25 15:11:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 25 15:11:48.504427 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f5784c1-f534-411b-b272-e41a9cc580bb None None] Authenticating user token {{(pid=101893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:11:48.514607 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f5784c1-f534-411b-b272-e41a9cc580bb None None] Validating token access rules against request {{(pid=101893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:11:48.519162 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9be7211c-3729-40ef-9b2c-b5770d34fdde admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cec56f74b2fa4826a506dc7b919465be', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:11:48.519968 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be7211c-3729-40ef-9b2c-b5770d34fdde admin admin] REQUEST_METHOD: `GET` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:11:48.520252 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be7211c-3729-40ef-9b2c-b5770d34fdde admin admin] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:11:48.520528 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be7211c-3729-40ef-9b2c-b5770d34fdde admin admin] PATH_INFO: `/v3/domains` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:11:48.521259 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9be7211c-3729-40ef-9b2c-b5770d34fdde admin admin] RBAC: Adding query filter params (name=Default) {{(pid=101893) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 15:11:48.521568 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9be7211c-3729-40ef-9b2c-b5770d34fdde admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:11:48.523484 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9be7211c-3729-40ef-9b2c-b5770d34fdde admin admin] RBAC: Authorization granted {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:11:48.540755 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 1209/2392] 10.222.0.84 () {58 vars in 1152 bytes} [Wed May 25 15:11:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 15:11:48.542219 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3965407b-d9c4-4a00-a5b0-a91216a94eef None None] Authenticating user token {{(pid=101892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:11:48.558309 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3965407b-d9c4-4a00-a5b0-a91216a94eef None None] Validating token access rules against request {{(pid=101892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:11:48.563721 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60b2937d-3f6d-4c28-880a-0a7d28e59939 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cec56f74b2fa4826a506dc7b919465be', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:11:48.564422 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b2937d-3f6d-4c28-880a-0a7d28e59939 admin admin] REQUEST_METHOD: `POST` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:11:48.564707 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b2937d-3f6d-4c28-880a-0a7d28e59939 admin admin] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:11:48.564984 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b2937d-3f6d-4c28-880a-0a7d28e59939 admin admin] PATH_INFO: `/v3/projects` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:11:48.565680 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60b2937d-3f6d-4c28-880a-0a7d28e59939 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:11:48.567909 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60b2937d-3f6d-4c28-880a-0a7d28e59939 admin admin] RBAC: Authorization granted {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:11:48.571622 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG dbcounter [-] [101892] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=101892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:11:48.676920 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 1184/2393] 10.222.0.84 () {60 vars in 1152 bytes} [Wed May 25 15:11:48 2022] POST /identity/v3/projects => generated 405 bytes in 135 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 15:11:48.677748 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9be7211c-3729-40ef-9b2c-b5770d34fdde admin admin] Authenticating user token {{(pid=101893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:11:48.688500 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9be7211c-3729-40ef-9b2c-b5770d34fdde admin admin] Validating token access rules against request {{(pid=101893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:11:48.755541 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d97e2b6-9e89-4325-8079-2087c4272afc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cec56f74b2fa4826a506dc7b919465be', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:11:48.756247 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d97e2b6-9e89-4325-8079-2087c4272afc admin admin] REQUEST_METHOD: `POST` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:11:48.756538 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d97e2b6-9e89-4325-8079-2087c4272afc admin admin] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:11:48.756819 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d97e2b6-9e89-4325-8079-2087c4272afc admin admin] PATH_INFO: `/v3/users` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:11:48.757549 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d97e2b6-9e89-4325-8079-2087c4272afc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:11:48.759682 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d97e2b6-9e89-4325-8079-2087c4272afc admin admin] RBAC: Authorization granted {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:11:48.826216 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 1210/2394] 10.222.0.84 () {60 vars in 1143 bytes} [Wed May 25 15:11:48 2022] POST /identity/v3/users => generated 303 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 25 15:11:48.830049 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60b2937d-3f6d-4c28-880a-0a7d28e59939 admin admin] Authenticating user token {{(pid=101892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:11:48.840531 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60b2937d-3f6d-4c28-880a-0a7d28e59939 admin admin] Validating token access rules against request {{(pid=101892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:11:48.845960 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a811f0e9-9420-4194-983b-1e4aef47d3cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cec56f74b2fa4826a506dc7b919465be', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:11:48.846706 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a811f0e9-9420-4194-983b-1e4aef47d3cb admin admin] REQUEST_METHOD: `GET` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:11:48.847140 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a811f0e9-9420-4194-983b-1e4aef47d3cb admin admin] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:11:48.847426 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a811f0e9-9420-4194-983b-1e4aef47d3cb admin admin] PATH_INFO: `/v3/roles` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:11:48.848147 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a811f0e9-9420-4194-983b-1e4aef47d3cb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:11:48.849771 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a811f0e9-9420-4194-983b-1e4aef47d3cb admin admin] RBAC: Authorization granted {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:11:48.863822 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 1185/2395] 10.222.0.84 () {58 vars in 1121 bytes} [Wed May 25 15:11:48 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 25 15:11:48.865048 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d97e2b6-9e89-4325-8079-2087c4272afc admin admin] Authenticating user token {{(pid=101893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:11:48.879068 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d97e2b6-9e89-4325-8079-2087c4272afc admin admin] Validating token access rules against request {{(pid=101893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:11:48.883977 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8605cfb5-3f05-4f76-9f43-5fa0af9d4690 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cec56f74b2fa4826a506dc7b919465be', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:11:48.889807 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8605cfb5-3f05-4f76-9f43-5fa0af9d4690 admin admin] REQUEST_METHOD: `GET` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:11:48.889807 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8605cfb5-3f05-4f76-9f43-5fa0af9d4690 admin admin] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:11:48.889807 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8605cfb5-3f05-4f76-9f43-5fa0af9d4690 admin admin] PATH_INFO: `/v3/roles` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:11:48.889807 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8605cfb5-3f05-4f76-9f43-5fa0af9d4690 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:11:48.889807 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8605cfb5-3f05-4f76-9f43-5fa0af9d4690 admin admin] RBAC: Authorization granted {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:11:48.903733 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 1211/2396] 10.222.0.84 () {58 vars in 1121 bytes} [Wed May 25 15:11:48 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 15:11:48.904873 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a811f0e9-9420-4194-983b-1e4aef47d3cb admin admin] Authenticating user token {{(pid=101892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:11:48.917152 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a811f0e9-9420-4194-983b-1e4aef47d3cb admin admin] Validating token access rules against request {{(pid=101892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:11:48.931369 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6241f28b-c650-4d7d-ace5-c85efb91adb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cec56f74b2fa4826a506dc7b919465be', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:11:48.932691 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6241f28b-c650-4d7d-ace5-c85efb91adb8 admin admin] REQUEST_METHOD: `PUT` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:11:48.933193 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6241f28b-c650-4d7d-ace5-c85efb91adb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:11:48.933651 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6241f28b-c650-4d7d-ace5-c85efb91adb8 admin admin] PATH_INFO: `/v3/projects/7cbfe2de02324ae08adfab6c1f4f8c2a/users/830ce5ff91254f839e54cc6bc070b157/roles/ff664fa0db7e4262a5accde96c3df4c3` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:11:48.952129 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6241f28b-c650-4d7d-ace5-c85efb91adb8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7cbfe2de02324ae08adfab6c1f4f8c2a, user_id=830ce5ff91254f839e54cc6bc070b157, role_id=ff664fa0db7e4262a5accde96c3df4c3)` {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:11:48.954939 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6241f28b-c650-4d7d-ace5-c85efb91adb8 admin admin] RBAC: Authorization granted {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:11:49.063652 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 1186/2397] 10.222.0.84 () {60 vars in 1482 bytes} [Wed May 25 15:11:48 2022] PUT /identity/v3/projects/7cbfe2de02324ae08adfab6c1f4f8c2a/users/830ce5ff91254f839e54cc6bc070b157/roles/ff664fa0db7e4262a5accde96c3df4c3 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 15:11:49.072568 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad10fbbe-39d8-4fbe-9d16-8df37a200676 None None] REQUEST_METHOD: `POST` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:11:49.072930 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad10fbbe-39d8-4fbe-9d16-8df37a200676 None None] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:11:49.073140 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad10fbbe-39d8-4fbe-9d16-8df37a200676 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:11:49.107028 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.auth.core [None req-ad10fbbe-39d8-4fbe-9d16-8df37a200676 None None] MFA Rules not processed for user `830ce5ff91254f839e54cc6bc070b157`. Rule list: `[]` (Enabled: `True`). {{(pid=101893) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:11:49.108419 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.fernet_utils [None req-ad10fbbe-39d8-4fbe-9d16-8df37a200676 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=101893) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:11:49.188772 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 1212/2398] 10.222.0.84 () {58 vars in 957 bytes} [Wed May 25 15:11:49 2022] POST /identity/v3/auth/tokens => generated 3272 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 15:11:49.189816 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6241f28b-c650-4d7d-ace5-c85efb91adb8 admin admin] Authenticating user token {{(pid=101892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:11:49.257287 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6241f28b-c650-4d7d-ace5-c85efb91adb8 admin admin] Validating token access rules against request {{(pid=101892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:11:49.263120 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f13467c6-9db5-42b6-80dc-5d69573d62c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cec56f74b2fa4826a506dc7b919465be', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:11:49.263842 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13467c6-9db5-42b6-80dc-5d69573d62c1 admin admin] REQUEST_METHOD: `POST` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:11:49.264132 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13467c6-9db5-42b6-80dc-5d69573d62c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:11:49.264413 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13467c6-9db5-42b6-80dc-5d69573d62c1 admin admin] PATH_INFO: `/v3/projects` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:11:49.265157 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f13467c6-9db5-42b6-80dc-5d69573d62c1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:11:49.267084 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f13467c6-9db5-42b6-80dc-5d69573d62c1 admin admin] RBAC: Authorization granted {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:11:49.352687 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 1187/2399] 10.222.0.84 () {60 vars in 1152 bytes} [Wed May 25 15:11:49 2022] POST /identity/v3/projects => generated 405 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 25 15:11:49.357392 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad10fbbe-39d8-4fbe-9d16-8df37a200676 None None] Authenticating user token {{(pid=101893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:11:49.364266 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG dbcounter [-] [101893] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=101893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:11:49.368748 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad10fbbe-39d8-4fbe-9d16-8df37a200676 None None] Validating token access rules against request {{(pid=101893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:11:49.431323 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3fd3b79-2bae-413c-9bd5-06b23c2022b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cec56f74b2fa4826a506dc7b919465be', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:11:49.432061 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3fd3b79-2bae-413c-9bd5-06b23c2022b9 admin admin] REQUEST_METHOD: `POST` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:11:49.432303 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3fd3b79-2bae-413c-9bd5-06b23c2022b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:11:49.432769 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3fd3b79-2bae-413c-9bd5-06b23c2022b9 admin admin] PATH_INFO: `/v3/users` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:11:49.433464 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3fd3b79-2bae-413c-9bd5-06b23c2022b9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:11:49.435609 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3fd3b79-2bae-413c-9bd5-06b23c2022b9 admin admin] RBAC: Authorization granted {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:11:49.505298 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 1213/2400] 10.222.0.84 () {60 vars in 1143 bytes} [Wed May 25 15:11:49 2022] POST /identity/v3/users => generated 309 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 15:11:49.509325 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f13467c6-9db5-42b6-80dc-5d69573d62c1 admin admin] Authenticating user token {{(pid=101892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:11:49.520720 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f13467c6-9db5-42b6-80dc-5d69573d62c1 admin admin] Validating token access rules against request {{(pid=101892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:11:49.525367 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33b4ebd7-6732-450b-b65c-29cc4b10cddd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cec56f74b2fa4826a506dc7b919465be', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:11:49.526039 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b4ebd7-6732-450b-b65c-29cc4b10cddd admin admin] REQUEST_METHOD: `GET` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:11:49.526327 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b4ebd7-6732-450b-b65c-29cc4b10cddd admin admin] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:11:49.526607 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b4ebd7-6732-450b-b65c-29cc4b10cddd admin admin] PATH_INFO: `/v3/roles` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:11:49.527368 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33b4ebd7-6732-450b-b65c-29cc4b10cddd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:11:49.529789 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33b4ebd7-6732-450b-b65c-29cc4b10cddd admin admin] RBAC: Authorization granted {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:11:49.541317 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 1188/2401] 10.222.0.84 () {58 vars in 1121 bytes} [Wed May 25 15:11:49 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 15:11:49.545556 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3fd3b79-2bae-413c-9bd5-06b23c2022b9 admin admin] Authenticating user token {{(pid=101893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:11:49.558448 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3fd3b79-2bae-413c-9bd5-06b23c2022b9 admin admin] Validating token access rules against request {{(pid=101893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:11:49.563287 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b7729e-8ee8-41ce-9013-23c682a86a87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cec56f74b2fa4826a506dc7b919465be', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:11:49.564229 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b7729e-8ee8-41ce-9013-23c682a86a87 admin admin] REQUEST_METHOD: `PUT` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:11:49.564677 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b7729e-8ee8-41ce-9013-23c682a86a87 admin admin] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:11:49.564969 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b7729e-8ee8-41ce-9013-23c682a86a87 admin admin] PATH_INFO: `/v3/projects/07572cdbd1f940d0b36a5969339ca7dc/users/51db9a58eab74acaa8bbf952b639f9f3/roles/a3b78e7d547d4d2d998b4c99a4396bba` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:11:49.581903 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4b7729e-8ee8-41ce-9013-23c682a86a87 admin admin] RBAC: Authorizing `identity:create_grant(project_id=07572cdbd1f940d0b36a5969339ca7dc, user_id=51db9a58eab74acaa8bbf952b639f9f3, role_id=a3b78e7d547d4d2d998b4c99a4396bba)` {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:11:49.584744 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4b7729e-8ee8-41ce-9013-23c682a86a87 admin admin] RBAC: Authorization granted {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:11:49.654327 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 1214/2402] 10.222.0.84 () {60 vars in 1482 bytes} [Wed May 25 15:11:49 2022] PUT /identity/v3/projects/07572cdbd1f940d0b36a5969339ca7dc/users/51db9a58eab74acaa8bbf952b639f9f3/roles/a3b78e7d547d4d2d998b4c99a4396bba => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 25 15:11:49.655579 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33b4ebd7-6732-450b-b65c-29cc4b10cddd admin admin] Authenticating user token {{(pid=101892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:11:49.665902 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33b4ebd7-6732-450b-b65c-29cc4b10cddd admin admin] Validating token access rules against request {{(pid=101892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:11:49.728245 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e59593-bc0f-4447-a635-5c8d548565be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cec56f74b2fa4826a506dc7b919465be', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:11:49.728918 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e59593-bc0f-4447-a635-5c8d548565be admin admin] REQUEST_METHOD: `GET` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:11:49.729201 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e59593-bc0f-4447-a635-5c8d548565be admin admin] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:11:49.729477 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e59593-bc0f-4447-a635-5c8d548565be admin admin] PATH_INFO: `/v3/roles` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:11:49.730204 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8e59593-bc0f-4447-a635-5c8d548565be admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:11:49.732441 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8e59593-bc0f-4447-a635-5c8d548565be admin admin] RBAC: Authorization granted {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:11:49.746485 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 1189/2403] 10.222.0.84 () {58 vars in 1121 bytes} [Wed May 25 15:11:49 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 15:11:49.748426 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b7729e-8ee8-41ce-9013-23c682a86a87 admin admin] Authenticating user token {{(pid=101893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:11:49.759375 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b7729e-8ee8-41ce-9013-23c682a86a87 admin admin] Validating token access rules against request {{(pid=101893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:11:49.764146 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0109f858-5a51-4035-b667-257de57b91f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cec56f74b2fa4826a506dc7b919465be', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:11:49.765068 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0109f858-5a51-4035-b667-257de57b91f0 admin admin] REQUEST_METHOD: `PUT` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:11:49.765359 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0109f858-5a51-4035-b667-257de57b91f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:11:49.765636 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0109f858-5a51-4035-b667-257de57b91f0 admin admin] PATH_INFO: `/v3/projects/07572cdbd1f940d0b36a5969339ca7dc/users/51db9a58eab74acaa8bbf952b639f9f3/roles/a3b78e7d547d4d2d998b4c99a4396bba` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:11:49.767694 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0109f858-5a51-4035-b667-257de57b91f0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=07572cdbd1f940d0b36a5969339ca7dc, user_id=51db9a58eab74acaa8bbf952b639f9f3, role_id=a3b78e7d547d4d2d998b4c99a4396bba)` {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:11:49.770376 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0109f858-5a51-4035-b667-257de57b91f0 admin admin] RBAC: Authorization granted {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:11:49.782363 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 1215/2404] 10.222.0.84 () {60 vars in 1482 bytes} [Wed May 25 15:11:49 2022] PUT /identity/v3/projects/07572cdbd1f940d0b36a5969339ca7dc/users/51db9a58eab74acaa8bbf952b639f9f3/roles/a3b78e7d547d4d2d998b4c99a4396bba => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 15:11:49.794328 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76451817-dd57-495d-9e46-10b3ab8a9354 None None] REQUEST_METHOD: `POST` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:11:49.794952 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76451817-dd57-495d-9e46-10b3ab8a9354 None None] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:11:49.795323 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76451817-dd57-495d-9e46-10b3ab8a9354 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:11:49.825290 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.auth.core [None req-76451817-dd57-495d-9e46-10b3ab8a9354 None None] MFA Rules not processed for user `51db9a58eab74acaa8bbf952b639f9f3`. Rule list: `[]` (Enabled: `True`). {{(pid=101892) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:11:49.826612 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.fernet_utils [None req-76451817-dd57-495d-9e46-10b3ab8a9354 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=101892) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:11:49.835889 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG dbcounter [-] [101892] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=101892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:11:49.900629 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 1190/2405] 10.222.0.84 () {58 vars in 957 bytes} [Wed May 25 15:11:49 2022] POST /identity/v3/auth/tokens => generated 3339 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 15:11:49.911761 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0109f858-5a51-4035-b667-257de57b91f0 admin admin] Authenticating user token {{(pid=101893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:11:49.913475 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.fernet_utils [None req-0109f858-5a51-4035-b667-257de57b91f0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=101893) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:11:49.976652 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0109f858-5a51-4035-b667-257de57b91f0 admin admin] Validating token access rules against request {{(pid=101893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:11:49.980419 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f026619-c55e-45a0-8028-d61dd435e94d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e079f89a5e524ab6ad4183e4f690de07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a000829c658c4a7cab67f7b6353ba3fa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:11:49.981826 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f026619-c55e-45a0-8028-d61dd435e94d service cinder] REQUEST_METHOD: `GET` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:11:49.982120 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f026619-c55e-45a0-8028-d61dd435e94d service cinder] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:11:49.982399 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f026619-c55e-45a0-8028-d61dd435e94d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:11:49.992447 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f026619-c55e-45a0-8028-d61dd435e94d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:11:49.993921 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f026619-c55e-45a0-8028-d61dd435e94d service cinder] RBAC: Authorization granted {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:11:50.005868 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 1216/2406] 10.222.0.84 () {60 vars in 1365 bytes} [Wed May 25 15:11:49 2022] GET /identity/v3/auth/tokens => generated 3339 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 15:11:50.175645 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76451817-dd57-495d-9e46-10b3ab8a9354 None None] Authenticating user token {{(pid=101892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:11:50.274061 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76451817-dd57-495d-9e46-10b3ab8a9354 None None] Validating token access rules against request {{(pid=101892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:11:50.280946 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c142926a-e50a-4d6f-b5be-c8b0f1b8fd4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cec56f74b2fa4826a506dc7b919465be', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:11:50.281954 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c142926a-e50a-4d6f-b5be-c8b0f1b8fd4b admin admin] REQUEST_METHOD: `DELETE` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:11:50.282340 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c142926a-e50a-4d6f-b5be-c8b0f1b8fd4b admin admin] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:11:50.282733 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c142926a-e50a-4d6f-b5be-c8b0f1b8fd4b admin admin] PATH_INFO: `/v3/users/830ce5ff91254f839e54cc6bc070b157` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:11:50.284097 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c142926a-e50a-4d6f-b5be-c8b0f1b8fd4b admin admin] RBAC: Authorizing `identity:delete_user(user_id=830ce5ff91254f839e54cc6bc070b157)` {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:11:50.286143 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c142926a-e50a-4d6f-b5be-c8b0f1b8fd4b admin admin] RBAC: Authorization granted {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:11:50.462094 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.notifications [None req-c142926a-e50a-4d6f-b5be-c8b0f1b8fd4b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '830ce5ff91254f839e54cc6bc070b157'} {{(pid=101892) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:11:50.471270 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.notifications [None req-c142926a-e50a-4d6f-b5be-c8b0f1b8fd4b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '830ce5ff91254f839e54cc6bc070b157'} {{(pid=101892) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:11:50.482502 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.notifications [None req-c142926a-e50a-4d6f-b5be-c8b0f1b8fd4b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '830ce5ff91254f839e54cc6bc070b157'} {{(pid=101892) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:11:50.483230 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.notifications [None req-c142926a-e50a-4d6f-b5be-c8b0f1b8fd4b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '830ce5ff91254f839e54cc6bc070b157'} {{(pid=101892) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:11:50.590515 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.notifications [None req-c142926a-e50a-4d6f-b5be-c8b0f1b8fd4b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '830ce5ff91254f839e54cc6bc070b157'} {{(pid=101892) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:11:50.601082 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 1191/2407] 10.222.0.84 () {58 vars in 1223 bytes} [Wed May 25 15:11:50 2022] DELETE /identity/v3/users/830ce5ff91254f839e54cc6bc070b157 => generated 0 bytes in 426 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 15:11:50.605595 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12280316-090f-403a-b448-d4598fd48275 None None] REQUEST_METHOD: `POST` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:11:50.606090 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12280316-090f-403a-b448-d4598fd48275 None None] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:11:50.606213 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12280316-090f-403a-b448-d4598fd48275 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:11:50.625390 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.auth.core [None req-12280316-090f-403a-b448-d4598fd48275 None None] MFA Rules not processed for user `05d87e87798e429aa1c10b24391f915e`. Rule list: `[]` (Enabled: `True`). {{(pid=101893) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:11:50.626712 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.fernet_utils [None req-12280316-090f-403a-b448-d4598fd48275 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=101893) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:11:50.679999 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG dbcounter [-] [101893] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=101893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:11:50.690488 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 1217/2408] 10.222.0.84 () {58 vars in 957 bytes} [Wed May 25 15:11:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 15:11:50.701151 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c142926a-e50a-4d6f-b5be-c8b0f1b8fd4b admin admin] Authenticating user token {{(pid=101892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:11:50.702550 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.fernet_utils [None req-c142926a-e50a-4d6f-b5be-c8b0f1b8fd4b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=101892) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:11:50.733107 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG dbcounter [-] [101892] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=101892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:11:50.770315 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c142926a-e50a-4d6f-b5be-c8b0f1b8fd4b admin admin] Validating token access rules against request {{(pid=101892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:11:50.774712 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d94a93-a851-48b7-9ea5-3b8ab898bfae service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ce28b25b907473588ccb87dc4acc06a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a000829c658c4a7cab67f7b6353ba3fa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:11:50.775395 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d94a93-a851-48b7-9ea5-3b8ab898bfae service neutron] REQUEST_METHOD: `GET` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:11:50.775716 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d94a93-a851-48b7-9ea5-3b8ab898bfae service neutron] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:11:50.775997 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d94a93-a851-48b7-9ea5-3b8ab898bfae service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:11:50.786049 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87d94a93-a851-48b7-9ea5-3b8ab898bfae service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:11:50.788400 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87d94a93-a851-48b7-9ea5-3b8ab898bfae service neutron] RBAC: Authorization granted {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:11:50.798655 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 1192/2409] 10.222.0.84 () {60 vars in 1365 bytes} [Wed May 25 15:11:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 15:11:51.202408 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12280316-090f-403a-b448-d4598fd48275 None None] Authenticating user token {{(pid=101893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:11:51.203940 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.fernet_utils [None req-12280316-090f-403a-b448-d4598fd48275 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=101893) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:11:51.216450 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12280316-090f-403a-b448-d4598fd48275 None None] Validating token access rules against request {{(pid=101893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:11:51.221162 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42d1aaba-1112-4e76-83ed-6e4146fb72c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cec56f74b2fa4826a506dc7b919465be', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:11:51.222044 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d1aaba-1112-4e76-83ed-6e4146fb72c0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:11:51.222328 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d1aaba-1112-4e76-83ed-6e4146fb72c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:11:51.222603 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d1aaba-1112-4e76-83ed-6e4146fb72c0 admin admin] PATH_INFO: `/v3/projects/7cbfe2de02324ae08adfab6c1f4f8c2a` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:11:51.224066 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42d1aaba-1112-4e76-83ed-6e4146fb72c0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7cbfe2de02324ae08adfab6c1f4f8c2a)` {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:11:51.225775 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42d1aaba-1112-4e76-83ed-6e4146fb72c0 admin admin] RBAC: Authorization granted {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:11:51.380883 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.notifications [None req-42d1aaba-1112-4e76-83ed-6e4146fb72c0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7cbfe2de02324ae08adfab6c1f4f8c2a', 'request_id': 'req-42d1aaba-1112-4e76-83ed-6e4146fb72c0'} {{(pid=101893) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:11:51.387878 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.notifications [None req-42d1aaba-1112-4e76-83ed-6e4146fb72c0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7cbfe2de02324ae08adfab6c1f4f8c2a', 'request_id': 'req-42d1aaba-1112-4e76-83ed-6e4146fb72c0'} {{(pid=101893) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:11:51.406290 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.notifications [None req-42d1aaba-1112-4e76-83ed-6e4146fb72c0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7cbfe2de02324ae08adfab6c1f4f8c2a', 'request_id': 'req-42d1aaba-1112-4e76-83ed-6e4146fb72c0'} {{(pid=101893) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:11:51.482484 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.notifications [None req-42d1aaba-1112-4e76-83ed-6e4146fb72c0 admin admin] The token cache is being invalidate because project 7cbfe2de02324ae08adfab6c1f4f8c2a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=101893) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 25 15:11:51.482760 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.notifications [None req-42d1aaba-1112-4e76-83ed-6e4146fb72c0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=101893) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:11:51.484092 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.notifications [None req-42d1aaba-1112-4e76-83ed-6e4146fb72c0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=101893) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:11:51.485603 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 1218/2410] 10.222.0.84 () {58 vars in 1232 bytes} [Wed May 25 15:11:51 2022] DELETE /identity/v3/projects/7cbfe2de02324ae08adfab6c1f4f8c2a => generated 0 bytes in 284 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 15:11:51.489759 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d94a93-a851-48b7-9ea5-3b8ab898bfae service neutron] Authenticating user token {{(pid=101892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:11:51.500058 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d94a93-a851-48b7-9ea5-3b8ab898bfae service neutron] Validating token access rules against request {{(pid=101892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:11:51.567846 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43734180-c245-4960-a984-bb04f56351b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cec56f74b2fa4826a506dc7b919465be', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:11:51.568809 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43734180-c245-4960-a984-bb04f56351b8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:11:51.569185 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43734180-c245-4960-a984-bb04f56351b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:11:51.569524 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43734180-c245-4960-a984-bb04f56351b8 admin admin] PATH_INFO: `/v3/users/51db9a58eab74acaa8bbf952b639f9f3` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:11:51.570835 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43734180-c245-4960-a984-bb04f56351b8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=51db9a58eab74acaa8bbf952b639f9f3)` {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:11:51.572855 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43734180-c245-4960-a984-bb04f56351b8 admin admin] RBAC: Authorization granted {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:11:51.780298 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.notifications [None req-43734180-c245-4960-a984-bb04f56351b8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '51db9a58eab74acaa8bbf952b639f9f3'} {{(pid=101892) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:11:51.788701 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.notifications [None req-43734180-c245-4960-a984-bb04f56351b8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '51db9a58eab74acaa8bbf952b639f9f3'} {{(pid=101892) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:11:51.811604 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.notifications [None req-43734180-c245-4960-a984-bb04f56351b8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '51db9a58eab74acaa8bbf952b639f9f3'} {{(pid=101892) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:11:51.812404 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.notifications [None req-43734180-c245-4960-a984-bb04f56351b8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '51db9a58eab74acaa8bbf952b639f9f3'} {{(pid=101892) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:11:51.886831 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.notifications [None req-43734180-c245-4960-a984-bb04f56351b8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '51db9a58eab74acaa8bbf952b639f9f3'} {{(pid=101892) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:11:51.894221 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 1193/2411] 10.222.0.84 () {58 vars in 1223 bytes} [Wed May 25 15:11:51 2022] DELETE /identity/v3/users/51db9a58eab74acaa8bbf952b639f9f3 => generated 0 bytes in 405 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 15:11:52.321571 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42d1aaba-1112-4e76-83ed-6e4146fb72c0 admin admin] Authenticating user token {{(pid=101893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:11:52.323099 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.fernet_utils [None req-42d1aaba-1112-4e76-83ed-6e4146fb72c0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=101893) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:11:52.345514 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42d1aaba-1112-4e76-83ed-6e4146fb72c0 admin admin] Validating token access rules against request {{(pid=101893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:11:52.417041 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d5fe606-9a20-408c-b351-4bd07f2d8d15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cec56f74b2fa4826a506dc7b919465be', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:11:52.417913 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5fe606-9a20-408c-b351-4bd07f2d8d15 admin admin] REQUEST_METHOD: `DELETE` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:11:52.418201 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5fe606-9a20-408c-b351-4bd07f2d8d15 admin admin] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:11:52.418547 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5fe606-9a20-408c-b351-4bd07f2d8d15 admin admin] PATH_INFO: `/v3/projects/07572cdbd1f940d0b36a5969339ca7dc` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:11:52.419784 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d5fe606-9a20-408c-b351-4bd07f2d8d15 admin admin] RBAC: Authorizing `identity:delete_project(project_id=07572cdbd1f940d0b36a5969339ca7dc)` {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:11:52.421874 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d5fe606-9a20-408c-b351-4bd07f2d8d15 admin admin] RBAC: Authorization granted {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:11:52.529779 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.notifications [None req-0d5fe606-9a20-408c-b351-4bd07f2d8d15 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '07572cdbd1f940d0b36a5969339ca7dc', 'request_id': 'req-0d5fe606-9a20-408c-b351-4bd07f2d8d15'} {{(pid=101893) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:11:52.537515 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.notifications [None req-0d5fe606-9a20-408c-b351-4bd07f2d8d15 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '07572cdbd1f940d0b36a5969339ca7dc', 'request_id': 'req-0d5fe606-9a20-408c-b351-4bd07f2d8d15'} {{(pid=101893) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:11:52.544425 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.notifications [None req-0d5fe606-9a20-408c-b351-4bd07f2d8d15 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '07572cdbd1f940d0b36a5969339ca7dc', 'request_id': 'req-0d5fe606-9a20-408c-b351-4bd07f2d8d15'} {{(pid=101893) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:11:52.769430 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.notifications [None req-0d5fe606-9a20-408c-b351-4bd07f2d8d15 admin admin] The token cache is being invalidate because project 07572cdbd1f940d0b36a5969339ca7dc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=101893) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 25 15:11:52.770183 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.notifications [None req-0d5fe606-9a20-408c-b351-4bd07f2d8d15 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=101893) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:11:52.770664 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.notifications [None req-0d5fe606-9a20-408c-b351-4bd07f2d8d15 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=101893) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:11:52.772298 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 1219/2412] 10.222.0.84 () {58 vars in 1232 bytes} [Wed May 25 15:11:52 2022] DELETE /identity/v3/projects/07572cdbd1f940d0b36a5969339ca7dc => generated 0 bytes in 452 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 15:11:52.777212 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2726efe-66d7-49ab-9e4c-6219b8025d65 None None] REQUEST_METHOD: `POST` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:11:52.777726 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2726efe-66d7-49ab-9e4c-6219b8025d65 None None] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:11:52.777832 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2726efe-66d7-49ab-9e4c-6219b8025d65 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:11:52.797476 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.auth.core [None req-e2726efe-66d7-49ab-9e4c-6219b8025d65 None None] MFA Rules not processed for user `05d87e87798e429aa1c10b24391f915e`. Rule list: `[]` (Enabled: `True`). {{(pid=101892) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:11:52.798671 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.fernet_utils [None req-e2726efe-66d7-49ab-9e4c-6219b8025d65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=101892) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:11:52.849743 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG dbcounter [-] [101892] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=101892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:11:52.867454 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 1194/2413] 10.222.0.84 () {58 vars in 957 bytes} [Wed May 25 15:11:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 15:11:52.875795 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f73ec3-45cb-4602-bc29-84c0f85f3fe7 None None] REQUEST_METHOD: `POST` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:11:52.876089 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f73ec3-45cb-4602-bc29-84c0f85f3fe7 None None] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:11:52.876373 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f73ec3-45cb-4602-bc29-84c0f85f3fe7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:11:52.895004 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.auth.core [None req-d1f73ec3-45cb-4602-bc29-84c0f85f3fe7 None None] MFA Rules not processed for user `05d87e87798e429aa1c10b24391f915e`. Rule list: `[]` (Enabled: `True`). {{(pid=101893) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:11:52.896302 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.fernet_utils [None req-d1f73ec3-45cb-4602-bc29-84c0f85f3fe7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=101893) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:11:52.904815 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 1220/2414] 10.222.0.84 () {58 vars in 957 bytes} [Wed May 25 15:11:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 15:11:52.908947 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2726efe-66d7-49ab-9e4c-6219b8025d65 None None] Authenticating user token {{(pid=101892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:11:52.919739 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2726efe-66d7-49ab-9e4c-6219b8025d65 None None] Validating token access rules against request {{(pid=101892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:11:52.925058 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0def1db9-0f13-4a24-9a03-1bcf1138a4b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cec56f74b2fa4826a506dc7b919465be', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:11:52.925714 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0def1db9-0f13-4a24-9a03-1bcf1138a4b8 admin admin] REQUEST_METHOD: `GET` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:11:52.926000 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0def1db9-0f13-4a24-9a03-1bcf1138a4b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:11:52.926285 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0def1db9-0f13-4a24-9a03-1bcf1138a4b8 admin admin] PATH_INFO: `/v3/domains` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:11:52.927002 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0def1db9-0f13-4a24-9a03-1bcf1138a4b8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=101892) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 15:11:52.927312 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0def1db9-0f13-4a24-9a03-1bcf1138a4b8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:11:52.928948 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0def1db9-0f13-4a24-9a03-1bcf1138a4b8 admin admin] RBAC: Authorization granted {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:11:52.940255 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 1195/2415] 10.222.0.84 () {58 vars in 1152 bytes} [Wed May 25 15:11:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 15:11:52.944944 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f73ec3-45cb-4602-bc29-84c0f85f3fe7 None None] Authenticating user token {{(pid=101893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:11:52.954218 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f73ec3-45cb-4602-bc29-84c0f85f3fe7 None None] Validating token access rules against request {{(pid=101893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:11:52.958875 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a39b16-67fd-46fd-873a-a954bc163b7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cec56f74b2fa4826a506dc7b919465be', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:11:52.959526 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a39b16-67fd-46fd-873a-a954bc163b7b admin admin] REQUEST_METHOD: `POST` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:11:52.959862 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a39b16-67fd-46fd-873a-a954bc163b7b admin admin] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:11:52.960141 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a39b16-67fd-46fd-873a-a954bc163b7b admin admin] PATH_INFO: `/v3/projects` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:11:52.960852 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4a39b16-67fd-46fd-873a-a954bc163b7b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:11:52.962757 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4a39b16-67fd-46fd-873a-a954bc163b7b admin admin] RBAC: Authorization granted {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:11:52.966542 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG dbcounter [-] [101893] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=101893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:11:53.059727 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 1221/2416] 10.222.0.84 () {60 vars in 1152 bytes} [Wed May 25 15:11:52 2022] POST /identity/v3/projects => generated 403 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 15:11:53.063954 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0def1db9-0f13-4a24-9a03-1bcf1138a4b8 admin admin] Authenticating user token {{(pid=101892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:11:53.074057 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0def1db9-0f13-4a24-9a03-1bcf1138a4b8 admin admin] Validating token access rules against request {{(pid=101892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:11:53.133347 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95f8d379-65b6-4af1-85f3-eae448df1c6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cec56f74b2fa4826a506dc7b919465be', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:11:53.134014 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f8d379-65b6-4af1-85f3-eae448df1c6e admin admin] REQUEST_METHOD: `POST` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:11:53.134296 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f8d379-65b6-4af1-85f3-eae448df1c6e admin admin] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:11:53.134570 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f8d379-65b6-4af1-85f3-eae448df1c6e admin admin] PATH_INFO: `/v3/users` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:11:53.135271 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95f8d379-65b6-4af1-85f3-eae448df1c6e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:11:53.137202 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95f8d379-65b6-4af1-85f3-eae448df1c6e admin admin] RBAC: Authorization granted {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:11:53.241325 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 1196/2417] 10.222.0.84 () {60 vars in 1143 bytes} [Wed May 25 15:11:53 2022] POST /identity/v3/users => generated 302 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 15:11:53.245692 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a39b16-67fd-46fd-873a-a954bc163b7b admin admin] Authenticating user token {{(pid=101893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:11:53.256227 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a39b16-67fd-46fd-873a-a954bc163b7b admin admin] Validating token access rules against request {{(pid=101893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:11:53.260938 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b3ddaec-3982-4177-af30-3fce4ad61b17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cec56f74b2fa4826a506dc7b919465be', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:11:53.261598 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b3ddaec-3982-4177-af30-3fce4ad61b17 admin admin] REQUEST_METHOD: `GET` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:11:53.261889 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b3ddaec-3982-4177-af30-3fce4ad61b17 admin admin] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:11:53.262169 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b3ddaec-3982-4177-af30-3fce4ad61b17 admin admin] PATH_INFO: `/v3/roles` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:11:53.263470 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b3ddaec-3982-4177-af30-3fce4ad61b17 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:11:53.265103 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b3ddaec-3982-4177-af30-3fce4ad61b17 admin admin] RBAC: Authorization granted {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:11:53.275523 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 1222/2418] 10.222.0.84 () {58 vars in 1121 bytes} [Wed May 25 15:11:53 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 25 15:11:53.280139 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95f8d379-65b6-4af1-85f3-eae448df1c6e admin admin] Authenticating user token {{(pid=101892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:11:53.290010 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95f8d379-65b6-4af1-85f3-eae448df1c6e admin admin] Validating token access rules against request {{(pid=101892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:11:53.294549 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb28a77-fc8a-41af-ba01-1284271fed92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cec56f74b2fa4826a506dc7b919465be', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:11:53.295191 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb28a77-fc8a-41af-ba01-1284271fed92 admin admin] REQUEST_METHOD: `GET` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:11:53.295511 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb28a77-fc8a-41af-ba01-1284271fed92 admin admin] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:11:53.295825 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb28a77-fc8a-41af-ba01-1284271fed92 admin admin] PATH_INFO: `/v3/roles` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:11:53.296543 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eb28a77-fc8a-41af-ba01-1284271fed92 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:11:53.298251 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eb28a77-fc8a-41af-ba01-1284271fed92 admin admin] RBAC: Authorization granted {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:11:53.308316 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 1197/2419] 10.222.0.84 () {58 vars in 1121 bytes} [Wed May 25 15:11:53 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 15:11:53.312305 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b3ddaec-3982-4177-af30-3fce4ad61b17 admin admin] Authenticating user token {{(pid=101893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:11:53.322372 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b3ddaec-3982-4177-af30-3fce4ad61b17 admin admin] Validating token access rules against request {{(pid=101893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:11:53.327531 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e13a5f1f-7fcc-4d48-ad28-be920522d62c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cec56f74b2fa4826a506dc7b919465be', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:11:53.328419 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13a5f1f-7fcc-4d48-ad28-be920522d62c admin admin] REQUEST_METHOD: `PUT` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:11:53.328699 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13a5f1f-7fcc-4d48-ad28-be920522d62c admin admin] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:11:53.328971 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13a5f1f-7fcc-4d48-ad28-be920522d62c admin admin] PATH_INFO: `/v3/projects/5ee7809e754c4cb7af0dc14dbe6795fd/users/ea01fb7770dc47709fee1d6286141ecb/roles/ff664fa0db7e4262a5accde96c3df4c3` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:11:53.343681 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e13a5f1f-7fcc-4d48-ad28-be920522d62c admin admin] RBAC: Authorizing `identity:create_grant(project_id=5ee7809e754c4cb7af0dc14dbe6795fd, user_id=ea01fb7770dc47709fee1d6286141ecb, role_id=ff664fa0db7e4262a5accde96c3df4c3)` {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:11:53.346327 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e13a5f1f-7fcc-4d48-ad28-be920522d62c admin admin] RBAC: Authorization granted {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:11:53.448046 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 1223/2420] 10.222.0.84 () {60 vars in 1482 bytes} [Wed May 25 15:11:53 2022] PUT /identity/v3/projects/5ee7809e754c4cb7af0dc14dbe6795fd/users/ea01fb7770dc47709fee1d6286141ecb/roles/ff664fa0db7e4262a5accde96c3df4c3 => generated 0 bytes in 136 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 15:11:53.453636 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca260f4-1fbc-4c7f-81a5-c943bd1d8b2e None None] REQUEST_METHOD: `POST` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:11:53.453931 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca260f4-1fbc-4c7f-81a5-c943bd1d8b2e None None] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:11:53.454213 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca260f4-1fbc-4c7f-81a5-c943bd1d8b2e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:11:53.472418 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.auth.core [None req-8ca260f4-1fbc-4c7f-81a5-c943bd1d8b2e None None] MFA Rules not processed for user `05d87e87798e429aa1c10b24391f915e`. Rule list: `[]` (Enabled: `True`). {{(pid=101892) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:11:53.473618 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.fernet_utils [None req-8ca260f4-1fbc-4c7f-81a5-c943bd1d8b2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=101892) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:11:53.531799 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 1198/2421] 10.222.0.84 () {58 vars in 957 bytes} [Wed May 25 15:11:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 15:11:53.541621 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e13a5f1f-7fcc-4d48-ad28-be920522d62c admin admin] Authenticating user token {{(pid=101893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:11:53.543360 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.fernet_utils [None req-e13a5f1f-7fcc-4d48-ad28-be920522d62c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=101893) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:11:53.602295 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e13a5f1f-7fcc-4d48-ad28-be920522d62c admin admin] Validating token access rules against request {{(pid=101893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:11:53.606476 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-721853c0-6c09-46b1-9bb1-e69a41aa6e41 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ce28b25b907473588ccb87dc4acc06a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a000829c658c4a7cab67f7b6353ba3fa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:11:53.607129 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721853c0-6c09-46b1-9bb1-e69a41aa6e41 service neutron] REQUEST_METHOD: `GET` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:11:53.607410 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721853c0-6c09-46b1-9bb1-e69a41aa6e41 service neutron] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:11:53.607770 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721853c0-6c09-46b1-9bb1-e69a41aa6e41 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:11:53.616681 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-721853c0-6c09-46b1-9bb1-e69a41aa6e41 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:11:53.618106 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-721853c0-6c09-46b1-9bb1-e69a41aa6e41 service neutron] RBAC: Authorization granted {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:11:53.627984 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 1224/2422] 10.222.0.84 () {60 vars in 1365 bytes} [Wed May 25 15:11:53 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 15:11:54.866966 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a558af-0824-4afb-837b-f33f728f7ce0 None None] REQUEST_METHOD: `POST` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:11:54.868012 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a558af-0824-4afb-837b-f33f728f7ce0 None None] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:11:54.868295 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a558af-0824-4afb-837b-f33f728f7ce0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:11:54.902049 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.auth.core [None req-c1a558af-0824-4afb-837b-f33f728f7ce0 None None] MFA Rules not processed for user `ea01fb7770dc47709fee1d6286141ecb`. Rule list: `[]` (Enabled: `True`). {{(pid=101892) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:11:54.903278 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.fernet_utils [None req-c1a558af-0824-4afb-837b-f33f728f7ce0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=101892) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:11:54.955743 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG dbcounter [-] [101892] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=101892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:11:54.980603 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 1199/2423] 10.222.0.84 () {58 vars in 957 bytes} [Wed May 25 15:11:54 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 15:11:54.985743 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-721853c0-6c09-46b1-9bb1-e69a41aa6e41 service neutron] Authenticating user token {{(pid=101893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:11:54.998008 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-721853c0-6c09-46b1-9bb1-e69a41aa6e41 service neutron] Validating token access rules against request {{(pid=101893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:11:55.002811 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df1c7e32-ec2a-47cc-b21f-95729ad94090 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cec56f74b2fa4826a506dc7b919465be', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:11:55.003415 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1c7e32-ec2a-47cc-b21f-95729ad94090 admin admin] REQUEST_METHOD: `POST` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:11:55.003764 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1c7e32-ec2a-47cc-b21f-95729ad94090 admin admin] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:11:55.004014 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1c7e32-ec2a-47cc-b21f-95729ad94090 admin admin] PATH_INFO: `/v3/projects` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:11:55.004717 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df1c7e32-ec2a-47cc-b21f-95729ad94090 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:11:55.006635 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df1c7e32-ec2a-47cc-b21f-95729ad94090 admin admin] RBAC: Authorization granted {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:11:55.079659 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 1225/2424] 10.222.0.84 () {60 vars in 1152 bytes} [Wed May 25 15:11:54 2022] POST /identity/v3/projects => generated 403 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 15:11:55.083856 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1a558af-0824-4afb-837b-f33f728f7ce0 None None] Authenticating user token {{(pid=101892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:11:55.094400 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1a558af-0824-4afb-837b-f33f728f7ce0 None None] Validating token access rules against request {{(pid=101892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:11:55.149980 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcc45616-aeab-49ef-9cbe-9931ad94adcd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cec56f74b2fa4826a506dc7b919465be', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:11:55.150637 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc45616-aeab-49ef-9cbe-9931ad94adcd admin admin] REQUEST_METHOD: `POST` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:11:55.150918 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc45616-aeab-49ef-9cbe-9931ad94adcd admin admin] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:11:55.151193 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc45616-aeab-49ef-9cbe-9931ad94adcd admin admin] PATH_INFO: `/v3/users` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:11:55.151907 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcc45616-aeab-49ef-9cbe-9931ad94adcd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:11:55.154480 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcc45616-aeab-49ef-9cbe-9931ad94adcd admin admin] RBAC: Authorization granted {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:11:55.270171 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 1200/2425] 10.222.0.84 () {60 vars in 1143 bytes} [Wed May 25 15:11:55 2022] POST /identity/v3/users => generated 308 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 15:11:55.273950 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df1c7e32-ec2a-47cc-b21f-95729ad94090 admin admin] Authenticating user token {{(pid=101893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:11:55.284872 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df1c7e32-ec2a-47cc-b21f-95729ad94090 admin admin] Validating token access rules against request {{(pid=101893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:11:55.289442 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f18bec-8433-441e-8138-c8e6410de1ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cec56f74b2fa4826a506dc7b919465be', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:11:55.290102 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f18bec-8433-441e-8138-c8e6410de1ff admin admin] REQUEST_METHOD: `GET` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:11:55.290389 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f18bec-8433-441e-8138-c8e6410de1ff admin admin] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:11:55.290668 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f18bec-8433-441e-8138-c8e6410de1ff admin admin] PATH_INFO: `/v3/roles` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:11:55.291477 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89f18bec-8433-441e-8138-c8e6410de1ff admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:11:55.293118 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89f18bec-8433-441e-8138-c8e6410de1ff admin admin] RBAC: Authorization granted {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:11:55.304546 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 1226/2426] 10.222.0.84 () {58 vars in 1121 bytes} [Wed May 25 15:11:55 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 15:11:55.308770 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcc45616-aeab-49ef-9cbe-9931ad94adcd admin admin] Authenticating user token {{(pid=101892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:11:55.318913 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcc45616-aeab-49ef-9cbe-9931ad94adcd admin admin] Validating token access rules against request {{(pid=101892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:11:55.323485 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70b73e7c-3d9d-4ab1-8d04-13d52f709b4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cec56f74b2fa4826a506dc7b919465be', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:11:55.324388 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b73e7c-3d9d-4ab1-8d04-13d52f709b4e admin admin] REQUEST_METHOD: `PUT` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:11:55.324672 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b73e7c-3d9d-4ab1-8d04-13d52f709b4e admin admin] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:11:55.324949 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b73e7c-3d9d-4ab1-8d04-13d52f709b4e admin admin] PATH_INFO: `/v3/projects/a3ae78de448f4c41ba64b4dc586e5cb2/users/08141b7d59794279a338a1ef38de5362/roles/a3b78e7d547d4d2d998b4c99a4396bba` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:11:55.339426 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70b73e7c-3d9d-4ab1-8d04-13d52f709b4e admin admin] RBAC: Authorizing `identity:create_grant(project_id=a3ae78de448f4c41ba64b4dc586e5cb2, user_id=08141b7d59794279a338a1ef38de5362, role_id=a3b78e7d547d4d2d998b4c99a4396bba)` {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:11:55.342612 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70b73e7c-3d9d-4ab1-8d04-13d52f709b4e admin admin] RBAC: Authorization granted {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:11:55.407442 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 1201/2427] 10.222.0.84 () {60 vars in 1482 bytes} [Wed May 25 15:11:55 2022] PUT /identity/v3/projects/a3ae78de448f4c41ba64b4dc586e5cb2/users/08141b7d59794279a338a1ef38de5362/roles/a3b78e7d547d4d2d998b4c99a4396bba => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 15:11:55.411435 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f18bec-8433-441e-8138-c8e6410de1ff admin admin] Authenticating user token {{(pid=101893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:11:55.422578 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f18bec-8433-441e-8138-c8e6410de1ff admin admin] Validating token access rules against request {{(pid=101893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:11:55.483072 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31e2b612-306a-41c0-b4c2-6085c64dea74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cec56f74b2fa4826a506dc7b919465be', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:11:55.483783 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e2b612-306a-41c0-b4c2-6085c64dea74 admin admin] REQUEST_METHOD: `GET` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:11:55.484069 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e2b612-306a-41c0-b4c2-6085c64dea74 admin admin] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:11:55.484344 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e2b612-306a-41c0-b4c2-6085c64dea74 admin admin] PATH_INFO: `/v3/roles` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:11:55.485068 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31e2b612-306a-41c0-b4c2-6085c64dea74 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:11:55.486711 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31e2b612-306a-41c0-b4c2-6085c64dea74 admin admin] RBAC: Authorization granted {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:11:55.496816 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 1227/2428] 10.222.0.84 () {58 vars in 1121 bytes} [Wed May 25 15:11:55 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 15:11:55.501425 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70b73e7c-3d9d-4ab1-8d04-13d52f709b4e admin admin] Authenticating user token {{(pid=101892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:11:55.511954 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70b73e7c-3d9d-4ab1-8d04-13d52f709b4e admin admin] Validating token access rules against request {{(pid=101892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:11:55.517635 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f6745a2-d1ca-47d4-abcb-dc0b051f378c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cec56f74b2fa4826a506dc7b919465be', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:11:55.518613 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6745a2-d1ca-47d4-abcb-dc0b051f378c admin admin] REQUEST_METHOD: `PUT` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:11:55.518895 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6745a2-d1ca-47d4-abcb-dc0b051f378c admin admin] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:11:55.519171 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6745a2-d1ca-47d4-abcb-dc0b051f378c admin admin] PATH_INFO: `/v3/projects/a3ae78de448f4c41ba64b4dc586e5cb2/users/08141b7d59794279a338a1ef38de5362/roles/a3b78e7d547d4d2d998b4c99a4396bba` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:11:55.521309 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f6745a2-d1ca-47d4-abcb-dc0b051f378c admin admin] RBAC: Authorizing `identity:create_grant(project_id=a3ae78de448f4c41ba64b4dc586e5cb2, user_id=08141b7d59794279a338a1ef38de5362, role_id=a3b78e7d547d4d2d998b4c99a4396bba)` {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:11:55.523952 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f6745a2-d1ca-47d4-abcb-dc0b051f378c admin admin] RBAC: Authorization granted {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:11:55.534983 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 1202/2429] 10.222.0.84 () {60 vars in 1482 bytes} [Wed May 25 15:11:55 2022] PUT /identity/v3/projects/a3ae78de448f4c41ba64b4dc586e5cb2/users/08141b7d59794279a338a1ef38de5362/roles/a3b78e7d547d4d2d998b4c99a4396bba => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 15:11:56.833396 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-258dc116-133c-42f3-8fae-241d86f3fcd1 None None] REQUEST_METHOD: `POST` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:11:56.833946 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-258dc116-133c-42f3-8fae-241d86f3fcd1 None None] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:11:56.833946 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-258dc116-133c-42f3-8fae-241d86f3fcd1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:11:56.862535 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.auth.core [None req-258dc116-133c-42f3-8fae-241d86f3fcd1 None None] MFA Rules not processed for user `08141b7d59794279a338a1ef38de5362`. Rule list: `[]` (Enabled: `True`). {{(pid=101893) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:11:56.863883 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.fernet_utils [None req-258dc116-133c-42f3-8fae-241d86f3fcd1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=101893) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:11:56.867966 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG dbcounter [-] [101893] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=101893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:11:56.942692 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 1228/2430] 10.222.0.84 () {58 vars in 957 bytes} [Wed May 25 15:11:56 2022] POST /identity/v3/auth/tokens => generated 3337 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 15:11:59.080159 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f6745a2-d1ca-47d4-abcb-dc0b051f378c admin admin] Authenticating user token {{(pid=101892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:11:59.139807 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f6745a2-d1ca-47d4-abcb-dc0b051f378c admin admin] Validating token access rules against request {{(pid=101892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:11:59.144336 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eb62886-ac80-4049-bd5b-89c57d5ac4b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cec56f74b2fa4826a506dc7b919465be', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:11:59.145221 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb62886-ac80-4049-bd5b-89c57d5ac4b7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:11:59.145487 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb62886-ac80-4049-bd5b-89c57d5ac4b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:11:59.145763 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb62886-ac80-4049-bd5b-89c57d5ac4b7 admin admin] PATH_INFO: `/v3/users/ea01fb7770dc47709fee1d6286141ecb` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:11:59.146932 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eb62886-ac80-4049-bd5b-89c57d5ac4b7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ea01fb7770dc47709fee1d6286141ecb)` {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:11:59.148886 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eb62886-ac80-4049-bd5b-89c57d5ac4b7 admin admin] RBAC: Authorization granted {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:11:59.317713 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG dbcounter [-] [101892] Writing DB stats keystone:SELECT=90,keystone:INSERT=5,keystone:DELETE=5 {{(pid=101892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:11:59.326027 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.notifications [None req-2eb62886-ac80-4049-bd5b-89c57d5ac4b7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ea01fb7770dc47709fee1d6286141ecb'} {{(pid=101892) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:11:59.332945 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.notifications [None req-2eb62886-ac80-4049-bd5b-89c57d5ac4b7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ea01fb7770dc47709fee1d6286141ecb'} {{(pid=101892) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:11:59.345086 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.notifications [None req-2eb62886-ac80-4049-bd5b-89c57d5ac4b7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ea01fb7770dc47709fee1d6286141ecb'} {{(pid=101892) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:11:59.345763 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.notifications [None req-2eb62886-ac80-4049-bd5b-89c57d5ac4b7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ea01fb7770dc47709fee1d6286141ecb'} {{(pid=101892) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:11:59.417740 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.notifications [None req-2eb62886-ac80-4049-bd5b-89c57d5ac4b7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ea01fb7770dc47709fee1d6286141ecb'} {{(pid=101892) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:11:59.423859 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 1203/2431] 10.222.0.84 () {58 vars in 1223 bytes} [Wed May 25 15:11:59 2022] DELETE /identity/v3/users/ea01fb7770dc47709fee1d6286141ecb => generated 0 bytes in 348 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 15:11:59.706185 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-258dc116-133c-42f3-8fae-241d86f3fcd1 None None] Authenticating user token {{(pid=101893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:11:59.717705 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-258dc116-133c-42f3-8fae-241d86f3fcd1 None None] Validating token access rules against request {{(pid=101893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:11:59.780087 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f7efbfb-9600-4324-9d03-cb239c6f206b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cec56f74b2fa4826a506dc7b919465be', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:11:59.781092 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7efbfb-9600-4324-9d03-cb239c6f206b admin admin] REQUEST_METHOD: `DELETE` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:11:59.781378 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7efbfb-9600-4324-9d03-cb239c6f206b admin admin] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:11:59.781655 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7efbfb-9600-4324-9d03-cb239c6f206b admin admin] PATH_INFO: `/v3/projects/5ee7809e754c4cb7af0dc14dbe6795fd` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:11:59.783026 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f7efbfb-9600-4324-9d03-cb239c6f206b admin admin] RBAC: Authorizing `identity:delete_project(project_id=5ee7809e754c4cb7af0dc14dbe6795fd)` {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:11:59.784998 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f7efbfb-9600-4324-9d03-cb239c6f206b admin admin] RBAC: Authorization granted {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:11:59.893983 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.notifications [None req-0f7efbfb-9600-4324-9d03-cb239c6f206b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5ee7809e754c4cb7af0dc14dbe6795fd', 'request_id': 'req-0f7efbfb-9600-4324-9d03-cb239c6f206b'} {{(pid=101893) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:11:59.900447 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.notifications [None req-0f7efbfb-9600-4324-9d03-cb239c6f206b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5ee7809e754c4cb7af0dc14dbe6795fd', 'request_id': 'req-0f7efbfb-9600-4324-9d03-cb239c6f206b'} {{(pid=101893) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:11:59.906100 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.notifications [None req-0f7efbfb-9600-4324-9d03-cb239c6f206b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5ee7809e754c4cb7af0dc14dbe6795fd', 'request_id': 'req-0f7efbfb-9600-4324-9d03-cb239c6f206b'} {{(pid=101893) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:11:59.980112 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.notifications [None req-0f7efbfb-9600-4324-9d03-cb239c6f206b admin admin] The token cache is being invalidate because project 5ee7809e754c4cb7af0dc14dbe6795fd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=101893) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 25 15:11:59.980335 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.notifications [None req-0f7efbfb-9600-4324-9d03-cb239c6f206b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=101893) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:11:59.981078 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.notifications [None req-0f7efbfb-9600-4324-9d03-cb239c6f206b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=101893) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:11:59.982654 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 1229/2432] 10.222.0.84 () {58 vars in 1232 bytes} [Wed May 25 15:11:59 2022] DELETE /identity/v3/projects/5ee7809e754c4cb7af0dc14dbe6795fd => generated 0 bytes in 277 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 15:11:59.986802 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eb62886-ac80-4049-bd5b-89c57d5ac4b7 admin admin] Authenticating user token {{(pid=101892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:11:59.988231 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.fernet_utils [None req-2eb62886-ac80-4049-bd5b-89c57d5ac4b7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=101892) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:12:00.001523 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eb62886-ac80-4049-bd5b-89c57d5ac4b7 admin admin] Validating token access rules against request {{(pid=101892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:12:00.057554 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a20253-7108-45bd-b77e-f4c03c7d0326 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cec56f74b2fa4826a506dc7b919465be', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:12:00.058521 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a20253-7108-45bd-b77e-f4c03c7d0326 admin admin] REQUEST_METHOD: `DELETE` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:12:00.058929 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a20253-7108-45bd-b77e-f4c03c7d0326 admin admin] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:12:00.059828 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a20253-7108-45bd-b77e-f4c03c7d0326 admin admin] PATH_INFO: `/v3/users/08141b7d59794279a338a1ef38de5362` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:12:00.061029 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86a20253-7108-45bd-b77e-f4c03c7d0326 admin admin] RBAC: Authorizing `identity:delete_user(user_id=08141b7d59794279a338a1ef38de5362)` {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:12:00.063126 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86a20253-7108-45bd-b77e-f4c03c7d0326 admin admin] RBAC: Authorization granted {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:12:00.223019 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.notifications [None req-86a20253-7108-45bd-b77e-f4c03c7d0326 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '08141b7d59794279a338a1ef38de5362'} {{(pid=101892) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:12:00.230085 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.notifications [None req-86a20253-7108-45bd-b77e-f4c03c7d0326 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '08141b7d59794279a338a1ef38de5362'} {{(pid=101892) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:12:00.242967 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.notifications [None req-86a20253-7108-45bd-b77e-f4c03c7d0326 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '08141b7d59794279a338a1ef38de5362'} {{(pid=101892) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:12:00.243622 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.notifications [None req-86a20253-7108-45bd-b77e-f4c03c7d0326 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '08141b7d59794279a338a1ef38de5362'} {{(pid=101892) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:12:00.304127 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.notifications [None req-86a20253-7108-45bd-b77e-f4c03c7d0326 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '08141b7d59794279a338a1ef38de5362'} {{(pid=101892) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:12:00.311381 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 1204/2433] 10.222.0.84 () {58 vars in 1223 bytes} [Wed May 25 15:11:59 2022] DELETE /identity/v3/users/08141b7d59794279a338a1ef38de5362 => generated 0 bytes in 325 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 15:12:00.568823 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f7efbfb-9600-4324-9d03-cb239c6f206b admin admin] Authenticating user token {{(pid=101893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:12:00.570421 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.fernet_utils [None req-0f7efbfb-9600-4324-9d03-cb239c6f206b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=101893) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:12:00.585458 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f7efbfb-9600-4324-9d03-cb239c6f206b admin admin] Validating token access rules against request {{(pid=101893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:12:00.616019 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG dbcounter [-] [101893] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=101893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:12:00.642909 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e69755a-695c-4247-a490-2bbb88960c0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cec56f74b2fa4826a506dc7b919465be', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:12:00.643802 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e69755a-695c-4247-a490-2bbb88960c0d admin admin] REQUEST_METHOD: `DELETE` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:12:00.644090 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e69755a-695c-4247-a490-2bbb88960c0d admin admin] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:12:00.644368 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e69755a-695c-4247-a490-2bbb88960c0d admin admin] PATH_INFO: `/v3/projects/a3ae78de448f4c41ba64b4dc586e5cb2` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:12:00.645549 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e69755a-695c-4247-a490-2bbb88960c0d admin admin] RBAC: Authorizing `identity:delete_project(project_id=a3ae78de448f4c41ba64b4dc586e5cb2)` {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:12:00.647481 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e69755a-695c-4247-a490-2bbb88960c0d admin admin] RBAC: Authorization granted {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:12:00.755431 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.notifications [None req-5e69755a-695c-4247-a490-2bbb88960c0d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a3ae78de448f4c41ba64b4dc586e5cb2', 'request_id': 'req-5e69755a-695c-4247-a490-2bbb88960c0d'} {{(pid=101893) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:12:00.761096 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.notifications [None req-5e69755a-695c-4247-a490-2bbb88960c0d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a3ae78de448f4c41ba64b4dc586e5cb2', 'request_id': 'req-5e69755a-695c-4247-a490-2bbb88960c0d'} {{(pid=101893) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:12:00.767545 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.notifications [None req-5e69755a-695c-4247-a490-2bbb88960c0d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a3ae78de448f4c41ba64b4dc586e5cb2', 'request_id': 'req-5e69755a-695c-4247-a490-2bbb88960c0d'} {{(pid=101893) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:12:00.863882 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.notifications [None req-5e69755a-695c-4247-a490-2bbb88960c0d admin admin] The token cache is being invalidate because project a3ae78de448f4c41ba64b4dc586e5cb2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=101893) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 25 15:12:00.864262 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.notifications [None req-5e69755a-695c-4247-a490-2bbb88960c0d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=101893) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:12:00.864973 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.notifications [None req-5e69755a-695c-4247-a490-2bbb88960c0d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=101893) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:12:00.866922 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 1230/2434] 10.222.0.84 () {58 vars in 1232 bytes} [Wed May 25 15:12:00 2022] DELETE /identity/v3/projects/a3ae78de448f4c41ba64b4dc586e5cb2 => generated 0 bytes in 298 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 15:12:00.871753 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a90d6c11-13ad-46ff-b4b2-d6ee8ef2ba5c None None] REQUEST_METHOD: `POST` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:12:00.872059 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a90d6c11-13ad-46ff-b4b2-d6ee8ef2ba5c None None] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:12:00.872341 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a90d6c11-13ad-46ff-b4b2-d6ee8ef2ba5c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:12:00.898480 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.auth.core [None req-a90d6c11-13ad-46ff-b4b2-d6ee8ef2ba5c None None] MFA Rules not processed for user `05d87e87798e429aa1c10b24391f915e`. Rule list: `[]` (Enabled: `True`). {{(pid=101892) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:12:00.898480 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.fernet_utils [None req-a90d6c11-13ad-46ff-b4b2-d6ee8ef2ba5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=101892) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:12:00.929278 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG dbcounter [-] [101892] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=101892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:12:00.971511 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 1205/2435] 10.222.0.84 () {58 vars in 957 bytes} [Wed May 25 15:12:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 15:12:00.979546 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e50cf23-aa3b-4ef5-a8a1-73765b0636b7 None None] REQUEST_METHOD: `POST` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:12:00.991190 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e50cf23-aa3b-4ef5-a8a1-73765b0636b7 None None] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:12:00.991190 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e50cf23-aa3b-4ef5-a8a1-73765b0636b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:12:01.001383 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.auth.core [None req-8e50cf23-aa3b-4ef5-a8a1-73765b0636b7 None None] MFA Rules not processed for user `05d87e87798e429aa1c10b24391f915e`. Rule list: `[]` (Enabled: `True`). {{(pid=101893) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:12:01.002606 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.fernet_utils [None req-8e50cf23-aa3b-4ef5-a8a1-73765b0636b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=101893) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:12:01.015464 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 1231/2436] 10.222.0.84 () {58 vars in 957 bytes} [Wed May 25 15:12:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 25 15:12:01.016652 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a90d6c11-13ad-46ff-b4b2-d6ee8ef2ba5c None None] Authenticating user token {{(pid=101892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:12:01.026784 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a90d6c11-13ad-46ff-b4b2-d6ee8ef2ba5c None None] Validating token access rules against request {{(pid=101892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:12:01.033706 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83829e4c-d1b7-4b96-930c-8e2a727bd23e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cec56f74b2fa4826a506dc7b919465be', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:12:01.034448 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83829e4c-d1b7-4b96-930c-8e2a727bd23e admin admin] REQUEST_METHOD: `GET` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:12:01.034747 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83829e4c-d1b7-4b96-930c-8e2a727bd23e admin admin] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:12:01.035027 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83829e4c-d1b7-4b96-930c-8e2a727bd23e admin admin] PATH_INFO: `/v3/domains` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:12:01.035787 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83829e4c-d1b7-4b96-930c-8e2a727bd23e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=101892) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 15:12:01.038676 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83829e4c-d1b7-4b96-930c-8e2a727bd23e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:12:01.038676 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83829e4c-d1b7-4b96-930c-8e2a727bd23e admin admin] RBAC: Authorization granted {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:12:01.050352 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 1206/2437] 10.222.0.84 () {58 vars in 1152 bytes} [Wed May 25 15:12:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 15:12:01.054321 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e50cf23-aa3b-4ef5-a8a1-73765b0636b7 None None] Authenticating user token {{(pid=101893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:12:01.064788 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e50cf23-aa3b-4ef5-a8a1-73765b0636b7 None None] Validating token access rules against request {{(pid=101893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:12:01.069832 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c82b8060-6e01-4f4e-a66f-81f847973c3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cec56f74b2fa4826a506dc7b919465be', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:12:01.070488 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c82b8060-6e01-4f4e-a66f-81f847973c3f admin admin] REQUEST_METHOD: `POST` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:12:01.070770 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c82b8060-6e01-4f4e-a66f-81f847973c3f admin admin] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:12:01.071046 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c82b8060-6e01-4f4e-a66f-81f847973c3f admin admin] PATH_INFO: `/v3/projects` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:12:01.071768 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c82b8060-6e01-4f4e-a66f-81f847973c3f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:12:01.073669 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c82b8060-6e01-4f4e-a66f-81f847973c3f admin admin] RBAC: Authorization granted {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:12:01.153636 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 1232/2438] 10.222.0.84 () {60 vars in 1152 bytes} [Wed May 25 15:12:01 2022] POST /identity/v3/projects => generated 369 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 25 15:12:01.157455 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83829e4c-d1b7-4b96-930c-8e2a727bd23e admin admin] Authenticating user token {{(pid=101892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:12:01.167499 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83829e4c-d1b7-4b96-930c-8e2a727bd23e admin admin] Validating token access rules against request {{(pid=101892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:12:01.222847 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2375db3-6a06-438e-8b51-1473b5477a13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cec56f74b2fa4826a506dc7b919465be', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:12:01.223503 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2375db3-6a06-438e-8b51-1473b5477a13 admin admin] REQUEST_METHOD: `POST` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:12:01.224117 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2375db3-6a06-438e-8b51-1473b5477a13 admin admin] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:12:01.224117 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2375db3-6a06-438e-8b51-1473b5477a13 admin admin] PATH_INFO: `/v3/users` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:12:01.224732 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2375db3-6a06-438e-8b51-1473b5477a13 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:12:01.226632 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2375db3-6a06-438e-8b51-1473b5477a13 admin admin] RBAC: Authorization granted {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:12:01.312596 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 1207/2439] 10.222.0.84 () {60 vars in 1143 bytes} [Wed May 25 15:12:01 2022] POST /identity/v3/users => generated 285 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 15:12:01.316672 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c82b8060-6e01-4f4e-a66f-81f847973c3f admin admin] Authenticating user token {{(pid=101893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:12:01.327949 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c82b8060-6e01-4f4e-a66f-81f847973c3f admin admin] Validating token access rules against request {{(pid=101893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:12:01.332648 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c66b9534-39aa-451d-b50a-6bd69668af50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cec56f74b2fa4826a506dc7b919465be', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:12:01.333306 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66b9534-39aa-451d-b50a-6bd69668af50 admin admin] REQUEST_METHOD: `GET` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:12:01.333594 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66b9534-39aa-451d-b50a-6bd69668af50 admin admin] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:12:01.333873 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66b9534-39aa-451d-b50a-6bd69668af50 admin admin] PATH_INFO: `/v3/roles` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:12:01.334596 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c66b9534-39aa-451d-b50a-6bd69668af50 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:12:01.336250 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c66b9534-39aa-451d-b50a-6bd69668af50 admin admin] RBAC: Authorization granted {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:12:01.346594 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 1233/2440] 10.222.0.84 () {58 vars in 1121 bytes} [Wed May 25 15:12:01 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 25 15:12:01.350445 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2375db3-6a06-438e-8b51-1473b5477a13 admin admin] Authenticating user token {{(pid=101892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:12:01.360345 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2375db3-6a06-438e-8b51-1473b5477a13 admin admin] Validating token access rules against request {{(pid=101892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:12:01.364955 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88afc9ea-4fc4-45fa-a851-c741e4259740 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cec56f74b2fa4826a506dc7b919465be', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:12:01.365638 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88afc9ea-4fc4-45fa-a851-c741e4259740 admin admin] REQUEST_METHOD: `GET` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:12:01.365927 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88afc9ea-4fc4-45fa-a851-c741e4259740 admin admin] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:12:01.366209 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88afc9ea-4fc4-45fa-a851-c741e4259740 admin admin] PATH_INFO: `/v3/roles` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:12:01.366932 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88afc9ea-4fc4-45fa-a851-c741e4259740 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:12:01.368557 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88afc9ea-4fc4-45fa-a851-c741e4259740 admin admin] RBAC: Authorization granted {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:12:01.378772 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 1208/2441] 10.222.0.84 () {58 vars in 1121 bytes} [Wed May 25 15:12:01 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 15:12:01.382802 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c66b9534-39aa-451d-b50a-6bd69668af50 admin admin] Authenticating user token {{(pid=101893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:12:01.393321 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c66b9534-39aa-451d-b50a-6bd69668af50 admin admin] Validating token access rules against request {{(pid=101893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:12:01.398072 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-117cdfde-ba77-4b35-baed-4cedc3e8463d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cec56f74b2fa4826a506dc7b919465be', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:12:01.398947 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117cdfde-ba77-4b35-baed-4cedc3e8463d admin admin] REQUEST_METHOD: `PUT` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:12:01.399231 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117cdfde-ba77-4b35-baed-4cedc3e8463d admin admin] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:12:01.399508 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117cdfde-ba77-4b35-baed-4cedc3e8463d admin admin] PATH_INFO: `/v3/projects/3fccbaa43f23419da2fb7f2e82bda88a/users/3c75aab43d914ff991b679a10fcc4741/roles/ff664fa0db7e4262a5accde96c3df4c3` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:12:01.413925 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-117cdfde-ba77-4b35-baed-4cedc3e8463d admin admin] RBAC: Authorizing `identity:create_grant(project_id=3fccbaa43f23419da2fb7f2e82bda88a, user_id=3c75aab43d914ff991b679a10fcc4741, role_id=ff664fa0db7e4262a5accde96c3df4c3)` {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:12:01.416638 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-117cdfde-ba77-4b35-baed-4cedc3e8463d admin admin] RBAC: Authorization granted {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:12:01.509450 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 1234/2442] 10.222.0.84 () {60 vars in 1482 bytes} [Wed May 25 15:12:01 2022] PUT /identity/v3/projects/3fccbaa43f23419da2fb7f2e82bda88a/users/3c75aab43d914ff991b679a10fcc4741/roles/ff664fa0db7e4262a5accde96c3df4c3 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 15:12:01.521411 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ed6a93-fa54-4d55-976e-810ca37442c4 None None] REQUEST_METHOD: `POST` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:12:01.521713 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ed6a93-fa54-4d55-976e-810ca37442c4 None None] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:12:01.521997 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ed6a93-fa54-4d55-976e-810ca37442c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:12:01.549017 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.auth.core [None req-69ed6a93-fa54-4d55-976e-810ca37442c4 None None] MFA Rules not processed for user `3c75aab43d914ff991b679a10fcc4741`. Rule list: `[]` (Enabled: `True`). {{(pid=101892) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:12:01.550225 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.fernet_utils [None req-69ed6a93-fa54-4d55-976e-810ca37442c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=101892) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:12:01.614339 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 1209/2443] 10.222.0.84 () {58 vars in 957 bytes} [Wed May 25 15:12:01 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 15:12:01.618769 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-117cdfde-ba77-4b35-baed-4cedc3e8463d admin admin] Authenticating user token {{(pid=101893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:12:01.676119 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG dbcounter [-] [101893] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=101893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:12:01.680079 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-117cdfde-ba77-4b35-baed-4cedc3e8463d admin admin] Validating token access rules against request {{(pid=101893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:12:01.685530 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f0b48be-a64c-4e57-9587-0146f7c88146 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cec56f74b2fa4826a506dc7b919465be', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:12:01.686384 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0b48be-a64c-4e57-9587-0146f7c88146 admin admin] REQUEST_METHOD: `POST` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:12:01.686673 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0b48be-a64c-4e57-9587-0146f7c88146 admin admin] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:12:01.686952 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0b48be-a64c-4e57-9587-0146f7c88146 admin admin] PATH_INFO: `/v3/projects` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:12:01.687688 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f0b48be-a64c-4e57-9587-0146f7c88146 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:12:01.689658 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f0b48be-a64c-4e57-9587-0146f7c88146 admin admin] RBAC: Authorization granted {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:12:01.807967 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 1235/2444] 10.222.0.84 () {60 vars in 1152 bytes} [Wed May 25 15:12:01 2022] POST /identity/v3/projects => generated 373 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 25 15:12:01.812330 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69ed6a93-fa54-4d55-976e-810ca37442c4 None None] Authenticating user token {{(pid=101892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:12:01.823192 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69ed6a93-fa54-4d55-976e-810ca37442c4 None None] Validating token access rules against request {{(pid=101892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:12:01.848907 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG dbcounter [-] [101892] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=101892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:12:01.879719 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-259dbce4-5b3b-4d93-803f-cf10af3c9b51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cec56f74b2fa4826a506dc7b919465be', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:12:01.880327 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259dbce4-5b3b-4d93-803f-cf10af3c9b51 admin admin] REQUEST_METHOD: `POST` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:12:01.880614 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259dbce4-5b3b-4d93-803f-cf10af3c9b51 admin admin] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:12:01.880894 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259dbce4-5b3b-4d93-803f-cf10af3c9b51 admin admin] PATH_INFO: `/v3/users` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:12:01.881580 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-259dbce4-5b3b-4d93-803f-cf10af3c9b51 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:12:01.883541 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-259dbce4-5b3b-4d93-803f-cf10af3c9b51 admin admin] RBAC: Authorization granted {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:12:01.990092 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 1210/2445] 10.222.0.84 () {60 vars in 1143 bytes} [Wed May 25 15:12:01 2022] POST /identity/v3/users => generated 293 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 15:12:01.993929 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f0b48be-a64c-4e57-9587-0146f7c88146 admin admin] Authenticating user token {{(pid=101893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:12:02.008643 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f0b48be-a64c-4e57-9587-0146f7c88146 admin admin] Validating token access rules against request {{(pid=101893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:12:02.013337 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91eff37b-ff2b-4865-8f10-640f6da52839 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cec56f74b2fa4826a506dc7b919465be', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:12:02.014000 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91eff37b-ff2b-4865-8f10-640f6da52839 admin admin] REQUEST_METHOD: `GET` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:12:02.014283 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91eff37b-ff2b-4865-8f10-640f6da52839 admin admin] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:12:02.014557 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91eff37b-ff2b-4865-8f10-640f6da52839 admin admin] PATH_INFO: `/v3/roles` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:12:02.015280 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91eff37b-ff2b-4865-8f10-640f6da52839 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:12:02.017107 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91eff37b-ff2b-4865-8f10-640f6da52839 admin admin] RBAC: Authorization granted {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:12:02.028638 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 1236/2446] 10.222.0.84 () {58 vars in 1121 bytes} [Wed May 25 15:12:01 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 15:12:02.037131 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-259dbce4-5b3b-4d93-803f-cf10af3c9b51 admin admin] Authenticating user token {{(pid=101892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:12:02.047830 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-259dbce4-5b3b-4d93-803f-cf10af3c9b51 admin admin] Validating token access rules against request {{(pid=101892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:12:02.052737 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d7d471-8661-4879-addb-c88ab5db8a01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cec56f74b2fa4826a506dc7b919465be', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:12:02.053614 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d7d471-8661-4879-addb-c88ab5db8a01 admin admin] REQUEST_METHOD: `PUT` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:12:02.053956 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d7d471-8661-4879-addb-c88ab5db8a01 admin admin] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:12:02.054238 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d7d471-8661-4879-addb-c88ab5db8a01 admin admin] PATH_INFO: `/v3/projects/6594d54d37ca43998449050a9aeeb3c2/users/15c9dd9a1f3d4973b688b7df6134cf8b/roles/a3b78e7d547d4d2d998b4c99a4396bba` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:12:02.069781 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02d7d471-8661-4879-addb-c88ab5db8a01 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6594d54d37ca43998449050a9aeeb3c2, user_id=15c9dd9a1f3d4973b688b7df6134cf8b, role_id=a3b78e7d547d4d2d998b4c99a4396bba)` {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:12:02.072522 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02d7d471-8661-4879-addb-c88ab5db8a01 admin admin] RBAC: Authorization granted {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:12:02.171245 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 1211/2447] 10.222.0.84 () {60 vars in 1482 bytes} [Wed May 25 15:12:02 2022] PUT /identity/v3/projects/6594d54d37ca43998449050a9aeeb3c2/users/15c9dd9a1f3d4973b688b7df6134cf8b/roles/a3b78e7d547d4d2d998b4c99a4396bba => generated 0 bytes in 135 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 15:12:02.175194 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91eff37b-ff2b-4865-8f10-640f6da52839 admin admin] Authenticating user token {{(pid=101893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:12:02.185732 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91eff37b-ff2b-4865-8f10-640f6da52839 admin admin] Validating token access rules against request {{(pid=101893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:12:02.258589 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-226a6636-1da9-4e6e-aa65-b4797087d00a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cec56f74b2fa4826a506dc7b919465be', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:12:02.259279 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226a6636-1da9-4e6e-aa65-b4797087d00a admin admin] REQUEST_METHOD: `GET` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:12:02.259619 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226a6636-1da9-4e6e-aa65-b4797087d00a admin admin] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:12:02.259878 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226a6636-1da9-4e6e-aa65-b4797087d00a admin admin] PATH_INFO: `/v3/roles` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:12:02.260621 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-226a6636-1da9-4e6e-aa65-b4797087d00a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:12:02.262834 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-226a6636-1da9-4e6e-aa65-b4797087d00a admin admin] RBAC: Authorization granted {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:12:02.274103 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 1237/2448] 10.222.0.84 () {58 vars in 1121 bytes} [Wed May 25 15:12:02 2022] GET /identity/v3/roles => generated 1420 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 15:12:02.279081 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d7d471-8661-4879-addb-c88ab5db8a01 admin admin] Authenticating user token {{(pid=101892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:12:02.292486 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d7d471-8661-4879-addb-c88ab5db8a01 admin admin] Validating token access rules against request {{(pid=101892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:12:02.297517 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b05c2e94-1ffc-4bb2-b050-d216adca2096 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cec56f74b2fa4826a506dc7b919465be', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:12:02.298500 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05c2e94-1ffc-4bb2-b050-d216adca2096 admin admin] REQUEST_METHOD: `PUT` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:12:02.298860 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05c2e94-1ffc-4bb2-b050-d216adca2096 admin admin] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:12:02.299208 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05c2e94-1ffc-4bb2-b050-d216adca2096 admin admin] PATH_INFO: `/v3/projects/6594d54d37ca43998449050a9aeeb3c2/users/15c9dd9a1f3d4973b688b7df6134cf8b/roles/a3b78e7d547d4d2d998b4c99a4396bba` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:12:02.301347 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b05c2e94-1ffc-4bb2-b050-d216adca2096 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6594d54d37ca43998449050a9aeeb3c2, user_id=15c9dd9a1f3d4973b688b7df6134cf8b, role_id=a3b78e7d547d4d2d998b4c99a4396bba)` {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:12:02.304160 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b05c2e94-1ffc-4bb2-b050-d216adca2096 admin admin] RBAC: Authorization granted {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:12:02.315499 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 1212/2449] 10.222.0.84 () {60 vars in 1482 bytes} [Wed May 25 15:12:02 2022] PUT /identity/v3/projects/6594d54d37ca43998449050a9aeeb3c2/users/15c9dd9a1f3d4973b688b7df6134cf8b/roles/a3b78e7d547d4d2d998b4c99a4396bba => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 15:12:02.326824 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80f7484-9d50-4308-ae0c-6585afc2404b None None] REQUEST_METHOD: `POST` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:12:02.327115 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80f7484-9d50-4308-ae0c-6585afc2404b None None] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:12:02.327395 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80f7484-9d50-4308-ae0c-6585afc2404b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:12:02.355427 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.auth.core [None req-e80f7484-9d50-4308-ae0c-6585afc2404b None None] MFA Rules not processed for user `15c9dd9a1f3d4973b688b7df6134cf8b`. Rule list: `[]` (Enabled: `True`). {{(pid=101893) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:12:02.356863 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.fernet_utils [None req-e80f7484-9d50-4308-ae0c-6585afc2404b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=101893) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:12:02.426489 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 1238/2450] 10.222.0.84 () {58 vars in 957 bytes} [Wed May 25 15:12:02 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 15:12:02.437686 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b05c2e94-1ffc-4bb2-b050-d216adca2096 admin admin] Authenticating user token {{(pid=101892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:12:02.439393 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.fernet_utils [None req-b05c2e94-1ffc-4bb2-b050-d216adca2096 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=101892) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:12:02.509498 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b05c2e94-1ffc-4bb2-b050-d216adca2096 admin admin] Validating token access rules against request {{(pid=101892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:12:02.514217 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82d53737-050f-44cd-a4f3-1569617f8944 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e079f89a5e524ab6ad4183e4f690de07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a000829c658c4a7cab67f7b6353ba3fa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:12:02.514963 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d53737-050f-44cd-a4f3-1569617f8944 service cinder] REQUEST_METHOD: `GET` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:12:02.515304 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d53737-050f-44cd-a4f3-1569617f8944 service cinder] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:12:02.515744 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d53737-050f-44cd-a4f3-1569617f8944 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:12:02.528591 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82d53737-050f-44cd-a4f3-1569617f8944 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:12:02.528591 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82d53737-050f-44cd-a4f3-1569617f8944 service cinder] RBAC: Authorization granted {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:12:02.537173 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 1213/2451] 10.222.0.84 () {60 vars in 1365 bytes} [Wed May 25 15:12:02 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 15:12:03.398287 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e80f7484-9d50-4308-ae0c-6585afc2404b None None] Authenticating user token {{(pid=101893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:12:03.453879 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG dbcounter [-] [101893] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=101893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:12:03.464402 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e80f7484-9d50-4308-ae0c-6585afc2404b None None] Validating token access rules against request {{(pid=101893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:12:03.469051 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73adade9-fc8c-47c5-b824-2d08af2f6ec2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cec56f74b2fa4826a506dc7b919465be', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:12:03.469939 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73adade9-fc8c-47c5-b824-2d08af2f6ec2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:12:03.470190 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73adade9-fc8c-47c5-b824-2d08af2f6ec2 admin admin] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:12:03.470464 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73adade9-fc8c-47c5-b824-2d08af2f6ec2 admin admin] PATH_INFO: `/v3/users/3c75aab43d914ff991b679a10fcc4741` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:12:03.471715 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73adade9-fc8c-47c5-b824-2d08af2f6ec2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3c75aab43d914ff991b679a10fcc4741)` {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:12:03.473652 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73adade9-fc8c-47c5-b824-2d08af2f6ec2 admin admin] RBAC: Authorization granted {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:12:03.673204 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.notifications [None req-73adade9-fc8c-47c5-b824-2d08af2f6ec2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3c75aab43d914ff991b679a10fcc4741'} {{(pid=101893) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:12:03.680074 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.notifications [None req-73adade9-fc8c-47c5-b824-2d08af2f6ec2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3c75aab43d914ff991b679a10fcc4741'} {{(pid=101893) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:12:03.692584 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.notifications [None req-73adade9-fc8c-47c5-b824-2d08af2f6ec2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3c75aab43d914ff991b679a10fcc4741'} {{(pid=101893) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:12:03.693251 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.notifications [None req-73adade9-fc8c-47c5-b824-2d08af2f6ec2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3c75aab43d914ff991b679a10fcc4741'} {{(pid=101893) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:12:03.693848 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.notifications [None req-73adade9-fc8c-47c5-b824-2d08af2f6ec2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3c75aab43d914ff991b679a10fcc4741'} {{(pid=101893) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:12:03.774405 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 1239/2452] 10.222.0.84 () {58 vars in 1223 bytes} [Wed May 25 15:12:03 2022] DELETE /identity/v3/users/3c75aab43d914ff991b679a10fcc4741 => generated 0 bytes in 377 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 25 15:12:03.779076 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a834b7-80a8-44bc-82db-0191ff16c164 None None] REQUEST_METHOD: `POST` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:12:03.779600 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a834b7-80a8-44bc-82db-0191ff16c164 None None] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:12:03.779713 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a834b7-80a8-44bc-82db-0191ff16c164 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:12:03.797657 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.auth.core [None req-61a834b7-80a8-44bc-82db-0191ff16c164 None None] MFA Rules not processed for user `05d87e87798e429aa1c10b24391f915e`. Rule list: `[]` (Enabled: `True`). {{(pid=101892) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:12:03.798834 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.fernet_utils [None req-61a834b7-80a8-44bc-82db-0191ff16c164 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=101892) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:12:03.857185 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 1214/2453] 10.222.0.84 () {58 vars in 957 bytes} [Wed May 25 15:12:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 15:12:03.866740 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73adade9-fc8c-47c5-b824-2d08af2f6ec2 admin admin] Authenticating user token {{(pid=101893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:12:03.868168 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.fernet_utils [None req-73adade9-fc8c-47c5-b824-2d08af2f6ec2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=101893) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:12:03.925605 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73adade9-fc8c-47c5-b824-2d08af2f6ec2 admin admin] Validating token access rules against request {{(pid=101893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:12:03.929304 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f73a14-5735-4b50-8a52-577b1b47d16e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ce28b25b907473588ccb87dc4acc06a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a000829c658c4a7cab67f7b6353ba3fa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:12:03.929964 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f73a14-5735-4b50-8a52-577b1b47d16e service neutron] REQUEST_METHOD: `GET` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:12:03.930240 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f73a14-5735-4b50-8a52-577b1b47d16e service neutron] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:12:03.930523 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f73a14-5735-4b50-8a52-577b1b47d16e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:12:03.940964 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92f73a14-5735-4b50-8a52-577b1b47d16e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:12:03.942748 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92f73a14-5735-4b50-8a52-577b1b47d16e service neutron] RBAC: Authorization granted {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:12:03.952564 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 1240/2454] 10.222.0.84 () {60 vars in 1365 bytes} [Wed May 25 15:12:03 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 15:12:04.371152 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61a834b7-80a8-44bc-82db-0191ff16c164 None None] Authenticating user token {{(pid=101892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:12:04.373582 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.fernet_utils [None req-61a834b7-80a8-44bc-82db-0191ff16c164 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=101892) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:12:04.384618 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61a834b7-80a8-44bc-82db-0191ff16c164 None None] Validating token access rules against request {{(pid=101892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:12:04.389186 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-499d4807-537a-4908-91ca-12d0de24f4c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cec56f74b2fa4826a506dc7b919465be', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:12:04.390096 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499d4807-537a-4908-91ca-12d0de24f4c2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:12:04.390365 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499d4807-537a-4908-91ca-12d0de24f4c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:12:04.390737 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499d4807-537a-4908-91ca-12d0de24f4c2 admin admin] PATH_INFO: `/v3/projects/3fccbaa43f23419da2fb7f2e82bda88a` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:12:04.391938 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-499d4807-537a-4908-91ca-12d0de24f4c2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3fccbaa43f23419da2fb7f2e82bda88a)` {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:12:04.393851 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-499d4807-537a-4908-91ca-12d0de24f4c2 admin admin] RBAC: Authorization granted {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:12:04.416704 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG dbcounter [-] [101892] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=101892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:12:04.507203 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.notifications [None req-499d4807-537a-4908-91ca-12d0de24f4c2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3fccbaa43f23419da2fb7f2e82bda88a', 'request_id': 'req-499d4807-537a-4908-91ca-12d0de24f4c2'} {{(pid=101892) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:12:04.514039 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.notifications [None req-499d4807-537a-4908-91ca-12d0de24f4c2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3fccbaa43f23419da2fb7f2e82bda88a', 'request_id': 'req-499d4807-537a-4908-91ca-12d0de24f4c2'} {{(pid=101892) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:12:04.523040 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.notifications [None req-499d4807-537a-4908-91ca-12d0de24f4c2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3fccbaa43f23419da2fb7f2e82bda88a', 'request_id': 'req-499d4807-537a-4908-91ca-12d0de24f4c2'} {{(pid=101892) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:12:04.600708 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.notifications [None req-499d4807-537a-4908-91ca-12d0de24f4c2 admin admin] The token cache is being invalidate because project 3fccbaa43f23419da2fb7f2e82bda88a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=101892) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 25 15:12:04.600998 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.notifications [None req-499d4807-537a-4908-91ca-12d0de24f4c2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=101892) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:12:04.601665 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.notifications [None req-499d4807-537a-4908-91ca-12d0de24f4c2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=101892) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:12:04.603209 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 1215/2455] 10.222.0.84 () {58 vars in 1232 bytes} [Wed May 25 15:12:04 2022] DELETE /identity/v3/projects/3fccbaa43f23419da2fb7f2e82bda88a => generated 0 bytes in 233 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 15:12:04.607157 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f73a14-5735-4b50-8a52-577b1b47d16e service neutron] Authenticating user token {{(pid=101893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:12:04.616926 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f73a14-5735-4b50-8a52-577b1b47d16e service neutron] Validating token access rules against request {{(pid=101893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:12:04.673753 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e63e30d4-180d-4d18-85a0-72c49b76622f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cec56f74b2fa4826a506dc7b919465be', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:12:04.674552 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63e30d4-180d-4d18-85a0-72c49b76622f admin admin] REQUEST_METHOD: `DELETE` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:12:04.674837 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63e30d4-180d-4d18-85a0-72c49b76622f admin admin] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:12:04.675117 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63e30d4-180d-4d18-85a0-72c49b76622f admin admin] PATH_INFO: `/v3/users/15c9dd9a1f3d4973b688b7df6134cf8b` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:12:04.676378 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e63e30d4-180d-4d18-85a0-72c49b76622f admin admin] RBAC: Authorizing `identity:delete_user(user_id=15c9dd9a1f3d4973b688b7df6134cf8b)` {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:12:04.678316 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e63e30d4-180d-4d18-85a0-72c49b76622f admin admin] RBAC: Authorization granted {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:12:04.694205 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG dbcounter [-] [101893] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=101893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:12:04.785112 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a59df67-8ee8-476c-8f4e-49005eec245e None None] REQUEST_METHOD: `POST` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:12:04.785572 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a59df67-8ee8-476c-8f4e-49005eec245e None None] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:12:04.785672 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a59df67-8ee8-476c-8f4e-49005eec245e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:12:04.803953 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.auth.core [None req-4a59df67-8ee8-476c-8f4e-49005eec245e None None] MFA Rules not processed for user `049a7ab3f95f460e908f79cc321176fd`. Rule list: `[]` (Enabled: `True`). {{(pid=101892) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:12:04.805234 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.fernet_utils [None req-4a59df67-8ee8-476c-8f4e-49005eec245e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=101892) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:12:04.862554 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 1216/2456] 10.222.0.84 () {58 vars in 967 bytes} [Wed May 25 15:12:04 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 25 15:12:04.871087 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.notifications [None req-e63e30d4-180d-4d18-85a0-72c49b76622f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '15c9dd9a1f3d4973b688b7df6134cf8b'} {{(pid=101893) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:12:04.876732 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a59df67-8ee8-476c-8f4e-49005eec245e None None] Authenticating user token {{(pid=101892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:12:04.879804 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.fernet_utils [None req-4a59df67-8ee8-476c-8f4e-49005eec245e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=101892) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:12:04.879963 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.notifications [None req-e63e30d4-180d-4d18-85a0-72c49b76622f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '15c9dd9a1f3d4973b688b7df6134cf8b'} {{(pid=101893) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:12:04.892274 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.notifications [None req-e63e30d4-180d-4d18-85a0-72c49b76622f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '15c9dd9a1f3d4973b688b7df6134cf8b'} {{(pid=101893) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:12:04.893138 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.notifications [None req-e63e30d4-180d-4d18-85a0-72c49b76622f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '15c9dd9a1f3d4973b688b7df6134cf8b'} {{(pid=101893) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:12:04.893873 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.notifications [None req-e63e30d4-180d-4d18-85a0-72c49b76622f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '15c9dd9a1f3d4973b688b7df6134cf8b'} {{(pid=101893) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:12:04.948586 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a59df67-8ee8-476c-8f4e-49005eec245e None None] Validating token access rules against request {{(pid=101892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:12:04.954243 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-079ba281-3d2d-46ae-8b6c-ebc0536cbd0b service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e196f0897b98455c9e164271d7d0070a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a000829c658c4a7cab67f7b6353ba3fa', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:12:04.954894 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079ba281-3d2d-46ae-8b6c-ebc0536cbd0b service swift] REQUEST_METHOD: `GET` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:12:04.955180 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079ba281-3d2d-46ae-8b6c-ebc0536cbd0b service swift] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:12:04.955460 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079ba281-3d2d-46ae-8b6c-ebc0536cbd0b service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:12:04.957378 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.fernet_utils [None req-079ba281-3d2d-46ae-8b6c-ebc0536cbd0b service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=101892) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:12:04.968032 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-079ba281-3d2d-46ae-8b6c-ebc0536cbd0b service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:12:04.969625 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-079ba281-3d2d-46ae-8b6c-ebc0536cbd0b service swift] RBAC: Authorization granted {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:12:04.977956 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 1217/2457] 10.222.0.84 () {60 vars in 1384 bytes} [Wed May 25 15:12:04 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) May 25 15:12:04.985853 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 1241/2458] 10.222.0.84 () {58 vars in 1223 bytes} [Wed May 25 15:12:04 2022] DELETE /identity/v3/users/15c9dd9a1f3d4973b688b7df6134cf8b => generated 0 bytes in 379 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 15:12:05.441113 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-079ba281-3d2d-46ae-8b6c-ebc0536cbd0b service swift] Authenticating user token {{(pid=101892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:12:05.441113 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.fernet_utils [None req-079ba281-3d2d-46ae-8b6c-ebc0536cbd0b service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=101892) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:12:05.459833 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-079ba281-3d2d-46ae-8b6c-ebc0536cbd0b service swift] Validating token access rules against request {{(pid=101892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:12:05.501882 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG dbcounter [-] [101892] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=101892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:12:05.517934 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcd73b9c-bd1f-4319-a8d5-1c1e0954bc3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cec56f74b2fa4826a506dc7b919465be', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:12:05.518791 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd73b9c-bd1f-4319-a8d5-1c1e0954bc3b admin admin] REQUEST_METHOD: `DELETE` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:12:05.519069 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd73b9c-bd1f-4319-a8d5-1c1e0954bc3b admin admin] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:12:05.519341 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd73b9c-bd1f-4319-a8d5-1c1e0954bc3b admin admin] PATH_INFO: `/v3/projects/6594d54d37ca43998449050a9aeeb3c2` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:12:05.520535 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcd73b9c-bd1f-4319-a8d5-1c1e0954bc3b admin admin] RBAC: Authorizing `identity:delete_project(project_id=6594d54d37ca43998449050a9aeeb3c2)` {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:12:05.522521 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcd73b9c-bd1f-4319-a8d5-1c1e0954bc3b admin admin] RBAC: Authorization granted {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:12:05.649751 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.notifications [None req-dcd73b9c-bd1f-4319-a8d5-1c1e0954bc3b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6594d54d37ca43998449050a9aeeb3c2', 'request_id': 'req-dcd73b9c-bd1f-4319-a8d5-1c1e0954bc3b'} {{(pid=101892) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:12:05.659456 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.notifications [None req-dcd73b9c-bd1f-4319-a8d5-1c1e0954bc3b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6594d54d37ca43998449050a9aeeb3c2', 'request_id': 'req-dcd73b9c-bd1f-4319-a8d5-1c1e0954bc3b'} {{(pid=101892) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:12:05.666601 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.notifications [None req-dcd73b9c-bd1f-4319-a8d5-1c1e0954bc3b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6594d54d37ca43998449050a9aeeb3c2', 'request_id': 'req-dcd73b9c-bd1f-4319-a8d5-1c1e0954bc3b'} {{(pid=101892) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:12:05.746841 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.notifications [None req-dcd73b9c-bd1f-4319-a8d5-1c1e0954bc3b admin admin] The token cache is being invalidate because project 6594d54d37ca43998449050a9aeeb3c2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=101892) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 25 15:12:05.749384 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.notifications [None req-dcd73b9c-bd1f-4319-a8d5-1c1e0954bc3b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=101892) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:12:05.749384 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.notifications [None req-dcd73b9c-bd1f-4319-a8d5-1c1e0954bc3b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=101892) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:12:05.750995 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 1218/2459] 10.222.0.84 () {58 vars in 1232 bytes} [Wed May 25 15:12:05 2022] DELETE /identity/v3/projects/6594d54d37ca43998449050a9aeeb3c2 => generated 0 bytes in 318 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 15:12:05.759740 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2bef50a-b802-47d9-83f9-522620381fd1 None None] REQUEST_METHOD: `POST` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:12:05.759740 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2bef50a-b802-47d9-83f9-522620381fd1 None None] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:12:05.759740 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2bef50a-b802-47d9-83f9-522620381fd1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:12:05.776902 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.auth.core [None req-a2bef50a-b802-47d9-83f9-522620381fd1 None None] MFA Rules not processed for user `05d87e87798e429aa1c10b24391f915e`. Rule list: `[]` (Enabled: `True`). {{(pid=101893) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:12:05.778134 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.fernet_utils [None req-a2bef50a-b802-47d9-83f9-522620381fd1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=101893) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:12:05.838501 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 1242/2460] 10.222.0.84 () {58 vars in 957 bytes} [Wed May 25 15:12:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 25 15:12:05.845932 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510b9ed5-712b-4516-bb2b-bef92a13d1d1 None None] REQUEST_METHOD: `POST` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:12:05.846443 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510b9ed5-712b-4516-bb2b-bef92a13d1d1 None None] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:12:05.846549 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510b9ed5-712b-4516-bb2b-bef92a13d1d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:12:05.864936 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.auth.core [None req-510b9ed5-712b-4516-bb2b-bef92a13d1d1 None None] MFA Rules not processed for user `05d87e87798e429aa1c10b24391f915e`. Rule list: `[]` (Enabled: `True`). {{(pid=101892) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:12:05.866138 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.fernet_utils [None req-510b9ed5-712b-4516-bb2b-bef92a13d1d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=101892) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:12:05.874651 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 1219/2461] 10.222.0.84 () {58 vars in 957 bytes} [Wed May 25 15:12:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 15:12:05.878830 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2bef50a-b802-47d9-83f9-522620381fd1 None None] Authenticating user token {{(pid=101893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:12:05.889036 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2bef50a-b802-47d9-83f9-522620381fd1 None None] Validating token access rules against request {{(pid=101893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:12:05.893647 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b1bbca5-83e6-44dd-a815-438332f1ac79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cec56f74b2fa4826a506dc7b919465be', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:12:05.894238 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1bbca5-83e6-44dd-a815-438332f1ac79 admin admin] REQUEST_METHOD: `GET` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:12:05.894525 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1bbca5-83e6-44dd-a815-438332f1ac79 admin admin] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:12:05.894803 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1bbca5-83e6-44dd-a815-438332f1ac79 admin admin] PATH_INFO: `/v3/domains` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:12:05.895532 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b1bbca5-83e6-44dd-a815-438332f1ac79 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=101893) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 15:12:05.895896 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b1bbca5-83e6-44dd-a815-438332f1ac79 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:12:05.897482 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b1bbca5-83e6-44dd-a815-438332f1ac79 admin admin] RBAC: Authorization granted {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:12:05.908946 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 1243/2462] 10.222.0.84 () {58 vars in 1152 bytes} [Wed May 25 15:12:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 15:12:05.913368 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-510b9ed5-712b-4516-bb2b-bef92a13d1d1 None None] Authenticating user token {{(pid=101892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:12:05.923658 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-510b9ed5-712b-4516-bb2b-bef92a13d1d1 None None] Validating token access rules against request {{(pid=101892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:12:05.928344 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c70ebb4-169f-4d97-a2cc-4bd082e7aa14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cec56f74b2fa4826a506dc7b919465be', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:12:05.928997 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c70ebb4-169f-4d97-a2cc-4bd082e7aa14 admin admin] REQUEST_METHOD: `POST` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:12:05.929283 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c70ebb4-169f-4d97-a2cc-4bd082e7aa14 admin admin] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:12:05.929564 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c70ebb4-169f-4d97-a2cc-4bd082e7aa14 admin admin] PATH_INFO: `/v3/projects` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:12:05.930250 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c70ebb4-169f-4d97-a2cc-4bd082e7aa14 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:12:05.932198 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c70ebb4-169f-4d97-a2cc-4bd082e7aa14 admin admin] RBAC: Authorization granted {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:12:06.034657 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 1220/2463] 10.222.0.84 () {60 vars in 1152 bytes} [Wed May 25 15:12:05 2022] POST /identity/v3/projects => generated 393 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 15:12:06.038906 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b1bbca5-83e6-44dd-a815-438332f1ac79 admin admin] Authenticating user token {{(pid=101893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:12:06.049675 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b1bbca5-83e6-44dd-a815-438332f1ac79 admin admin] Validating token access rules against request {{(pid=101893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:12:06.107149 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7319a1f4-ed5f-4ed1-855a-cc42799b84e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cec56f74b2fa4826a506dc7b919465be', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:12:06.107851 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7319a1f4-ed5f-4ed1-855a-cc42799b84e8 admin admin] REQUEST_METHOD: `POST` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:12:06.108140 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7319a1f4-ed5f-4ed1-855a-cc42799b84e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:12:06.108420 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7319a1f4-ed5f-4ed1-855a-cc42799b84e8 admin admin] PATH_INFO: `/v3/users` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:12:06.109100 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7319a1f4-ed5f-4ed1-855a-cc42799b84e8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:12:06.111048 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7319a1f4-ed5f-4ed1-855a-cc42799b84e8 admin admin] RBAC: Authorization granted {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:12:06.204340 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 1244/2464] 10.222.0.84 () {60 vars in 1143 bytes} [Wed May 25 15:12:06 2022] POST /identity/v3/users => generated 297 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 15:12:06.205566 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c70ebb4-169f-4d97-a2cc-4bd082e7aa14 admin admin] Authenticating user token {{(pid=101892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:12:06.215901 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c70ebb4-169f-4d97-a2cc-4bd082e7aa14 admin admin] Validating token access rules against request {{(pid=101892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:12:06.220467 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be716d4-beef-4dc4-ae4e-184cfba832a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cec56f74b2fa4826a506dc7b919465be', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:12:06.221122 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be716d4-beef-4dc4-ae4e-184cfba832a0 admin admin] REQUEST_METHOD: `GET` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:12:06.221408 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be716d4-beef-4dc4-ae4e-184cfba832a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:12:06.221686 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be716d4-beef-4dc4-ae4e-184cfba832a0 admin admin] PATH_INFO: `/v3/roles` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:12:06.222408 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0be716d4-beef-4dc4-ae4e-184cfba832a0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:12:06.224042 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0be716d4-beef-4dc4-ae4e-184cfba832a0 admin admin] RBAC: Authorization granted {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:12:06.234739 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 1221/2465] 10.222.0.84 () {58 vars in 1121 bytes} [Wed May 25 15:12:06 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 15:12:06.239231 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7319a1f4-ed5f-4ed1-855a-cc42799b84e8 admin admin] Authenticating user token {{(pid=101893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:12:06.249370 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7319a1f4-ed5f-4ed1-855a-cc42799b84e8 admin admin] Validating token access rules against request {{(pid=101893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:12:06.254287 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff523c4-19eb-44bc-b370-2b60383a68b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cec56f74b2fa4826a506dc7b919465be', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:12:06.254975 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff523c4-19eb-44bc-b370-2b60383a68b0 admin admin] REQUEST_METHOD: `GET` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:12:06.255280 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff523c4-19eb-44bc-b370-2b60383a68b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:12:06.255766 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff523c4-19eb-44bc-b370-2b60383a68b0 admin admin] PATH_INFO: `/v3/roles` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:12:06.256512 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bff523c4-19eb-44bc-b370-2b60383a68b0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:12:06.258142 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bff523c4-19eb-44bc-b370-2b60383a68b0 admin admin] RBAC: Authorization granted {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:12:06.263603 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG dbcounter [-] [101893] Writing DB stats keystone:DELETE=9,keystone:SELECT=87,keystone:INSERT=4 {{(pid=101893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:12:06.268599 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 1245/2466] 10.222.0.84 () {58 vars in 1121 bytes} [Wed May 25 15:12:06 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 15:12:06.272877 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be716d4-beef-4dc4-ae4e-184cfba832a0 admin admin] Authenticating user token {{(pid=101892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:12:06.283112 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be716d4-beef-4dc4-ae4e-184cfba832a0 admin admin] Validating token access rules against request {{(pid=101892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:12:06.288162 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71365982-9c86-4497-8c2d-10ff6ee55005 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cec56f74b2fa4826a506dc7b919465be', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:12:06.288990 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71365982-9c86-4497-8c2d-10ff6ee55005 admin admin] REQUEST_METHOD: `PUT` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:12:06.289276 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71365982-9c86-4497-8c2d-10ff6ee55005 admin admin] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:12:06.289556 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71365982-9c86-4497-8c2d-10ff6ee55005 admin admin] PATH_INFO: `/v3/projects/f07e56d391644cef85298a9878d2461a/users/5f8b3fa6b0be430b941db1385a2169a1/roles/ff664fa0db7e4262a5accde96c3df4c3` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:12:06.305088 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71365982-9c86-4497-8c2d-10ff6ee55005 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f07e56d391644cef85298a9878d2461a, user_id=5f8b3fa6b0be430b941db1385a2169a1, role_id=ff664fa0db7e4262a5accde96c3df4c3)` {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:12:06.308016 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71365982-9c86-4497-8c2d-10ff6ee55005 admin admin] RBAC: Authorization granted {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:12:06.389889 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 1222/2467] 10.222.0.84 () {60 vars in 1482 bytes} [Wed May 25 15:12:06 2022] PUT /identity/v3/projects/f07e56d391644cef85298a9878d2461a/users/5f8b3fa6b0be430b941db1385a2169a1/roles/ff664fa0db7e4262a5accde96c3df4c3 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 15:12:06.401199 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f6bc16-84f2-4762-813a-fa59bb99b3b2 None None] REQUEST_METHOD: `POST` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:12:06.401496 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f6bc16-84f2-4762-813a-fa59bb99b3b2 None None] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:12:06.401781 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f6bc16-84f2-4762-813a-fa59bb99b3b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:12:06.430382 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.auth.core [None req-79f6bc16-84f2-4762-813a-fa59bb99b3b2 None None] MFA Rules not processed for user `5f8b3fa6b0be430b941db1385a2169a1`. Rule list: `[]` (Enabled: `True`). {{(pid=101893) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:12:06.431631 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.fernet_utils [None req-79f6bc16-84f2-4762-813a-fa59bb99b3b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=101893) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:12:06.497857 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 1246/2468] 10.222.0.84 () {58 vars in 957 bytes} [Wed May 25 15:12:06 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 15:12:06.502324 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71365982-9c86-4497-8c2d-10ff6ee55005 admin admin] Authenticating user token {{(pid=101892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:12:06.565070 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71365982-9c86-4497-8c2d-10ff6ee55005 admin admin] Validating token access rules against request {{(pid=101892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:12:06.570020 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab6d45b8-9d0e-48f8-940f-e2481c4a8dc6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cec56f74b2fa4826a506dc7b919465be', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:12:06.570676 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6d45b8-9d0e-48f8-940f-e2481c4a8dc6 admin admin] REQUEST_METHOD: `POST` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:12:06.570966 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6d45b8-9d0e-48f8-940f-e2481c4a8dc6 admin admin] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:12:06.571246 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6d45b8-9d0e-48f8-940f-e2481c4a8dc6 admin admin] PATH_INFO: `/v3/projects` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:12:06.571972 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab6d45b8-9d0e-48f8-940f-e2481c4a8dc6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:12:06.573878 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab6d45b8-9d0e-48f8-940f-e2481c4a8dc6 admin admin] RBAC: Authorization granted {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:12:06.586950 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG dbcounter [-] [101892] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=101892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:12:06.650337 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 1223/2469] 10.222.0.84 () {60 vars in 1152 bytes} [Wed May 25 15:12:06 2022] POST /identity/v3/projects => generated 391 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 15:12:06.654874 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79f6bc16-84f2-4762-813a-fa59bb99b3b2 None None] Authenticating user token {{(pid=101893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:12:06.665703 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79f6bc16-84f2-4762-813a-fa59bb99b3b2 None None] Validating token access rules against request {{(pid=101893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:12:06.721415 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ea975d0-8b9a-4530-9ccb-fb7ded27a07c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cec56f74b2fa4826a506dc7b919465be', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:12:06.722088 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea975d0-8b9a-4530-9ccb-fb7ded27a07c admin admin] REQUEST_METHOD: `POST` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:12:06.722400 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea975d0-8b9a-4530-9ccb-fb7ded27a07c admin admin] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:12:06.722677 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea975d0-8b9a-4530-9ccb-fb7ded27a07c admin admin] PATH_INFO: `/v3/users` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:12:06.723363 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ea975d0-8b9a-4530-9ccb-fb7ded27a07c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:12:06.725327 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ea975d0-8b9a-4530-9ccb-fb7ded27a07c admin admin] RBAC: Authorization granted {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:12:06.831123 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 1247/2470] 10.222.0.84 () {60 vars in 1143 bytes} [Wed May 25 15:12:06 2022] POST /identity/v3/users => generated 302 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 15:12:06.832886 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab6d45b8-9d0e-48f8-940f-e2481c4a8dc6 admin admin] Authenticating user token {{(pid=101892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:12:06.844051 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab6d45b8-9d0e-48f8-940f-e2481c4a8dc6 admin admin] Validating token access rules against request {{(pid=101892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:12:06.848850 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-067e02cb-b25a-4b3c-bd29-d9ad2ff8cd1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cec56f74b2fa4826a506dc7b919465be', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:12:06.849520 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067e02cb-b25a-4b3c-bd29-d9ad2ff8cd1c admin admin] REQUEST_METHOD: `GET` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:12:06.849797 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067e02cb-b25a-4b3c-bd29-d9ad2ff8cd1c admin admin] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:12:06.850077 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067e02cb-b25a-4b3c-bd29-d9ad2ff8cd1c admin admin] PATH_INFO: `/v3/roles` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:12:06.850799 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-067e02cb-b25a-4b3c-bd29-d9ad2ff8cd1c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:12:06.852456 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-067e02cb-b25a-4b3c-bd29-d9ad2ff8cd1c admin admin] RBAC: Authorization granted {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:12:06.865893 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 1224/2471] 10.222.0.84 () {58 vars in 1121 bytes} [Wed May 25 15:12:06 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 15:12:06.867541 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ea975d0-8b9a-4530-9ccb-fb7ded27a07c admin admin] Authenticating user token {{(pid=101893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:12:06.878097 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ea975d0-8b9a-4530-9ccb-fb7ded27a07c admin admin] Validating token access rules against request {{(pid=101893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:12:06.882999 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-011a11e5-9f51-4372-8926-9accfc3443f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cec56f74b2fa4826a506dc7b919465be', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:12:06.884047 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011a11e5-9f51-4372-8926-9accfc3443f0 admin admin] REQUEST_METHOD: `PUT` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:12:06.884338 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011a11e5-9f51-4372-8926-9accfc3443f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:12:06.884646 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011a11e5-9f51-4372-8926-9accfc3443f0 admin admin] PATH_INFO: `/v3/projects/00a146d2594649aea6058f2fe99e4de0/users/b8d0ae0de61e4b9fb62a18da8bfa91d0/roles/a3b78e7d547d4d2d998b4c99a4396bba` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:12:06.900723 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-011a11e5-9f51-4372-8926-9accfc3443f0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=00a146d2594649aea6058f2fe99e4de0, user_id=b8d0ae0de61e4b9fb62a18da8bfa91d0, role_id=a3b78e7d547d4d2d998b4c99a4396bba)` {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:12:06.904084 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-011a11e5-9f51-4372-8926-9accfc3443f0 admin admin] RBAC: Authorization granted {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:12:07.031205 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 1248/2472] 10.222.0.84 () {60 vars in 1482 bytes} [Wed May 25 15:12:06 2022] PUT /identity/v3/projects/00a146d2594649aea6058f2fe99e4de0/users/b8d0ae0de61e4b9fb62a18da8bfa91d0/roles/a3b78e7d547d4d2d998b4c99a4396bba => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 15:12:07.036459 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-067e02cb-b25a-4b3c-bd29-d9ad2ff8cd1c admin admin] Authenticating user token {{(pid=101892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:12:07.047084 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-067e02cb-b25a-4b3c-bd29-d9ad2ff8cd1c admin admin] Validating token access rules against request {{(pid=101892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:12:07.102566 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8070ab7b-8882-46cd-94e8-729a5223e582 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cec56f74b2fa4826a506dc7b919465be', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:12:07.103231 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8070ab7b-8882-46cd-94e8-729a5223e582 admin admin] REQUEST_METHOD: `GET` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:12:07.103515 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8070ab7b-8882-46cd-94e8-729a5223e582 admin admin] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:12:07.103829 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8070ab7b-8882-46cd-94e8-729a5223e582 admin admin] PATH_INFO: `/v3/roles` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:12:07.104545 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8070ab7b-8882-46cd-94e8-729a5223e582 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:12:07.106682 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8070ab7b-8882-46cd-94e8-729a5223e582 admin admin] RBAC: Authorization granted {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:12:07.116168 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 1225/2473] 10.222.0.84 () {58 vars in 1121 bytes} [Wed May 25 15:12:07 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 15:12:07.120352 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-011a11e5-9f51-4372-8926-9accfc3443f0 admin admin] Authenticating user token {{(pid=101893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:12:07.131355 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-011a11e5-9f51-4372-8926-9accfc3443f0 admin admin] Validating token access rules against request {{(pid=101893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:12:07.136277 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b9994fc-a3ee-42c0-b4cf-32ffb93342bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cec56f74b2fa4826a506dc7b919465be', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:12:07.137155 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b9994fc-a3ee-42c0-b4cf-32ffb93342bf admin admin] REQUEST_METHOD: `PUT` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:12:07.137436 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b9994fc-a3ee-42c0-b4cf-32ffb93342bf admin admin] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:12:07.137713 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b9994fc-a3ee-42c0-b4cf-32ffb93342bf admin admin] PATH_INFO: `/v3/projects/00a146d2594649aea6058f2fe99e4de0/users/b8d0ae0de61e4b9fb62a18da8bfa91d0/roles/a3b78e7d547d4d2d998b4c99a4396bba` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:12:07.139714 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b9994fc-a3ee-42c0-b4cf-32ffb93342bf admin admin] RBAC: Authorizing `identity:create_grant(project_id=00a146d2594649aea6058f2fe99e4de0, user_id=b8d0ae0de61e4b9fb62a18da8bfa91d0, role_id=a3b78e7d547d4d2d998b4c99a4396bba)` {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:12:07.142407 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b9994fc-a3ee-42c0-b4cf-32ffb93342bf admin admin] RBAC: Authorization granted {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:12:07.153179 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 1249/2474] 10.222.0.84 () {60 vars in 1482 bytes} [Wed May 25 15:12:07 2022] PUT /identity/v3/projects/00a146d2594649aea6058f2fe99e4de0/users/b8d0ae0de61e4b9fb62a18da8bfa91d0/roles/a3b78e7d547d4d2d998b4c99a4396bba => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 15:12:07.163230 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56bf02a6-ce9c-4647-8159-9112a57cd136 None None] REQUEST_METHOD: `POST` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:12:07.163530 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56bf02a6-ce9c-4647-8159-9112a57cd136 None None] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:12:07.163850 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56bf02a6-ce9c-4647-8159-9112a57cd136 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:12:07.189840 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.auth.core [None req-56bf02a6-ce9c-4647-8159-9112a57cd136 None None] MFA Rules not processed for user `b8d0ae0de61e4b9fb62a18da8bfa91d0`. Rule list: `[]` (Enabled: `True`). {{(pid=101892) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:12:07.191045 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.fernet_utils [None req-56bf02a6-ce9c-4647-8159-9112a57cd136 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=101892) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:12:07.257662 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 1226/2475] 10.222.0.84 () {58 vars in 957 bytes} [Wed May 25 15:12:07 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 15:12:07.268230 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b9994fc-a3ee-42c0-b4cf-32ffb93342bf admin admin] Authenticating user token {{(pid=101893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:12:07.269913 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.fernet_utils [None req-4b9994fc-a3ee-42c0-b4cf-32ffb93342bf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=101893) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:12:07.323614 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG dbcounter [-] [101893] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=101893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:12:07.338075 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b9994fc-a3ee-42c0-b4cf-32ffb93342bf admin admin] Validating token access rules against request {{(pid=101893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:12:07.343327 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4a0cda0-cbbf-4de4-ba4e-a84af382bf9e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e079f89a5e524ab6ad4183e4f690de07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a000829c658c4a7cab67f7b6353ba3fa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:12:07.344043 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a0cda0-cbbf-4de4-ba4e-a84af382bf9e service cinder] REQUEST_METHOD: `GET` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:12:07.344332 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a0cda0-cbbf-4de4-ba4e-a84af382bf9e service cinder] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:12:07.344609 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a0cda0-cbbf-4de4-ba4e-a84af382bf9e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:12:07.353959 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4a0cda0-cbbf-4de4-ba4e-a84af382bf9e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:12:07.355351 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4a0cda0-cbbf-4de4-ba4e-a84af382bf9e service cinder] RBAC: Authorization granted {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:12:07.365585 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 1250/2476] 10.222.0.84 () {60 vars in 1365 bytes} [Wed May 25 15:12:07 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 15:12:07.411494 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56bf02a6-ce9c-4647-8159-9112a57cd136 None None] Authenticating user token {{(pid=101892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:12:07.412913 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.fernet_utils [None req-56bf02a6-ce9c-4647-8159-9112a57cd136 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=101892) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:12:07.425230 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56bf02a6-ce9c-4647-8159-9112a57cd136 None None] Validating token access rules against request {{(pid=101892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:12:07.428760 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de918472-d241-4988-8382-d707038c07c1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e079f89a5e524ab6ad4183e4f690de07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a000829c658c4a7cab67f7b6353ba3fa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:12:07.429403 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de918472-d241-4988-8382-d707038c07c1 service cinder] REQUEST_METHOD: `GET` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:12:07.429687 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de918472-d241-4988-8382-d707038c07c1 service cinder] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:12:07.429967 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de918472-d241-4988-8382-d707038c07c1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:12:07.486920 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de918472-d241-4988-8382-d707038c07c1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:12:07.488386 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de918472-d241-4988-8382-d707038c07c1 service cinder] RBAC: Authorization granted {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:12:07.497761 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 1227/2477] 10.222.0.84 () {60 vars in 1365 bytes} [Wed May 25 15:12:07 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 15:12:12.097157 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4a0cda0-cbbf-4de4-ba4e-a84af382bf9e service cinder] Authenticating user token {{(pid=101893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:12:12.158722 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4a0cda0-cbbf-4de4-ba4e-a84af382bf9e service cinder] Validating token access rules against request {{(pid=101893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:12:12.163212 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-993170df-5008-4330-adf8-7e42393d62b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cec56f74b2fa4826a506dc7b919465be', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:12:12.164113 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993170df-5008-4330-adf8-7e42393d62b3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:12:12.164399 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993170df-5008-4330-adf8-7e42393d62b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:12:12.164674 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993170df-5008-4330-adf8-7e42393d62b3 admin admin] PATH_INFO: `/v3/users/5f8b3fa6b0be430b941db1385a2169a1` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:12:12.165915 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-993170df-5008-4330-adf8-7e42393d62b3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5f8b3fa6b0be430b941db1385a2169a1)` {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:12:12.168020 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-993170df-5008-4330-adf8-7e42393d62b3 admin admin] RBAC: Authorization granted {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:12:12.316280 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.notifications [None req-993170df-5008-4330-adf8-7e42393d62b3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5f8b3fa6b0be430b941db1385a2169a1'} {{(pid=101893) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:12:12.323330 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.notifications [None req-993170df-5008-4330-adf8-7e42393d62b3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5f8b3fa6b0be430b941db1385a2169a1'} {{(pid=101893) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:12:12.335574 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.notifications [None req-993170df-5008-4330-adf8-7e42393d62b3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5f8b3fa6b0be430b941db1385a2169a1'} {{(pid=101893) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:12:12.336270 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.notifications [None req-993170df-5008-4330-adf8-7e42393d62b3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5f8b3fa6b0be430b941db1385a2169a1'} {{(pid=101893) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:12:12.336984 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.notifications [None req-993170df-5008-4330-adf8-7e42393d62b3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5f8b3fa6b0be430b941db1385a2169a1'} {{(pid=101893) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:12:12.406675 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 1251/2478] 10.222.0.84 () {58 vars in 1223 bytes} [Wed May 25 15:12:12 2022] DELETE /identity/v3/users/5f8b3fa6b0be430b941db1385a2169a1 => generated 0 bytes in 310 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 15:12:12.423427 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407e1fbc-38fc-467a-a07f-c13d82c35f04 None None] REQUEST_METHOD: `POST` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:12:12.423931 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407e1fbc-38fc-467a-a07f-c13d82c35f04 None None] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:12:12.424026 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407e1fbc-38fc-467a-a07f-c13d82c35f04 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:12:12.429836 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG dbcounter [-] [101892] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=101892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:12:12.442765 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.auth.core [None req-407e1fbc-38fc-467a-a07f-c13d82c35f04 None None] MFA Rules not processed for user `05d87e87798e429aa1c10b24391f915e`. Rule list: `[]` (Enabled: `True`). {{(pid=101892) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:12:12.444017 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.fernet_utils [None req-407e1fbc-38fc-467a-a07f-c13d82c35f04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=101892) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:12:12.515181 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 1228/2479] 10.222.0.84 () {58 vars in 957 bytes} [Wed May 25 15:12:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 15:12:12.525120 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-993170df-5008-4330-adf8-7e42393d62b3 admin admin] Authenticating user token {{(pid=101893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:12:12.526609 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.fernet_utils [None req-993170df-5008-4330-adf8-7e42393d62b3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=101893) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:12:12.595663 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-993170df-5008-4330-adf8-7e42393d62b3 admin admin] Validating token access rules against request {{(pid=101893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:12:12.599356 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c7bbfd-b245-464e-804a-fef0ff4d7d4d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ce28b25b907473588ccb87dc4acc06a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a000829c658c4a7cab67f7b6353ba3fa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:12:12.600043 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c7bbfd-b245-464e-804a-fef0ff4d7d4d service neutron] REQUEST_METHOD: `GET` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:12:12.600328 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c7bbfd-b245-464e-804a-fef0ff4d7d4d service neutron] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:12:12.600600 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c7bbfd-b245-464e-804a-fef0ff4d7d4d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:12:12.609759 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8c7bbfd-b245-464e-804a-fef0ff4d7d4d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:12:12.613893 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8c7bbfd-b245-464e-804a-fef0ff4d7d4d service neutron] RBAC: Authorization granted {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:12:12.620955 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 1252/2480] 10.222.0.84 () {60 vars in 1365 bytes} [Wed May 25 15:12:12 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 15:12:13.290510 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-407e1fbc-38fc-467a-a07f-c13d82c35f04 None None] Authenticating user token {{(pid=101892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:12:13.291988 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.fernet_utils [None req-407e1fbc-38fc-467a-a07f-c13d82c35f04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=101892) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:12:13.310587 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-407e1fbc-38fc-467a-a07f-c13d82c35f04 None None] Validating token access rules against request {{(pid=101892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:12:13.316235 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae965c2-b171-4d62-9e39-51b59321acf6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cec56f74b2fa4826a506dc7b919465be', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:12:13.317388 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae965c2-b171-4d62-9e39-51b59321acf6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:12:13.317672 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae965c2-b171-4d62-9e39-51b59321acf6 admin admin] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:12:13.317981 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae965c2-b171-4d62-9e39-51b59321acf6 admin admin] PATH_INFO: `/v3/projects/f07e56d391644cef85298a9878d2461a` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:12:13.319857 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aae965c2-b171-4d62-9e39-51b59321acf6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f07e56d391644cef85298a9878d2461a)` {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:12:13.322837 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aae965c2-b171-4d62-9e39-51b59321acf6 admin admin] RBAC: Authorization granted {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:12:13.426911 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.notifications [None req-aae965c2-b171-4d62-9e39-51b59321acf6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f07e56d391644cef85298a9878d2461a', 'request_id': 'req-aae965c2-b171-4d62-9e39-51b59321acf6'} {{(pid=101892) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:12:13.433050 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.notifications [None req-aae965c2-b171-4d62-9e39-51b59321acf6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f07e56d391644cef85298a9878d2461a', 'request_id': 'req-aae965c2-b171-4d62-9e39-51b59321acf6'} {{(pid=101892) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:12:13.438504 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.notifications [None req-aae965c2-b171-4d62-9e39-51b59321acf6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f07e56d391644cef85298a9878d2461a', 'request_id': 'req-aae965c2-b171-4d62-9e39-51b59321acf6'} {{(pid=101892) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:12:13.522767 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.notifications [None req-aae965c2-b171-4d62-9e39-51b59321acf6 admin admin] The token cache is being invalidate because project f07e56d391644cef85298a9878d2461a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=101892) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 25 15:12:13.523057 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.notifications [None req-aae965c2-b171-4d62-9e39-51b59321acf6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=101892) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:12:13.523724 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.notifications [None req-aae965c2-b171-4d62-9e39-51b59321acf6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=101892) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:12:13.525279 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 1229/2481] 10.222.0.84 () {58 vars in 1232 bytes} [Wed May 25 15:12:13 2022] DELETE /identity/v3/projects/f07e56d391644cef85298a9878d2461a => generated 0 bytes in 235 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 15:12:13.529898 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c7bbfd-b245-464e-804a-fef0ff4d7d4d service neutron] Authenticating user token {{(pid=101893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:12:13.539749 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c7bbfd-b245-464e-804a-fef0ff4d7d4d service neutron] Validating token access rules against request {{(pid=101893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:12:13.543401 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG dbcounter [-] [101893] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=101893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:12:13.600069 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-384c5a6d-7c36-4e41-a2df-c70d69b477c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cec56f74b2fa4826a506dc7b919465be', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:12:13.600945 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384c5a6d-7c36-4e41-a2df-c70d69b477c7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:12:13.601246 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384c5a6d-7c36-4e41-a2df-c70d69b477c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:12:13.601508 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384c5a6d-7c36-4e41-a2df-c70d69b477c7 admin admin] PATH_INFO: `/v3/users/b8d0ae0de61e4b9fb62a18da8bfa91d0` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:12:13.602737 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-384c5a6d-7c36-4e41-a2df-c70d69b477c7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b8d0ae0de61e4b9fb62a18da8bfa91d0)` {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:12:13.604715 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-384c5a6d-7c36-4e41-a2df-c70d69b477c7 admin admin] RBAC: Authorization granted {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:12:13.763757 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.notifications [None req-384c5a6d-7c36-4e41-a2df-c70d69b477c7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b8d0ae0de61e4b9fb62a18da8bfa91d0'} {{(pid=101893) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:12:13.770590 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.notifications [None req-384c5a6d-7c36-4e41-a2df-c70d69b477c7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b8d0ae0de61e4b9fb62a18da8bfa91d0'} {{(pid=101893) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:12:13.783297 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.notifications [None req-384c5a6d-7c36-4e41-a2df-c70d69b477c7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b8d0ae0de61e4b9fb62a18da8bfa91d0'} {{(pid=101893) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:12:13.783985 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.notifications [None req-384c5a6d-7c36-4e41-a2df-c70d69b477c7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b8d0ae0de61e4b9fb62a18da8bfa91d0'} {{(pid=101893) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:12:13.784579 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.notifications [None req-384c5a6d-7c36-4e41-a2df-c70d69b477c7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b8d0ae0de61e4b9fb62a18da8bfa91d0'} {{(pid=101893) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:12:13.852651 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 1253/2482] 10.222.0.84 () {58 vars in 1223 bytes} [Wed May 25 15:12:13 2022] DELETE /identity/v3/users/b8d0ae0de61e4b9fb62a18da8bfa91d0 => generated 0 bytes in 323 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 15:12:14.311676 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae965c2-b171-4d62-9e39-51b59321acf6 admin admin] Authenticating user token {{(pid=101892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:12:14.311676 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.fernet_utils [None req-aae965c2-b171-4d62-9e39-51b59321acf6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=101892) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:12:14.323205 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae965c2-b171-4d62-9e39-51b59321acf6 admin admin] Validating token access rules against request {{(pid=101892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:12:14.383316 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a552dfb7-764c-4beb-9184-56b7945cf38d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cec56f74b2fa4826a506dc7b919465be', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:12:14.384574 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a552dfb7-764c-4beb-9184-56b7945cf38d admin admin] REQUEST_METHOD: `DELETE` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:12:14.384920 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a552dfb7-764c-4beb-9184-56b7945cf38d admin admin] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:12:14.386038 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a552dfb7-764c-4beb-9184-56b7945cf38d admin admin] PATH_INFO: `/v3/projects/00a146d2594649aea6058f2fe99e4de0` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:12:14.386723 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a552dfb7-764c-4beb-9184-56b7945cf38d admin admin] RBAC: Authorizing `identity:delete_project(project_id=00a146d2594649aea6058f2fe99e4de0)` {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:12:14.388764 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a552dfb7-764c-4beb-9184-56b7945cf38d admin admin] RBAC: Authorization granted {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:12:14.497957 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG dbcounter [-] [101892] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=101892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:12:14.512887 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.notifications [None req-a552dfb7-764c-4beb-9184-56b7945cf38d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '00a146d2594649aea6058f2fe99e4de0', 'request_id': 'req-a552dfb7-764c-4beb-9184-56b7945cf38d'} {{(pid=101892) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:12:14.519124 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.notifications [None req-a552dfb7-764c-4beb-9184-56b7945cf38d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '00a146d2594649aea6058f2fe99e4de0', 'request_id': 'req-a552dfb7-764c-4beb-9184-56b7945cf38d'} {{(pid=101892) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:12:14.524580 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.notifications [None req-a552dfb7-764c-4beb-9184-56b7945cf38d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '00a146d2594649aea6058f2fe99e4de0', 'request_id': 'req-a552dfb7-764c-4beb-9184-56b7945cf38d'} {{(pid=101892) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:12:14.597724 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.notifications [None req-a552dfb7-764c-4beb-9184-56b7945cf38d admin admin] The token cache is being invalidate because project 00a146d2594649aea6058f2fe99e4de0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=101892) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 25 15:12:14.598025 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.notifications [None req-a552dfb7-764c-4beb-9184-56b7945cf38d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=101892) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:12:14.598684 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.notifications [None req-a552dfb7-764c-4beb-9184-56b7945cf38d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=101892) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:12:14.600366 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 1230/2483] 10.222.0.84 () {58 vars in 1232 bytes} [Wed May 25 15:12:14 2022] DELETE /identity/v3/projects/00a146d2594649aea6058f2fe99e4de0 => generated 0 bytes in 294 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 15:12:14.605364 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef197f3c-f21f-40a1-a993-f240c06bbf1a None None] REQUEST_METHOD: `POST` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:12:14.606344 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef197f3c-f21f-40a1-a993-f240c06bbf1a None None] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:12:14.606479 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef197f3c-f21f-40a1-a993-f240c06bbf1a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:12:14.624871 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.auth.core [None req-ef197f3c-f21f-40a1-a993-f240c06bbf1a None None] MFA Rules not processed for user `05d87e87798e429aa1c10b24391f915e`. Rule list: `[]` (Enabled: `True`). {{(pid=101893) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:12:14.626067 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.fernet_utils [None req-ef197f3c-f21f-40a1-a993-f240c06bbf1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=101893) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:12:14.685589 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 1254/2484] 10.222.0.84 () {58 vars in 957 bytes} [Wed May 25 15:12:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 15:12:14.693563 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2131c581-6e6e-4f00-b37f-8a8fd900f925 None None] REQUEST_METHOD: `POST` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:12:14.693859 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2131c581-6e6e-4f00-b37f-8a8fd900f925 None None] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:12:14.694145 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2131c581-6e6e-4f00-b37f-8a8fd900f925 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:12:14.712481 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.auth.core [None req-2131c581-6e6e-4f00-b37f-8a8fd900f925 None None] MFA Rules not processed for user `05d87e87798e429aa1c10b24391f915e`. Rule list: `[]` (Enabled: `True`). {{(pid=101892) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:12:14.713682 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.fernet_utils [None req-2131c581-6e6e-4f00-b37f-8a8fd900f925 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=101892) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:12:14.722298 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 1231/2485] 10.222.0.84 () {58 vars in 957 bytes} [Wed May 25 15:12:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 15:12:14.726561 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef197f3c-f21f-40a1-a993-f240c06bbf1a None None] Authenticating user token {{(pid=101893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:12:14.736848 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef197f3c-f21f-40a1-a993-f240c06bbf1a None None] Validating token access rules against request {{(pid=101893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:12:14.741588 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbfc36f2-f707-456a-b145-727abe8ed800 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cec56f74b2fa4826a506dc7b919465be', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:12:14.742240 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbfc36f2-f707-456a-b145-727abe8ed800 admin admin] REQUEST_METHOD: `GET` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:12:14.742523 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbfc36f2-f707-456a-b145-727abe8ed800 admin admin] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:12:14.742800 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbfc36f2-f707-456a-b145-727abe8ed800 admin admin] PATH_INFO: `/v3/domains` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:12:14.743551 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbfc36f2-f707-456a-b145-727abe8ed800 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=101893) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 15:12:14.743881 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbfc36f2-f707-456a-b145-727abe8ed800 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:12:14.745479 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbfc36f2-f707-456a-b145-727abe8ed800 admin admin] RBAC: Authorization granted {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:12:14.756855 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 1255/2486] 10.222.0.84 () {58 vars in 1152 bytes} [Wed May 25 15:12:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 15:12:14.761023 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2131c581-6e6e-4f00-b37f-8a8fd900f925 None None] Authenticating user token {{(pid=101892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:12:14.770353 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2131c581-6e6e-4f00-b37f-8a8fd900f925 None None] Validating token access rules against request {{(pid=101892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:12:14.775254 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae8ce85-e040-4afe-9e07-94b52b16ec40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cec56f74b2fa4826a506dc7b919465be', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:12:14.775937 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae8ce85-e040-4afe-9e07-94b52b16ec40 admin admin] REQUEST_METHOD: `POST` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:12:14.776221 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae8ce85-e040-4afe-9e07-94b52b16ec40 admin admin] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:12:14.776495 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae8ce85-e040-4afe-9e07-94b52b16ec40 admin admin] PATH_INFO: `/v3/projects` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:12:14.777186 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ae8ce85-e040-4afe-9e07-94b52b16ec40 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:12:14.779729 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ae8ce85-e040-4afe-9e07-94b52b16ec40 admin admin] RBAC: Authorization granted {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:12:14.851306 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 1232/2487] 10.222.0.84 () {60 vars in 1152 bytes} [Wed May 25 15:12:14 2022] POST /identity/v3/projects => generated 379 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 25 15:12:14.858365 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbfc36f2-f707-456a-b145-727abe8ed800 admin admin] Authenticating user token {{(pid=101893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:12:14.868825 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbfc36f2-f707-456a-b145-727abe8ed800 admin admin] Validating token access rules against request {{(pid=101893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:12:14.878152 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG dbcounter [-] [101893] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=101893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:12:14.929315 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6972e7b-3e21-47bf-babc-b40eadf9175c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cec56f74b2fa4826a506dc7b919465be', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:12:14.929998 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6972e7b-3e21-47bf-babc-b40eadf9175c admin admin] REQUEST_METHOD: `POST` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:12:14.930282 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6972e7b-3e21-47bf-babc-b40eadf9175c admin admin] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:12:14.930563 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6972e7b-3e21-47bf-babc-b40eadf9175c admin admin] PATH_INFO: `/v3/users` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:12:14.931274 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6972e7b-3e21-47bf-babc-b40eadf9175c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:12:14.933261 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6972e7b-3e21-47bf-babc-b40eadf9175c admin admin] RBAC: Authorization granted {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:12:15.005875 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 1256/2488] 10.222.0.84 () {60 vars in 1143 bytes} [Wed May 25 15:12:14 2022] POST /identity/v3/users => generated 290 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 15:12:15.009991 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae8ce85-e040-4afe-9e07-94b52b16ec40 admin admin] Authenticating user token {{(pid=101892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:12:15.034179 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae8ce85-e040-4afe-9e07-94b52b16ec40 admin admin] Validating token access rules against request {{(pid=101892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:12:15.038962 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17f09a53-b244-4b83-93f6-5e0f03ed982c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cec56f74b2fa4826a506dc7b919465be', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:12:15.039657 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f09a53-b244-4b83-93f6-5e0f03ed982c admin admin] REQUEST_METHOD: `GET` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:12:15.039944 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f09a53-b244-4b83-93f6-5e0f03ed982c admin admin] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:12:15.040224 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f09a53-b244-4b83-93f6-5e0f03ed982c admin admin] PATH_INFO: `/v3/roles` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:12:15.040952 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17f09a53-b244-4b83-93f6-5e0f03ed982c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:12:15.042548 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17f09a53-b244-4b83-93f6-5e0f03ed982c admin admin] RBAC: Authorization granted {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:12:15.052713 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 1233/2489] 10.222.0.84 () {58 vars in 1121 bytes} [Wed May 25 15:12:15 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 15:12:15.056817 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6972e7b-3e21-47bf-babc-b40eadf9175c admin admin] Authenticating user token {{(pid=101893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:12:15.067134 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6972e7b-3e21-47bf-babc-b40eadf9175c admin admin] Validating token access rules against request {{(pid=101893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:12:15.072127 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-546a58d3-3bcf-4901-8dc6-720381e04b8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cec56f74b2fa4826a506dc7b919465be', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:12:15.072791 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546a58d3-3bcf-4901-8dc6-720381e04b8c admin admin] REQUEST_METHOD: `GET` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:12:15.073076 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546a58d3-3bcf-4901-8dc6-720381e04b8c admin admin] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:12:15.073354 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546a58d3-3bcf-4901-8dc6-720381e04b8c admin admin] PATH_INFO: `/v3/roles` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:12:15.074080 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-546a58d3-3bcf-4901-8dc6-720381e04b8c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:12:15.076389 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-546a58d3-3bcf-4901-8dc6-720381e04b8c admin admin] RBAC: Authorization granted {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:12:15.086525 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 1257/2490] 10.222.0.84 () {58 vars in 1121 bytes} [Wed May 25 15:12:15 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 15:12:15.091394 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17f09a53-b244-4b83-93f6-5e0f03ed982c admin admin] Authenticating user token {{(pid=101892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:12:15.101648 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17f09a53-b244-4b83-93f6-5e0f03ed982c admin admin] Validating token access rules against request {{(pid=101892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:12:15.106690 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1b27747-81a4-47d1-83f3-3a397fc79608 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cec56f74b2fa4826a506dc7b919465be', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:12:15.107580 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b27747-81a4-47d1-83f3-3a397fc79608 admin admin] REQUEST_METHOD: `PUT` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:12:15.107862 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b27747-81a4-47d1-83f3-3a397fc79608 admin admin] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:12:15.108338 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b27747-81a4-47d1-83f3-3a397fc79608 admin admin] PATH_INFO: `/v3/projects/135a7e3716994861b8558c483364a9db/users/b40a146671fc4107a2def6f6e0317140/roles/ff664fa0db7e4262a5accde96c3df4c3` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:12:15.124866 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1b27747-81a4-47d1-83f3-3a397fc79608 admin admin] RBAC: Authorizing `identity:create_grant(project_id=135a7e3716994861b8558c483364a9db, user_id=b40a146671fc4107a2def6f6e0317140, role_id=ff664fa0db7e4262a5accde96c3df4c3)` {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:12:15.128015 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1b27747-81a4-47d1-83f3-3a397fc79608 admin admin] RBAC: Authorization granted {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:12:15.203755 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 1234/2491] 10.222.0.84 () {60 vars in 1482 bytes} [Wed May 25 15:12:15 2022] PUT /identity/v3/projects/135a7e3716994861b8558c483364a9db/users/b40a146671fc4107a2def6f6e0317140/roles/ff664fa0db7e4262a5accde96c3df4c3 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 15:12:15.215057 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839e9197-0f5c-415a-97f7-0df69839c057 None None] REQUEST_METHOD: `POST` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:12:15.215374 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839e9197-0f5c-415a-97f7-0df69839c057 None None] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:12:15.215691 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839e9197-0f5c-415a-97f7-0df69839c057 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:12:15.242179 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.auth.core [None req-839e9197-0f5c-415a-97f7-0df69839c057 None None] MFA Rules not processed for user `b40a146671fc4107a2def6f6e0317140`. Rule list: `[]` (Enabled: `True`). {{(pid=101893) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:12:15.243342 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.fernet_utils [None req-839e9197-0f5c-415a-97f7-0df69839c057 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=101893) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:12:15.306810 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 1258/2492] 10.222.0.84 () {58 vars in 957 bytes} [Wed May 25 15:12:15 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 15:12:15.312191 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1b27747-81a4-47d1-83f3-3a397fc79608 admin admin] Authenticating user token {{(pid=101892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:12:15.374058 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1b27747-81a4-47d1-83f3-3a397fc79608 admin admin] Validating token access rules against request {{(pid=101892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:12:15.378802 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bc0ee29-c413-4770-9f37-cd45633a0750 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cec56f74b2fa4826a506dc7b919465be', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:12:15.379443 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc0ee29-c413-4770-9f37-cd45633a0750 admin admin] REQUEST_METHOD: `POST` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:12:15.379756 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc0ee29-c413-4770-9f37-cd45633a0750 admin admin] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:12:15.380038 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc0ee29-c413-4770-9f37-cd45633a0750 admin admin] PATH_INFO: `/v3/projects` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:12:15.380729 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bc0ee29-c413-4770-9f37-cd45633a0750 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:12:15.382640 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bc0ee29-c413-4770-9f37-cd45633a0750 admin admin] RBAC: Authorization granted {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:12:15.502226 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 1235/2493] 10.222.0.84 () {60 vars in 1152 bytes} [Wed May 25 15:12:15 2022] POST /identity/v3/projects => generated 383 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 25 15:12:15.506476 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-839e9197-0f5c-415a-97f7-0df69839c057 None None] Authenticating user token {{(pid=101893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:12:15.517827 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-839e9197-0f5c-415a-97f7-0df69839c057 None None] Validating token access rules against request {{(pid=101893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:12:15.573827 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14e41bf3-ab8c-4de5-ab19-8e2c4447eaf8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cec56f74b2fa4826a506dc7b919465be', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:12:15.574493 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e41bf3-ab8c-4de5-ab19-8e2c4447eaf8 admin admin] REQUEST_METHOD: `POST` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:12:15.575415 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e41bf3-ab8c-4de5-ab19-8e2c4447eaf8 admin admin] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:12:15.575790 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e41bf3-ab8c-4de5-ab19-8e2c4447eaf8 admin admin] PATH_INFO: `/v3/users` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:12:15.576493 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14e41bf3-ab8c-4de5-ab19-8e2c4447eaf8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:12:15.578397 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14e41bf3-ab8c-4de5-ab19-8e2c4447eaf8 admin admin] RBAC: Authorization granted {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:12:15.677592 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 1259/2494] 10.222.0.84 () {60 vars in 1143 bytes} [Wed May 25 15:12:15 2022] POST /identity/v3/users => generated 298 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 25 15:12:15.681450 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bc0ee29-c413-4770-9f37-cd45633a0750 admin admin] Authenticating user token {{(pid=101892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:12:15.692502 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bc0ee29-c413-4770-9f37-cd45633a0750 admin admin] Validating token access rules against request {{(pid=101892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:12:15.697084 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-292b9672-d2bc-4945-9840-787237bb942e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cec56f74b2fa4826a506dc7b919465be', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:12:15.697739 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292b9672-d2bc-4945-9840-787237bb942e admin admin] REQUEST_METHOD: `GET` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:12:15.698025 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292b9672-d2bc-4945-9840-787237bb942e admin admin] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:12:15.698328 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292b9672-d2bc-4945-9840-787237bb942e admin admin] PATH_INFO: `/v3/roles` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:12:15.699055 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-292b9672-d2bc-4945-9840-787237bb942e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:12:15.701349 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-292b9672-d2bc-4945-9840-787237bb942e admin admin] RBAC: Authorization granted {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:12:15.711792 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 1236/2495] 10.222.0.84 () {58 vars in 1121 bytes} [Wed May 25 15:12:15 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 15:12:15.715830 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14e41bf3-ab8c-4de5-ab19-8e2c4447eaf8 admin admin] Authenticating user token {{(pid=101893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:12:15.725768 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14e41bf3-ab8c-4de5-ab19-8e2c4447eaf8 admin admin] Validating token access rules against request {{(pid=101893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:12:15.730381 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4180ff51-f5b5-4695-9852-9d46ea7ddf59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cec56f74b2fa4826a506dc7b919465be', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:12:15.731794 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4180ff51-f5b5-4695-9852-9d46ea7ddf59 admin admin] REQUEST_METHOD: `PUT` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:12:15.732079 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4180ff51-f5b5-4695-9852-9d46ea7ddf59 admin admin] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:12:15.732356 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4180ff51-f5b5-4695-9852-9d46ea7ddf59 admin admin] PATH_INFO: `/v3/projects/2b14f105cb234135a00bdea4ce269cba/users/be5fd646922040cb8ef46afb39b632b2/roles/a3b78e7d547d4d2d998b4c99a4396bba` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:12:15.740697 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG dbcounter [-] [101893] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=101893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:12:15.747779 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4180ff51-f5b5-4695-9852-9d46ea7ddf59 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2b14f105cb234135a00bdea4ce269cba, user_id=be5fd646922040cb8ef46afb39b632b2, role_id=a3b78e7d547d4d2d998b4c99a4396bba)` {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:12:15.750464 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4180ff51-f5b5-4695-9852-9d46ea7ddf59 admin admin] RBAC: Authorization granted {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:12:15.814792 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 1260/2496] 10.222.0.84 () {60 vars in 1482 bytes} [Wed May 25 15:12:15 2022] PUT /identity/v3/projects/2b14f105cb234135a00bdea4ce269cba/users/be5fd646922040cb8ef46afb39b632b2/roles/a3b78e7d547d4d2d998b4c99a4396bba => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 15:12:15.818996 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-292b9672-d2bc-4945-9840-787237bb942e admin admin] Authenticating user token {{(pid=101892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:12:15.829426 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-292b9672-d2bc-4945-9840-787237bb942e admin admin] Validating token access rules against request {{(pid=101892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:12:15.853764 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG dbcounter [-] [101892] Writing DB stats keystone:SELECT=91,keystone:DELETE=5,keystone:INSERT=4 {{(pid=101892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:12:15.889351 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fde6a40d-d5a8-41cf-acb1-b3c367f1b87b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cec56f74b2fa4826a506dc7b919465be', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:12:15.890039 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde6a40d-d5a8-41cf-acb1-b3c367f1b87b admin admin] REQUEST_METHOD: `GET` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:12:15.898273 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde6a40d-d5a8-41cf-acb1-b3c367f1b87b admin admin] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:12:15.898628 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde6a40d-d5a8-41cf-acb1-b3c367f1b87b admin admin] PATH_INFO: `/v3/roles` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:12:15.899402 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fde6a40d-d5a8-41cf-acb1-b3c367f1b87b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:12:15.901068 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fde6a40d-d5a8-41cf-acb1-b3c367f1b87b admin admin] RBAC: Authorization granted {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:12:15.912451 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 1237/2497] 10.222.0.84 () {58 vars in 1121 bytes} [Wed May 25 15:12:15 2022] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 15:12:15.916736 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4180ff51-f5b5-4695-9852-9d46ea7ddf59 admin admin] Authenticating user token {{(pid=101893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:12:15.927315 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4180ff51-f5b5-4695-9852-9d46ea7ddf59 admin admin] Validating token access rules against request {{(pid=101893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:12:15.932062 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5d1073b-824e-457a-8e94-0e0be323b7b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cec56f74b2fa4826a506dc7b919465be', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:12:15.932918 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d1073b-824e-457a-8e94-0e0be323b7b5 admin admin] REQUEST_METHOD: `PUT` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:12:15.933193 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d1073b-824e-457a-8e94-0e0be323b7b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:12:15.933464 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d1073b-824e-457a-8e94-0e0be323b7b5 admin admin] PATH_INFO: `/v3/projects/2b14f105cb234135a00bdea4ce269cba/users/be5fd646922040cb8ef46afb39b632b2/roles/a3b78e7d547d4d2d998b4c99a4396bba` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:12:15.935554 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5d1073b-824e-457a-8e94-0e0be323b7b5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2b14f105cb234135a00bdea4ce269cba, user_id=be5fd646922040cb8ef46afb39b632b2, role_id=a3b78e7d547d4d2d998b4c99a4396bba)` {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:12:15.938389 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5d1073b-824e-457a-8e94-0e0be323b7b5 admin admin] RBAC: Authorization granted {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:12:15.948995 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 1261/2498] 10.222.0.84 () {60 vars in 1482 bytes} [Wed May 25 15:12:15 2022] PUT /identity/v3/projects/2b14f105cb234135a00bdea4ce269cba/users/be5fd646922040cb8ef46afb39b632b2/roles/a3b78e7d547d4d2d998b4c99a4396bba => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 15:12:15.959613 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40607393-08a3-4668-bec7-dbe5054389c9 None None] REQUEST_METHOD: `POST` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:12:15.959911 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40607393-08a3-4668-bec7-dbe5054389c9 None None] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:12:15.960195 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40607393-08a3-4668-bec7-dbe5054389c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:12:15.987475 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.auth.core [None req-40607393-08a3-4668-bec7-dbe5054389c9 None None] MFA Rules not processed for user `be5fd646922040cb8ef46afb39b632b2`. Rule list: `[]` (Enabled: `True`). {{(pid=101892) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:12:15.988789 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.fernet_utils [None req-40607393-08a3-4668-bec7-dbe5054389c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=101892) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:12:16.058362 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 1238/2499] 10.222.0.84 () {58 vars in 957 bytes} [Wed May 25 15:12:15 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 15:12:16.069419 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5d1073b-824e-457a-8e94-0e0be323b7b5 admin admin] Authenticating user token {{(pid=101893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:12:16.071090 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.fernet_utils [None req-b5d1073b-824e-457a-8e94-0e0be323b7b5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=101893) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:12:16.129100 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5d1073b-824e-457a-8e94-0e0be323b7b5 admin admin] Validating token access rules against request {{(pid=101893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:12:16.132963 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db65feae-12a1-450c-ac9f-a31903821aa5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e079f89a5e524ab6ad4183e4f690de07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a000829c658c4a7cab67f7b6353ba3fa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:12:16.133612 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db65feae-12a1-450c-ac9f-a31903821aa5 service cinder] REQUEST_METHOD: `GET` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:12:16.133898 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db65feae-12a1-450c-ac9f-a31903821aa5 service cinder] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:12:16.134203 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db65feae-12a1-450c-ac9f-a31903821aa5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:12:16.144272 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db65feae-12a1-450c-ac9f-a31903821aa5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:12:16.145720 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db65feae-12a1-450c-ac9f-a31903821aa5 service cinder] RBAC: Authorization granted {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:12:16.155256 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 1262/2500] 10.222.0.84 () {60 vars in 1365 bytes} [Wed May 25 15:12:16 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 15:12:16.251881 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40607393-08a3-4668-bec7-dbe5054389c9 None None] Authenticating user token {{(pid=101892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:12:16.261571 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40607393-08a3-4668-bec7-dbe5054389c9 None None] Validating token access rules against request {{(pid=101892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:12:16.265910 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-696cb42a-55ee-4bd1-acd0-f6592a115d84 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e079f89a5e524ab6ad4183e4f690de07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a000829c658c4a7cab67f7b6353ba3fa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:12:16.266560 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696cb42a-55ee-4bd1-acd0-f6592a115d84 service cinder] REQUEST_METHOD: `GET` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:12:16.266860 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696cb42a-55ee-4bd1-acd0-f6592a115d84 service cinder] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:12:16.267133 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696cb42a-55ee-4bd1-acd0-f6592a115d84 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:12:16.324505 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-696cb42a-55ee-4bd1-acd0-f6592a115d84 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:12:16.331520 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-696cb42a-55ee-4bd1-acd0-f6592a115d84 service cinder] RBAC: Authorization granted {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:12:16.335462 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 1239/2501] 10.222.0.84 () {60 vars in 1365 bytes} [Wed May 25 15:12:16 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 15:12:19.361975 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db65feae-12a1-450c-ac9f-a31903821aa5 service cinder] Authenticating user token {{(pid=101893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:12:19.423922 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db65feae-12a1-450c-ac9f-a31903821aa5 service cinder] Validating token access rules against request {{(pid=101893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:12:19.428392 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc63db44-0155-4e7d-964a-c69b3094e0b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cec56f74b2fa4826a506dc7b919465be', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:12:19.429251 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc63db44-0155-4e7d-964a-c69b3094e0b8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:12:19.429526 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc63db44-0155-4e7d-964a-c69b3094e0b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:12:19.429795 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc63db44-0155-4e7d-964a-c69b3094e0b8 admin admin] PATH_INFO: `/v3/users/b40a146671fc4107a2def6f6e0317140` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:12:19.430958 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc63db44-0155-4e7d-964a-c69b3094e0b8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b40a146671fc4107a2def6f6e0317140)` {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:12:19.432913 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc63db44-0155-4e7d-964a-c69b3094e0b8 admin admin] RBAC: Authorization granted {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:12:19.617372 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.notifications [None req-fc63db44-0155-4e7d-964a-c69b3094e0b8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b40a146671fc4107a2def6f6e0317140'} {{(pid=101893) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:12:19.617372 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.notifications [None req-fc63db44-0155-4e7d-964a-c69b3094e0b8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b40a146671fc4107a2def6f6e0317140'} {{(pid=101893) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:12:19.628499 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.notifications [None req-fc63db44-0155-4e7d-964a-c69b3094e0b8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b40a146671fc4107a2def6f6e0317140'} {{(pid=101893) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:12:19.629300 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.notifications [None req-fc63db44-0155-4e7d-964a-c69b3094e0b8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b40a146671fc4107a2def6f6e0317140'} {{(pid=101893) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:12:19.629792 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.notifications [None req-fc63db44-0155-4e7d-964a-c69b3094e0b8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b40a146671fc4107a2def6f6e0317140'} {{(pid=101893) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:12:19.633470 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG dbcounter [-] [101893] Writing DB stats keystone:SELECT=87,keystone:INSERT=3,keystone:DELETE=10 {{(pid=101893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:12:19.706363 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 1263/2502] 10.222.0.84 () {58 vars in 1223 bytes} [Wed May 25 15:12:19 2022] DELETE /identity/v3/users/b40a146671fc4107a2def6f6e0317140 => generated 0 bytes in 345 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 15:12:19.711183 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84a0df8-e57c-4da9-b7c1-92547a2959b1 None None] REQUEST_METHOD: `POST` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:12:19.711741 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84a0df8-e57c-4da9-b7c1-92547a2959b1 None None] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:12:19.711852 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84a0df8-e57c-4da9-b7c1-92547a2959b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:12:19.729204 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.auth.core [None req-f84a0df8-e57c-4da9-b7c1-92547a2959b1 None None] MFA Rules not processed for user `05d87e87798e429aa1c10b24391f915e`. Rule list: `[]` (Enabled: `True`). {{(pid=101892) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:12:19.730382 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.fernet_utils [None req-f84a0df8-e57c-4da9-b7c1-92547a2959b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=101892) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:12:19.771048 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG dbcounter [-] [101892] Writing DB stats keystone:SELECT=100 {{(pid=101892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:12:19.788435 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 1240/2503] 10.222.0.84 () {58 vars in 957 bytes} [Wed May 25 15:12:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 25 15:12:19.798500 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc63db44-0155-4e7d-964a-c69b3094e0b8 admin admin] Authenticating user token {{(pid=101893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:12:19.800011 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.fernet_utils [None req-fc63db44-0155-4e7d-964a-c69b3094e0b8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=101893) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:12:19.856943 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc63db44-0155-4e7d-964a-c69b3094e0b8 admin admin] Validating token access rules against request {{(pid=101893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:12:19.860677 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-821a87c1-b3d8-41d4-9540-4aab473a74a0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ce28b25b907473588ccb87dc4acc06a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a000829c658c4a7cab67f7b6353ba3fa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:12:19.861338 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821a87c1-b3d8-41d4-9540-4aab473a74a0 service neutron] REQUEST_METHOD: `GET` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:12:19.865659 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821a87c1-b3d8-41d4-9540-4aab473a74a0 service neutron] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:12:19.865659 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821a87c1-b3d8-41d4-9540-4aab473a74a0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:12:19.873643 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-821a87c1-b3d8-41d4-9540-4aab473a74a0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:12:19.876696 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-821a87c1-b3d8-41d4-9540-4aab473a74a0 service neutron] RBAC: Authorization granted {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:12:19.887992 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 1264/2504] 10.222.0.84 () {60 vars in 1365 bytes} [Wed May 25 15:12:19 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 15:12:20.344876 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f84a0df8-e57c-4da9-b7c1-92547a2959b1 None None] Authenticating user token {{(pid=101892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:12:20.346312 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.fernet_utils [None req-f84a0df8-e57c-4da9-b7c1-92547a2959b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=101892) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:12:20.359041 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f84a0df8-e57c-4da9-b7c1-92547a2959b1 None None] Validating token access rules against request {{(pid=101892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:12:20.363818 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df9b785d-3ce5-45e7-b7ee-b20fea87a151 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cec56f74b2fa4826a506dc7b919465be', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:12:20.364759 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9b785d-3ce5-45e7-b7ee-b20fea87a151 admin admin] REQUEST_METHOD: `DELETE` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:12:20.365111 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9b785d-3ce5-45e7-b7ee-b20fea87a151 admin admin] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:12:20.365388 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9b785d-3ce5-45e7-b7ee-b20fea87a151 admin admin] PATH_INFO: `/v3/projects/135a7e3716994861b8558c483364a9db` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:12:20.366571 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df9b785d-3ce5-45e7-b7ee-b20fea87a151 admin admin] RBAC: Authorizing `identity:delete_project(project_id=135a7e3716994861b8558c483364a9db)` {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:12:20.368529 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df9b785d-3ce5-45e7-b7ee-b20fea87a151 admin admin] RBAC: Authorization granted {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:12:20.506417 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.notifications [None req-df9b785d-3ce5-45e7-b7ee-b20fea87a151 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '135a7e3716994861b8558c483364a9db', 'request_id': 'req-df9b785d-3ce5-45e7-b7ee-b20fea87a151'} {{(pid=101892) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:12:20.512669 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.notifications [None req-df9b785d-3ce5-45e7-b7ee-b20fea87a151 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '135a7e3716994861b8558c483364a9db', 'request_id': 'req-df9b785d-3ce5-45e7-b7ee-b20fea87a151'} {{(pid=101892) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:12:20.518180 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.notifications [None req-df9b785d-3ce5-45e7-b7ee-b20fea87a151 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '135a7e3716994861b8558c483364a9db', 'request_id': 'req-df9b785d-3ce5-45e7-b7ee-b20fea87a151'} {{(pid=101892) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:12:20.585339 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.notifications [None req-df9b785d-3ce5-45e7-b7ee-b20fea87a151 admin admin] The token cache is being invalidate because project 135a7e3716994861b8558c483364a9db was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=101892) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 25 15:12:20.585628 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.notifications [None req-df9b785d-3ce5-45e7-b7ee-b20fea87a151 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=101892) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:12:20.586241 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.notifications [None req-df9b785d-3ce5-45e7-b7ee-b20fea87a151 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=101892) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:12:20.587819 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 1241/2505] 10.222.0.84 () {58 vars in 1232 bytes} [Wed May 25 15:12:20 2022] DELETE /identity/v3/projects/135a7e3716994861b8558c483364a9db => generated 0 bytes in 244 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 15:12:20.591758 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-821a87c1-b3d8-41d4-9540-4aab473a74a0 service neutron] Authenticating user token {{(pid=101893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:12:20.601697 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-821a87c1-b3d8-41d4-9540-4aab473a74a0 service neutron] Validating token access rules against request {{(pid=101893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:12:20.659167 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d979902-95ff-4dae-a795-1bd9fb82e9ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cec56f74b2fa4826a506dc7b919465be', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:12:20.659998 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d979902-95ff-4dae-a795-1bd9fb82e9ea admin admin] REQUEST_METHOD: `DELETE` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:12:20.660307 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d979902-95ff-4dae-a795-1bd9fb82e9ea admin admin] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:12:20.660583 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d979902-95ff-4dae-a795-1bd9fb82e9ea admin admin] PATH_INFO: `/v3/users/be5fd646922040cb8ef46afb39b632b2` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:12:20.661755 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d979902-95ff-4dae-a795-1bd9fb82e9ea admin admin] RBAC: Authorizing `identity:delete_user(user_id=be5fd646922040cb8ef46afb39b632b2)` {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:12:20.663693 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d979902-95ff-4dae-a795-1bd9fb82e9ea admin admin] RBAC: Authorization granted {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:12:20.850790 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.notifications [None req-3d979902-95ff-4dae-a795-1bd9fb82e9ea admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'be5fd646922040cb8ef46afb39b632b2'} {{(pid=101893) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:12:20.858491 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.notifications [None req-3d979902-95ff-4dae-a795-1bd9fb82e9ea admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'be5fd646922040cb8ef46afb39b632b2'} {{(pid=101893) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:12:20.870310 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.notifications [None req-3d979902-95ff-4dae-a795-1bd9fb82e9ea admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'be5fd646922040cb8ef46afb39b632b2'} {{(pid=101893) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:12:20.870991 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.notifications [None req-3d979902-95ff-4dae-a795-1bd9fb82e9ea admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'be5fd646922040cb8ef46afb39b632b2'} {{(pid=101893) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:12:20.871633 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.notifications [None req-3d979902-95ff-4dae-a795-1bd9fb82e9ea admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'be5fd646922040cb8ef46afb39b632b2'} {{(pid=101893) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:12:20.943410 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 1265/2506] 10.222.0.84 () {58 vars in 1223 bytes} [Wed May 25 15:12:20 2022] DELETE /identity/v3/users/be5fd646922040cb8ef46afb39b632b2 => generated 0 bytes in 352 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 15:12:21.370310 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df9b785d-3ce5-45e7-b7ee-b20fea87a151 admin admin] Authenticating user token {{(pid=101892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:12:21.372410 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.fernet_utils [None req-df9b785d-3ce5-45e7-b7ee-b20fea87a151 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=101892) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:12:21.388317 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df9b785d-3ce5-45e7-b7ee-b20fea87a151 admin admin] Validating token access rules against request {{(pid=101892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:12:21.446067 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16b8e200-79b8-40e7-ac4c-4272ac67ee0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cec56f74b2fa4826a506dc7b919465be', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:12:21.446929 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b8e200-79b8-40e7-ac4c-4272ac67ee0b admin admin] REQUEST_METHOD: `DELETE` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:12:21.447215 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b8e200-79b8-40e7-ac4c-4272ac67ee0b admin admin] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:12:21.447490 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b8e200-79b8-40e7-ac4c-4272ac67ee0b admin admin] PATH_INFO: `/v3/projects/2b14f105cb234135a00bdea4ce269cba` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:12:21.448784 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16b8e200-79b8-40e7-ac4c-4272ac67ee0b admin admin] RBAC: Authorizing `identity:delete_project(project_id=2b14f105cb234135a00bdea4ce269cba)` {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:12:21.451314 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16b8e200-79b8-40e7-ac4c-4272ac67ee0b admin admin] RBAC: Authorization granted {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:12:21.561315 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.notifications [None req-16b8e200-79b8-40e7-ac4c-4272ac67ee0b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2b14f105cb234135a00bdea4ce269cba', 'request_id': 'req-16b8e200-79b8-40e7-ac4c-4272ac67ee0b'} {{(pid=101892) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:12:21.567786 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.notifications [None req-16b8e200-79b8-40e7-ac4c-4272ac67ee0b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2b14f105cb234135a00bdea4ce269cba', 'request_id': 'req-16b8e200-79b8-40e7-ac4c-4272ac67ee0b'} {{(pid=101892) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:12:21.573248 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.notifications [None req-16b8e200-79b8-40e7-ac4c-4272ac67ee0b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2b14f105cb234135a00bdea4ce269cba', 'request_id': 'req-16b8e200-79b8-40e7-ac4c-4272ac67ee0b'} {{(pid=101892) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:12:21.642291 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG dbcounter [-] [101892] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=101892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:12:21.646104 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.notifications [None req-16b8e200-79b8-40e7-ac4c-4272ac67ee0b admin admin] The token cache is being invalidate because project 2b14f105cb234135a00bdea4ce269cba was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=101892) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 25 15:12:21.646394 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.notifications [None req-16b8e200-79b8-40e7-ac4c-4272ac67ee0b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=101892) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:12:21.647010 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.notifications [None req-16b8e200-79b8-40e7-ac4c-4272ac67ee0b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=101892) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:12:21.648574 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 1242/2507] 10.222.0.84 () {58 vars in 1232 bytes} [Wed May 25 15:12:21 2022] DELETE /identity/v3/projects/2b14f105cb234135a00bdea4ce269cba => generated 0 bytes in 279 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 25 15:12:21.653679 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f56f98-3120-4bbb-935f-c8e48dd13035 None None] REQUEST_METHOD: `POST` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:12:21.656103 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f56f98-3120-4bbb-935f-c8e48dd13035 None None] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:12:21.656103 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f56f98-3120-4bbb-935f-c8e48dd13035 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:12:21.672365 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.auth.core [None req-90f56f98-3120-4bbb-935f-c8e48dd13035 None None] MFA Rules not processed for user `05d87e87798e429aa1c10b24391f915e`. Rule list: `[]` (Enabled: `True`). {{(pid=101893) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:12:21.673564 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.fernet_utils [None req-90f56f98-3120-4bbb-935f-c8e48dd13035 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=101893) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:12:21.686257 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG dbcounter [-] [101893] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=101893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:12:21.734206 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 1266/2508] 10.222.0.84 () {58 vars in 957 bytes} [Wed May 25 15:12:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 15:12:21.742925 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a9de1d-94e1-47fb-a10d-c839156d6f6e None None] REQUEST_METHOD: `POST` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:12:21.743217 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a9de1d-94e1-47fb-a10d-c839156d6f6e None None] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:12:21.743516 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a9de1d-94e1-47fb-a10d-c839156d6f6e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:12:21.764006 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.auth.core [None req-03a9de1d-94e1-47fb-a10d-c839156d6f6e None None] MFA Rules not processed for user `05d87e87798e429aa1c10b24391f915e`. Rule list: `[]` (Enabled: `True`). {{(pid=101892) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:12:21.765220 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.fernet_utils [None req-03a9de1d-94e1-47fb-a10d-c839156d6f6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=101892) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:12:21.773149 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 1243/2509] 10.222.0.84 () {58 vars in 957 bytes} [Wed May 25 15:12:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 25 15:12:21.777370 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90f56f98-3120-4bbb-935f-c8e48dd13035 None None] Authenticating user token {{(pid=101893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:12:21.787863 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90f56f98-3120-4bbb-935f-c8e48dd13035 None None] Validating token access rules against request {{(pid=101893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:12:21.792490 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a028e66-79b6-4173-b2f1-de3ac7e8be1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cec56f74b2fa4826a506dc7b919465be', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:12:21.793646 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a028e66-79b6-4173-b2f1-de3ac7e8be1f admin admin] REQUEST_METHOD: `GET` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:12:21.793976 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a028e66-79b6-4173-b2f1-de3ac7e8be1f admin admin] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:12:21.794253 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a028e66-79b6-4173-b2f1-de3ac7e8be1f admin admin] PATH_INFO: `/v3/domains` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:12:21.794981 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a028e66-79b6-4173-b2f1-de3ac7e8be1f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=101893) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 15:12:21.795291 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a028e66-79b6-4173-b2f1-de3ac7e8be1f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:12:21.796951 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a028e66-79b6-4173-b2f1-de3ac7e8be1f admin admin] RBAC: Authorization granted {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:12:21.808824 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 1267/2510] 10.222.0.84 () {58 vars in 1152 bytes} [Wed May 25 15:12:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 15:12:21.815809 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03a9de1d-94e1-47fb-a10d-c839156d6f6e None None] Authenticating user token {{(pid=101892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:12:21.823201 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03a9de1d-94e1-47fb-a10d-c839156d6f6e None None] Validating token access rules against request {{(pid=101892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:12:21.827825 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cec785ca-5f30-432e-aec5-0e382caa0385 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cec56f74b2fa4826a506dc7b919465be', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:12:21.828481 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec785ca-5f30-432e-aec5-0e382caa0385 admin admin] REQUEST_METHOD: `POST` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:12:21.828761 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec785ca-5f30-432e-aec5-0e382caa0385 admin admin] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:12:21.829035 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec785ca-5f30-432e-aec5-0e382caa0385 admin admin] PATH_INFO: `/v3/projects` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:12:21.829734 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cec785ca-5f30-432e-aec5-0e382caa0385 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:12:21.831699 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cec785ca-5f30-432e-aec5-0e382caa0385 admin admin] RBAC: Authorization granted {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:12:21.907549 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 1244/2511] 10.222.0.84 () {60 vars in 1152 bytes} [Wed May 25 15:12:21 2022] POST /identity/v3/projects => generated 373 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 15:12:21.911389 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a028e66-79b6-4173-b2f1-de3ac7e8be1f admin admin] Authenticating user token {{(pid=101893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:12:21.922026 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a028e66-79b6-4173-b2f1-de3ac7e8be1f admin admin] Validating token access rules against request {{(pid=101893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:12:21.979091 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34b516ad-46e1-4aee-8899-b3a7b2697c43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cec56f74b2fa4826a506dc7b919465be', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:12:21.979803 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b516ad-46e1-4aee-8899-b3a7b2697c43 admin admin] REQUEST_METHOD: `POST` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:12:21.980095 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b516ad-46e1-4aee-8899-b3a7b2697c43 admin admin] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:12:21.980378 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b516ad-46e1-4aee-8899-b3a7b2697c43 admin admin] PATH_INFO: `/v3/users` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:12:21.981865 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34b516ad-46e1-4aee-8899-b3a7b2697c43 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:12:21.983869 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34b516ad-46e1-4aee-8899-b3a7b2697c43 admin admin] RBAC: Authorization granted {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:12:22.072115 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 1268/2512] 10.222.0.84 () {60 vars in 1143 bytes} [Wed May 25 15:12:21 2022] POST /identity/v3/users => generated 287 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 15:12:22.076082 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cec785ca-5f30-432e-aec5-0e382caa0385 admin admin] Authenticating user token {{(pid=101892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:12:22.088014 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cec785ca-5f30-432e-aec5-0e382caa0385 admin admin] Validating token access rules against request {{(pid=101892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:12:22.093141 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8338c3d8-fedd-4ac9-b35f-74e1b96b0e0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cec56f74b2fa4826a506dc7b919465be', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:12:22.093873 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8338c3d8-fedd-4ac9-b35f-74e1b96b0e0c admin admin] REQUEST_METHOD: `GET` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:12:22.094161 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8338c3d8-fedd-4ac9-b35f-74e1b96b0e0c admin admin] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:12:22.094443 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8338c3d8-fedd-4ac9-b35f-74e1b96b0e0c admin admin] PATH_INFO: `/v3/roles` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:12:22.095176 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8338c3d8-fedd-4ac9-b35f-74e1b96b0e0c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:12:22.096881 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8338c3d8-fedd-4ac9-b35f-74e1b96b0e0c admin admin] RBAC: Authorization granted {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:12:22.108366 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 1245/2513] 10.222.0.84 () {58 vars in 1121 bytes} [Wed May 25 15:12:22 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 15:12:22.112440 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34b516ad-46e1-4aee-8899-b3a7b2697c43 admin admin] Authenticating user token {{(pid=101893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:12:22.123372 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34b516ad-46e1-4aee-8899-b3a7b2697c43 admin admin] Validating token access rules against request {{(pid=101893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:12:22.128238 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0a4090b-a17f-4c3d-8ab3-1325f9b2003b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cec56f74b2fa4826a506dc7b919465be', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:12:22.128904 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a4090b-a17f-4c3d-8ab3-1325f9b2003b admin admin] REQUEST_METHOD: `GET` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:12:22.129222 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a4090b-a17f-4c3d-8ab3-1325f9b2003b admin admin] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:12:22.129501 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a4090b-a17f-4c3d-8ab3-1325f9b2003b admin admin] PATH_INFO: `/v3/roles` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:12:22.130226 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0a4090b-a17f-4c3d-8ab3-1325f9b2003b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:12:22.131870 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0a4090b-a17f-4c3d-8ab3-1325f9b2003b admin admin] RBAC: Authorization granted {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:12:22.142339 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 1269/2514] 10.222.0.84 () {58 vars in 1121 bytes} [Wed May 25 15:12:22 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 15:12:22.146518 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8338c3d8-fedd-4ac9-b35f-74e1b96b0e0c admin admin] Authenticating user token {{(pid=101892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:12:22.157017 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8338c3d8-fedd-4ac9-b35f-74e1b96b0e0c admin admin] Validating token access rules against request {{(pid=101892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:12:22.161685 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-975c12d0-bd8d-43b4-bd95-f776d3295f1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cec56f74b2fa4826a506dc7b919465be', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:12:22.162558 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975c12d0-bd8d-43b4-bd95-f776d3295f1c admin admin] REQUEST_METHOD: `PUT` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:12:22.162844 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975c12d0-bd8d-43b4-bd95-f776d3295f1c admin admin] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:12:22.163121 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975c12d0-bd8d-43b4-bd95-f776d3295f1c admin admin] PATH_INFO: `/v3/projects/de8087d12975444c9d50074b593f31ff/users/193c1207d2b34393b8b73f406eeebf06/roles/ff664fa0db7e4262a5accde96c3df4c3` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:12:22.179101 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-975c12d0-bd8d-43b4-bd95-f776d3295f1c admin admin] RBAC: Authorizing `identity:create_grant(project_id=de8087d12975444c9d50074b593f31ff, user_id=193c1207d2b34393b8b73f406eeebf06, role_id=ff664fa0db7e4262a5accde96c3df4c3)` {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:12:22.181860 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-975c12d0-bd8d-43b4-bd95-f776d3295f1c admin admin] RBAC: Authorization granted {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:12:22.282028 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 1246/2515] 10.222.0.84 () {60 vars in 1482 bytes} [Wed May 25 15:12:22 2022] PUT /identity/v3/projects/de8087d12975444c9d50074b593f31ff/users/193c1207d2b34393b8b73f406eeebf06/roles/ff664fa0db7e4262a5accde96c3df4c3 => generated 0 bytes in 136 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 15:12:22.292393 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eee239a-914d-421b-98c8-63acba0d146c None None] REQUEST_METHOD: `POST` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:12:22.296157 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eee239a-914d-421b-98c8-63acba0d146c None None] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:12:22.296157 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eee239a-914d-421b-98c8-63acba0d146c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:12:22.321329 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.auth.core [None req-4eee239a-914d-421b-98c8-63acba0d146c None None] MFA Rules not processed for user `193c1207d2b34393b8b73f406eeebf06`. Rule list: `[]` (Enabled: `True`). {{(pid=101893) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:12:22.322641 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.fernet_utils [None req-4eee239a-914d-421b-98c8-63acba0d146c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=101893) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:12:22.398609 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 1270/2516] 10.222.0.84 () {58 vars in 957 bytes} [Wed May 25 15:12:22 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 25 15:12:22.410380 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-975c12d0-bd8d-43b4-bd95-f776d3295f1c admin admin] Authenticating user token {{(pid=101892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:12:22.412291 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.fernet_utils [None req-975c12d0-bd8d-43b4-bd95-f776d3295f1c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=101892) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:12:22.485132 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-975c12d0-bd8d-43b4-bd95-f776d3295f1c admin admin] Validating token access rules against request {{(pid=101892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:12:22.491148 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c99150-a394-47fd-bf9a-6a4573458278 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e079f89a5e524ab6ad4183e4f690de07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a000829c658c4a7cab67f7b6353ba3fa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:12:22.492954 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c99150-a394-47fd-bf9a-6a4573458278 service cinder] REQUEST_METHOD: `GET` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:12:22.493399 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c99150-a394-47fd-bf9a-6a4573458278 service cinder] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:12:22.493694 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c99150-a394-47fd-bf9a-6a4573458278 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:12:22.504961 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54c99150-a394-47fd-bf9a-6a4573458278 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:12:22.506414 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54c99150-a394-47fd-bf9a-6a4573458278 service cinder] RBAC: Authorization granted {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:12:22.516863 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 1247/2517] 10.222.0.84 () {60 vars in 1365 bytes} [Wed May 25 15:12:22 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 15:12:24.299930 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04bfa149-0213-4820-a24e-042384c7e140 None None] REQUEST_METHOD: `POST` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:12:24.300439 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04bfa149-0213-4820-a24e-042384c7e140 None None] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:12:24.300539 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04bfa149-0213-4820-a24e-042384c7e140 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:12:24.318181 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.auth.core [None req-04bfa149-0213-4820-a24e-042384c7e140 None None] MFA Rules not processed for user `193c1207d2b34393b8b73f406eeebf06`. Rule list: `[]` (Enabled: `True`). {{(pid=101893) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:12:24.319450 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.fernet_utils [None req-04bfa149-0213-4820-a24e-042384c7e140 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=101893) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:12:24.327245 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 1271/2518] 10.222.0.84 () {58 vars in 957 bytes} [Wed May 25 15:12:24 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 15:12:29.608515 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c99150-a394-47fd-bf9a-6a4573458278 service cinder] Authenticating user token {{(pid=101892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:12:29.609963 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.fernet_utils [None req-54c99150-a394-47fd-bf9a-6a4573458278 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=101892) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:12:29.668243 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c99150-a394-47fd-bf9a-6a4573458278 service cinder] Validating token access rules against request {{(pid=101892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:12:29.672072 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-658e2dc8-36b5-40f9-abad-07d6f6e1c4db service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ce28b25b907473588ccb87dc4acc06a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a000829c658c4a7cab67f7b6353ba3fa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:12:29.672714 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658e2dc8-36b5-40f9-abad-07d6f6e1c4db service neutron] REQUEST_METHOD: `GET` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:12:29.672994 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658e2dc8-36b5-40f9-abad-07d6f6e1c4db service neutron] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:12:29.673268 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658e2dc8-36b5-40f9-abad-07d6f6e1c4db service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:12:29.675007 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.fernet_utils [None req-658e2dc8-36b5-40f9-abad-07d6f6e1c4db service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=101892) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:12:29.728910 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG dbcounter [-] [101892] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=101892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:12:29.744059 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-658e2dc8-36b5-40f9-abad-07d6f6e1c4db service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:12:29.746685 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-658e2dc8-36b5-40f9-abad-07d6f6e1c4db service neutron] RBAC: Authorization granted {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:12:29.756415 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 1248/2519] 10.222.0.84 () {60 vars in 1365 bytes} [Wed May 25 15:12:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 148 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 15:12:33.603157 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04bfa149-0213-4820-a24e-042384c7e140 None None] Authenticating user token {{(pid=101893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:12:33.611827 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.fernet_utils [None req-04bfa149-0213-4820-a24e-042384c7e140 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=101893) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:12:33.619747 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04bfa149-0213-4820-a24e-042384c7e140 None None] Validating token access rules against request {{(pid=101893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:12:33.625055 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd710d4-68f8-41d8-9f47-65b4af382e8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cec56f74b2fa4826a506dc7b919465be', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:12:33.625935 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd710d4-68f8-41d8-9f47-65b4af382e8c admin admin] REQUEST_METHOD: `DELETE` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:12:33.626267 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd710d4-68f8-41d8-9f47-65b4af382e8c admin admin] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:12:33.626502 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd710d4-68f8-41d8-9f47-65b4af382e8c admin admin] PATH_INFO: `/v3/users/7fa42494cb4549f295d23e08cf93d330` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:12:33.627725 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdd710d4-68f8-41d8-9f47-65b4af382e8c admin admin] RBAC: Authorizing `identity:delete_user(user_id=7fa42494cb4549f295d23e08cf93d330)` {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:12:33.629658 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdd710d4-68f8-41d8-9f47-65b4af382e8c admin admin] RBAC: Authorization granted {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:12:33.631277 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG dbcounter [-] [101893] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=101893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:12:33.810042 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.notifications [None req-cdd710d4-68f8-41d8-9f47-65b4af382e8c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7fa42494cb4549f295d23e08cf93d330'} {{(pid=101893) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:12:33.817349 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.notifications [None req-cdd710d4-68f8-41d8-9f47-65b4af382e8c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7fa42494cb4549f295d23e08cf93d330'} {{(pid=101893) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:12:33.830128 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.notifications [None req-cdd710d4-68f8-41d8-9f47-65b4af382e8c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7fa42494cb4549f295d23e08cf93d330'} {{(pid=101893) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:12:33.830840 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.notifications [None req-cdd710d4-68f8-41d8-9f47-65b4af382e8c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7fa42494cb4549f295d23e08cf93d330'} {{(pid=101893) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:12:33.831441 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.notifications [None req-cdd710d4-68f8-41d8-9f47-65b4af382e8c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7fa42494cb4549f295d23e08cf93d330'} {{(pid=101893) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:12:33.916967 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 1272/2520] 10.222.0.84 () {58 vars in 1223 bytes} [Wed May 25 15:12:33 2022] DELETE /identity/v3/users/7fa42494cb4549f295d23e08cf93d330 => generated 0 bytes in 314 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 15:12:34.413524 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-658e2dc8-36b5-40f9-abad-07d6f6e1c4db service neutron] Authenticating user token {{(pid=101892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:12:34.425295 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-658e2dc8-36b5-40f9-abad-07d6f6e1c4db service neutron] Validating token access rules against request {{(pid=101892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:12:34.490851 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dafd863e-fa3e-45ee-9fc0-854f588aaeba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cec56f74b2fa4826a506dc7b919465be', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:12:34.491879 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dafd863e-fa3e-45ee-9fc0-854f588aaeba admin admin] REQUEST_METHOD: `DELETE` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:12:34.492016 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dafd863e-fa3e-45ee-9fc0-854f588aaeba admin admin] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:12:34.492303 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dafd863e-fa3e-45ee-9fc0-854f588aaeba admin admin] PATH_INFO: `/v3/projects/94a53aea4e3e468bade273e5a1dea39e` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:12:34.494594 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dafd863e-fa3e-45ee-9fc0-854f588aaeba admin admin] RBAC: Authorizing `identity:delete_project(project_id=94a53aea4e3e468bade273e5a1dea39e)` {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:12:34.496616 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dafd863e-fa3e-45ee-9fc0-854f588aaeba admin admin] RBAC: Authorization granted {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:12:34.634053 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.notifications [None req-dafd863e-fa3e-45ee-9fc0-854f588aaeba admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '94a53aea4e3e468bade273e5a1dea39e', 'request_id': 'req-dafd863e-fa3e-45ee-9fc0-854f588aaeba'} {{(pid=101892) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:12:34.641279 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.notifications [None req-dafd863e-fa3e-45ee-9fc0-854f588aaeba admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '94a53aea4e3e468bade273e5a1dea39e', 'request_id': 'req-dafd863e-fa3e-45ee-9fc0-854f588aaeba'} {{(pid=101892) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:12:34.648266 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.notifications [None req-dafd863e-fa3e-45ee-9fc0-854f588aaeba admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '94a53aea4e3e468bade273e5a1dea39e', 'request_id': 'req-dafd863e-fa3e-45ee-9fc0-854f588aaeba'} {{(pid=101892) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:12:34.725735 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.notifications [None req-dafd863e-fa3e-45ee-9fc0-854f588aaeba admin admin] The token cache is being invalidate because project 94a53aea4e3e468bade273e5a1dea39e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=101892) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 25 15:12:34.725956 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.notifications [None req-dafd863e-fa3e-45ee-9fc0-854f588aaeba admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=101892) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:12:34.726575 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.notifications [None req-dafd863e-fa3e-45ee-9fc0-854f588aaeba admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=101892) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:12:34.728160 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 1249/2521] 10.222.0.84 () {58 vars in 1232 bytes} [Wed May 25 15:12:34 2022] DELETE /identity/v3/projects/94a53aea4e3e468bade273e5a1dea39e => generated 0 bytes in 315 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 15:12:34.733093 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8990e6-7cc3-47ae-a7e4-3ba7de0424cf None None] REQUEST_METHOD: `POST` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:12:34.733568 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8990e6-7cc3-47ae-a7e4-3ba7de0424cf None None] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:12:34.733678 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8990e6-7cc3-47ae-a7e4-3ba7de0424cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:12:34.751173 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.auth.core [None req-bd8990e6-7cc3-47ae-a7e4-3ba7de0424cf None None] MFA Rules not processed for user `05d87e87798e429aa1c10b24391f915e`. Rule list: `[]` (Enabled: `True`). {{(pid=101893) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:12:34.752419 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.fernet_utils [None req-bd8990e6-7cc3-47ae-a7e4-3ba7de0424cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=101893) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:12:34.811920 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 1273/2522] 10.222.0.84 () {58 vars in 957 bytes} [Wed May 25 15:12:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 15:12:34.819964 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edade632-96d5-4cd9-8631-b3564eb009d0 None None] REQUEST_METHOD: `POST` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:12:34.820257 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edade632-96d5-4cd9-8631-b3564eb009d0 None None] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:12:34.820541 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edade632-96d5-4cd9-8631-b3564eb009d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:12:34.839017 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.auth.core [None req-edade632-96d5-4cd9-8631-b3564eb009d0 None None] MFA Rules not processed for user `05d87e87798e429aa1c10b24391f915e`. Rule list: `[]` (Enabled: `True`). {{(pid=101892) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:12:34.840796 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.fernet_utils [None req-edade632-96d5-4cd9-8631-b3564eb009d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=101892) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:12:34.848652 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 1250/2523] 10.222.0.84 () {58 vars in 957 bytes} [Wed May 25 15:12:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 15:12:34.852726 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd8990e6-7cc3-47ae-a7e4-3ba7de0424cf None None] Authenticating user token {{(pid=101893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:12:34.862670 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd8990e6-7cc3-47ae-a7e4-3ba7de0424cf None None] Validating token access rules against request {{(pid=101893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:12:34.867859 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-764b6102-a2ae-4a54-87c0-37a32924f072 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cec56f74b2fa4826a506dc7b919465be', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:12:34.868686 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764b6102-a2ae-4a54-87c0-37a32924f072 admin admin] REQUEST_METHOD: `GET` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:12:34.868974 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764b6102-a2ae-4a54-87c0-37a32924f072 admin admin] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:12:34.869246 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764b6102-a2ae-4a54-87c0-37a32924f072 admin admin] PATH_INFO: `/v3/domains` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:12:34.869972 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-764b6102-a2ae-4a54-87c0-37a32924f072 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=101893) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 15:12:34.871522 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-764b6102-a2ae-4a54-87c0-37a32924f072 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:12:34.873321 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-764b6102-a2ae-4a54-87c0-37a32924f072 admin admin] RBAC: Authorization granted {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:12:34.885387 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 1274/2524] 10.222.0.84 () {58 vars in 1152 bytes} [Wed May 25 15:12:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 15:12:34.890334 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edade632-96d5-4cd9-8631-b3564eb009d0 None None] Authenticating user token {{(pid=101892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:12:34.899548 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edade632-96d5-4cd9-8631-b3564eb009d0 None None] Validating token access rules against request {{(pid=101892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:12:34.904239 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c82b268-c643-4984-b313-8cd86cb91375 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cec56f74b2fa4826a506dc7b919465be', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:12:34.904896 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c82b268-c643-4984-b313-8cd86cb91375 admin admin] REQUEST_METHOD: `POST` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:12:34.905169 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c82b268-c643-4984-b313-8cd86cb91375 admin admin] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:12:34.905444 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c82b268-c643-4984-b313-8cd86cb91375 admin admin] PATH_INFO: `/v3/projects` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:12:34.906179 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c82b268-c643-4984-b313-8cd86cb91375 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:12:34.908086 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c82b268-c643-4984-b313-8cd86cb91375 admin admin] RBAC: Authorization granted {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:12:34.998698 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 1251/2525] 10.222.0.84 () {60 vars in 1152 bytes} [Wed May 25 15:12:34 2022] POST /identity/v3/projects => generated 365 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 25 15:12:35.002773 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-764b6102-a2ae-4a54-87c0-37a32924f072 admin admin] Authenticating user token {{(pid=101893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:12:35.013622 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-764b6102-a2ae-4a54-87c0-37a32924f072 admin admin] Validating token access rules against request {{(pid=101893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:12:35.075472 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1cda5cd-3458-4803-a161-1fbfb13d4c82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cec56f74b2fa4826a506dc7b919465be', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:12:35.076184 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1cda5cd-3458-4803-a161-1fbfb13d4c82 admin admin] REQUEST_METHOD: `POST` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:12:35.076476 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1cda5cd-3458-4803-a161-1fbfb13d4c82 admin admin] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:12:35.076759 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1cda5cd-3458-4803-a161-1fbfb13d4c82 admin admin] PATH_INFO: `/v3/users` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:12:35.077448 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1cda5cd-3458-4803-a161-1fbfb13d4c82 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:12:35.079386 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1cda5cd-3458-4803-a161-1fbfb13d4c82 admin admin] RBAC: Authorization granted {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:12:35.089771 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG dbcounter [-] [101893] Writing DB stats keystone:SELECT=86,keystone:DELETE=10,keystone:INSERT=4 {{(pid=101893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:12:35.174763 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 1275/2526] 10.222.0.84 () {60 vars in 1143 bytes} [Wed May 25 15:12:35 2022] POST /identity/v3/users => generated 283 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 15:12:35.178883 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c82b268-c643-4984-b313-8cd86cb91375 admin admin] Authenticating user token {{(pid=101892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:12:35.189906 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c82b268-c643-4984-b313-8cd86cb91375 admin admin] Validating token access rules against request {{(pid=101892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:12:35.194682 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e738df9f-5d13-4d05-8491-806d1406a4b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cec56f74b2fa4826a506dc7b919465be', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:12:35.195330 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e738df9f-5d13-4d05-8491-806d1406a4b4 admin admin] REQUEST_METHOD: `GET` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:12:35.195678 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e738df9f-5d13-4d05-8491-806d1406a4b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:12:35.195957 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e738df9f-5d13-4d05-8491-806d1406a4b4 admin admin] PATH_INFO: `/v3/roles` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:12:35.196670 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e738df9f-5d13-4d05-8491-806d1406a4b4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:12:35.201073 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e738df9f-5d13-4d05-8491-806d1406a4b4 admin admin] RBAC: Authorization granted {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:12:35.209362 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 1252/2527] 10.222.0.84 () {58 vars in 1121 bytes} [Wed May 25 15:12:35 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 15:12:35.213475 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1cda5cd-3458-4803-a161-1fbfb13d4c82 admin admin] Authenticating user token {{(pid=101893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:12:35.223723 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1cda5cd-3458-4803-a161-1fbfb13d4c82 admin admin] Validating token access rules against request {{(pid=101893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:12:35.228467 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29ce7c10-d859-4d97-b45a-ac40f4120111 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cec56f74b2fa4826a506dc7b919465be', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:12:35.229121 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ce7c10-d859-4d97-b45a-ac40f4120111 admin admin] REQUEST_METHOD: `GET` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:12:35.229486 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ce7c10-d859-4d97-b45a-ac40f4120111 admin admin] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:12:35.229770 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ce7c10-d859-4d97-b45a-ac40f4120111 admin admin] PATH_INFO: `/v3/roles` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:12:35.231025 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29ce7c10-d859-4d97-b45a-ac40f4120111 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:12:35.232662 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29ce7c10-d859-4d97-b45a-ac40f4120111 admin admin] RBAC: Authorization granted {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:12:35.243649 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 1276/2528] 10.222.0.84 () {58 vars in 1121 bytes} [Wed May 25 15:12:35 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 25 15:12:35.248278 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e738df9f-5d13-4d05-8491-806d1406a4b4 admin admin] Authenticating user token {{(pid=101892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:12:35.258088 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e738df9f-5d13-4d05-8491-806d1406a4b4 admin admin] Validating token access rules against request {{(pid=101892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:12:35.262763 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc206ef1-eb1a-407d-850f-5a6492b54250 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cec56f74b2fa4826a506dc7b919465be', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:12:35.263678 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc206ef1-eb1a-407d-850f-5a6492b54250 admin admin] REQUEST_METHOD: `PUT` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:12:35.263962 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc206ef1-eb1a-407d-850f-5a6492b54250 admin admin] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:12:35.264240 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc206ef1-eb1a-407d-850f-5a6492b54250 admin admin] PATH_INFO: `/v3/projects/4617dedf0d394c1c8433202e3cbe8508/users/69bc0d9de0b1432e9cb81ffc60b62834/roles/ff664fa0db7e4262a5accde96c3df4c3` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:12:35.286427 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc206ef1-eb1a-407d-850f-5a6492b54250 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4617dedf0d394c1c8433202e3cbe8508, user_id=69bc0d9de0b1432e9cb81ffc60b62834, role_id=ff664fa0db7e4262a5accde96c3df4c3)` {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:12:35.289214 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc206ef1-eb1a-407d-850f-5a6492b54250 admin admin] RBAC: Authorization granted {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:12:35.396958 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 1253/2529] 10.222.0.84 () {60 vars in 1482 bytes} [Wed May 25 15:12:35 2022] PUT /identity/v3/projects/4617dedf0d394c1c8433202e3cbe8508/users/69bc0d9de0b1432e9cb81ffc60b62834/roles/ff664fa0db7e4262a5accde96c3df4c3 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 15:12:35.407014 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d75f095-0425-4982-bc02-30f12c8a1498 None None] REQUEST_METHOD: `POST` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:12:35.407304 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d75f095-0425-4982-bc02-30f12c8a1498 None None] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:12:35.407611 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d75f095-0425-4982-bc02-30f12c8a1498 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:12:35.435416 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.auth.core [None req-0d75f095-0425-4982-bc02-30f12c8a1498 None None] MFA Rules not processed for user `69bc0d9de0b1432e9cb81ffc60b62834`. Rule list: `[]` (Enabled: `True`). {{(pid=101893) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:12:35.436724 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.fernet_utils [None req-0d75f095-0425-4982-bc02-30f12c8a1498 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=101893) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:12:35.501554 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 1277/2530] 10.222.0.84 () {58 vars in 957 bytes} [Wed May 25 15:12:35 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 15:12:35.505867 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc206ef1-eb1a-407d-850f-5a6492b54250 admin admin] Authenticating user token {{(pid=101892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:12:35.523379 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG dbcounter [-] [101892] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=101892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:12:35.568099 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc206ef1-eb1a-407d-850f-5a6492b54250 admin admin] Validating token access rules against request {{(pid=101892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:12:35.573056 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dc26bff-0839-47b9-bcfd-c7e9879dee0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cec56f74b2fa4826a506dc7b919465be', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:12:35.573712 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc26bff-0839-47b9-bcfd-c7e9879dee0f admin admin] REQUEST_METHOD: `POST` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:12:35.574001 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc26bff-0839-47b9-bcfd-c7e9879dee0f admin admin] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:12:35.574281 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc26bff-0839-47b9-bcfd-c7e9879dee0f admin admin] PATH_INFO: `/v3/projects` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:12:35.574982 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dc26bff-0839-47b9-bcfd-c7e9879dee0f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:12:35.576966 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dc26bff-0839-47b9-bcfd-c7e9879dee0f admin admin] RBAC: Authorization granted {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:12:35.660061 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 1254/2531] 10.222.0.84 () {60 vars in 1152 bytes} [Wed May 25 15:12:35 2022] POST /identity/v3/projects => generated 363 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 15:12:35.661178 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d75f095-0425-4982-bc02-30f12c8a1498 None None] Authenticating user token {{(pid=101893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:12:35.673608 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d75f095-0425-4982-bc02-30f12c8a1498 None None] Validating token access rules against request {{(pid=101893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:12:35.733873 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2020258e-37ab-4a2e-a9c1-c158142fe057 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cec56f74b2fa4826a506dc7b919465be', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:12:35.734553 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2020258e-37ab-4a2e-a9c1-c158142fe057 admin admin] REQUEST_METHOD: `POST` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:12:35.734958 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2020258e-37ab-4a2e-a9c1-c158142fe057 admin admin] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:12:35.735248 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2020258e-37ab-4a2e-a9c1-c158142fe057 admin admin] PATH_INFO: `/v3/users` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:12:35.735986 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2020258e-37ab-4a2e-a9c1-c158142fe057 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:12:35.737933 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2020258e-37ab-4a2e-a9c1-c158142fe057 admin admin] RBAC: Authorization granted {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:12:35.814653 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 1278/2532] 10.222.0.84 () {60 vars in 1143 bytes} [Wed May 25 15:12:35 2022] POST /identity/v3/users => generated 288 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 15:12:35.818772 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dc26bff-0839-47b9-bcfd-c7e9879dee0f admin admin] Authenticating user token {{(pid=101892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:12:35.829633 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dc26bff-0839-47b9-bcfd-c7e9879dee0f admin admin] Validating token access rules against request {{(pid=101892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:12:35.834739 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c9ca36-8eec-41ea-b179-dcd6fde3ecf1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cec56f74b2fa4826a506dc7b919465be', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:12:35.835597 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c9ca36-8eec-41ea-b179-dcd6fde3ecf1 admin admin] REQUEST_METHOD: `GET` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:12:35.835893 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c9ca36-8eec-41ea-b179-dcd6fde3ecf1 admin admin] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:12:35.836205 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c9ca36-8eec-41ea-b179-dcd6fde3ecf1 admin admin] PATH_INFO: `/v3/roles` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:12:35.837012 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7c9ca36-8eec-41ea-b179-dcd6fde3ecf1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:12:35.838840 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7c9ca36-8eec-41ea-b179-dcd6fde3ecf1 admin admin] RBAC: Authorization granted {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:12:35.850939 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 1255/2533] 10.222.0.84 () {58 vars in 1121 bytes} [Wed May 25 15:12:35 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 15:12:35.854972 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2020258e-37ab-4a2e-a9c1-c158142fe057 admin admin] Authenticating user token {{(pid=101893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:12:35.865969 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2020258e-37ab-4a2e-a9c1-c158142fe057 admin admin] Validating token access rules against request {{(pid=101893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:12:35.870824 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97a7c9ba-ef84-4ec2-bf3c-5a8e1b6fa463 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cec56f74b2fa4826a506dc7b919465be', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:12:35.872241 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a7c9ba-ef84-4ec2-bf3c-5a8e1b6fa463 admin admin] REQUEST_METHOD: `PUT` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:12:35.872241 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a7c9ba-ef84-4ec2-bf3c-5a8e1b6fa463 admin admin] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:12:35.872453 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a7c9ba-ef84-4ec2-bf3c-5a8e1b6fa463 admin admin] PATH_INFO: `/v3/projects/395f7e2b17104e0f95be456043e3a403/users/3f1a55c025784b30840336fb8c8ec849/roles/a3b78e7d547d4d2d998b4c99a4396bba` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:12:35.888497 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97a7c9ba-ef84-4ec2-bf3c-5a8e1b6fa463 admin admin] RBAC: Authorizing `identity:create_grant(project_id=395f7e2b17104e0f95be456043e3a403, user_id=3f1a55c025784b30840336fb8c8ec849, role_id=a3b78e7d547d4d2d998b4c99a4396bba)` {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:12:35.891154 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97a7c9ba-ef84-4ec2-bf3c-5a8e1b6fa463 admin admin] RBAC: Authorization granted {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:12:35.979770 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 1279/2534] 10.222.0.84 () {60 vars in 1482 bytes} [Wed May 25 15:12:35 2022] PUT /identity/v3/projects/395f7e2b17104e0f95be456043e3a403/users/3f1a55c025784b30840336fb8c8ec849/roles/a3b78e7d547d4d2d998b4c99a4396bba => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 15:12:35.984553 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c9ca36-8eec-41ea-b179-dcd6fde3ecf1 admin admin] Authenticating user token {{(pid=101892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:12:35.994741 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c9ca36-8eec-41ea-b179-dcd6fde3ecf1 admin admin] Validating token access rules against request {{(pid=101892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:12:36.051987 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81b684ec-a73e-4803-a06b-5665644ec2a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cec56f74b2fa4826a506dc7b919465be', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:12:36.052510 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b684ec-a73e-4803-a06b-5665644ec2a6 admin admin] REQUEST_METHOD: `GET` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:12:36.052793 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b684ec-a73e-4803-a06b-5665644ec2a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:12:36.053073 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b684ec-a73e-4803-a06b-5665644ec2a6 admin admin] PATH_INFO: `/v3/roles` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:12:36.053792 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81b684ec-a73e-4803-a06b-5665644ec2a6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:12:36.055399 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81b684ec-a73e-4803-a06b-5665644ec2a6 admin admin] RBAC: Authorization granted {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:12:36.065053 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 1256/2535] 10.222.0.84 () {58 vars in 1121 bytes} [Wed May 25 15:12:35 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 25 15:12:36.069602 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97a7c9ba-ef84-4ec2-bf3c-5a8e1b6fa463 admin admin] Authenticating user token {{(pid=101893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:12:36.080341 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97a7c9ba-ef84-4ec2-bf3c-5a8e1b6fa463 admin admin] Validating token access rules against request {{(pid=101893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:12:36.085121 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-659f3998-8c50-48fb-9277-ffe8d5bb2366 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cec56f74b2fa4826a506dc7b919465be', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:12:36.086005 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659f3998-8c50-48fb-9277-ffe8d5bb2366 admin admin] REQUEST_METHOD: `PUT` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:12:36.086284 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659f3998-8c50-48fb-9277-ffe8d5bb2366 admin admin] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:12:36.086552 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659f3998-8c50-48fb-9277-ffe8d5bb2366 admin admin] PATH_INFO: `/v3/projects/395f7e2b17104e0f95be456043e3a403/users/3f1a55c025784b30840336fb8c8ec849/roles/a3b78e7d547d4d2d998b4c99a4396bba` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:12:36.088755 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-659f3998-8c50-48fb-9277-ffe8d5bb2366 admin admin] RBAC: Authorizing `identity:create_grant(project_id=395f7e2b17104e0f95be456043e3a403, user_id=3f1a55c025784b30840336fb8c8ec849, role_id=a3b78e7d547d4d2d998b4c99a4396bba)` {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:12:36.092012 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-659f3998-8c50-48fb-9277-ffe8d5bb2366 admin admin] RBAC: Authorization granted {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:12:36.103638 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 1280/2536] 10.222.0.84 () {60 vars in 1482 bytes} [Wed May 25 15:12:36 2022] PUT /identity/v3/projects/395f7e2b17104e0f95be456043e3a403/users/3f1a55c025784b30840336fb8c8ec849/roles/a3b78e7d547d4d2d998b4c99a4396bba => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 25 15:12:36.123570 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a04bba-5386-44cf-be39-1d6ba4af8062 None None] REQUEST_METHOD: `POST` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:12:36.123950 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a04bba-5386-44cf-be39-1d6ba4af8062 None None] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:12:36.124275 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a04bba-5386-44cf-be39-1d6ba4af8062 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:12:36.156613 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.auth.core [None req-f7a04bba-5386-44cf-be39-1d6ba4af8062 None None] MFA Rules not processed for user `3f1a55c025784b30840336fb8c8ec849`. Rule list: `[]` (Enabled: `True`). {{(pid=101892) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:12:36.157871 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.fernet_utils [None req-f7a04bba-5386-44cf-be39-1d6ba4af8062 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=101892) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:12:36.235289 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 1257/2537] 10.222.0.84 () {58 vars in 957 bytes} [Wed May 25 15:12:36 2022] POST /identity/v3/auth/tokens => generated 3297 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 15:12:36.247535 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-659f3998-8c50-48fb-9277-ffe8d5bb2366 admin admin] Authenticating user token {{(pid=101893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:12:36.249291 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.fernet_utils [None req-659f3998-8c50-48fb-9277-ffe8d5bb2366 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=101893) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:12:36.289378 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG dbcounter [-] [101893] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=101893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:12:36.319168 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-659f3998-8c50-48fb-9277-ffe8d5bb2366 admin admin] Validating token access rules against request {{(pid=101893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:12:36.323537 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee7402e1-3a54-4e8c-b5a1-7c6690ac99a6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e079f89a5e524ab6ad4183e4f690de07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a000829c658c4a7cab67f7b6353ba3fa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:12:36.324816 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7402e1-3a54-4e8c-b5a1-7c6690ac99a6 service cinder] REQUEST_METHOD: `GET` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:12:36.325097 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7402e1-3a54-4e8c-b5a1-7c6690ac99a6 service cinder] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:12:36.325363 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7402e1-3a54-4e8c-b5a1-7c6690ac99a6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:12:36.335358 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee7402e1-3a54-4e8c-b5a1-7c6690ac99a6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:12:36.336896 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee7402e1-3a54-4e8c-b5a1-7c6690ac99a6 service cinder] RBAC: Authorization granted {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:12:36.346911 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 1281/2538] 10.222.0.84 () {60 vars in 1365 bytes} [Wed May 25 15:12:36 2022] GET /identity/v3/auth/tokens => generated 3297 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 15:12:36.514523 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7a04bba-5386-44cf-be39-1d6ba4af8062 None None] Authenticating user token {{(pid=101892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:12:36.524593 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7a04bba-5386-44cf-be39-1d6ba4af8062 None None] Validating token access rules against request {{(pid=101892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:12:36.528722 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92dbe377-76f1-4de2-98f3-b95f0243b78b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e079f89a5e524ab6ad4183e4f690de07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a000829c658c4a7cab67f7b6353ba3fa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:12:36.529375 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92dbe377-76f1-4de2-98f3-b95f0243b78b service cinder] REQUEST_METHOD: `GET` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:12:36.529657 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92dbe377-76f1-4de2-98f3-b95f0243b78b service cinder] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:12:36.529930 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92dbe377-76f1-4de2-98f3-b95f0243b78b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:12:36.539937 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG dbcounter [-] [101892] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=101892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:12:36.601811 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92dbe377-76f1-4de2-98f3-b95f0243b78b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:12:36.601811 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92dbe377-76f1-4de2-98f3-b95f0243b78b service cinder] RBAC: Authorization granted {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:12:36.608038 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 1258/2539] 10.222.0.84 () {60 vars in 1365 bytes} [Wed May 25 15:12:36 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 15:12:40.112254 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee7402e1-3a54-4e8c-b5a1-7c6690ac99a6 service cinder] Authenticating user token {{(pid=101893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:12:40.181561 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee7402e1-3a54-4e8c-b5a1-7c6690ac99a6 service cinder] Validating token access rules against request {{(pid=101893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:12:40.186142 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ccb3188-e824-4936-a43d-5a23a9aa5ce6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cec56f74b2fa4826a506dc7b919465be', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:12:40.187013 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ccb3188-e824-4936-a43d-5a23a9aa5ce6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:12:40.187298 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ccb3188-e824-4936-a43d-5a23a9aa5ce6 admin admin] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:12:40.187600 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ccb3188-e824-4936-a43d-5a23a9aa5ce6 admin admin] PATH_INFO: `/v3/users/69bc0d9de0b1432e9cb81ffc60b62834` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:12:40.188797 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ccb3188-e824-4936-a43d-5a23a9aa5ce6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=69bc0d9de0b1432e9cb81ffc60b62834)` {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:12:40.190785 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ccb3188-e824-4936-a43d-5a23a9aa5ce6 admin admin] RBAC: Authorization granted {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:12:40.369911 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.notifications [None req-0ccb3188-e824-4936-a43d-5a23a9aa5ce6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '69bc0d9de0b1432e9cb81ffc60b62834'} {{(pid=101893) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:12:40.376955 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.notifications [None req-0ccb3188-e824-4936-a43d-5a23a9aa5ce6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '69bc0d9de0b1432e9cb81ffc60b62834'} {{(pid=101893) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:12:40.388653 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.notifications [None req-0ccb3188-e824-4936-a43d-5a23a9aa5ce6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '69bc0d9de0b1432e9cb81ffc60b62834'} {{(pid=101893) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:12:40.389463 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.notifications [None req-0ccb3188-e824-4936-a43d-5a23a9aa5ce6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '69bc0d9de0b1432e9cb81ffc60b62834'} {{(pid=101893) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:12:40.390080 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.notifications [None req-0ccb3188-e824-4936-a43d-5a23a9aa5ce6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '69bc0d9de0b1432e9cb81ffc60b62834'} {{(pid=101893) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:12:40.470965 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 1282/2540] 10.222.0.84 () {58 vars in 1223 bytes} [Wed May 25 15:12:40 2022] DELETE /identity/v3/users/69bc0d9de0b1432e9cb81ffc60b62834 => generated 0 bytes in 359 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 15:12:40.475665 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84c0f53-23a3-4347-9a24-ad154a720b15 None None] REQUEST_METHOD: `POST` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:12:40.476127 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84c0f53-23a3-4347-9a24-ad154a720b15 None None] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:12:40.483790 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84c0f53-23a3-4347-9a24-ad154a720b15 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:12:40.493853 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.auth.core [None req-f84c0f53-23a3-4347-9a24-ad154a720b15 None None] MFA Rules not processed for user `05d87e87798e429aa1c10b24391f915e`. Rule list: `[]` (Enabled: `True`). {{(pid=101892) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:12:40.495031 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.fernet_utils [None req-f84c0f53-23a3-4347-9a24-ad154a720b15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=101892) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:12:40.553920 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 1259/2541] 10.222.0.84 () {58 vars in 957 bytes} [Wed May 25 15:12:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 25 15:12:40.565275 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ccb3188-e824-4936-a43d-5a23a9aa5ce6 admin admin] Authenticating user token {{(pid=101893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:12:40.567100 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.fernet_utils [None req-0ccb3188-e824-4936-a43d-5a23a9aa5ce6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=101893) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:12:40.620010 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG dbcounter [-] [101893] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=101893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:12:40.623720 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ccb3188-e824-4936-a43d-5a23a9aa5ce6 admin admin] Validating token access rules against request {{(pid=101893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:12:40.627364 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7121a8ca-25cf-487c-bfbf-b5ebe90a12c6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ce28b25b907473588ccb87dc4acc06a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a000829c658c4a7cab67f7b6353ba3fa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:12:40.636861 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7121a8ca-25cf-487c-bfbf-b5ebe90a12c6 service neutron] REQUEST_METHOD: `GET` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:12:40.636861 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7121a8ca-25cf-487c-bfbf-b5ebe90a12c6 service neutron] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:12:40.636861 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7121a8ca-25cf-487c-bfbf-b5ebe90a12c6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:12:40.638108 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7121a8ca-25cf-487c-bfbf-b5ebe90a12c6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:12:40.639538 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7121a8ca-25cf-487c-bfbf-b5ebe90a12c6 service neutron] RBAC: Authorization granted {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:12:40.648937 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 1283/2542] 10.222.0.84 () {60 vars in 1365 bytes} [Wed May 25 15:12:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 15:12:41.061614 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f84c0f53-23a3-4347-9a24-ad154a720b15 None None] Authenticating user token {{(pid=101892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:12:41.063143 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.fernet_utils [None req-f84c0f53-23a3-4347-9a24-ad154a720b15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=101892) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:12:41.075995 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f84c0f53-23a3-4347-9a24-ad154a720b15 None None] Validating token access rules against request {{(pid=101892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:12:41.081379 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-025ac657-3b4b-4ce4-b957-e333a472803d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cec56f74b2fa4826a506dc7b919465be', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:12:41.082448 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-025ac657-3b4b-4ce4-b957-e333a472803d admin admin] REQUEST_METHOD: `DELETE` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:12:41.082784 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-025ac657-3b4b-4ce4-b957-e333a472803d admin admin] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:12:41.083086 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-025ac657-3b4b-4ce4-b957-e333a472803d admin admin] PATH_INFO: `/v3/projects/4617dedf0d394c1c8433202e3cbe8508` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:12:41.084327 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-025ac657-3b4b-4ce4-b957-e333a472803d admin admin] RBAC: Authorizing `identity:delete_project(project_id=4617dedf0d394c1c8433202e3cbe8508)` {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:12:41.087226 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-025ac657-3b4b-4ce4-b957-e333a472803d admin admin] RBAC: Authorization granted {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:12:41.221804 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.notifications [None req-025ac657-3b4b-4ce4-b957-e333a472803d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4617dedf0d394c1c8433202e3cbe8508', 'request_id': 'req-025ac657-3b4b-4ce4-b957-e333a472803d'} {{(pid=101892) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:12:41.229063 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.notifications [None req-025ac657-3b4b-4ce4-b957-e333a472803d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4617dedf0d394c1c8433202e3cbe8508', 'request_id': 'req-025ac657-3b4b-4ce4-b957-e333a472803d'} {{(pid=101892) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:12:41.236145 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.notifications [None req-025ac657-3b4b-4ce4-b957-e333a472803d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4617dedf0d394c1c8433202e3cbe8508', 'request_id': 'req-025ac657-3b4b-4ce4-b957-e333a472803d'} {{(pid=101892) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:12:41.310409 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.notifications [None req-025ac657-3b4b-4ce4-b957-e333a472803d admin admin] The token cache is being invalidate because project 4617dedf0d394c1c8433202e3cbe8508 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=101892) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 25 15:12:41.310699 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.notifications [None req-025ac657-3b4b-4ce4-b957-e333a472803d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=101892) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:12:41.311329 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.notifications [None req-025ac657-3b4b-4ce4-b957-e333a472803d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=101892) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:12:41.312883 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 1260/2543] 10.222.0.84 () {58 vars in 1232 bytes} [Wed May 25 15:12:41 2022] DELETE /identity/v3/projects/4617dedf0d394c1c8433202e3cbe8508 => generated 0 bytes in 252 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 15:12:41.318599 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7121a8ca-25cf-487c-bfbf-b5ebe90a12c6 service neutron] Authenticating user token {{(pid=101893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:12:41.333628 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7121a8ca-25cf-487c-bfbf-b5ebe90a12c6 service neutron] Validating token access rules against request {{(pid=101893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:12:41.397142 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c9ac25e-5733-4390-b06a-4bb9e375b9da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cec56f74b2fa4826a506dc7b919465be', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:12:41.398029 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c9ac25e-5733-4390-b06a-4bb9e375b9da admin admin] REQUEST_METHOD: `DELETE` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:12:41.398310 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c9ac25e-5733-4390-b06a-4bb9e375b9da admin admin] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:12:41.398588 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c9ac25e-5733-4390-b06a-4bb9e375b9da admin admin] PATH_INFO: `/v3/users/3f1a55c025784b30840336fb8c8ec849` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:12:41.399813 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c9ac25e-5733-4390-b06a-4bb9e375b9da admin admin] RBAC: Authorizing `identity:delete_user(user_id=3f1a55c025784b30840336fb8c8ec849)` {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:12:41.401843 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c9ac25e-5733-4390-b06a-4bb9e375b9da admin admin] RBAC: Authorization granted {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:12:41.625787 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.notifications [None req-6c9ac25e-5733-4390-b06a-4bb9e375b9da admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3f1a55c025784b30840336fb8c8ec849'} {{(pid=101893) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:12:41.634695 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.notifications [None req-6c9ac25e-5733-4390-b06a-4bb9e375b9da admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3f1a55c025784b30840336fb8c8ec849'} {{(pid=101893) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:12:41.648527 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.notifications [None req-6c9ac25e-5733-4390-b06a-4bb9e375b9da admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3f1a55c025784b30840336fb8c8ec849'} {{(pid=101893) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:12:41.649326 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.notifications [None req-6c9ac25e-5733-4390-b06a-4bb9e375b9da admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3f1a55c025784b30840336fb8c8ec849'} {{(pid=101893) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:12:41.649951 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.notifications [None req-6c9ac25e-5733-4390-b06a-4bb9e375b9da admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3f1a55c025784b30840336fb8c8ec849'} {{(pid=101893) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:12:41.720389 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 1284/2544] 10.222.0.84 () {58 vars in 1223 bytes} [Wed May 25 15:12:41 2022] DELETE /identity/v3/users/3f1a55c025784b30840336fb8c8ec849 => generated 0 bytes in 403 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 15:12:42.302019 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-025ac657-3b4b-4ce4-b957-e333a472803d admin admin] Authenticating user token {{(pid=101892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:12:42.302735 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.fernet_utils [None req-025ac657-3b4b-4ce4-b957-e333a472803d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=101892) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:12:42.318174 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-025ac657-3b4b-4ce4-b957-e333a472803d admin admin] Validating token access rules against request {{(pid=101892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:12:42.362343 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG dbcounter [-] [101892] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=101892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:12:42.390188 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2819fc7-7072-4742-b423-09b8d9ade1e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cec56f74b2fa4826a506dc7b919465be', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:12:42.391056 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2819fc7-7072-4742-b423-09b8d9ade1e1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:12:42.391338 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2819fc7-7072-4742-b423-09b8d9ade1e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:12:42.391642 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2819fc7-7072-4742-b423-09b8d9ade1e1 admin admin] PATH_INFO: `/v3/projects/395f7e2b17104e0f95be456043e3a403` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:12:42.393017 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2819fc7-7072-4742-b423-09b8d9ade1e1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=395f7e2b17104e0f95be456043e3a403)` {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:12:42.404291 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2819fc7-7072-4742-b423-09b8d9ade1e1 admin admin] RBAC: Authorization granted {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:12:42.532984 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.notifications [None req-a2819fc7-7072-4742-b423-09b8d9ade1e1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '395f7e2b17104e0f95be456043e3a403', 'request_id': 'req-a2819fc7-7072-4742-b423-09b8d9ade1e1'} {{(pid=101892) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:12:42.539734 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.notifications [None req-a2819fc7-7072-4742-b423-09b8d9ade1e1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '395f7e2b17104e0f95be456043e3a403', 'request_id': 'req-a2819fc7-7072-4742-b423-09b8d9ade1e1'} {{(pid=101892) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:12:42.545501 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.notifications [None req-a2819fc7-7072-4742-b423-09b8d9ade1e1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '395f7e2b17104e0f95be456043e3a403', 'request_id': 'req-a2819fc7-7072-4742-b423-09b8d9ade1e1'} {{(pid=101892) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:12:42.676829 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.notifications [None req-a2819fc7-7072-4742-b423-09b8d9ade1e1 admin admin] The token cache is being invalidate because project 395f7e2b17104e0f95be456043e3a403 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=101892) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 25 15:12:42.677139 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.notifications [None req-a2819fc7-7072-4742-b423-09b8d9ade1e1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=101892) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:12:42.677958 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.notifications [None req-a2819fc7-7072-4742-b423-09b8d9ade1e1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=101892) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:12:42.679725 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 1261/2545] 10.222.0.84 () {58 vars in 1232 bytes} [Wed May 25 15:12:42 2022] DELETE /identity/v3/projects/395f7e2b17104e0f95be456043e3a403 => generated 0 bytes in 380 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 15:12:42.685343 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfdcf8fd-b3e1-43aa-b4da-649a066cd000 None None] REQUEST_METHOD: `POST` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:12:42.685844 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfdcf8fd-b3e1-43aa-b4da-649a066cd000 None None] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:12:42.685942 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfdcf8fd-b3e1-43aa-b4da-649a066cd000 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:12:42.706036 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.auth.core [None req-bfdcf8fd-b3e1-43aa-b4da-649a066cd000 None None] MFA Rules not processed for user `05d87e87798e429aa1c10b24391f915e`. Rule list: `[]` (Enabled: `True`). {{(pid=101893) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:12:42.707259 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.fernet_utils [None req-bfdcf8fd-b3e1-43aa-b4da-649a066cd000 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=101893) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:12:42.767002 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 1285/2546] 10.222.0.84 () {58 vars in 957 bytes} [Wed May 25 15:12:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 15:12:42.774911 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427d0ccd-2532-4629-815a-6c9abf91c7c9 None None] REQUEST_METHOD: `POST` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:12:42.775206 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427d0ccd-2532-4629-815a-6c9abf91c7c9 None None] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:12:42.775490 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427d0ccd-2532-4629-815a-6c9abf91c7c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:12:42.794933 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.auth.core [None req-427d0ccd-2532-4629-815a-6c9abf91c7c9 None None] MFA Rules not processed for user `05d87e87798e429aa1c10b24391f915e`. Rule list: `[]` (Enabled: `True`). {{(pid=101892) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:12:42.796172 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.fernet_utils [None req-427d0ccd-2532-4629-815a-6c9abf91c7c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=101892) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:12:42.804184 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 1262/2547] 10.222.0.84 () {58 vars in 957 bytes} [Wed May 25 15:12:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 15:12:42.808947 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfdcf8fd-b3e1-43aa-b4da-649a066cd000 None None] Authenticating user token {{(pid=101893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:12:42.818830 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfdcf8fd-b3e1-43aa-b4da-649a066cd000 None None] Validating token access rules against request {{(pid=101893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:12:42.823447 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d83d0c1f-e0a6-4f15-81a8-6acbfd9257a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cec56f74b2fa4826a506dc7b919465be', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:12:42.824135 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83d0c1f-e0a6-4f15-81a8-6acbfd9257a0 admin admin] REQUEST_METHOD: `GET` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:12:42.824421 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83d0c1f-e0a6-4f15-81a8-6acbfd9257a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:12:42.824698 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83d0c1f-e0a6-4f15-81a8-6acbfd9257a0 admin admin] PATH_INFO: `/v3/domains` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:12:42.825422 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d83d0c1f-e0a6-4f15-81a8-6acbfd9257a0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=101893) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 15:12:42.825734 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d83d0c1f-e0a6-4f15-81a8-6acbfd9257a0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:12:42.827346 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d83d0c1f-e0a6-4f15-81a8-6acbfd9257a0 admin admin] RBAC: Authorization granted {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:12:42.834446 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG dbcounter [-] [101893] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=101893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:12:42.839239 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 1286/2548] 10.222.0.84 () {58 vars in 1152 bytes} [Wed May 25 15:12:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 15:12:42.843506 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-427d0ccd-2532-4629-815a-6c9abf91c7c9 None None] Authenticating user token {{(pid=101892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:12:42.853500 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-427d0ccd-2532-4629-815a-6c9abf91c7c9 None None] Validating token access rules against request {{(pid=101892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:12:42.858960 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bc3c347-c4c3-4774-a094-e2d7d8e56381 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cec56f74b2fa4826a506dc7b919465be', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:12:42.859685 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc3c347-c4c3-4774-a094-e2d7d8e56381 admin admin] REQUEST_METHOD: `POST` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:12:42.859973 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc3c347-c4c3-4774-a094-e2d7d8e56381 admin admin] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:12:42.860254 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc3c347-c4c3-4774-a094-e2d7d8e56381 admin admin] PATH_INFO: `/v3/projects` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:12:42.860954 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bc3c347-c4c3-4774-a094-e2d7d8e56381 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:12:42.862902 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bc3c347-c4c3-4774-a094-e2d7d8e56381 admin admin] RBAC: Authorization granted {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:12:42.970035 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 1263/2549] 10.222.0.84 () {60 vars in 1152 bytes} [Wed May 25 15:12:42 2022] POST /identity/v3/projects => generated 387 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 25 15:12:42.974188 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d83d0c1f-e0a6-4f15-81a8-6acbfd9257a0 admin admin] Authenticating user token {{(pid=101893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:12:42.984635 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d83d0c1f-e0a6-4f15-81a8-6acbfd9257a0 admin admin] Validating token access rules against request {{(pid=101893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:12:43.062698 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5fab3cf-7c0c-47e6-8457-fae7590320d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cec56f74b2fa4826a506dc7b919465be', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:12:43.063382 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5fab3cf-7c0c-47e6-8457-fae7590320d4 admin admin] REQUEST_METHOD: `POST` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:12:43.063697 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5fab3cf-7c0c-47e6-8457-fae7590320d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:12:43.064055 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5fab3cf-7c0c-47e6-8457-fae7590320d4 admin admin] PATH_INFO: `/v3/users` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:12:43.064929 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5fab3cf-7c0c-47e6-8457-fae7590320d4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:12:43.067422 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5fab3cf-7c0c-47e6-8457-fae7590320d4 admin admin] RBAC: Authorization granted {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:12:43.177337 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 1287/2550] 10.222.0.84 () {60 vars in 1143 bytes} [Wed May 25 15:12:42 2022] POST /identity/v3/users => generated 294 bytes in 203 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 15:12:43.181194 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bc3c347-c4c3-4774-a094-e2d7d8e56381 admin admin] Authenticating user token {{(pid=101892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:12:43.192112 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bc3c347-c4c3-4774-a094-e2d7d8e56381 admin admin] Validating token access rules against request {{(pid=101892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:12:43.197151 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42de1de4-b7c3-4304-a718-2439dc260cd8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cec56f74b2fa4826a506dc7b919465be', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:12:43.197826 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42de1de4-b7c3-4304-a718-2439dc260cd8 admin admin] REQUEST_METHOD: `GET` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:12:43.198143 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42de1de4-b7c3-4304-a718-2439dc260cd8 admin admin] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:12:43.198499 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42de1de4-b7c3-4304-a718-2439dc260cd8 admin admin] PATH_INFO: `/v3/roles` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:12:43.199201 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42de1de4-b7c3-4304-a718-2439dc260cd8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:12:43.203462 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42de1de4-b7c3-4304-a718-2439dc260cd8 admin admin] RBAC: Authorization granted {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:12:43.211764 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 1264/2551] 10.222.0.84 () {58 vars in 1121 bytes} [Wed May 25 15:12:43 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 25 15:12:43.216350 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5fab3cf-7c0c-47e6-8457-fae7590320d4 admin admin] Authenticating user token {{(pid=101893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:12:43.227041 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5fab3cf-7c0c-47e6-8457-fae7590320d4 admin admin] Validating token access rules against request {{(pid=101893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:12:43.233419 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-895a7e0e-fee7-4dd3-a9ba-ad0a0c17d508 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cec56f74b2fa4826a506dc7b919465be', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:12:43.234162 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895a7e0e-fee7-4dd3-a9ba-ad0a0c17d508 admin admin] REQUEST_METHOD: `GET` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:12:43.234537 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895a7e0e-fee7-4dd3-a9ba-ad0a0c17d508 admin admin] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:12:43.234876 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895a7e0e-fee7-4dd3-a9ba-ad0a0c17d508 admin admin] PATH_INFO: `/v3/roles` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:12:43.235709 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-895a7e0e-fee7-4dd3-a9ba-ad0a0c17d508 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:12:43.237414 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-895a7e0e-fee7-4dd3-a9ba-ad0a0c17d508 admin admin] RBAC: Authorization granted {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:12:43.248412 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 1288/2552] 10.222.0.84 () {58 vars in 1121 bytes} [Wed May 25 15:12:43 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 15:12:43.252589 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42de1de4-b7c3-4304-a718-2439dc260cd8 admin admin] Authenticating user token {{(pid=101892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:12:43.263094 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42de1de4-b7c3-4304-a718-2439dc260cd8 admin admin] Validating token access rules against request {{(pid=101892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:12:43.267839 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5adcad6-9bca-484f-b6fb-414ba6d470d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cec56f74b2fa4826a506dc7b919465be', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:12:43.268832 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5adcad6-9bca-484f-b6fb-414ba6d470d1 admin admin] REQUEST_METHOD: `PUT` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:12:43.269115 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5adcad6-9bca-484f-b6fb-414ba6d470d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:12:43.269389 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5adcad6-9bca-484f-b6fb-414ba6d470d1 admin admin] PATH_INFO: `/v3/projects/5bab97a33b8d4c19b25799488d4767dc/users/d89a09060b964caaac99084104c9abce/roles/ff664fa0db7e4262a5accde96c3df4c3` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:12:43.284432 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5adcad6-9bca-484f-b6fb-414ba6d470d1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5bab97a33b8d4c19b25799488d4767dc, user_id=d89a09060b964caaac99084104c9abce, role_id=ff664fa0db7e4262a5accde96c3df4c3)` {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:12:43.287066 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5adcad6-9bca-484f-b6fb-414ba6d470d1 admin admin] RBAC: Authorization granted {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:12:43.361710 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 1265/2553] 10.222.0.84 () {60 vars in 1482 bytes} [Wed May 25 15:12:43 2022] PUT /identity/v3/projects/5bab97a33b8d4c19b25799488d4767dc/users/d89a09060b964caaac99084104c9abce/roles/ff664fa0db7e4262a5accde96c3df4c3 => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 25 15:12:43.371996 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4b7fd5-9c5e-438f-a2a6-f071b8f34fbf None None] REQUEST_METHOD: `POST` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:12:43.372286 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4b7fd5-9c5e-438f-a2a6-f071b8f34fbf None None] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:12:43.372563 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4b7fd5-9c5e-438f-a2a6-f071b8f34fbf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:12:43.400753 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.auth.core [None req-ce4b7fd5-9c5e-438f-a2a6-f071b8f34fbf None None] MFA Rules not processed for user `d89a09060b964caaac99084104c9abce`. Rule list: `[]` (Enabled: `True`). {{(pid=101893) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:12:43.402467 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.fernet_utils [None req-ce4b7fd5-9c5e-438f-a2a6-f071b8f34fbf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=101893) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:12:43.470684 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 1289/2554] 10.222.0.84 () {58 vars in 957 bytes} [Wed May 25 15:12:43 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 15:12:43.475234 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5adcad6-9bca-484f-b6fb-414ba6d470d1 admin admin] Authenticating user token {{(pid=101892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:12:43.536621 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5adcad6-9bca-484f-b6fb-414ba6d470d1 admin admin] Validating token access rules against request {{(pid=101892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:12:43.541140 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67fa9c80-06e4-41aa-bd66-d454014e7653 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cec56f74b2fa4826a506dc7b919465be', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:12:43.541785 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67fa9c80-06e4-41aa-bd66-d454014e7653 admin admin] REQUEST_METHOD: `POST` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:12:43.542069 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67fa9c80-06e4-41aa-bd66-d454014e7653 admin admin] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:12:43.542845 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67fa9c80-06e4-41aa-bd66-d454014e7653 admin admin] PATH_INFO: `/v3/projects` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:12:43.543522 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67fa9c80-06e4-41aa-bd66-d454014e7653 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:12:43.545482 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67fa9c80-06e4-41aa-bd66-d454014e7653 admin admin] RBAC: Authorization granted {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:12:43.548645 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG dbcounter [-] [101892] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=101892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:12:43.637574 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 1266/2555] 10.222.0.84 () {60 vars in 1152 bytes} [Wed May 25 15:12:43 2022] POST /identity/v3/projects => generated 387 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 15:12:43.641627 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce4b7fd5-9c5e-438f-a2a6-f071b8f34fbf None None] Authenticating user token {{(pid=101893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:12:43.652267 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce4b7fd5-9c5e-438f-a2a6-f071b8f34fbf None None] Validating token access rules against request {{(pid=101893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:12:43.708593 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af9ea2e-7a36-45d6-acaa-1fddd3b8df83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cec56f74b2fa4826a506dc7b919465be', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:12:43.709314 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af9ea2e-7a36-45d6-acaa-1fddd3b8df83 admin admin] REQUEST_METHOD: `POST` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:12:43.709523 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af9ea2e-7a36-45d6-acaa-1fddd3b8df83 admin admin] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:12:43.709797 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af9ea2e-7a36-45d6-acaa-1fddd3b8df83 admin admin] PATH_INFO: `/v3/users` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:12:43.710482 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0af9ea2e-7a36-45d6-acaa-1fddd3b8df83 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:12:43.712424 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0af9ea2e-7a36-45d6-acaa-1fddd3b8df83 admin admin] RBAC: Authorization granted {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:12:43.721796 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG dbcounter [-] [101893] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=101893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:12:43.831111 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 1290/2556] 10.222.0.84 () {60 vars in 1143 bytes} [Wed May 25 15:12:43 2022] POST /identity/v3/users => generated 300 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 15:12:43.834939 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67fa9c80-06e4-41aa-bd66-d454014e7653 admin admin] Authenticating user token {{(pid=101892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:12:43.845997 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67fa9c80-06e4-41aa-bd66-d454014e7653 admin admin] Validating token access rules against request {{(pid=101892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:12:43.850613 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8630f2f1-0cb9-4c76-9d6e-f3b0684448d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cec56f74b2fa4826a506dc7b919465be', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:12:43.851263 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8630f2f1-0cb9-4c76-9d6e-f3b0684448d0 admin admin] REQUEST_METHOD: `GET` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:12:43.851544 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8630f2f1-0cb9-4c76-9d6e-f3b0684448d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:12:43.851891 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8630f2f1-0cb9-4c76-9d6e-f3b0684448d0 admin admin] PATH_INFO: `/v3/roles` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:12:43.852622 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8630f2f1-0cb9-4c76-9d6e-f3b0684448d0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:12:43.854206 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8630f2f1-0cb9-4c76-9d6e-f3b0684448d0 admin admin] RBAC: Authorization granted {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:12:43.864560 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 1267/2557] 10.222.0.84 () {58 vars in 1121 bytes} [Wed May 25 15:12:43 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 15:12:43.868519 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af9ea2e-7a36-45d6-acaa-1fddd3b8df83 admin admin] Authenticating user token {{(pid=101893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:12:43.878857 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af9ea2e-7a36-45d6-acaa-1fddd3b8df83 admin admin] Validating token access rules against request {{(pid=101893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:12:43.883408 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb57811-6133-4b89-a3aa-9f43d8c86796 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cec56f74b2fa4826a506dc7b919465be', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:12:43.884309 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb57811-6133-4b89-a3aa-9f43d8c86796 admin admin] REQUEST_METHOD: `PUT` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:12:43.884595 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb57811-6133-4b89-a3aa-9f43d8c86796 admin admin] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:12:43.884873 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb57811-6133-4b89-a3aa-9f43d8c86796 admin admin] PATH_INFO: `/v3/projects/2faf7deb316d4121b7e78aa1a78fd827/users/ccf96ab6543847a39f2b09948c066a49/roles/a3b78e7d547d4d2d998b4c99a4396bba` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:12:43.900074 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abb57811-6133-4b89-a3aa-9f43d8c86796 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2faf7deb316d4121b7e78aa1a78fd827, user_id=ccf96ab6543847a39f2b09948c066a49, role_id=a3b78e7d547d4d2d998b4c99a4396bba)` {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:12:43.902757 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abb57811-6133-4b89-a3aa-9f43d8c86796 admin admin] RBAC: Authorization granted {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:12:43.979024 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 1291/2558] 10.222.0.84 () {60 vars in 1482 bytes} [Wed May 25 15:12:43 2022] PUT /identity/v3/projects/2faf7deb316d4121b7e78aa1a78fd827/users/ccf96ab6543847a39f2b09948c066a49/roles/a3b78e7d547d4d2d998b4c99a4396bba => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 15:12:43.983050 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8630f2f1-0cb9-4c76-9d6e-f3b0684448d0 admin admin] Authenticating user token {{(pid=101892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:12:43.992767 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8630f2f1-0cb9-4c76-9d6e-f3b0684448d0 admin admin] Validating token access rules against request {{(pid=101892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:12:44.049343 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-618635b7-bbf3-40eb-ac0a-0a2c6f3b40e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cec56f74b2fa4826a506dc7b919465be', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:12:44.050010 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618635b7-bbf3-40eb-ac0a-0a2c6f3b40e2 admin admin] REQUEST_METHOD: `GET` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:12:44.050298 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618635b7-bbf3-40eb-ac0a-0a2c6f3b40e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:12:44.050586 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618635b7-bbf3-40eb-ac0a-0a2c6f3b40e2 admin admin] PATH_INFO: `/v3/roles` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:12:44.051308 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-618635b7-bbf3-40eb-ac0a-0a2c6f3b40e2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:12:44.052989 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-618635b7-bbf3-40eb-ac0a-0a2c6f3b40e2 admin admin] RBAC: Authorization granted {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:12:44.063165 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 1268/2559] 10.222.0.84 () {58 vars in 1121 bytes} [Wed May 25 15:12:43 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 15:12:44.067817 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb57811-6133-4b89-a3aa-9f43d8c86796 admin admin] Authenticating user token {{(pid=101893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:12:44.078967 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb57811-6133-4b89-a3aa-9f43d8c86796 admin admin] Validating token access rules against request {{(pid=101893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:12:44.083858 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1fed367-192b-42b6-a088-5efa37ee03c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cec56f74b2fa4826a506dc7b919465be', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:12:44.084730 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1fed367-192b-42b6-a088-5efa37ee03c9 admin admin] REQUEST_METHOD: `PUT` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:12:44.085040 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1fed367-192b-42b6-a088-5efa37ee03c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:12:44.085320 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1fed367-192b-42b6-a088-5efa37ee03c9 admin admin] PATH_INFO: `/v3/projects/2faf7deb316d4121b7e78aa1a78fd827/users/ccf96ab6543847a39f2b09948c066a49/roles/a3b78e7d547d4d2d998b4c99a4396bba` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:12:44.087306 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1fed367-192b-42b6-a088-5efa37ee03c9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2faf7deb316d4121b7e78aa1a78fd827, user_id=ccf96ab6543847a39f2b09948c066a49, role_id=a3b78e7d547d4d2d998b4c99a4396bba)` {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:12:44.090253 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1fed367-192b-42b6-a088-5efa37ee03c9 admin admin] RBAC: Authorization granted {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:12:44.101210 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 1292/2560] 10.222.0.84 () {60 vars in 1482 bytes} [Wed May 25 15:12:44 2022] PUT /identity/v3/projects/2faf7deb316d4121b7e78aa1a78fd827/users/ccf96ab6543847a39f2b09948c066a49/roles/a3b78e7d547d4d2d998b4c99a4396bba => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 15:12:44.112471 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4ba2ac-06bc-426e-9b36-1beeac1b4389 None None] REQUEST_METHOD: `POST` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:12:44.112769 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4ba2ac-06bc-426e-9b36-1beeac1b4389 None None] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:12:44.113053 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4ba2ac-06bc-426e-9b36-1beeac1b4389 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:12:44.140308 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.auth.core [None req-2e4ba2ac-06bc-426e-9b36-1beeac1b4389 None None] MFA Rules not processed for user `ccf96ab6543847a39f2b09948c066a49`. Rule list: `[]` (Enabled: `True`). {{(pid=101892) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:12:44.141848 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.fernet_utils [None req-2e4ba2ac-06bc-426e-9b36-1beeac1b4389 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=101892) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:12:44.210137 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 1269/2561] 10.222.0.84 () {58 vars in 957 bytes} [Wed May 25 15:12:44 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 15:12:44.221336 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1fed367-192b-42b6-a088-5efa37ee03c9 admin admin] Authenticating user token {{(pid=101893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:12:44.223098 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.fernet_utils [None req-d1fed367-192b-42b6-a088-5efa37ee03c9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=101893) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:12:44.288824 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1fed367-192b-42b6-a088-5efa37ee03c9 admin admin] Validating token access rules against request {{(pid=101893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:12:44.293104 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa744a6-7a50-4d87-a86a-a198fe1dc6a6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e079f89a5e524ab6ad4183e4f690de07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a000829c658c4a7cab67f7b6353ba3fa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:12:44.293753 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa744a6-7a50-4d87-a86a-a198fe1dc6a6 service cinder] REQUEST_METHOD: `GET` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:12:44.294040 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa744a6-7a50-4d87-a86a-a198fe1dc6a6 service cinder] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:12:44.294321 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa744a6-7a50-4d87-a86a-a198fe1dc6a6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:12:44.309196 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fa744a6-7a50-4d87-a86a-a198fe1dc6a6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:12:44.310670 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fa744a6-7a50-4d87-a86a-a198fe1dc6a6 service cinder] RBAC: Authorization granted {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:12:44.321215 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 1293/2562] 10.222.0.84 () {60 vars in 1365 bytes} [Wed May 25 15:12:44 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 25 15:12:44.350522 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e4ba2ac-06bc-426e-9b36-1beeac1b4389 None None] Authenticating user token {{(pid=101892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:12:44.408109 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG dbcounter [-] [101892] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=101892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:12:44.413660 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e4ba2ac-06bc-426e-9b36-1beeac1b4389 None None] Validating token access rules against request {{(pid=101892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:12:44.419186 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce82fb7-3862-47ad-8753-266d9ae71b81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cec56f74b2fa4826a506dc7b919465be', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:12:44.420346 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce82fb7-3862-47ad-8753-266d9ae71b81 admin admin] REQUEST_METHOD: `DELETE` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:12:44.420629 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce82fb7-3862-47ad-8753-266d9ae71b81 admin admin] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:12:44.420906 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce82fb7-3862-47ad-8753-266d9ae71b81 admin admin] PATH_INFO: `/v3/users/d89a09060b964caaac99084104c9abce` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:12:44.422728 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dce82fb7-3862-47ad-8753-266d9ae71b81 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d89a09060b964caaac99084104c9abce)` {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:12:44.425107 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dce82fb7-3862-47ad-8753-266d9ae71b81 admin admin] RBAC: Authorization granted {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:12:44.572125 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e625e320-e4f2-4d2b-aef5-c2687bce5ddc None None] REQUEST_METHOD: `POST` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:12:44.572531 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e625e320-e4f2-4d2b-aef5-c2687bce5ddc None None] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:12:44.572820 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e625e320-e4f2-4d2b-aef5-c2687bce5ddc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:12:44.592021 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.auth.core [None req-e625e320-e4f2-4d2b-aef5-c2687bce5ddc None None] MFA Rules not processed for user `049a7ab3f95f460e908f79cc321176fd`. Rule list: `[]` (Enabled: `True`). {{(pid=101893) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:12:44.593471 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.fernet_utils [None req-e625e320-e4f2-4d2b-aef5-c2687bce5ddc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=101893) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:12:44.619948 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.notifications [None req-dce82fb7-3862-47ad-8753-266d9ae71b81 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd89a09060b964caaac99084104c9abce'} {{(pid=101892) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:12:44.628176 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.notifications [None req-dce82fb7-3862-47ad-8753-266d9ae71b81 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd89a09060b964caaac99084104c9abce'} {{(pid=101892) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:12:44.641891 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.notifications [None req-dce82fb7-3862-47ad-8753-266d9ae71b81 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd89a09060b964caaac99084104c9abce'} {{(pid=101892) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:12:44.642601 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.notifications [None req-dce82fb7-3862-47ad-8753-266d9ae71b81 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd89a09060b964caaac99084104c9abce'} {{(pid=101892) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:12:44.648892 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 1294/2563] 10.222.0.84 () {58 vars in 1009 bytes} [Wed May 25 15:12:44 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 25 15:12:44.669989 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e625e320-e4f2-4d2b-aef5-c2687bce5ddc None None] Authenticating user token {{(pid=101893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:12:44.671376 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.fernet_utils [None req-e625e320-e4f2-4d2b-aef5-c2687bce5ddc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=101893) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:12:44.703294 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.notifications [None req-dce82fb7-3862-47ad-8753-266d9ae71b81 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd89a09060b964caaac99084104c9abce'} {{(pid=101892) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:12:44.712851 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 1270/2564] 10.222.0.84 () {58 vars in 1223 bytes} [Wed May 25 15:12:44 2022] DELETE /identity/v3/users/d89a09060b964caaac99084104c9abce => generated 0 bytes in 363 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 15:12:44.718754 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165ee876-66bb-43bb-9826-8dfc91292cc7 None None] REQUEST_METHOD: `POST` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:12:44.719049 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165ee876-66bb-43bb-9826-8dfc91292cc7 None None] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:12:44.719347 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165ee876-66bb-43bb-9826-8dfc91292cc7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:12:44.736362 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.auth.core [None req-165ee876-66bb-43bb-9826-8dfc91292cc7 None None] MFA Rules not processed for user `05d87e87798e429aa1c10b24391f915e`. Rule list: `[]` (Enabled: `True`). {{(pid=101892) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:12:44.737548 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.fernet_utils [None req-165ee876-66bb-43bb-9826-8dfc91292cc7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=101892) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:12:44.747484 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e625e320-e4f2-4d2b-aef5-c2687bce5ddc None None] Validating token access rules against request {{(pid=101893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:12:44.752470 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG dbcounter [-] [101893] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=101893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:12:44.802471 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 1271/2565] 10.222.0.84 () {58 vars in 957 bytes} [Wed May 25 15:12:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 25 15:12:44.816764 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdf0cdc7-043e-4ee3-b8b5-d8cae06a20d6 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e196f0897b98455c9e164271d7d0070a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a000829c658c4a7cab67f7b6353ba3fa', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:12:44.817094 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-165ee876-66bb-43bb-9826-8dfc91292cc7 None None] Authenticating user token {{(pid=101892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:12:44.817426 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf0cdc7-043e-4ee3-b8b5-d8cae06a20d6 service swift] REQUEST_METHOD: `GET` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:12:44.817712 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf0cdc7-043e-4ee3-b8b5-d8cae06a20d6 service swift] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:12:44.817991 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf0cdc7-043e-4ee3-b8b5-d8cae06a20d6 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:12:44.818506 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.fernet_utils [None req-165ee876-66bb-43bb-9826-8dfc91292cc7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=101892) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:12:44.819829 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.fernet_utils [None req-bdf0cdc7-043e-4ee3-b8b5-d8cae06a20d6 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=101893) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:12:44.876189 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-165ee876-66bb-43bb-9826-8dfc91292cc7 None None] Validating token access rules against request {{(pid=101892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:12:44.879339 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdf0cdc7-043e-4ee3-b8b5-d8cae06a20d6 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:12:44.879884 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2569151d-613d-4984-8a14-0aa8b92b2cbf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ce28b25b907473588ccb87dc4acc06a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a000829c658c4a7cab67f7b6353ba3fa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:12:44.880536 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2569151d-613d-4984-8a14-0aa8b92b2cbf service neutron] REQUEST_METHOD: `GET` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:12:44.880822 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2569151d-613d-4984-8a14-0aa8b92b2cbf service neutron] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:12:44.881059 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdf0cdc7-043e-4ee3-b8b5-d8cae06a20d6 service swift] RBAC: Authorization granted {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:12:44.881168 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2569151d-613d-4984-8a14-0aa8b92b2cbf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:12:44.889934 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 1295/2566] 10.222.0.84 () {60 vars in 1384 bytes} [Wed May 25 15:12:44 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 220 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) May 25 15:12:44.890911 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2569151d-613d-4984-8a14-0aa8b92b2cbf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:12:44.892377 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2569151d-613d-4984-8a14-0aa8b92b2cbf service neutron] RBAC: Authorization granted {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:12:44.905294 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 1272/2567] 10.222.0.84 () {60 vars in 1365 bytes} [Wed May 25 15:12:44 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 25 15:12:45.327653 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdf0cdc7-043e-4ee3-b8b5-d8cae06a20d6 service swift] Authenticating user token {{(pid=101893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:12:45.332298 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.fernet_utils [None req-bdf0cdc7-043e-4ee3-b8b5-d8cae06a20d6 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=101893) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:12:45.352690 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdf0cdc7-043e-4ee3-b8b5-d8cae06a20d6 service swift] Validating token access rules against request {{(pid=101893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:12:45.359994 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4679b196-4985-4fa5-b5df-45f1d1e0f5e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cec56f74b2fa4826a506dc7b919465be', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:12:45.360877 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4679b196-4985-4fa5-b5df-45f1d1e0f5e2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:12:45.361162 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4679b196-4985-4fa5-b5df-45f1d1e0f5e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:12:45.361442 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4679b196-4985-4fa5-b5df-45f1d1e0f5e2 admin admin] PATH_INFO: `/v3/projects/5bab97a33b8d4c19b25799488d4767dc` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:12:45.362630 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4679b196-4985-4fa5-b5df-45f1d1e0f5e2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5bab97a33b8d4c19b25799488d4767dc)` {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:12:45.364589 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4679b196-4985-4fa5-b5df-45f1d1e0f5e2 admin admin] RBAC: Authorization granted {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:12:45.508158 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.notifications [None req-4679b196-4985-4fa5-b5df-45f1d1e0f5e2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5bab97a33b8d4c19b25799488d4767dc', 'request_id': 'req-4679b196-4985-4fa5-b5df-45f1d1e0f5e2'} {{(pid=101893) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:12:45.518464 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.notifications [None req-4679b196-4985-4fa5-b5df-45f1d1e0f5e2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5bab97a33b8d4c19b25799488d4767dc', 'request_id': 'req-4679b196-4985-4fa5-b5df-45f1d1e0f5e2'} {{(pid=101893) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:12:45.525875 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.notifications [None req-4679b196-4985-4fa5-b5df-45f1d1e0f5e2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5bab97a33b8d4c19b25799488d4767dc', 'request_id': 'req-4679b196-4985-4fa5-b5df-45f1d1e0f5e2'} {{(pid=101893) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:12:45.606208 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.notifications [None req-4679b196-4985-4fa5-b5df-45f1d1e0f5e2 admin admin] The token cache is being invalidate because project 5bab97a33b8d4c19b25799488d4767dc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=101893) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 25 15:12:45.606521 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.notifications [None req-4679b196-4985-4fa5-b5df-45f1d1e0f5e2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=101893) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:12:45.611096 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.notifications [None req-4679b196-4985-4fa5-b5df-45f1d1e0f5e2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=101893) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:12:45.611096 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 1296/2568] 10.222.0.84 () {58 vars in 1232 bytes} [Wed May 25 15:12:45 2022] DELETE /identity/v3/projects/5bab97a33b8d4c19b25799488d4767dc => generated 0 bytes in 282 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 15:12:45.615098 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2569151d-613d-4984-8a14-0aa8b92b2cbf service neutron] Authenticating user token {{(pid=101892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:12:45.627212 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2569151d-613d-4984-8a14-0aa8b92b2cbf service neutron] Validating token access rules against request {{(pid=101892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:12:45.640895 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG dbcounter [-] [101892] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=101892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:12:45.687343 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be626cd8-9803-4833-bfcf-7d29299bc311 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cec56f74b2fa4826a506dc7b919465be', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:12:45.688397 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be626cd8-9803-4833-bfcf-7d29299bc311 admin admin] REQUEST_METHOD: `DELETE` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:12:45.688681 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be626cd8-9803-4833-bfcf-7d29299bc311 admin admin] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:12:45.688958 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be626cd8-9803-4833-bfcf-7d29299bc311 admin admin] PATH_INFO: `/v3/users/ccf96ab6543847a39f2b09948c066a49` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:12:45.690180 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be626cd8-9803-4833-bfcf-7d29299bc311 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ccf96ab6543847a39f2b09948c066a49)` {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:12:45.692418 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be626cd8-9803-4833-bfcf-7d29299bc311 admin admin] RBAC: Authorization granted {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:12:45.904559 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.notifications [None req-be626cd8-9803-4833-bfcf-7d29299bc311 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ccf96ab6543847a39f2b09948c066a49'} {{(pid=101892) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:12:45.912163 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.notifications [None req-be626cd8-9803-4833-bfcf-7d29299bc311 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ccf96ab6543847a39f2b09948c066a49'} {{(pid=101892) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:12:45.922454 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1442e26-92db-400a-b527-88079d2b45eb None None] REQUEST_METHOD: `POST` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:12:45.922925 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1442e26-92db-400a-b527-88079d2b45eb None None] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:12:45.923043 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1442e26-92db-400a-b527-88079d2b45eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:12:45.925635 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.notifications [None req-be626cd8-9803-4833-bfcf-7d29299bc311 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ccf96ab6543847a39f2b09948c066a49'} {{(pid=101892) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:12:45.928336 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.notifications [None req-be626cd8-9803-4833-bfcf-7d29299bc311 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ccf96ab6543847a39f2b09948c066a49'} {{(pid=101892) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:12:45.942294 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.auth.core [None req-b1442e26-92db-400a-b527-88079d2b45eb None None] MFA Rules not processed for user `049a7ab3f95f460e908f79cc321176fd`. Rule list: `[]` (Enabled: `True`). {{(pid=101893) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:12:45.943650 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.fernet_utils [None req-b1442e26-92db-400a-b527-88079d2b45eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=101893) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:12:45.971961 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG dbcounter [-] [101893] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=101893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:12:45.999216 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 1297/2569] 10.222.0.84 () {58 vars in 967 bytes} [Wed May 25 15:12:45 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 25 15:12:46.002452 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.notifications [None req-be626cd8-9803-4833-bfcf-7d29299bc311 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ccf96ab6543847a39f2b09948c066a49'} {{(pid=101892) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:12:46.013093 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 1273/2570] 10.222.0.84 () {58 vars in 1223 bytes} [Wed May 25 15:12:45 2022] DELETE /identity/v3/users/ccf96ab6543847a39f2b09948c066a49 => generated 0 bytes in 396 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 15:12:46.013341 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1442e26-92db-400a-b527-88079d2b45eb None None] Authenticating user token {{(pid=101893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:12:46.013620 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.fernet_utils [None req-b1442e26-92db-400a-b527-88079d2b45eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=101893) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:12:46.086338 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1442e26-92db-400a-b527-88079d2b45eb None None] Validating token access rules against request {{(pid=101893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:12:46.146773 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc933239-e43f-456e-b2ec-d2637ddc6c3e service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e196f0897b98455c9e164271d7d0070a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a000829c658c4a7cab67f7b6353ba3fa', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:12:46.147416 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc933239-e43f-456e-b2ec-d2637ddc6c3e service swift] REQUEST_METHOD: `GET` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:12:46.147737 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc933239-e43f-456e-b2ec-d2637ddc6c3e service swift] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:12:46.148014 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc933239-e43f-456e-b2ec-d2637ddc6c3e service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:12:46.149851 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.fernet_utils [None req-bc933239-e43f-456e-b2ec-d2637ddc6c3e service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=101893) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:12:46.207463 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc933239-e43f-456e-b2ec-d2637ddc6c3e service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:12:46.209077 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc933239-e43f-456e-b2ec-d2637ddc6c3e service swift] RBAC: Authorization granted {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:12:46.217247 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 1298/2571] 10.222.0.84 () {60 vars in 1384 bytes} [Wed May 25 15:12:46 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 206 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 25 15:12:46.483204 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be626cd8-9803-4833-bfcf-7d29299bc311 admin admin] Authenticating user token {{(pid=101892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:12:46.485114 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.fernet_utils [None req-be626cd8-9803-4833-bfcf-7d29299bc311 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=101892) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:12:46.555381 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be626cd8-9803-4833-bfcf-7d29299bc311 admin admin] Validating token access rules against request {{(pid=101892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:12:46.560734 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea6f87c4-5f35-4de5-bded-6fba43f24fe4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cec56f74b2fa4826a506dc7b919465be', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:12:46.561626 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6f87c4-5f35-4de5-bded-6fba43f24fe4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:12:46.561915 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6f87c4-5f35-4de5-bded-6fba43f24fe4 admin admin] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:12:46.562197 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6f87c4-5f35-4de5-bded-6fba43f24fe4 admin admin] PATH_INFO: `/v3/projects/2faf7deb316d4121b7e78aa1a78fd827` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:12:46.563426 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea6f87c4-5f35-4de5-bded-6fba43f24fe4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2faf7deb316d4121b7e78aa1a78fd827)` {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:12:46.565396 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea6f87c4-5f35-4de5-bded-6fba43f24fe4 admin admin] RBAC: Authorization granted {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:12:46.697571 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG dbcounter [-] [101892] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=101892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:12:46.704109 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.notifications [None req-ea6f87c4-5f35-4de5-bded-6fba43f24fe4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2faf7deb316d4121b7e78aa1a78fd827', 'request_id': 'req-ea6f87c4-5f35-4de5-bded-6fba43f24fe4'} {{(pid=101892) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:12:46.710190 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.notifications [None req-ea6f87c4-5f35-4de5-bded-6fba43f24fe4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2faf7deb316d4121b7e78aa1a78fd827', 'request_id': 'req-ea6f87c4-5f35-4de5-bded-6fba43f24fe4'} {{(pid=101892) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:12:46.716343 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.notifications [None req-ea6f87c4-5f35-4de5-bded-6fba43f24fe4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2faf7deb316d4121b7e78aa1a78fd827', 'request_id': 'req-ea6f87c4-5f35-4de5-bded-6fba43f24fe4'} {{(pid=101892) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:12:46.790005 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.notifications [None req-ea6f87c4-5f35-4de5-bded-6fba43f24fe4 admin admin] The token cache is being invalidate because project 2faf7deb316d4121b7e78aa1a78fd827 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=101892) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 25 15:12:46.790296 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.notifications [None req-ea6f87c4-5f35-4de5-bded-6fba43f24fe4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=101892) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:12:46.790912 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.notifications [None req-ea6f87c4-5f35-4de5-bded-6fba43f24fe4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=101892) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:12:46.793037 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 1274/2572] 10.222.0.84 () {58 vars in 1232 bytes} [Wed May 25 15:12:46 2022] DELETE /identity/v3/projects/2faf7deb316d4121b7e78aa1a78fd827 => generated 0 bytes in 311 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 15:12:46.797979 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4618889-c22a-4b44-8973-e345848da4b6 None None] REQUEST_METHOD: `POST` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:12:46.798303 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4618889-c22a-4b44-8973-e345848da4b6 None None] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:12:46.798585 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4618889-c22a-4b44-8973-e345848da4b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:12:46.817685 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.auth.core [None req-a4618889-c22a-4b44-8973-e345848da4b6 None None] MFA Rules not processed for user `05d87e87798e429aa1c10b24391f915e`. Rule list: `[]` (Enabled: `True`). {{(pid=101893) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:12:46.818489 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.fernet_utils [None req-a4618889-c22a-4b44-8973-e345848da4b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=101893) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:12:46.837584 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646174b3-9e6f-42c3-9b79-dc238c3558d7 None None] REQUEST_METHOD: `POST` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:12:46.837951 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646174b3-9e6f-42c3-9b79-dc238c3558d7 None None] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:12:46.838310 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646174b3-9e6f-42c3-9b79-dc238c3558d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:12:46.839168 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG dbcounter [-] [101893] Writing DB stats keystone:SELECT=100 {{(pid=101893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:12:46.857406 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.auth.core [None req-646174b3-9e6f-42c3-9b79-dc238c3558d7 None None] MFA Rules not processed for user `049a7ab3f95f460e908f79cc321176fd`. Rule list: `[]` (Enabled: `True`). {{(pid=101892) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:12:46.858557 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.fernet_utils [None req-646174b3-9e6f-42c3-9b79-dc238c3558d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=101892) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:12:46.884044 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 1299/2573] 10.222.0.84 () {58 vars in 957 bytes} [Wed May 25 15:12:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 15:12:46.891855 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-718b82d7-cdc1-4123-ac15-0f652a6d0240 None None] REQUEST_METHOD: `POST` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:12:46.892155 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-718b82d7-cdc1-4123-ac15-0f652a6d0240 None None] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:12:46.892436 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-718b82d7-cdc1-4123-ac15-0f652a6d0240 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:12:46.910773 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.auth.core [None req-718b82d7-cdc1-4123-ac15-0f652a6d0240 None None] MFA Rules not processed for user `05d87e87798e429aa1c10b24391f915e`. Rule list: `[]` (Enabled: `True`). {{(pid=101893) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:12:46.913259 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.fernet_utils [None req-718b82d7-cdc1-4123-ac15-0f652a6d0240 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=101893) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:12:46.920764 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 1275/2574] 10.222.0.84 () {58 vars in 1009 bytes} [Wed May 25 15:12:46 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 25 15:12:46.920902 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 1300/2575] 10.222.0.84 () {58 vars in 957 bytes} [Wed May 25 15:12:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 15:12:46.924776 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-646174b3-9e6f-42c3-9b79-dc238c3558d7 None None] Authenticating user token {{(pid=101892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:12:46.933251 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-718b82d7-cdc1-4123-ac15-0f652a6d0240 None None] Authenticating user token {{(pid=101893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:12:46.934615 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.fernet_utils [None req-718b82d7-cdc1-4123-ac15-0f652a6d0240 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=101893) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:12:46.936258 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-646174b3-9e6f-42c3-9b79-dc238c3558d7 None None] Validating token access rules against request {{(pid=101892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:12:46.940811 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d92d7af8-28b0-4b31-a61d-5764975fa1ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cec56f74b2fa4826a506dc7b919465be', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:12:46.941735 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92d7af8-28b0-4b31-a61d-5764975fa1ec admin admin] REQUEST_METHOD: `GET` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:12:46.942017 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92d7af8-28b0-4b31-a61d-5764975fa1ec admin admin] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:12:46.942294 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92d7af8-28b0-4b31-a61d-5764975fa1ec admin admin] PATH_INFO: `/v3/domains` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:12:46.943101 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d92d7af8-28b0-4b31-a61d-5764975fa1ec admin admin] RBAC: Adding query filter params (name=Default) {{(pid=101892) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 15:12:46.943413 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d92d7af8-28b0-4b31-a61d-5764975fa1ec admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:12:46.945059 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d92d7af8-28b0-4b31-a61d-5764975fa1ec admin admin] RBAC: Authorization granted {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:12:46.956894 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 1276/2576] 10.222.0.84 () {58 vars in 1152 bytes} [Wed May 25 15:12:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 15:12:46.961061 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d92d7af8-28b0-4b31-a61d-5764975fa1ec admin admin] Authenticating user token {{(pid=101892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:12:46.971361 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d92d7af8-28b0-4b31-a61d-5764975fa1ec admin admin] Validating token access rules against request {{(pid=101892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:12:46.975908 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57d09828-d668-462e-9c7d-fe55846d88f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cec56f74b2fa4826a506dc7b919465be', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:12:46.976539 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d09828-d668-462e-9c7d-fe55846d88f4 admin admin] REQUEST_METHOD: `POST` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:12:46.976825 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d09828-d668-462e-9c7d-fe55846d88f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:12:46.977104 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d09828-d668-462e-9c7d-fe55846d88f4 admin admin] PATH_INFO: `/v3/projects` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:12:46.977830 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57d09828-d668-462e-9c7d-fe55846d88f4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:12:46.980365 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57d09828-d668-462e-9c7d-fe55846d88f4 admin admin] RBAC: Authorization granted {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:12:47.008198 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-718b82d7-cdc1-4123-ac15-0f652a6d0240 None None] Validating token access rules against request {{(pid=101893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:12:47.013304 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea67b29d-35ca-4189-8cc7-330786cd4067 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e196f0897b98455c9e164271d7d0070a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a000829c658c4a7cab67f7b6353ba3fa', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:12:47.013942 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea67b29d-35ca-4189-8cc7-330786cd4067 service swift] REQUEST_METHOD: `GET` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:12:47.014227 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea67b29d-35ca-4189-8cc7-330786cd4067 service swift] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:12:47.014500 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea67b29d-35ca-4189-8cc7-330786cd4067 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:12:47.022643 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea67b29d-35ca-4189-8cc7-330786cd4067 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:12:47.024263 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea67b29d-35ca-4189-8cc7-330786cd4067 service swift] RBAC: Authorization granted {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:12:47.032833 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 1301/2577] 10.222.0.84 () {60 vars in 1384 bytes} [Wed May 25 15:12:46 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) May 25 15:12:47.055024 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 1277/2578] 10.222.0.84 () {60 vars in 1152 bytes} [Wed May 25 15:12:46 2022] POST /identity/v3/projects => generated 385 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 15:12:47.059498 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea67b29d-35ca-4189-8cc7-330786cd4067 service swift] Authenticating user token {{(pid=101893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:12:47.070217 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea67b29d-35ca-4189-8cc7-330786cd4067 service swift] Validating token access rules against request {{(pid=101893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:12:47.126840 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59db99f2-40f1-44d7-9258-a761919c97eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cec56f74b2fa4826a506dc7b919465be', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:12:47.127509 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59db99f2-40f1-44d7-9258-a761919c97eb admin admin] REQUEST_METHOD: `POST` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:12:47.127829 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59db99f2-40f1-44d7-9258-a761919c97eb admin admin] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:12:47.128108 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59db99f2-40f1-44d7-9258-a761919c97eb admin admin] PATH_INFO: `/v3/users` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:12:47.128789 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59db99f2-40f1-44d7-9258-a761919c97eb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:12:47.130712 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59db99f2-40f1-44d7-9258-a761919c97eb admin admin] RBAC: Authorization granted {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:12:47.231976 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 1302/2579] 10.222.0.84 () {60 vars in 1143 bytes} [Wed May 25 15:12:47 2022] POST /identity/v3/users => generated 293 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 15:12:47.236294 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57d09828-d668-462e-9c7d-fe55846d88f4 admin admin] Authenticating user token {{(pid=101892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:12:47.246580 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57d09828-d668-462e-9c7d-fe55846d88f4 admin admin] Validating token access rules against request {{(pid=101892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:12:47.251377 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58a79604-e91c-43cb-b458-9d49ba876acd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cec56f74b2fa4826a506dc7b919465be', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:12:47.252628 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a79604-e91c-43cb-b458-9d49ba876acd admin admin] REQUEST_METHOD: `GET` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:12:47.252628 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a79604-e91c-43cb-b458-9d49ba876acd admin admin] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:12:47.252628 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a79604-e91c-43cb-b458-9d49ba876acd admin admin] PATH_INFO: `/v3/roles` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:12:47.253305 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58a79604-e91c-43cb-b458-9d49ba876acd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:12:47.254941 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58a79604-e91c-43cb-b458-9d49ba876acd admin admin] RBAC: Authorization granted {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:12:47.265462 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 1278/2580] 10.222.0.84 () {58 vars in 1121 bytes} [Wed May 25 15:12:47 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 15:12:47.269761 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59db99f2-40f1-44d7-9258-a761919c97eb admin admin] Authenticating user token {{(pid=101893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:12:47.280534 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59db99f2-40f1-44d7-9258-a761919c97eb admin admin] Validating token access rules against request {{(pid=101893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:12:47.287163 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-479eee65-6abb-48ff-899f-1e1fa8783ed3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cec56f74b2fa4826a506dc7b919465be', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:12:47.287869 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479eee65-6abb-48ff-899f-1e1fa8783ed3 admin admin] REQUEST_METHOD: `GET` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:12:47.288153 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479eee65-6abb-48ff-899f-1e1fa8783ed3 admin admin] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:12:47.288545 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479eee65-6abb-48ff-899f-1e1fa8783ed3 admin admin] PATH_INFO: `/v3/roles` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:12:47.289300 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-479eee65-6abb-48ff-899f-1e1fa8783ed3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:12:47.290906 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-479eee65-6abb-48ff-899f-1e1fa8783ed3 admin admin] RBAC: Authorization granted {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:12:47.303889 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 1303/2581] 10.222.0.84 () {58 vars in 1121 bytes} [Wed May 25 15:12:47 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 15:12:47.308589 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58a79604-e91c-43cb-b458-9d49ba876acd admin admin] Authenticating user token {{(pid=101892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:12:47.318857 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58a79604-e91c-43cb-b458-9d49ba876acd admin admin] Validating token access rules against request {{(pid=101892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:12:47.324188 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-807c7ec1-12b7-436c-a485-b38884baedb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cec56f74b2fa4826a506dc7b919465be', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:12:47.325074 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807c7ec1-12b7-436c-a485-b38884baedb6 admin admin] REQUEST_METHOD: `PUT` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:12:47.325367 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807c7ec1-12b7-436c-a485-b38884baedb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:12:47.325715 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807c7ec1-12b7-436c-a485-b38884baedb6 admin admin] PATH_INFO: `/v3/projects/b6860ac7ace0461499ce500e794c7b29/users/aae79ca2231e413ea6f84d8d9e899160/roles/ff664fa0db7e4262a5accde96c3df4c3` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:12:47.341306 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-807c7ec1-12b7-436c-a485-b38884baedb6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b6860ac7ace0461499ce500e794c7b29, user_id=aae79ca2231e413ea6f84d8d9e899160, role_id=ff664fa0db7e4262a5accde96c3df4c3)` {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:12:47.344018 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-807c7ec1-12b7-436c-a485-b38884baedb6 admin admin] RBAC: Authorization granted {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:12:47.414963 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 1279/2582] 10.222.0.84 () {60 vars in 1482 bytes} [Wed May 25 15:12:47 2022] PUT /identity/v3/projects/b6860ac7ace0461499ce500e794c7b29/users/aae79ca2231e413ea6f84d8d9e899160/roles/ff664fa0db7e4262a5accde96c3df4c3 => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 15:12:47.432463 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb6e918-9167-4156-878a-8dfc4cc245d0 None None] REQUEST_METHOD: `POST` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:12:47.432874 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb6e918-9167-4156-878a-8dfc4cc245d0 None None] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:12:47.433197 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb6e918-9167-4156-878a-8dfc4cc245d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:12:47.469377 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.auth.core [None req-5bb6e918-9167-4156-878a-8dfc4cc245d0 None None] MFA Rules not processed for user `aae79ca2231e413ea6f84d8d9e899160`. Rule list: `[]` (Enabled: `True`). {{(pid=101893) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:12:47.470771 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.fernet_utils [None req-5bb6e918-9167-4156-878a-8dfc4cc245d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=101893) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:12:47.483157 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG dbcounter [-] [101893] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=101893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:12:47.539080 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 1304/2583] 10.222.0.84 () {58 vars in 957 bytes} [Wed May 25 15:12:47 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 15:12:47.543719 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-807c7ec1-12b7-436c-a485-b38884baedb6 admin admin] Authenticating user token {{(pid=101892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:12:47.613481 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-807c7ec1-12b7-436c-a485-b38884baedb6 admin admin] Validating token access rules against request {{(pid=101892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:12:47.618408 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46272cca-2222-494e-9cd4-ec9eb749972c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cec56f74b2fa4826a506dc7b919465be', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:12:47.619100 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46272cca-2222-494e-9cd4-ec9eb749972c admin admin] REQUEST_METHOD: `POST` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:12:47.619388 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46272cca-2222-494e-9cd4-ec9eb749972c admin admin] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:12:47.619717 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46272cca-2222-494e-9cd4-ec9eb749972c admin admin] PATH_INFO: `/v3/projects` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:12:47.621036 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46272cca-2222-494e-9cd4-ec9eb749972c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:12:47.622930 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46272cca-2222-494e-9cd4-ec9eb749972c admin admin] RBAC: Authorization granted {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:12:47.627092 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG dbcounter [-] [101892] Writing DB stats keystone:SELECT=93,keystone:DELETE=4,keystone:INSERT=3 {{(pid=101892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:12:47.659706 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f255c4e5-e91d-4d29-b1b8-b534bd0d6f54 None None] REQUEST_METHOD: `POST` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:12:47.660001 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f255c4e5-e91d-4d29-b1b8-b534bd0d6f54 None None] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:12:47.660341 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f255c4e5-e91d-4d29-b1b8-b534bd0d6f54 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:12:47.678336 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.auth.core [None req-f255c4e5-e91d-4d29-b1b8-b534bd0d6f54 None None] MFA Rules not processed for user `049a7ab3f95f460e908f79cc321176fd`. Rule list: `[]` (Enabled: `True`). {{(pid=101893) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:12:47.679529 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.fernet_utils [None req-f255c4e5-e91d-4d29-b1b8-b534bd0d6f54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=101893) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:12:47.707173 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 1280/2584] 10.222.0.84 () {60 vars in 1152 bytes} [Wed May 25 15:12:47 2022] POST /identity/v3/projects => generated 387 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 15:12:47.711369 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46272cca-2222-494e-9cd4-ec9eb749972c admin admin] Authenticating user token {{(pid=101892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:12:47.736204 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 1305/2585] 10.222.0.84 () {58 vars in 967 bytes} [Wed May 25 15:12:47 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 15:12:47.748384 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f255c4e5-e91d-4d29-b1b8-b534bd0d6f54 None None] Authenticating user token {{(pid=101893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:12:47.774344 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46272cca-2222-494e-9cd4-ec9eb749972c admin admin] Validating token access rules against request {{(pid=101892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:12:47.779581 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ef7e697-3419-462c-855d-a4ccc5e66092 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cec56f74b2fa4826a506dc7b919465be', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:12:47.780245 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef7e697-3419-462c-855d-a4ccc5e66092 admin admin] REQUEST_METHOD: `POST` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:12:47.780529 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef7e697-3419-462c-855d-a4ccc5e66092 admin admin] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:12:47.780807 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef7e697-3419-462c-855d-a4ccc5e66092 admin admin] PATH_INFO: `/v3/users` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:12:47.781495 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ef7e697-3419-462c-855d-a4ccc5e66092 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:12:47.783412 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ef7e697-3419-462c-855d-a4ccc5e66092 admin admin] RBAC: Authorization granted {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:12:47.814288 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f255c4e5-e91d-4d29-b1b8-b534bd0d6f54 None None] Validating token access rules against request {{(pid=101893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:12:47.863510 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 1281/2586] 10.222.0.84 () {60 vars in 1143 bytes} [Wed May 25 15:12:47 2022] POST /identity/v3/users => generated 300 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 25 15:12:47.867454 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ef7e697-3419-462c-855d-a4ccc5e66092 admin admin] Authenticating user token {{(pid=101892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:12:47.868014 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG dbcounter [-] [101893] Writing DB stats keystone:SELECT=100 {{(pid=101893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:12:47.874504 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe6a2f0-9939-46fd-a521-b1610ee026ed service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e196f0897b98455c9e164271d7d0070a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a000829c658c4a7cab67f7b6353ba3fa', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:12:47.875162 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe6a2f0-9939-46fd-a521-b1610ee026ed service swift] REQUEST_METHOD: `GET` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:12:47.875449 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe6a2f0-9939-46fd-a521-b1610ee026ed service swift] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:12:47.875754 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe6a2f0-9939-46fd-a521-b1610ee026ed service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:12:47.877623 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ef7e697-3419-462c-855d-a4ccc5e66092 admin admin] Validating token access rules against request {{(pid=101892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:12:47.882345 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b221a4b0-16a5-4999-ad40-15f7b74a106f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cec56f74b2fa4826a506dc7b919465be', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:12:47.883023 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b221a4b0-16a5-4999-ad40-15f7b74a106f admin admin] REQUEST_METHOD: `GET` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:12:47.883312 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b221a4b0-16a5-4999-ad40-15f7b74a106f admin admin] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:12:47.883616 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b221a4b0-16a5-4999-ad40-15f7b74a106f admin admin] PATH_INFO: `/v3/roles` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:12:47.884346 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b221a4b0-16a5-4999-ad40-15f7b74a106f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:12:47.885938 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b221a4b0-16a5-4999-ad40-15f7b74a106f admin admin] RBAC: Authorization granted {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:12:47.896077 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 1282/2587] 10.222.0.84 () {58 vars in 1121 bytes} [Wed May 25 15:12:47 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 25 15:12:47.900185 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b221a4b0-16a5-4999-ad40-15f7b74a106f admin admin] Authenticating user token {{(pid=101892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:12:47.910109 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b221a4b0-16a5-4999-ad40-15f7b74a106f admin admin] Validating token access rules against request {{(pid=101892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:12:47.915069 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a4c173-21a0-4ef7-a9bf-2753e40e088b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cec56f74b2fa4826a506dc7b919465be', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:12:47.925472 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a4c173-21a0-4ef7-a9bf-2753e40e088b admin admin] REQUEST_METHOD: `PUT` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:12:47.925472 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a4c173-21a0-4ef7-a9bf-2753e40e088b admin admin] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:12:47.925472 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a4c173-21a0-4ef7-a9bf-2753e40e088b admin admin] PATH_INFO: `/v3/projects/07616ef8442f4795a4a3706b600e08e6/users/1446363c564342e7a011c220f2fca15f/roles/a3b78e7d547d4d2d998b4c99a4396bba` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:12:47.933147 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4a4c173-21a0-4ef7-a9bf-2753e40e088b admin admin] RBAC: Authorizing `identity:create_grant(project_id=07616ef8442f4795a4a3706b600e08e6, user_id=1446363c564342e7a011c220f2fca15f, role_id=a3b78e7d547d4d2d998b4c99a4396bba)` {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:12:47.933500 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbe6a2f0-9939-46fd-a521-b1610ee026ed service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:12:47.935130 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbe6a2f0-9939-46fd-a521-b1610ee026ed service swift] RBAC: Authorization granted {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:12:47.935976 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4a4c173-21a0-4ef7-a9bf-2753e40e088b admin admin] RBAC: Authorization granted {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:12:47.944110 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 1306/2588] 10.222.0.84 () {60 vars in 1384 bytes} [Wed May 25 15:12:47 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 196 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 25 15:12:48.008079 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 1283/2589] 10.222.0.84 () {60 vars in 1482 bytes} [Wed May 25 15:12:47 2022] PUT /identity/v3/projects/07616ef8442f4795a4a3706b600e08e6/users/1446363c564342e7a011c220f2fca15f/roles/a3b78e7d547d4d2d998b4c99a4396bba => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 25 15:12:48.012518 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe6a2f0-9939-46fd-a521-b1610ee026ed service swift] Authenticating user token {{(pid=101893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:12:48.023132 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe6a2f0-9939-46fd-a521-b1610ee026ed service swift] Validating token access rules against request {{(pid=101893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:12:48.084140 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b75d6e3-4535-42f3-a10f-a049300ce924 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cec56f74b2fa4826a506dc7b919465be', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:12:48.084808 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b75d6e3-4535-42f3-a10f-a049300ce924 admin admin] REQUEST_METHOD: `GET` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:12:48.085096 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b75d6e3-4535-42f3-a10f-a049300ce924 admin admin] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:12:48.085376 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b75d6e3-4535-42f3-a10f-a049300ce924 admin admin] PATH_INFO: `/v3/roles` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:12:48.086100 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b75d6e3-4535-42f3-a10f-a049300ce924 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:12:48.087819 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b75d6e3-4535-42f3-a10f-a049300ce924 admin admin] RBAC: Authorization granted {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:12:48.098487 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 1307/2590] 10.222.0.84 () {58 vars in 1121 bytes} [Wed May 25 15:12:48 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 25 15:12:48.102536 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a4c173-21a0-4ef7-a9bf-2753e40e088b admin admin] Authenticating user token {{(pid=101892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:12:48.113457 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a4c173-21a0-4ef7-a9bf-2753e40e088b admin admin] Validating token access rules against request {{(pid=101892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:12:48.118038 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3e62023-4e4b-4e0e-ac4c-09d6d463cd5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cec56f74b2fa4826a506dc7b919465be', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:12:48.118879 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e62023-4e4b-4e0e-ac4c-09d6d463cd5c admin admin] REQUEST_METHOD: `PUT` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:12:48.119158 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e62023-4e4b-4e0e-ac4c-09d6d463cd5c admin admin] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:12:48.119432 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e62023-4e4b-4e0e-ac4c-09d6d463cd5c admin admin] PATH_INFO: `/v3/projects/07616ef8442f4795a4a3706b600e08e6/users/1446363c564342e7a011c220f2fca15f/roles/a3b78e7d547d4d2d998b4c99a4396bba` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:12:48.121991 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3e62023-4e4b-4e0e-ac4c-09d6d463cd5c admin admin] RBAC: Authorizing `identity:create_grant(project_id=07616ef8442f4795a4a3706b600e08e6, user_id=1446363c564342e7a011c220f2fca15f, role_id=a3b78e7d547d4d2d998b4c99a4396bba)` {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:12:48.124672 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3e62023-4e4b-4e0e-ac4c-09d6d463cd5c admin admin] RBAC: Authorization granted {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:12:48.134949 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 1284/2591] 10.222.0.84 () {60 vars in 1482 bytes} [Wed May 25 15:12:48 2022] PUT /identity/v3/projects/07616ef8442f4795a4a3706b600e08e6/users/1446363c564342e7a011c220f2fca15f/roles/a3b78e7d547d4d2d998b4c99a4396bba => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 25 15:12:48.146179 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab73828-1b11-408e-b94b-7d0808ed104b None None] REQUEST_METHOD: `POST` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:12:48.146473 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab73828-1b11-408e-b94b-7d0808ed104b None None] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:12:48.149298 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab73828-1b11-408e-b94b-7d0808ed104b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:12:48.174881 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.auth.core [None req-bab73828-1b11-408e-b94b-7d0808ed104b None None] MFA Rules not processed for user `1446363c564342e7a011c220f2fca15f`. Rule list: `[]` (Enabled: `True`). {{(pid=101893) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:12:48.176128 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.fernet_utils [None req-bab73828-1b11-408e-b94b-7d0808ed104b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=101893) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:12:48.245433 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 1308/2592] 10.222.0.84 () {58 vars in 957 bytes} [Wed May 25 15:12:48 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 15:12:48.257168 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3e62023-4e4b-4e0e-ac4c-09d6d463cd5c admin admin] Authenticating user token {{(pid=101892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:12:48.258818 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.fernet_utils [None req-c3e62023-4e4b-4e0e-ac4c-09d6d463cd5c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=101892) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:12:48.322009 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3e62023-4e4b-4e0e-ac4c-09d6d463cd5c admin admin] Validating token access rules against request {{(pid=101892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:12:48.325892 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1db4b3e1-a1b6-4208-88ed-3364b1d40a43 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e079f89a5e524ab6ad4183e4f690de07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a000829c658c4a7cab67f7b6353ba3fa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:12:48.326530 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db4b3e1-a1b6-4208-88ed-3364b1d40a43 service cinder] REQUEST_METHOD: `GET` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:12:48.326811 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db4b3e1-a1b6-4208-88ed-3364b1d40a43 service cinder] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:12:48.327349 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db4b3e1-a1b6-4208-88ed-3364b1d40a43 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:12:48.336786 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1db4b3e1-a1b6-4208-88ed-3364b1d40a43 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:12:48.338217 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1db4b3e1-a1b6-4208-88ed-3364b1d40a43 service cinder] RBAC: Authorization granted {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:12:48.347905 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 1285/2593] 10.222.0.84 () {60 vars in 1365 bytes} [Wed May 25 15:12:48 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 15:12:48.413187 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bab73828-1b11-408e-b94b-7d0808ed104b None None] Authenticating user token {{(pid=101893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:12:48.443458 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG dbcounter [-] [101893] Writing DB stats keystone:SELECT=100 {{(pid=101893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:12:48.491642 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bab73828-1b11-408e-b94b-7d0808ed104b None None] Validating token access rules against request {{(pid=101893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:12:48.497274 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65029d8b-2f39-47cc-938f-0c20d4362723 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cec56f74b2fa4826a506dc7b919465be', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:12:48.498231 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65029d8b-2f39-47cc-938f-0c20d4362723 admin admin] REQUEST_METHOD: `DELETE` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:12:48.498635 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65029d8b-2f39-47cc-938f-0c20d4362723 admin admin] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:12:48.498840 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65029d8b-2f39-47cc-938f-0c20d4362723 admin admin] PATH_INFO: `/v3/users/aae79ca2231e413ea6f84d8d9e899160` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:12:48.500169 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65029d8b-2f39-47cc-938f-0c20d4362723 admin admin] RBAC: Authorizing `identity:delete_user(user_id=aae79ca2231e413ea6f84d8d9e899160)` {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:12:48.502336 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65029d8b-2f39-47cc-938f-0c20d4362723 admin admin] RBAC: Authorization granted {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:12:48.694285 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.notifications [None req-65029d8b-2f39-47cc-938f-0c20d4362723 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'aae79ca2231e413ea6f84d8d9e899160'} {{(pid=101893) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:12:48.701704 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.notifications [None req-65029d8b-2f39-47cc-938f-0c20d4362723 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'aae79ca2231e413ea6f84d8d9e899160'} {{(pid=101893) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:12:48.716347 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.notifications [None req-65029d8b-2f39-47cc-938f-0c20d4362723 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'aae79ca2231e413ea6f84d8d9e899160'} {{(pid=101893) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:12:48.717050 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.notifications [None req-65029d8b-2f39-47cc-938f-0c20d4362723 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'aae79ca2231e413ea6f84d8d9e899160'} {{(pid=101893) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:12:48.717654 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.notifications [None req-65029d8b-2f39-47cc-938f-0c20d4362723 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'aae79ca2231e413ea6f84d8d9e899160'} {{(pid=101893) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:12:48.819374 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 1309/2594] 10.222.0.84 () {58 vars in 1223 bytes} [Wed May 25 15:12:48 2022] DELETE /identity/v3/users/aae79ca2231e413ea6f84d8d9e899160 => generated 0 bytes in 407 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 15:12:48.824424 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff2a01f5-bb92-4fc0-a7f2-260ff7872bd6 None None] REQUEST_METHOD: `POST` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:12:48.824898 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff2a01f5-bb92-4fc0-a7f2-260ff7872bd6 None None] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:12:48.825019 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff2a01f5-bb92-4fc0-a7f2-260ff7872bd6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:12:48.843007 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.auth.core [None req-ff2a01f5-bb92-4fc0-a7f2-260ff7872bd6 None None] MFA Rules not processed for user `05d87e87798e429aa1c10b24391f915e`. Rule list: `[]` (Enabled: `True`). {{(pid=101892) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:12:48.844271 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.fernet_utils [None req-ff2a01f5-bb92-4fc0-a7f2-260ff7872bd6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=101892) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:12:48.869282 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG dbcounter [-] [101892] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=101892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:12:48.907044 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 1286/2595] 10.222.0.84 () {58 vars in 957 bytes} [Wed May 25 15:12:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 15:12:48.915879 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65029d8b-2f39-47cc-938f-0c20d4362723 admin admin] Authenticating user token {{(pid=101893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:12:48.917286 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.fernet_utils [None req-65029d8b-2f39-47cc-938f-0c20d4362723 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=101893) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:12:48.978238 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65029d8b-2f39-47cc-938f-0c20d4362723 admin admin] Validating token access rules against request {{(pid=101893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:12:48.981961 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-279a8c84-eb6c-4d75-b4d3-dffe4285dd79 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ce28b25b907473588ccb87dc4acc06a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a000829c658c4a7cab67f7b6353ba3fa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:12:48.982617 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279a8c84-eb6c-4d75-b4d3-dffe4285dd79 service neutron] REQUEST_METHOD: `GET` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:12:48.982887 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279a8c84-eb6c-4d75-b4d3-dffe4285dd79 service neutron] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:12:48.983166 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279a8c84-eb6c-4d75-b4d3-dffe4285dd79 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:12:48.992058 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-279a8c84-eb6c-4d75-b4d3-dffe4285dd79 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:12:48.993495 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-279a8c84-eb6c-4d75-b4d3-dffe4285dd79 service neutron] RBAC: Authorization granted {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:12:49.003021 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 1310/2596] 10.222.0.84 () {60 vars in 1365 bytes} [Wed May 25 15:12:48 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 25 15:12:49.453701 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff2a01f5-bb92-4fc0-a7f2-260ff7872bd6 None None] Authenticating user token {{(pid=101892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:12:49.455733 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.fernet_utils [None req-ff2a01f5-bb92-4fc0-a7f2-260ff7872bd6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=101892) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:12:49.472318 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff2a01f5-bb92-4fc0-a7f2-260ff7872bd6 None None] Validating token access rules against request {{(pid=101892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:12:49.480820 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abf88040-c633-45b7-85f6-3f7a7e553164 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cec56f74b2fa4826a506dc7b919465be', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:12:49.481650 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf88040-c633-45b7-85f6-3f7a7e553164 admin admin] REQUEST_METHOD: `DELETE` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:12:49.482021 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf88040-c633-45b7-85f6-3f7a7e553164 admin admin] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:12:49.482399 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf88040-c633-45b7-85f6-3f7a7e553164 admin admin] PATH_INFO: `/v3/projects/b6860ac7ace0461499ce500e794c7b29` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:12:49.486223 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abf88040-c633-45b7-85f6-3f7a7e553164 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b6860ac7ace0461499ce500e794c7b29)` {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:12:49.486750 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abf88040-c633-45b7-85f6-3f7a7e553164 admin admin] RBAC: Authorization granted {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:12:49.619423 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.notifications [None req-abf88040-c633-45b7-85f6-3f7a7e553164 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b6860ac7ace0461499ce500e794c7b29', 'request_id': 'req-abf88040-c633-45b7-85f6-3f7a7e553164'} {{(pid=101892) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:12:49.626102 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.notifications [None req-abf88040-c633-45b7-85f6-3f7a7e553164 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b6860ac7ace0461499ce500e794c7b29', 'request_id': 'req-abf88040-c633-45b7-85f6-3f7a7e553164'} {{(pid=101892) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:12:49.631685 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.notifications [None req-abf88040-c633-45b7-85f6-3f7a7e553164 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b6860ac7ace0461499ce500e794c7b29', 'request_id': 'req-abf88040-c633-45b7-85f6-3f7a7e553164'} {{(pid=101892) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:12:49.699221 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.notifications [None req-abf88040-c633-45b7-85f6-3f7a7e553164 admin admin] The token cache is being invalidate because project b6860ac7ace0461499ce500e794c7b29 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=101892) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 25 15:12:49.699442 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.notifications [None req-abf88040-c633-45b7-85f6-3f7a7e553164 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=101892) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:12:49.700092 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.notifications [None req-abf88040-c633-45b7-85f6-3f7a7e553164 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=101892) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:12:49.701779 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 1287/2597] 10.222.0.84 () {58 vars in 1232 bytes} [Wed May 25 15:12:49 2022] DELETE /identity/v3/projects/b6860ac7ace0461499ce500e794c7b29 => generated 0 bytes in 249 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 15:12:49.706064 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-279a8c84-eb6c-4d75-b4d3-dffe4285dd79 service neutron] Authenticating user token {{(pid=101893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:12:49.716711 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-279a8c84-eb6c-4d75-b4d3-dffe4285dd79 service neutron] Validating token access rules against request {{(pid=101893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:12:49.762364 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG dbcounter [-] [101893] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=101893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:12:49.774632 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4f48b22-6d4c-41a9-9b41-ad1b7c2c90a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cec56f74b2fa4826a506dc7b919465be', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:12:49.775505 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f48b22-6d4c-41a9-9b41-ad1b7c2c90a3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:12:49.775827 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f48b22-6d4c-41a9-9b41-ad1b7c2c90a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:12:49.776109 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f48b22-6d4c-41a9-9b41-ad1b7c2c90a3 admin admin] PATH_INFO: `/v3/users/1446363c564342e7a011c220f2fca15f` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:12:49.777939 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4f48b22-6d4c-41a9-9b41-ad1b7c2c90a3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1446363c564342e7a011c220f2fca15f)` {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:12:49.779918 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4f48b22-6d4c-41a9-9b41-ad1b7c2c90a3 admin admin] RBAC: Authorization granted {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:12:49.978373 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.notifications [None req-c4f48b22-6d4c-41a9-9b41-ad1b7c2c90a3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1446363c564342e7a011c220f2fca15f'} {{(pid=101893) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:12:49.986513 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.notifications [None req-c4f48b22-6d4c-41a9-9b41-ad1b7c2c90a3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1446363c564342e7a011c220f2fca15f'} {{(pid=101893) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:12:49.998769 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.notifications [None req-c4f48b22-6d4c-41a9-9b41-ad1b7c2c90a3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1446363c564342e7a011c220f2fca15f'} {{(pid=101893) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:12:49.999481 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.notifications [None req-c4f48b22-6d4c-41a9-9b41-ad1b7c2c90a3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1446363c564342e7a011c220f2fca15f'} {{(pid=101893) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:12:50.000105 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.notifications [None req-c4f48b22-6d4c-41a9-9b41-ad1b7c2c90a3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1446363c564342e7a011c220f2fca15f'} {{(pid=101893) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:12:50.082624 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 1311/2598] 10.222.0.84 () {58 vars in 1223 bytes} [Wed May 25 15:12:49 2022] DELETE /identity/v3/users/1446363c564342e7a011c220f2fca15f => generated 0 bytes in 377 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 15:12:50.512264 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abf88040-c633-45b7-85f6-3f7a7e553164 admin admin] Authenticating user token {{(pid=101892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:12:50.513815 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.fernet_utils [None req-abf88040-c633-45b7-85f6-3f7a7e553164 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=101892) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:12:50.529116 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abf88040-c633-45b7-85f6-3f7a7e553164 admin admin] Validating token access rules against request {{(pid=101892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:12:50.561885 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4f48b22-6d4c-41a9-9b41-ad1b7c2c90a3 admin admin] Authenticating user token {{(pid=101893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:12:50.563369 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.fernet_utils [None req-c4f48b22-6d4c-41a9-9b41-ad1b7c2c90a3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=101893) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:12:50.598062 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ce8085-e416-400c-aff5-c2b38bf77a90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cec56f74b2fa4826a506dc7b919465be', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:12:50.599054 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ce8085-e416-400c-aff5-c2b38bf77a90 admin admin] REQUEST_METHOD: `DELETE` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:12:50.599430 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ce8085-e416-400c-aff5-c2b38bf77a90 admin admin] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:12:50.599828 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ce8085-e416-400c-aff5-c2b38bf77a90 admin admin] PATH_INFO: `/v3/projects/07616ef8442f4795a4a3706b600e08e6` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:12:50.601043 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1ce8085-e416-400c-aff5-c2b38bf77a90 admin admin] RBAC: Authorizing `identity:delete_project(project_id=07616ef8442f4795a4a3706b600e08e6)` {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:12:50.602964 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1ce8085-e416-400c-aff5-c2b38bf77a90 admin admin] RBAC: Authorization granted {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:12:50.630380 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4f48b22-6d4c-41a9-9b41-ad1b7c2c90a3 admin admin] Validating token access rules against request {{(pid=101893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:12:50.635057 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d38eae-1b8e-4652-8301-1d28bd75c131 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cec56f74b2fa4826a506dc7b919465be', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:12:50.636005 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d38eae-1b8e-4652-8301-1d28bd75c131 admin admin] REQUEST_METHOD: `DELETE` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:12:50.636291 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d38eae-1b8e-4652-8301-1d28bd75c131 admin admin] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:12:50.636698 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d38eae-1b8e-4652-8301-1d28bd75c131 admin admin] PATH_INFO: `/v3/users/193c1207d2b34393b8b73f406eeebf06` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:12:50.638448 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28d38eae-1b8e-4652-8301-1d28bd75c131 admin admin] RBAC: Authorizing `identity:delete_user(user_id=193c1207d2b34393b8b73f406eeebf06)` {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:12:50.640407 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28d38eae-1b8e-4652-8301-1d28bd75c131 admin admin] RBAC: Authorization granted {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:12:50.751380 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.notifications [None req-f1ce8085-e416-400c-aff5-c2b38bf77a90 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '07616ef8442f4795a4a3706b600e08e6', 'request_id': 'req-f1ce8085-e416-400c-aff5-c2b38bf77a90'} {{(pid=101892) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:12:50.757591 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.notifications [None req-f1ce8085-e416-400c-aff5-c2b38bf77a90 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '07616ef8442f4795a4a3706b600e08e6', 'request_id': 'req-f1ce8085-e416-400c-aff5-c2b38bf77a90'} {{(pid=101892) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:12:50.759496 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG dbcounter [-] [101892] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=101892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:12:50.763897 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.notifications [None req-f1ce8085-e416-400c-aff5-c2b38bf77a90 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '07616ef8442f4795a4a3706b600e08e6', 'request_id': 'req-f1ce8085-e416-400c-aff5-c2b38bf77a90'} {{(pid=101892) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:12:50.833214 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.notifications [None req-28d38eae-1b8e-4652-8301-1d28bd75c131 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '193c1207d2b34393b8b73f406eeebf06'} {{(pid=101893) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:12:50.840052 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.notifications [None req-28d38eae-1b8e-4652-8301-1d28bd75c131 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '193c1207d2b34393b8b73f406eeebf06'} {{(pid=101893) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:12:50.847995 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.notifications [None req-f1ce8085-e416-400c-aff5-c2b38bf77a90 admin admin] The token cache is being invalidate because project 07616ef8442f4795a4a3706b600e08e6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=101892) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 25 15:12:50.848290 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.notifications [None req-f1ce8085-e416-400c-aff5-c2b38bf77a90 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=101892) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:12:50.848512 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG dbcounter [-] [101893] Writing DB stats keystone:SELECT=81,keystone:DELETE=18,keystone:INSERT=1 {{(pid=101893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:12:50.848909 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.notifications [None req-f1ce8085-e416-400c-aff5-c2b38bf77a90 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=101892) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:12:50.850536 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 1288/2599] 10.222.0.84 () {58 vars in 1232 bytes} [Wed May 25 15:12:50 2022] DELETE /identity/v3/projects/07616ef8442f4795a4a3706b600e08e6 => generated 0 bytes in 339 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 15:12:50.855287 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5454f012-f970-4313-ba9e-33ab47dde81d None None] REQUEST_METHOD: `POST` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:12:50.855585 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5454f012-f970-4313-ba9e-33ab47dde81d None None] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:12:50.855871 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5454f012-f970-4313-ba9e-33ab47dde81d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:12:50.857844 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.notifications [None req-28d38eae-1b8e-4652-8301-1d28bd75c131 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '193c1207d2b34393b8b73f406eeebf06'} {{(pid=101893) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:12:50.858543 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.notifications [None req-28d38eae-1b8e-4652-8301-1d28bd75c131 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '193c1207d2b34393b8b73f406eeebf06'} {{(pid=101893) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:12:50.859161 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.notifications [None req-28d38eae-1b8e-4652-8301-1d28bd75c131 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '193c1207d2b34393b8b73f406eeebf06'} {{(pid=101893) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:12:50.875350 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.auth.core [None req-5454f012-f970-4313-ba9e-33ab47dde81d None None] MFA Rules not processed for user `05d87e87798e429aa1c10b24391f915e`. Rule list: `[]` (Enabled: `True`). {{(pid=101892) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:12:50.876586 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.fernet_utils [None req-5454f012-f970-4313-ba9e-33ab47dde81d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=101892) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:12:50.934253 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 1289/2600] 10.222.0.84 () {58 vars in 957 bytes} [Wed May 25 15:12:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 25 15:12:50.940000 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 1312/2601] 10.222.0.84 () {58 vars in 1223 bytes} [Wed May 25 15:12:50 2022] DELETE /identity/v3/users/193c1207d2b34393b8b73f406eeebf06 => generated 0 bytes in 379 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 15:12:50.943091 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9505a5-f7f0-40f3-835a-67a934ecd68a None None] REQUEST_METHOD: `POST` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:12:50.943091 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9505a5-f7f0-40f3-835a-67a934ecd68a None None] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:12:50.943091 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9505a5-f7f0-40f3-835a-67a934ecd68a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:12:50.945833 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c06ab4-575d-447c-aef1-5ca511696e32 None None] REQUEST_METHOD: `POST` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:12:50.946280 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c06ab4-575d-447c-aef1-5ca511696e32 None None] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:12:50.946503 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c06ab4-575d-447c-aef1-5ca511696e32 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:12:50.961439 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.auth.core [None req-8a9505a5-f7f0-40f3-835a-67a934ecd68a None None] MFA Rules not processed for user `05d87e87798e429aa1c10b24391f915e`. Rule list: `[]` (Enabled: `True`). {{(pid=101892) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:12:50.962790 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.fernet_utils [None req-8a9505a5-f7f0-40f3-835a-67a934ecd68a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=101892) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:12:50.964478 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.auth.core [None req-d3c06ab4-575d-447c-aef1-5ca511696e32 None None] MFA Rules not processed for user `05d87e87798e429aa1c10b24391f915e`. Rule list: `[]` (Enabled: `True`). {{(pid=101893) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:12:50.965653 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.fernet_utils [None req-d3c06ab4-575d-447c-aef1-5ca511696e32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=101893) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:12:51.028754 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 1290/2602] 10.222.0.84 () {58 vars in 957 bytes} [Wed May 25 15:12:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 25 15:12:51.028948 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 1313/2603] 10.222.0.84 () {58 vars in 957 bytes} [Wed May 25 15:12:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 15:12:51.030804 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a9505a5-f7f0-40f3-835a-67a934ecd68a None None] Authenticating user token {{(pid=101892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:12:51.036699 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c06ab4-575d-447c-aef1-5ca511696e32 None None] Authenticating user token {{(pid=101893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:12:51.038068 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.fernet_utils [None req-d3c06ab4-575d-447c-aef1-5ca511696e32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=101893) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:12:51.040487 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a9505a5-f7f0-40f3-835a-67a934ecd68a None None] Validating token access rules against request {{(pid=101892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:12:51.045092 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f41f90c-fe18-4a32-a2d4-5b162502f70d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cec56f74b2fa4826a506dc7b919465be', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:12:51.045742 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f41f90c-fe18-4a32-a2d4-5b162502f70d admin admin] REQUEST_METHOD: `GET` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:12:51.046092 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f41f90c-fe18-4a32-a2d4-5b162502f70d admin admin] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:12:51.046463 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f41f90c-fe18-4a32-a2d4-5b162502f70d admin admin] PATH_INFO: `/v3/domains` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:12:51.051638 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f41f90c-fe18-4a32-a2d4-5b162502f70d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=101892) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 15:12:51.051638 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f41f90c-fe18-4a32-a2d4-5b162502f70d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:12:51.051638 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f41f90c-fe18-4a32-a2d4-5b162502f70d admin admin] RBAC: Authorization granted {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:12:51.061635 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 1291/2604] 10.222.0.84 () {58 vars in 1152 bytes} [Wed May 25 15:12:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 15:12:51.066104 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f41f90c-fe18-4a32-a2d4-5b162502f70d admin admin] Authenticating user token {{(pid=101892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:12:51.077319 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f41f90c-fe18-4a32-a2d4-5b162502f70d admin admin] Validating token access rules against request {{(pid=101892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:12:51.082460 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2bf5b7b-fa11-4379-8867-fea07558f4f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cec56f74b2fa4826a506dc7b919465be', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:12:51.083102 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2bf5b7b-fa11-4379-8867-fea07558f4f1 admin admin] REQUEST_METHOD: `POST` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:12:51.083388 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2bf5b7b-fa11-4379-8867-fea07558f4f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:12:51.083700 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2bf5b7b-fa11-4379-8867-fea07558f4f1 admin admin] PATH_INFO: `/v3/projects` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:12:51.084384 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2bf5b7b-fa11-4379-8867-fea07558f4f1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:12:51.086369 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2bf5b7b-fa11-4379-8867-fea07558f4f1 admin admin] RBAC: Authorization granted {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:12:51.098845 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c06ab4-575d-447c-aef1-5ca511696e32 None None] Validating token access rules against request {{(pid=101893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:12:51.103638 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-153a7c2d-d638-41db-ac18-59e8931935a4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ce28b25b907473588ccb87dc4acc06a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a000829c658c4a7cab67f7b6353ba3fa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:12:51.104300 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-153a7c2d-d638-41db-ac18-59e8931935a4 service neutron] REQUEST_METHOD: `GET` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:12:51.104590 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-153a7c2d-d638-41db-ac18-59e8931935a4 service neutron] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:12:51.104871 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-153a7c2d-d638-41db-ac18-59e8931935a4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:12:51.115170 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-153a7c2d-d638-41db-ac18-59e8931935a4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:12:51.116655 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-153a7c2d-d638-41db-ac18-59e8931935a4 service neutron] RBAC: Authorization granted {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:12:51.127042 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 1314/2605] 10.222.0.84 () {60 vars in 1365 bytes} [Wed May 25 15:12:51 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 25 15:12:51.212949 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 1292/2606] 10.222.0.84 () {60 vars in 1152 bytes} [Wed May 25 15:12:51 2022] POST /identity/v3/projects => generated 387 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 25 15:12:51.214175 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-153a7c2d-d638-41db-ac18-59e8931935a4 service neutron] Authenticating user token {{(pid=101893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:12:51.224384 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-153a7c2d-d638-41db-ac18-59e8931935a4 service neutron] Validating token access rules against request {{(pid=101893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:12:51.284227 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a60b499-ca3c-4062-81ec-6da70435b3b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cec56f74b2fa4826a506dc7b919465be', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:12:51.284817 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a60b499-ca3c-4062-81ec-6da70435b3b9 admin admin] REQUEST_METHOD: `POST` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:12:51.285102 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a60b499-ca3c-4062-81ec-6da70435b3b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:12:51.285371 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a60b499-ca3c-4062-81ec-6da70435b3b9 admin admin] PATH_INFO: `/v3/users` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:12:51.286047 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a60b499-ca3c-4062-81ec-6da70435b3b9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:12:51.288146 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a60b499-ca3c-4062-81ec-6da70435b3b9 admin admin] RBAC: Authorization granted {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:12:51.375237 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2bf5b7b-fa11-4379-8867-fea07558f4f1 admin admin] Authenticating user token {{(pid=101892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:12:51.377014 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.fernet_utils [None req-f2bf5b7b-fa11-4379-8867-fea07558f4f1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=101892) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:12:51.391420 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2bf5b7b-fa11-4379-8867-fea07558f4f1 admin admin] Validating token access rules against request {{(pid=101892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:12:51.398516 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 1315/2607] 10.222.0.84 () {60 vars in 1143 bytes} [Wed May 25 15:12:51 2022] POST /identity/v3/users => generated 294 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 15:12:51.399579 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46c9dca8-68cd-428a-948f-7f2dff16b59f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cec56f74b2fa4826a506dc7b919465be', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:12:51.399579 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c9dca8-68cd-428a-948f-7f2dff16b59f admin admin] REQUEST_METHOD: `DELETE` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:12:51.399811 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c9dca8-68cd-428a-948f-7f2dff16b59f admin admin] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:12:51.400024 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c9dca8-68cd-428a-948f-7f2dff16b59f admin admin] PATH_INFO: `/v3/projects/de8087d12975444c9d50074b593f31ff` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:12:51.401359 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46c9dca8-68cd-428a-948f-7f2dff16b59f admin admin] RBAC: Authorizing `identity:delete_project(project_id=de8087d12975444c9d50074b593f31ff)` {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:12:51.403257 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a60b499-ca3c-4062-81ec-6da70435b3b9 admin admin] Authenticating user token {{(pid=101893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:12:51.404057 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46c9dca8-68cd-428a-948f-7f2dff16b59f admin admin] RBAC: Authorization granted {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:12:51.415417 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a60b499-ca3c-4062-81ec-6da70435b3b9 admin admin] Validating token access rules against request {{(pid=101893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:12:51.421146 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a28ac2ec-4502-4f5c-81a3-b33c85af9695 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cec56f74b2fa4826a506dc7b919465be', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:12:51.421815 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28ac2ec-4502-4f5c-81a3-b33c85af9695 admin admin] REQUEST_METHOD: `GET` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:12:51.422098 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28ac2ec-4502-4f5c-81a3-b33c85af9695 admin admin] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:12:51.422375 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28ac2ec-4502-4f5c-81a3-b33c85af9695 admin admin] PATH_INFO: `/v3/roles` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:12:51.423099 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a28ac2ec-4502-4f5c-81a3-b33c85af9695 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:12:51.424742 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a28ac2ec-4502-4f5c-81a3-b33c85af9695 admin admin] RBAC: Authorization granted {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:12:51.436716 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 1316/2608] 10.222.0.84 () {58 vars in 1121 bytes} [Wed May 25 15:12:51 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 15:12:51.443283 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a28ac2ec-4502-4f5c-81a3-b33c85af9695 admin admin] Authenticating user token {{(pid=101893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:12:51.453820 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a28ac2ec-4502-4f5c-81a3-b33c85af9695 admin admin] Validating token access rules against request {{(pid=101893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:12:51.458666 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe28ba8c-e226-47bc-8d65-ec41bc71e8c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cec56f74b2fa4826a506dc7b919465be', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:12:51.459327 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe28ba8c-e226-47bc-8d65-ec41bc71e8c4 admin admin] REQUEST_METHOD: `GET` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:12:51.459637 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe28ba8c-e226-47bc-8d65-ec41bc71e8c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:12:51.459950 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe28ba8c-e226-47bc-8d65-ec41bc71e8c4 admin admin] PATH_INFO: `/v3/roles` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:12:51.460629 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe28ba8c-e226-47bc-8d65-ec41bc71e8c4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:12:51.462302 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe28ba8c-e226-47bc-8d65-ec41bc71e8c4 admin admin] RBAC: Authorization granted {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:12:51.463693 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG dbcounter [-] [101893] Writing DB stats keystone:SELECT=94,keystone:DELETE=2,keystone:INSERT=4 {{(pid=101893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:12:51.473971 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 1317/2609] 10.222.0.84 () {58 vars in 1121 bytes} [Wed May 25 15:12:51 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 25 15:12:51.477911 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe28ba8c-e226-47bc-8d65-ec41bc71e8c4 admin admin] Authenticating user token {{(pid=101893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:12:51.487971 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe28ba8c-e226-47bc-8d65-ec41bc71e8c4 admin admin] Validating token access rules against request {{(pid=101893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:12:51.492808 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a622858d-a739-4909-9497-ebce339791d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cec56f74b2fa4826a506dc7b919465be', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:12:51.493689 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a622858d-a739-4909-9497-ebce339791d5 admin admin] REQUEST_METHOD: `PUT` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:12:51.493975 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a622858d-a739-4909-9497-ebce339791d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:12:51.497785 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a622858d-a739-4909-9497-ebce339791d5 admin admin] PATH_INFO: `/v3/projects/bbacc5160ff248eeb544911cb335720f/users/1b59aa3420494b538fa876cbab8b23c0/roles/ff664fa0db7e4262a5accde96c3df4c3` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:12:51.509968 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a622858d-a739-4909-9497-ebce339791d5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bbacc5160ff248eeb544911cb335720f, user_id=1b59aa3420494b538fa876cbab8b23c0, role_id=ff664fa0db7e4262a5accde96c3df4c3)` {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:12:51.513274 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a622858d-a739-4909-9497-ebce339791d5 admin admin] RBAC: Authorization granted {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:12:51.513408 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG dbcounter [-] [101892] Writing DB stats keystone:SELECT=93,keystone:DELETE=5,keystone:INSERT=2 {{(pid=101892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:12:51.516429 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.notifications [None req-46c9dca8-68cd-428a-948f-7f2dff16b59f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'de8087d12975444c9d50074b593f31ff', 'request_id': 'req-46c9dca8-68cd-428a-948f-7f2dff16b59f'} {{(pid=101892) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:12:51.522844 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.notifications [None req-46c9dca8-68cd-428a-948f-7f2dff16b59f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'de8087d12975444c9d50074b593f31ff', 'request_id': 'req-46c9dca8-68cd-428a-948f-7f2dff16b59f'} {{(pid=101892) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:12:51.528768 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.notifications [None req-46c9dca8-68cd-428a-948f-7f2dff16b59f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'de8087d12975444c9d50074b593f31ff', 'request_id': 'req-46c9dca8-68cd-428a-948f-7f2dff16b59f'} {{(pid=101892) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:12:51.563054 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 1318/2610] 10.222.0.84 () {60 vars in 1482 bytes} [Wed May 25 15:12:51 2022] PUT /identity/v3/projects/bbacc5160ff248eeb544911cb335720f/users/1b59aa3420494b538fa876cbab8b23c0/roles/ff664fa0db7e4262a5accde96c3df4c3 => generated 0 bytes in 85 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 25 15:12:51.573245 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bebeba7-2d28-471d-b9b5-e0ee73c4da34 None None] REQUEST_METHOD: `POST` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:12:51.573568 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bebeba7-2d28-471d-b9b5-e0ee73c4da34 None None] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:12:51.573876 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bebeba7-2d28-471d-b9b5-e0ee73c4da34 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:12:51.582726 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.notifications [None req-46c9dca8-68cd-428a-948f-7f2dff16b59f admin admin] The token cache is being invalidate because project de8087d12975444c9d50074b593f31ff was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=101892) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 25 15:12:51.583019 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.notifications [None req-46c9dca8-68cd-428a-948f-7f2dff16b59f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=101892) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:12:51.583701 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.notifications [None req-46c9dca8-68cd-428a-948f-7f2dff16b59f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=101892) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:12:51.586396 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 1293/2611] 10.222.0.84 () {58 vars in 1232 bytes} [Wed May 25 15:12:51 2022] DELETE /identity/v3/projects/de8087d12975444c9d50074b593f31ff => generated 0 bytes in 211 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 25 15:12:51.591215 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3631afab-0ebf-4d54-be1e-dd1821bd5388 None None] REQUEST_METHOD: `POST` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:12:51.591503 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3631afab-0ebf-4d54-be1e-dd1821bd5388 None None] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:12:51.591830 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3631afab-0ebf-4d54-be1e-dd1821bd5388 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:12:51.601663 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.auth.core [None req-4bebeba7-2d28-471d-b9b5-e0ee73c4da34 None None] MFA Rules not processed for user `1b59aa3420494b538fa876cbab8b23c0`. Rule list: `[]` (Enabled: `True`). {{(pid=101893) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:12:51.602901 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.fernet_utils [None req-4bebeba7-2d28-471d-b9b5-e0ee73c4da34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=101893) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:12:51.610099 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.auth.core [None req-3631afab-0ebf-4d54-be1e-dd1821bd5388 None None] MFA Rules not processed for user `05d87e87798e429aa1c10b24391f915e`. Rule list: `[]` (Enabled: `True`). {{(pid=101892) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:12:51.611452 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.fernet_utils [None req-3631afab-0ebf-4d54-be1e-dd1821bd5388 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=101892) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:12:51.666735 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 1319/2612] 10.222.0.84 () {58 vars in 957 bytes} [Wed May 25 15:12:51 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 25 15:12:51.670784 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 1294/2613] 10.222.0.84 () {58 vars in 957 bytes} [Wed May 25 15:12:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 15:12:51.671321 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bebeba7-2d28-471d-b9b5-e0ee73c4da34 None None] Authenticating user token {{(pid=101893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:12:51.672846 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.fernet_utils [None req-4bebeba7-2d28-471d-b9b5-e0ee73c4da34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=101893) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:12:51.678367 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd45f27-98c0-40b7-a59e-e7c3ca368dcf None None] REQUEST_METHOD: `POST` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:12:51.679018 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd45f27-98c0-40b7-a59e-e7c3ca368dcf None None] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:12:51.679018 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd45f27-98c0-40b7-a59e-e7c3ca368dcf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:12:51.686848 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bebeba7-2d28-471d-b9b5-e0ee73c4da34 None None] Validating token access rules against request {{(pid=101893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:12:51.691918 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee0cbc5-821c-45ad-898b-1b247a0c2f5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cec56f74b2fa4826a506dc7b919465be', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:12:51.692596 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee0cbc5-821c-45ad-898b-1b247a0c2f5c admin admin] REQUEST_METHOD: `POST` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:12:51.692880 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee0cbc5-821c-45ad-898b-1b247a0c2f5c admin admin] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:12:51.693159 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee0cbc5-821c-45ad-898b-1b247a0c2f5c admin admin] PATH_INFO: `/v3/projects` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:12:51.693854 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aee0cbc5-821c-45ad-898b-1b247a0c2f5c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:12:51.695837 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aee0cbc5-821c-45ad-898b-1b247a0c2f5c admin admin] RBAC: Authorization granted {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:12:51.697337 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.auth.core [None req-2bd45f27-98c0-40b7-a59e-e7c3ca368dcf None None] MFA Rules not processed for user `05d87e87798e429aa1c10b24391f915e`. Rule list: `[]` (Enabled: `True`). {{(pid=101892) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:12:51.698508 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.fernet_utils [None req-2bd45f27-98c0-40b7-a59e-e7c3ca368dcf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=101892) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:12:51.706820 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 1295/2614] 10.222.0.84 () {58 vars in 957 bytes} [Wed May 25 15:12:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 25 15:12:51.710859 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bd45f27-98c0-40b7-a59e-e7c3ca368dcf None None] Authenticating user token {{(pid=101892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:12:51.719852 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bd45f27-98c0-40b7-a59e-e7c3ca368dcf None None] Validating token access rules against request {{(pid=101892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:12:51.724394 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-425d1816-008e-4869-b190-20872265acb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cec56f74b2fa4826a506dc7b919465be', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:12:51.725023 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425d1816-008e-4869-b190-20872265acb4 admin admin] REQUEST_METHOD: `GET` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:12:51.725305 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425d1816-008e-4869-b190-20872265acb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:12:51.725578 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425d1816-008e-4869-b190-20872265acb4 admin admin] PATH_INFO: `/v3/domains` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:12:51.726288 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-425d1816-008e-4869-b190-20872265acb4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=101892) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 15:12:51.726593 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-425d1816-008e-4869-b190-20872265acb4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:12:51.728218 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-425d1816-008e-4869-b190-20872265acb4 admin admin] RBAC: Authorization granted {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:12:51.740492 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 1296/2615] 10.222.0.84 () {58 vars in 1152 bytes} [Wed May 25 15:12:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 15:12:51.744667 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-425d1816-008e-4869-b190-20872265acb4 admin admin] Authenticating user token {{(pid=101892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:12:51.754462 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-425d1816-008e-4869-b190-20872265acb4 admin admin] Validating token access rules against request {{(pid=101892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:12:51.759006 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b19d103a-bd1f-4beb-a5cd-45ac5925d431 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cec56f74b2fa4826a506dc7b919465be', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:12:51.759634 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19d103a-bd1f-4beb-a5cd-45ac5925d431 admin admin] REQUEST_METHOD: `POST` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:12:51.759920 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19d103a-bd1f-4beb-a5cd-45ac5925d431 admin admin] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:12:51.760195 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19d103a-bd1f-4beb-a5cd-45ac5925d431 admin admin] PATH_INFO: `/v3/projects` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:12:51.760853 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b19d103a-bd1f-4beb-a5cd-45ac5925d431 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:12:51.763239 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b19d103a-bd1f-4beb-a5cd-45ac5925d431 admin admin] RBAC: Authorization granted {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:12:51.775946 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 1320/2616] 10.222.0.84 () {60 vars in 1152 bytes} [Wed May 25 15:12:51 2022] POST /identity/v3/projects => generated 387 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 25 15:12:51.776969 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee0cbc5-821c-45ad-898b-1b247a0c2f5c admin admin] Authenticating user token {{(pid=101893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:12:51.837902 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee0cbc5-821c-45ad-898b-1b247a0c2f5c admin admin] Validating token access rules against request {{(pid=101893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:12:51.843065 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b6bca5a-c301-4b9c-9ebc-3620271ab5e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cec56f74b2fa4826a506dc7b919465be', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:12:51.843767 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b6bca5a-c301-4b9c-9ebc-3620271ab5e9 admin admin] REQUEST_METHOD: `POST` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:12:51.844056 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b6bca5a-c301-4b9c-9ebc-3620271ab5e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:12:51.844337 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b6bca5a-c301-4b9c-9ebc-3620271ab5e9 admin admin] PATH_INFO: `/v3/users` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:12:51.845021 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b6bca5a-c301-4b9c-9ebc-3620271ab5e9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:12:51.846948 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b6bca5a-c301-4b9c-9ebc-3620271ab5e9 admin admin] RBAC: Authorization granted {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:12:51.871794 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 1297/2617] 10.222.0.84 () {60 vars in 1152 bytes} [Wed May 25 15:12:51 2022] POST /identity/v3/projects => generated 371 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 25 15:12:51.875922 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b19d103a-bd1f-4beb-a5cd-45ac5925d431 admin admin] Authenticating user token {{(pid=101892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:12:51.936238 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b19d103a-bd1f-4beb-a5cd-45ac5925d431 admin admin] Validating token access rules against request {{(pid=101892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:12:51.941307 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51eed270-6bd6-4c4e-83d9-60b47ae01741 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cec56f74b2fa4826a506dc7b919465be', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:12:51.941969 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51eed270-6bd6-4c4e-83d9-60b47ae01741 admin admin] REQUEST_METHOD: `POST` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:12:51.942249 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51eed270-6bd6-4c4e-83d9-60b47ae01741 admin admin] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:12:51.942525 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51eed270-6bd6-4c4e-83d9-60b47ae01741 admin admin] PATH_INFO: `/v3/users` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:12:51.943253 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51eed270-6bd6-4c4e-83d9-60b47ae01741 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:12:51.945248 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51eed270-6bd6-4c4e-83d9-60b47ae01741 admin admin] RBAC: Authorization granted {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:12:51.972441 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 1321/2618] 10.222.0.84 () {60 vars in 1143 bytes} [Wed May 25 15:12:51 2022] POST /identity/v3/users => generated 294 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 15:12:51.976321 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b6bca5a-c301-4b9c-9ebc-3620271ab5e9 admin admin] Authenticating user token {{(pid=101893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:12:51.986478 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b6bca5a-c301-4b9c-9ebc-3620271ab5e9 admin admin] Validating token access rules against request {{(pid=101893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:12:51.991236 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a66162c-d053-4df6-8773-8511f8927496 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cec56f74b2fa4826a506dc7b919465be', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:12:51.991943 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a66162c-d053-4df6-8773-8511f8927496 admin admin] REQUEST_METHOD: `GET` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:12:51.992210 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a66162c-d053-4df6-8773-8511f8927496 admin admin] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:12:51.992482 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a66162c-d053-4df6-8773-8511f8927496 admin admin] PATH_INFO: `/v3/roles` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:12:51.993196 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a66162c-d053-4df6-8773-8511f8927496 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:12:51.994839 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a66162c-d053-4df6-8773-8511f8927496 admin admin] RBAC: Authorization granted {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:12:52.005180 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 1322/2619] 10.222.0.84 () {58 vars in 1121 bytes} [Wed May 25 15:12:51 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 25 15:12:52.008954 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a66162c-d053-4df6-8773-8511f8927496 admin admin] Authenticating user token {{(pid=101893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:12:52.019054 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a66162c-d053-4df6-8773-8511f8927496 admin admin] Validating token access rules against request {{(pid=101893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:12:52.023715 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0ef97e4-58b2-4df5-8266-a92fb9cf2e39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cec56f74b2fa4826a506dc7b919465be', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:12:52.027326 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ef97e4-58b2-4df5-8266-a92fb9cf2e39 admin admin] REQUEST_METHOD: `GET` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:12:52.027326 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ef97e4-58b2-4df5-8266-a92fb9cf2e39 admin admin] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:12:52.027326 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ef97e4-58b2-4df5-8266-a92fb9cf2e39 admin admin] PATH_INFO: `/v3/roles` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:12:52.027326 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0ef97e4-58b2-4df5-8266-a92fb9cf2e39 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:12:52.027326 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0ef97e4-58b2-4df5-8266-a92fb9cf2e39 admin admin] RBAC: Authorization granted {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:12:52.038146 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 1323/2620] 10.222.0.84 () {58 vars in 1121 bytes} [Wed May 25 15:12:52 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 25 15:12:52.041963 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0ef97e4-58b2-4df5-8266-a92fb9cf2e39 admin admin] Authenticating user token {{(pid=101893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:12:52.051637 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0ef97e4-58b2-4df5-8266-a92fb9cf2e39 admin admin] Validating token access rules against request {{(pid=101893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:12:52.052425 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 1298/2621] 10.222.0.84 () {60 vars in 1143 bytes} [Wed May 25 15:12:51 2022] POST /identity/v3/users => generated 286 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 25 15:12:52.056432 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36eefc40-1bbc-46ab-9a9e-c151ceaa0ee9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cec56f74b2fa4826a506dc7b919465be', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:12:52.057731 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36eefc40-1bbc-46ab-9a9e-c151ceaa0ee9 admin admin] REQUEST_METHOD: `PUT` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:12:52.057958 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36eefc40-1bbc-46ab-9a9e-c151ceaa0ee9 admin admin] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:12:52.058240 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36eefc40-1bbc-46ab-9a9e-c151ceaa0ee9 admin admin] PATH_INFO: `/v3/projects/e32f99280ad547c79aff420e60c20000/users/ecc3de83558b447cafa1fa882e354bf7/roles/ff664fa0db7e4262a5accde96c3df4c3` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:12:52.058850 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51eed270-6bd6-4c4e-83d9-60b47ae01741 admin admin] Authenticating user token {{(pid=101892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:12:52.060692 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG dbcounter [-] [101893] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=101893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:12:52.069011 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51eed270-6bd6-4c4e-83d9-60b47ae01741 admin admin] Validating token access rules against request {{(pid=101892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:12:52.073482 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36eefc40-1bbc-46ab-9a9e-c151ceaa0ee9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e32f99280ad547c79aff420e60c20000, user_id=ecc3de83558b447cafa1fa882e354bf7, role_id=ff664fa0db7e4262a5accde96c3df4c3)` {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:12:52.073738 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98e77c06-f4a9-432c-aa9d-246388e94ef9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cec56f74b2fa4826a506dc7b919465be', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:12:52.074908 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e77c06-f4a9-432c-aa9d-246388e94ef9 admin admin] REQUEST_METHOD: `GET` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:12:52.075195 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e77c06-f4a9-432c-aa9d-246388e94ef9 admin admin] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:12:52.075478 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e77c06-f4a9-432c-aa9d-246388e94ef9 admin admin] PATH_INFO: `/v3/roles` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:12:52.076247 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98e77c06-f4a9-432c-aa9d-246388e94ef9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:12:52.076765 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36eefc40-1bbc-46ab-9a9e-c151ceaa0ee9 admin admin] RBAC: Authorization granted {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:12:52.077831 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98e77c06-f4a9-432c-aa9d-246388e94ef9 admin admin] RBAC: Authorization granted {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:12:52.088203 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 1299/2622] 10.222.0.84 () {58 vars in 1121 bytes} [Wed May 25 15:12:52 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 25 15:12:52.092678 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98e77c06-f4a9-432c-aa9d-246388e94ef9 admin admin] Authenticating user token {{(pid=101892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:12:52.102323 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98e77c06-f4a9-432c-aa9d-246388e94ef9 admin admin] Validating token access rules against request {{(pid=101892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:12:52.106914 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-836da91c-287b-4a23-98f2-890c4f2d8e2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cec56f74b2fa4826a506dc7b919465be', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:12:52.107534 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836da91c-287b-4a23-98f2-890c4f2d8e2c admin admin] REQUEST_METHOD: `GET` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:12:52.107858 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836da91c-287b-4a23-98f2-890c4f2d8e2c admin admin] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:12:52.108140 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836da91c-287b-4a23-98f2-890c4f2d8e2c admin admin] PATH_INFO: `/v3/roles` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:12:52.108852 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-836da91c-287b-4a23-98f2-890c4f2d8e2c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:12:52.110416 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-836da91c-287b-4a23-98f2-890c4f2d8e2c admin admin] RBAC: Authorization granted {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:12:52.115461 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG dbcounter [-] [101892] Writing DB stats keystone:DELETE=4,keystone:SELECT=91,keystone:INSERT=5 {{(pid=101892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:12:52.121696 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 1300/2623] 10.222.0.84 () {58 vars in 1121 bytes} [Wed May 25 15:12:52 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 25 15:12:52.125532 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-836da91c-287b-4a23-98f2-890c4f2d8e2c admin admin] Authenticating user token {{(pid=101892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:12:52.134937 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-836da91c-287b-4a23-98f2-890c4f2d8e2c admin admin] Validating token access rules against request {{(pid=101892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:12:52.140393 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee8cae3c-3038-4edf-8ea3-8a79fe07a36e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cec56f74b2fa4826a506dc7b919465be', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:12:52.141227 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8cae3c-3038-4edf-8ea3-8a79fe07a36e admin admin] REQUEST_METHOD: `PUT` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:12:52.141509 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8cae3c-3038-4edf-8ea3-8a79fe07a36e admin admin] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:12:52.141786 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8cae3c-3038-4edf-8ea3-8a79fe07a36e admin admin] PATH_INFO: `/v3/projects/62c74474b96744798313d5f901bd002c/users/4e3b076bde0145559e76d607a7d2cf81/roles/ff664fa0db7e4262a5accde96c3df4c3` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:12:52.150677 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 1324/2624] 10.222.0.84 () {60 vars in 1482 bytes} [Wed May 25 15:12:52 2022] PUT /identity/v3/projects/e32f99280ad547c79aff420e60c20000/users/ecc3de83558b447cafa1fa882e354bf7/roles/ff664fa0db7e4262a5accde96c3df4c3 => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 25 15:12:52.156457 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee8cae3c-3038-4edf-8ea3-8a79fe07a36e admin admin] RBAC: Authorizing `identity:create_grant(project_id=62c74474b96744798313d5f901bd002c, user_id=4e3b076bde0145559e76d607a7d2cf81, role_id=ff664fa0db7e4262a5accde96c3df4c3)` {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:12:52.159117 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee8cae3c-3038-4edf-8ea3-8a79fe07a36e admin admin] RBAC: Authorization granted {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:12:52.164181 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13095b25-ef1c-460a-8ed2-f488b8618ae2 None None] REQUEST_METHOD: `POST` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:12:52.164478 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13095b25-ef1c-460a-8ed2-f488b8618ae2 None None] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:12:52.164761 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13095b25-ef1c-460a-8ed2-f488b8618ae2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:12:52.191213 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.auth.core [None req-13095b25-ef1c-460a-8ed2-f488b8618ae2 None None] MFA Rules not processed for user `ecc3de83558b447cafa1fa882e354bf7`. Rule list: `[]` (Enabled: `True`). {{(pid=101893) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:12:52.192449 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.fernet_utils [None req-13095b25-ef1c-460a-8ed2-f488b8618ae2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=101893) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:12:52.242324 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 1301/2625] 10.222.0.84 () {60 vars in 1482 bytes} [Wed May 25 15:12:52 2022] PUT /identity/v3/projects/62c74474b96744798313d5f901bd002c/users/4e3b076bde0145559e76d607a7d2cf81/roles/ff664fa0db7e4262a5accde96c3df4c3 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 25 15:12:52.247833 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8343ac6c-1723-4371-aa1a-0b7dfeb8d90b None None] REQUEST_METHOD: `POST` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:12:52.248395 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8343ac6c-1723-4371-aa1a-0b7dfeb8d90b None None] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:12:52.248931 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8343ac6c-1723-4371-aa1a-0b7dfeb8d90b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:12:52.255478 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 1325/2626] 10.222.0.84 () {58 vars in 957 bytes} [Wed May 25 15:12:52 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 25 15:12:52.259859 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13095b25-ef1c-460a-8ed2-f488b8618ae2 None None] Authenticating user token {{(pid=101893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:12:52.266938 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.auth.core [None req-8343ac6c-1723-4371-aa1a-0b7dfeb8d90b None None] MFA Rules not processed for user `05d87e87798e429aa1c10b24391f915e`. Rule list: `[]` (Enabled: `True`). {{(pid=101892) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:12:52.268156 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.fernet_utils [None req-8343ac6c-1723-4371-aa1a-0b7dfeb8d90b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=101892) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:12:52.322136 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13095b25-ef1c-460a-8ed2-f488b8618ae2 None None] Validating token access rules against request {{(pid=101893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:12:52.327600 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 1302/2627] 10.222.0.84 () {58 vars in 957 bytes} [Wed May 25 15:12:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 25 15:12:52.327756 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad2187b9-5d27-40b4-b08a-6e98f17a1f63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cec56f74b2fa4826a506dc7b919465be', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:12:52.328164 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2187b9-5d27-40b4-b08a-6e98f17a1f63 admin admin] REQUEST_METHOD: `POST` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:12:52.328451 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2187b9-5d27-40b4-b08a-6e98f17a1f63 admin admin] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:12:52.328730 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2187b9-5d27-40b4-b08a-6e98f17a1f63 admin admin] PATH_INFO: `/v3/projects` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:12:52.329418 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad2187b9-5d27-40b4-b08a-6e98f17a1f63 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:12:52.331485 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad2187b9-5d27-40b4-b08a-6e98f17a1f63 admin admin] RBAC: Authorization granted {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:12:52.337561 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8343ac6c-1723-4371-aa1a-0b7dfeb8d90b None None] Authenticating user token {{(pid=101892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:12:52.339021 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.fernet_utils [None req-8343ac6c-1723-4371-aa1a-0b7dfeb8d90b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=101892) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:12:52.394308 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8343ac6c-1723-4371-aa1a-0b7dfeb8d90b None None] Validating token access rules against request {{(pid=101892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:12:52.397903 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd74db7d-fe13-41f3-8a4c-80910edbe2f6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ce28b25b907473588ccb87dc4acc06a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a000829c658c4a7cab67f7b6353ba3fa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:12:52.398538 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd74db7d-fe13-41f3-8a4c-80910edbe2f6 service neutron] REQUEST_METHOD: `GET` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:12:52.398821 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd74db7d-fe13-41f3-8a4c-80910edbe2f6 service neutron] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:12:52.399096 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd74db7d-fe13-41f3-8a4c-80910edbe2f6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:12:52.408071 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd74db7d-fe13-41f3-8a4c-80910edbe2f6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:12:52.409495 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd74db7d-fe13-41f3-8a4c-80910edbe2f6 service neutron] RBAC: Authorization granted {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:12:52.413383 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 1326/2628] 10.222.0.84 () {60 vars in 1152 bytes} [Wed May 25 15:12:52 2022] POST /identity/v3/projects => generated 385 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 25 15:12:52.417671 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad2187b9-5d27-40b4-b08a-6e98f17a1f63 admin admin] Authenticating user token {{(pid=101893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:12:52.419646 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 1303/2629] 10.222.0.84 () {60 vars in 1365 bytes} [Wed May 25 15:12:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 25 15:12:52.480744 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG dbcounter [-] [101893] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=101893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:12:52.484678 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad2187b9-5d27-40b4-b08a-6e98f17a1f63 admin admin] Validating token access rules against request {{(pid=101893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:12:52.489755 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3070b40-4fb6-4820-920c-961b11910c63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cec56f74b2fa4826a506dc7b919465be', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:12:52.490467 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3070b40-4fb6-4820-920c-961b11910c63 admin admin] REQUEST_METHOD: `POST` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:12:52.490776 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3070b40-4fb6-4820-920c-961b11910c63 admin admin] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:12:52.491029 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3070b40-4fb6-4820-920c-961b11910c63 admin admin] PATH_INFO: `/v3/users` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:12:52.491782 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3070b40-4fb6-4820-920c-961b11910c63 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:12:52.493717 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3070b40-4fb6-4820-920c-961b11910c63 admin admin] RBAC: Authorization granted {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:12:52.627288 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 1327/2630] 10.222.0.84 () {60 vars in 1143 bytes} [Wed May 25 15:12:52 2022] POST /identity/v3/users => generated 299 bytes in 210 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 25 15:12:52.631331 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd74db7d-fe13-41f3-8a4c-80910edbe2f6 service neutron] Authenticating user token {{(pid=101892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:12:52.641137 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd74db7d-fe13-41f3-8a4c-80910edbe2f6 service neutron] Validating token access rules against request {{(pid=101892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:12:52.645661 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f4cfd1-0d9d-453c-a8e1-e68d689a609e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cec56f74b2fa4826a506dc7b919465be', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:12:52.646325 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f4cfd1-0d9d-453c-a8e1-e68d689a609e admin admin] REQUEST_METHOD: `GET` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:12:52.646612 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f4cfd1-0d9d-453c-a8e1-e68d689a609e admin admin] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:12:52.646893 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f4cfd1-0d9d-453c-a8e1-e68d689a609e admin admin] PATH_INFO: `/v3/roles` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:12:52.647645 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1f4cfd1-0d9d-453c-a8e1-e68d689a609e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:12:52.649379 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1f4cfd1-0d9d-453c-a8e1-e68d689a609e admin admin] RBAC: Authorization granted {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:12:52.659274 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 1304/2631] 10.222.0.84 () {58 vars in 1121 bytes} [Wed May 25 15:12:52 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 15:12:52.663432 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3070b40-4fb6-4820-920c-961b11910c63 admin admin] Authenticating user token {{(pid=101893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:12:52.674106 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3070b40-4fb6-4820-920c-961b11910c63 admin admin] Validating token access rules against request {{(pid=101893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:12:52.678786 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cbe5cfa-7e87-4007-b750-d3c54a9669ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cec56f74b2fa4826a506dc7b919465be', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:12:52.679773 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cbe5cfa-7e87-4007-b750-d3c54a9669ef admin admin] REQUEST_METHOD: `PUT` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:12:52.680065 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cbe5cfa-7e87-4007-b750-d3c54a9669ef admin admin] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:12:52.683209 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cbe5cfa-7e87-4007-b750-d3c54a9669ef admin admin] PATH_INFO: `/v3/projects/e0ccea6819624886b212ac7c95070b51/users/5b64b07c162f4fbaa710bdb21596ed60/roles/a3b78e7d547d4d2d998b4c99a4396bba` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:12:52.697482 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cbe5cfa-7e87-4007-b750-d3c54a9669ef admin admin] RBAC: Authorizing `identity:create_grant(project_id=e0ccea6819624886b212ac7c95070b51, user_id=5b64b07c162f4fbaa710bdb21596ed60, role_id=a3b78e7d547d4d2d998b4c99a4396bba)` {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:12:52.702352 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cbe5cfa-7e87-4007-b750-d3c54a9669ef admin admin] RBAC: Authorization granted {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:12:52.814023 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 1328/2632] 10.222.0.84 () {60 vars in 1482 bytes} [Wed May 25 15:12:52 2022] PUT /identity/v3/projects/e0ccea6819624886b212ac7c95070b51/users/5b64b07c162f4fbaa710bdb21596ed60/roles/a3b78e7d547d4d2d998b4c99a4396bba => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 15:12:52.818312 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f4cfd1-0d9d-453c-a8e1-e68d689a609e admin admin] Authenticating user token {{(pid=101892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:12:52.828730 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f4cfd1-0d9d-453c-a8e1-e68d689a609e admin admin] Validating token access rules against request {{(pid=101892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:12:52.890254 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf1c7a58-0221-4bb6-956a-1ffd7864dfb5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cec56f74b2fa4826a506dc7b919465be', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:12:52.890980 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf1c7a58-0221-4bb6-956a-1ffd7864dfb5 admin admin] REQUEST_METHOD: `GET` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:12:52.891266 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf1c7a58-0221-4bb6-956a-1ffd7864dfb5 admin admin] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:12:52.891613 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf1c7a58-0221-4bb6-956a-1ffd7864dfb5 admin admin] PATH_INFO: `/v3/roles` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:12:52.892343 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf1c7a58-0221-4bb6-956a-1ffd7864dfb5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:12:52.893923 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf1c7a58-0221-4bb6-956a-1ffd7864dfb5 admin admin] RBAC: Authorization granted {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:12:52.904402 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 1305/2633] 10.222.0.84 () {58 vars in 1121 bytes} [Wed May 25 15:12:52 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 15:12:52.908523 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cbe5cfa-7e87-4007-b750-d3c54a9669ef admin admin] Authenticating user token {{(pid=101893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:12:52.919833 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cbe5cfa-7e87-4007-b750-d3c54a9669ef admin admin] Validating token access rules against request {{(pid=101893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:12:52.924564 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f75c3f9a-7f1d-4fc6-9727-2dd38cb75cc2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cec56f74b2fa4826a506dc7b919465be', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:12:52.925390 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75c3f9a-7f1d-4fc6-9727-2dd38cb75cc2 admin admin] REQUEST_METHOD: `PUT` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:12:52.925675 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75c3f9a-7f1d-4fc6-9727-2dd38cb75cc2 admin admin] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:12:52.925951 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75c3f9a-7f1d-4fc6-9727-2dd38cb75cc2 admin admin] PATH_INFO: `/v3/projects/e0ccea6819624886b212ac7c95070b51/users/5b64b07c162f4fbaa710bdb21596ed60/roles/a3b78e7d547d4d2d998b4c99a4396bba` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:12:52.927952 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f75c3f9a-7f1d-4fc6-9727-2dd38cb75cc2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e0ccea6819624886b212ac7c95070b51, user_id=5b64b07c162f4fbaa710bdb21596ed60, role_id=a3b78e7d547d4d2d998b4c99a4396bba)` {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:12:52.930630 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f75c3f9a-7f1d-4fc6-9727-2dd38cb75cc2 admin admin] RBAC: Authorization granted {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:12:52.942681 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 1329/2634] 10.222.0.84 () {60 vars in 1482 bytes} [Wed May 25 15:12:52 2022] PUT /identity/v3/projects/e0ccea6819624886b212ac7c95070b51/users/5b64b07c162f4fbaa710bdb21596ed60/roles/a3b78e7d547d4d2d998b4c99a4396bba => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 15:12:52.953144 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397522af-61b5-40dc-aa9d-f9913992d2ee None None] REQUEST_METHOD: `POST` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:12:52.953524 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397522af-61b5-40dc-aa9d-f9913992d2ee None None] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:12:52.953865 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397522af-61b5-40dc-aa9d-f9913992d2ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:12:52.960817 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG dbcounter [-] [101892] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=101892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:12:52.985067 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.auth.core [None req-397522af-61b5-40dc-aa9d-f9913992d2ee None None] MFA Rules not processed for user `5b64b07c162f4fbaa710bdb21596ed60`. Rule list: `[]` (Enabled: `True`). {{(pid=101892) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:12:52.990363 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.fernet_utils [None req-397522af-61b5-40dc-aa9d-f9913992d2ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=101892) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:12:53.063061 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 1306/2635] 10.222.0.84 () {58 vars in 957 bytes} [Wed May 25 15:12:52 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 15:12:53.074779 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f75c3f9a-7f1d-4fc6-9727-2dd38cb75cc2 admin admin] Authenticating user token {{(pid=101893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:12:53.076703 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.fernet_utils [None req-f75c3f9a-7f1d-4fc6-9727-2dd38cb75cc2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=101893) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:12:53.136455 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f75c3f9a-7f1d-4fc6-9727-2dd38cb75cc2 admin admin] Validating token access rules against request {{(pid=101893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:12:53.140208 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf64db85-3b54-425b-bf8b-75cac0a33a0f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e079f89a5e524ab6ad4183e4f690de07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a000829c658c4a7cab67f7b6353ba3fa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:12:53.140911 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf64db85-3b54-425b-bf8b-75cac0a33a0f service cinder] REQUEST_METHOD: `GET` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:12:53.141148 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf64db85-3b54-425b-bf8b-75cac0a33a0f service cinder] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:12:53.141570 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf64db85-3b54-425b-bf8b-75cac0a33a0f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:12:53.151177 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf64db85-3b54-425b-bf8b-75cac0a33a0f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:12:53.153522 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf64db85-3b54-425b-bf8b-75cac0a33a0f service cinder] RBAC: Authorization granted {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:12:53.163631 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 1330/2636] 10.222.0.84 () {60 vars in 1365 bytes} [Wed May 25 15:12:53 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 15:12:54.237604 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-397522af-61b5-40dc-aa9d-f9913992d2ee None None] Authenticating user token {{(pid=101892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:12:54.239076 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.fernet_utils [None req-397522af-61b5-40dc-aa9d-f9913992d2ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=101892) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:12:54.254241 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-397522af-61b5-40dc-aa9d-f9913992d2ee None None] Validating token access rules against request {{(pid=101892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:12:54.258578 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e985e413-f3fd-4011-8c7b-71d8382943b9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e079f89a5e524ab6ad4183e4f690de07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a000829c658c4a7cab67f7b6353ba3fa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:12:54.259229 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e985e413-f3fd-4011-8c7b-71d8382943b9 service cinder] REQUEST_METHOD: `GET` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:12:54.259508 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e985e413-f3fd-4011-8c7b-71d8382943b9 service cinder] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:12:54.259929 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e985e413-f3fd-4011-8c7b-71d8382943b9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:12:54.326868 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e985e413-f3fd-4011-8c7b-71d8382943b9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:12:54.328467 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e985e413-f3fd-4011-8c7b-71d8382943b9 service cinder] RBAC: Authorization granted {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:12:54.338048 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 1307/2637] 10.222.0.84 () {60 vars in 1365 bytes} [Wed May 25 15:12:54 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 15:12:57.621910 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260d38a7-8058-498c-9737-43c89ffdcd79 None None] REQUEST_METHOD: `POST` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:12:57.622967 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260d38a7-8058-498c-9737-43c89ffdcd79 None None] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:12:57.623415 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260d38a7-8058-498c-9737-43c89ffdcd79 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:12:57.657411 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.auth.core [None req-260d38a7-8058-498c-9737-43c89ffdcd79 None None] MFA Rules not processed for user `4e3b076bde0145559e76d607a7d2cf81`. Rule list: `[]` (Enabled: `True`). {{(pid=101893) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:12:57.658771 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.fernet_utils [None req-260d38a7-8058-498c-9737-43c89ffdcd79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=101893) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:12:57.731135 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 1331/2638] 10.222.0.84 () {58 vars in 957 bytes} [Wed May 25 15:12:57 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 15:12:57.735515 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e985e413-f3fd-4011-8c7b-71d8382943b9 service cinder] Authenticating user token {{(pid=101892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:12:57.803873 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e985e413-f3fd-4011-8c7b-71d8382943b9 service cinder] Validating token access rules against request {{(pid=101892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:12:57.808516 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4c11e19-aa0a-43a9-b7fe-df43d3a5d342 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cec56f74b2fa4826a506dc7b919465be', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:12:57.809185 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c11e19-aa0a-43a9-b7fe-df43d3a5d342 admin admin] REQUEST_METHOD: `POST` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:12:57.809473 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c11e19-aa0a-43a9-b7fe-df43d3a5d342 admin admin] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:12:57.809751 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c11e19-aa0a-43a9-b7fe-df43d3a5d342 admin admin] PATH_INFO: `/v3/projects` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:12:57.810449 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4c11e19-aa0a-43a9-b7fe-df43d3a5d342 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:12:57.812474 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4c11e19-aa0a-43a9-b7fe-df43d3a5d342 admin admin] RBAC: Authorization granted {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:12:57.958642 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 1308/2639] 10.222.0.84 () {60 vars in 1152 bytes} [Wed May 25 15:12:57 2022] POST /identity/v3/projects => generated 373 bytes in 224 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 25 15:12:57.962768 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-260d38a7-8058-498c-9737-43c89ffdcd79 None None] Authenticating user token {{(pid=101893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:12:57.974446 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-260d38a7-8058-498c-9737-43c89ffdcd79 None None] Validating token access rules against request {{(pid=101893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:12:58.016120 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG dbcounter [-] [101893] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=101893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:12:58.031847 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ef6699-7e05-465a-9e09-1a2faf7ebfd9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cec56f74b2fa4826a506dc7b919465be', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:12:58.032517 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ef6699-7e05-465a-9e09-1a2faf7ebfd9 admin admin] REQUEST_METHOD: `POST` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:12:58.032802 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ef6699-7e05-465a-9e09-1a2faf7ebfd9 admin admin] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:12:58.033080 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ef6699-7e05-465a-9e09-1a2faf7ebfd9 admin admin] PATH_INFO: `/v3/users` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:12:58.033762 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97ef6699-7e05-465a-9e09-1a2faf7ebfd9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:12:58.035712 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97ef6699-7e05-465a-9e09-1a2faf7ebfd9 admin admin] RBAC: Authorization granted {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:12:58.145576 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 1332/2640] 10.222.0.84 () {60 vars in 1143 bytes} [Wed May 25 15:12:57 2022] POST /identity/v3/users => generated 293 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 15:12:58.158051 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4c11e19-aa0a-43a9-b7fe-df43d3a5d342 admin admin] Authenticating user token {{(pid=101892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:12:58.170146 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4c11e19-aa0a-43a9-b7fe-df43d3a5d342 admin admin] Validating token access rules against request {{(pid=101892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:12:58.183057 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4236f3d0-384e-4359-a827-3c8ecf0d4ed1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cec56f74b2fa4826a506dc7b919465be', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:12:58.183777 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4236f3d0-384e-4359-a827-3c8ecf0d4ed1 admin admin] REQUEST_METHOD: `GET` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:12:58.184106 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4236f3d0-384e-4359-a827-3c8ecf0d4ed1 admin admin] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:12:58.184675 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4236f3d0-384e-4359-a827-3c8ecf0d4ed1 admin admin] PATH_INFO: `/v3/roles` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:12:58.188709 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4236f3d0-384e-4359-a827-3c8ecf0d4ed1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:12:58.188709 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4236f3d0-384e-4359-a827-3c8ecf0d4ed1 admin admin] RBAC: Authorization granted {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:12:58.201611 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 1309/2641] 10.222.0.84 () {58 vars in 1121 bytes} [Wed May 25 15:12:58 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 25 15:12:58.205340 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ef6699-7e05-465a-9e09-1a2faf7ebfd9 admin admin] Authenticating user token {{(pid=101893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:12:58.219647 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ef6699-7e05-465a-9e09-1a2faf7ebfd9 admin admin] Validating token access rules against request {{(pid=101893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:12:58.226228 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-366b724b-b116-415a-9065-0f2c01aaf6d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cec56f74b2fa4826a506dc7b919465be', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:12:58.227334 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366b724b-b116-415a-9065-0f2c01aaf6d2 admin admin] REQUEST_METHOD: `PUT` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:12:58.227764 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366b724b-b116-415a-9065-0f2c01aaf6d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:12:58.228250 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366b724b-b116-415a-9065-0f2c01aaf6d2 admin admin] PATH_INFO: `/v3/projects/f5a4e14d2b3e4882ac21c6cd84cff106/users/afd057de163243329131da8fac5a9d5b/roles/a3b78e7d547d4d2d998b4c99a4396bba` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:12:58.249220 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-366b724b-b116-415a-9065-0f2c01aaf6d2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f5a4e14d2b3e4882ac21c6cd84cff106, user_id=afd057de163243329131da8fac5a9d5b, role_id=a3b78e7d547d4d2d998b4c99a4396bba)` {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:12:58.252239 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-366b724b-b116-415a-9065-0f2c01aaf6d2 admin admin] RBAC: Authorization granted {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:12:58.323911 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 1333/2642] 10.222.0.84 () {60 vars in 1482 bytes} [Wed May 25 15:12:58 2022] PUT /identity/v3/projects/f5a4e14d2b3e4882ac21c6cd84cff106/users/afd057de163243329131da8fac5a9d5b/roles/a3b78e7d547d4d2d998b4c99a4396bba => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 15:12:58.328206 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4236f3d0-384e-4359-a827-3c8ecf0d4ed1 admin admin] Authenticating user token {{(pid=101892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:12:58.334444 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG dbcounter [-] [101892] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=101892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:12:58.339900 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4236f3d0-384e-4359-a827-3c8ecf0d4ed1 admin admin] Validating token access rules against request {{(pid=101892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:12:58.402622 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a040ddc9-f50c-4170-9499-f4c9f7b3f92d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cec56f74b2fa4826a506dc7b919465be', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:12:58.403934 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a040ddc9-f50c-4170-9499-f4c9f7b3f92d admin admin] REQUEST_METHOD: `GET` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:12:58.404220 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a040ddc9-f50c-4170-9499-f4c9f7b3f92d admin admin] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:12:58.404501 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a040ddc9-f50c-4170-9499-f4c9f7b3f92d admin admin] PATH_INFO: `/v3/roles` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:12:58.405244 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a040ddc9-f50c-4170-9499-f4c9f7b3f92d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:12:58.407208 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a040ddc9-f50c-4170-9499-f4c9f7b3f92d admin admin] RBAC: Authorization granted {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:12:58.419615 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 1310/2643] 10.222.0.84 () {58 vars in 1121 bytes} [Wed May 25 15:12:58 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 25 15:12:58.423535 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-366b724b-b116-415a-9065-0f2c01aaf6d2 admin admin] Authenticating user token {{(pid=101893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:12:58.435323 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-366b724b-b116-415a-9065-0f2c01aaf6d2 admin admin] Validating token access rules against request {{(pid=101893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:12:58.441951 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbfd83fa-84a8-4953-9465-48d80c3a2898 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cec56f74b2fa4826a506dc7b919465be', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:12:58.442855 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbfd83fa-84a8-4953-9465-48d80c3a2898 admin admin] REQUEST_METHOD: `PUT` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:12:58.443328 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbfd83fa-84a8-4953-9465-48d80c3a2898 admin admin] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:12:58.443650 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbfd83fa-84a8-4953-9465-48d80c3a2898 admin admin] PATH_INFO: `/v3/projects/f5a4e14d2b3e4882ac21c6cd84cff106/users/afd057de163243329131da8fac5a9d5b/roles/a3b78e7d547d4d2d998b4c99a4396bba` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:12:58.445770 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbfd83fa-84a8-4953-9465-48d80c3a2898 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f5a4e14d2b3e4882ac21c6cd84cff106, user_id=afd057de163243329131da8fac5a9d5b, role_id=a3b78e7d547d4d2d998b4c99a4396bba)` {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:12:58.448676 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbfd83fa-84a8-4953-9465-48d80c3a2898 admin admin] RBAC: Authorization granted {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:12:58.460658 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 1334/2644] 10.222.0.84 () {60 vars in 1482 bytes} [Wed May 25 15:12:58 2022] PUT /identity/v3/projects/f5a4e14d2b3e4882ac21c6cd84cff106/users/afd057de163243329131da8fac5a9d5b/roles/a3b78e7d547d4d2d998b4c99a4396bba => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 25 15:12:59.482564 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a040ddc9-f50c-4170-9499-f4c9f7b3f92d admin admin] Authenticating user token {{(pid=101892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:12:59.554024 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a040ddc9-f50c-4170-9499-f4c9f7b3f92d admin admin] Validating token access rules against request {{(pid=101892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:12:59.608563 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab0b3670-6ad7-4cc5-b22b-2244a4d3ad1e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e079f89a5e524ab6ad4183e4f690de07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a000829c658c4a7cab67f7b6353ba3fa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:12:59.609309 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0b3670-6ad7-4cc5-b22b-2244a4d3ad1e service cinder] REQUEST_METHOD: `GET` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:12:59.609739 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0b3670-6ad7-4cc5-b22b-2244a4d3ad1e service cinder] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:12:59.610019 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0b3670-6ad7-4cc5-b22b-2244a4d3ad1e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:12:59.671447 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab0b3670-6ad7-4cc5-b22b-2244a4d3ad1e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:12:59.672937 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab0b3670-6ad7-4cc5-b22b-2244a4d3ad1e service cinder] RBAC: Authorization granted {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:12:59.684809 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 1311/2645] 10.222.0.84 () {60 vars in 1365 bytes} [Wed May 25 15:12:59 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 203 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 15:13:03.125657 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbfd83fa-84a8-4953-9465-48d80c3a2898 admin admin] Authenticating user token {{(pid=101893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:13:03.206074 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbfd83fa-84a8-4953-9465-48d80c3a2898 admin admin] Validating token access rules against request {{(pid=101893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:13:03.210680 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15b1890d-db40-4f6c-9719-64ff6caf7470 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ce28b25b907473588ccb87dc4acc06a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a000829c658c4a7cab67f7b6353ba3fa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:13:03.211441 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b1890d-db40-4f6c-9719-64ff6caf7470 service neutron] REQUEST_METHOD: `GET` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:13:03.211862 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b1890d-db40-4f6c-9719-64ff6caf7470 service neutron] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:13:03.212045 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b1890d-db40-4f6c-9719-64ff6caf7470 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:13:03.214189 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.fernet_utils [None req-15b1890d-db40-4f6c-9719-64ff6caf7470 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=101893) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:13:03.320119 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15b1890d-db40-4f6c-9719-64ff6caf7470 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:13:03.321780 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15b1890d-db40-4f6c-9719-64ff6caf7470 service neutron] RBAC: Authorization granted {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:13:03.339089 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 1335/2646] 10.222.0.84 () {60 vars in 1365 bytes} [Wed May 25 15:13:03 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 214 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 15:13:04.381025 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab0b3670-6ad7-4cc5-b22b-2244a4d3ad1e service cinder] Authenticating user token {{(pid=101892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:13:04.406425 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG dbcounter [-] [101892] Writing DB stats keystone:SELECT=100 {{(pid=101892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:13:04.494551 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab0b3670-6ad7-4cc5-b22b-2244a4d3ad1e service cinder] Validating token access rules against request {{(pid=101892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:13:04.521299 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d1313eb-9b08-494f-a330-1f91494a39e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cec56f74b2fa4826a506dc7b919465be', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:13:04.522211 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1313eb-9b08-494f-a330-1f91494a39e7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:13:04.522496 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1313eb-9b08-494f-a330-1f91494a39e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:13:04.522775 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1313eb-9b08-494f-a330-1f91494a39e7 admin admin] PATH_INFO: `/v3/users/1b59aa3420494b538fa876cbab8b23c0` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:13:04.524090 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d1313eb-9b08-494f-a330-1f91494a39e7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1b59aa3420494b538fa876cbab8b23c0)` {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:13:04.526065 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d1313eb-9b08-494f-a330-1f91494a39e7 admin admin] RBAC: Authorization granted {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:13:04.569803 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15b1890d-db40-4f6c-9719-64ff6caf7470 service neutron] Authenticating user token {{(pid=101893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:13:04.583928 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15b1890d-db40-4f6c-9719-64ff6caf7470 service neutron] Validating token access rules against request {{(pid=101893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:13:04.592000 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bab972e-8e17-45ac-b228-95f9368de26f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ce28b25b907473588ccb87dc4acc06a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a000829c658c4a7cab67f7b6353ba3fa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:13:04.602691 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bab972e-8e17-45ac-b228-95f9368de26f service neutron] REQUEST_METHOD: `GET` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:13:04.602691 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bab972e-8e17-45ac-b228-95f9368de26f service neutron] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:13:04.602691 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bab972e-8e17-45ac-b228-95f9368de26f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:13:04.602691 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.fernet_utils [None req-6bab972e-8e17-45ac-b228-95f9368de26f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=101893) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:13:04.621345 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bab972e-8e17-45ac-b228-95f9368de26f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:13:04.623669 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bab972e-8e17-45ac-b228-95f9368de26f service neutron] RBAC: Authorization granted {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:13:04.643972 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 1336/2647] 10.222.0.84 () {60 vars in 1365 bytes} [Wed May 25 15:13:04 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 74 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 25 15:13:04.802934 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.notifications [None req-1d1313eb-9b08-494f-a330-1f91494a39e7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1b59aa3420494b538fa876cbab8b23c0'} {{(pid=101892) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:13:04.806351 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa3b528-f539-49d4-b699-3138ac2344b2 None None] REQUEST_METHOD: `POST` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:13:04.807048 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa3b528-f539-49d4-b699-3138ac2344b2 None None] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:13:04.807339 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa3b528-f539-49d4-b699-3138ac2344b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:13:04.818778 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.notifications [None req-1d1313eb-9b08-494f-a330-1f91494a39e7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1b59aa3420494b538fa876cbab8b23c0'} {{(pid=101892) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:13:04.834540 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.notifications [None req-1d1313eb-9b08-494f-a330-1f91494a39e7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1b59aa3420494b538fa876cbab8b23c0'} {{(pid=101892) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:13:04.835638 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.notifications [None req-1d1313eb-9b08-494f-a330-1f91494a39e7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1b59aa3420494b538fa876cbab8b23c0'} {{(pid=101892) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:13:04.842562 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.auth.core [None req-4aa3b528-f539-49d4-b699-3138ac2344b2 None None] MFA Rules not processed for user `afd057de163243329131da8fac5a9d5b`. Rule list: `[]` (Enabled: `True`). {{(pid=101893) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:13:04.845003 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.fernet_utils [None req-4aa3b528-f539-49d4-b699-3138ac2344b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=101893) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:13:04.855761 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG dbcounter [-] [101893] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=101893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:13:04.939977 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 1337/2648] 10.222.0.84 () {58 vars in 957 bytes} [Wed May 25 15:13:04 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 25 15:13:04.944250 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.notifications [None req-1d1313eb-9b08-494f-a330-1f91494a39e7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1b59aa3420494b538fa876cbab8b23c0'} {{(pid=101892) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:13:04.947467 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aa3b528-f539-49d4-b699-3138ac2344b2 None None] Authenticating user token {{(pid=101893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:13:04.956632 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.fernet_utils [None req-4aa3b528-f539-49d4-b699-3138ac2344b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=101893) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:13:04.956783 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 1312/2649] 10.222.0.84 () {58 vars in 1223 bytes} [Wed May 25 15:13:04 2022] DELETE /identity/v3/users/1b59aa3420494b538fa876cbab8b23c0 => generated 0 bytes in 573 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 15:13:04.958517 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a54c1fc-b738-4a47-aec5-b5dd92004636 None None] REQUEST_METHOD: `POST` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:13:04.958908 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a54c1fc-b738-4a47-aec5-b5dd92004636 None None] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:13:04.959315 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a54c1fc-b738-4a47-aec5-b5dd92004636 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:13:04.974406 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aa3b528-f539-49d4-b699-3138ac2344b2 None None] Validating token access rules against request {{(pid=101893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:13:04.984420 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.auth.core [None req-5a54c1fc-b738-4a47-aec5-b5dd92004636 None None] MFA Rules not processed for user `05d87e87798e429aa1c10b24391f915e`. Rule list: `[]` (Enabled: `True`). {{(pid=101892) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:13:04.985763 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.fernet_utils [None req-5a54c1fc-b738-4a47-aec5-b5dd92004636 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=101892) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:13:05.071251 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b08000-925f-48a5-8bb0-4c347d87787f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2aeb182e6a5b43cfb0cc347ec847c848', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a000829c658c4a7cab67f7b6353ba3fa', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:13:05.071945 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b08000-925f-48a5-8bb0-4c347d87787f service nova] REQUEST_METHOD: `GET` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:13:05.072228 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b08000-925f-48a5-8bb0-4c347d87787f service nova] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:13:05.072579 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b08000-925f-48a5-8bb0-4c347d87787f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:13:05.074326 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.fernet_utils [None req-c0b08000-925f-48a5-8bb0-4c347d87787f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=101893) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:13:05.081481 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 1313/2650] 10.222.0.84 () {58 vars in 957 bytes} [Wed May 25 15:13:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 15:13:05.092902 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a54c1fc-b738-4a47-aec5-b5dd92004636 None None] Authenticating user token {{(pid=101892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:13:05.095290 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.fernet_utils [None req-5a54c1fc-b738-4a47-aec5-b5dd92004636 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=101892) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:13:05.134994 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG dbcounter [-] [101892] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=101892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:13:05.141793 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0b08000-925f-48a5-8bb0-4c347d87787f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:13:05.143580 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0b08000-925f-48a5-8bb0-4c347d87787f service nova] RBAC: Authorization granted {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:13:05.154330 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 1338/2651] 10.222.0.84 () {60 vars in 1365 bytes} [Wed May 25 15:13:04 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 207 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 25 15:13:05.162427 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a54c1fc-b738-4a47-aec5-b5dd92004636 None None] Validating token access rules against request {{(pid=101892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:13:05.166514 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43df48ab-f386-4d0b-8a63-15b36f3fd941 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ce28b25b907473588ccb87dc4acc06a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a000829c658c4a7cab67f7b6353ba3fa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:13:05.167288 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43df48ab-f386-4d0b-8a63-15b36f3fd941 service neutron] REQUEST_METHOD: `GET` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:13:05.167698 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43df48ab-f386-4d0b-8a63-15b36f3fd941 service neutron] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:13:05.168075 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43df48ab-f386-4d0b-8a63-15b36f3fd941 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:13:05.178866 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43df48ab-f386-4d0b-8a63-15b36f3fd941 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:13:05.180433 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43df48ab-f386-4d0b-8a63-15b36f3fd941 service neutron] RBAC: Authorization granted {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:13:05.191438 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 1314/2652] 10.222.0.84 () {60 vars in 1365 bytes} [Wed May 25 15:13:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 25 15:13:05.666781 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b08000-925f-48a5-8bb0-4c347d87787f service nova] Authenticating user token {{(pid=101893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:13:05.668346 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.fernet_utils [None req-c0b08000-925f-48a5-8bb0-4c347d87787f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=101893) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:13:05.684556 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b08000-925f-48a5-8bb0-4c347d87787f service nova] Validating token access rules against request {{(pid=101893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:13:05.695602 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b34d24ca-3ddf-4bc7-90da-1226723301d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cec56f74b2fa4826a506dc7b919465be', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:13:05.696985 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34d24ca-3ddf-4bc7-90da-1226723301d7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:13:05.696985 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34d24ca-3ddf-4bc7-90da-1226723301d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:13:05.697193 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34d24ca-3ddf-4bc7-90da-1226723301d7 admin admin] PATH_INFO: `/v3/projects/bbacc5160ff248eeb544911cb335720f` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:13:05.698809 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b34d24ca-3ddf-4bc7-90da-1226723301d7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bbacc5160ff248eeb544911cb335720f)` {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:13:05.701690 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b34d24ca-3ddf-4bc7-90da-1226723301d7 admin admin] RBAC: Authorization granted {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:13:05.862290 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG dbcounter [-] [101893] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=101893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:13:05.875269 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.notifications [None req-b34d24ca-3ddf-4bc7-90da-1226723301d7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bbacc5160ff248eeb544911cb335720f', 'request_id': 'req-b34d24ca-3ddf-4bc7-90da-1226723301d7'} {{(pid=101893) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:13:05.885955 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.notifications [None req-b34d24ca-3ddf-4bc7-90da-1226723301d7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bbacc5160ff248eeb544911cb335720f', 'request_id': 'req-b34d24ca-3ddf-4bc7-90da-1226723301d7'} {{(pid=101893) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:13:05.896862 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.notifications [None req-b34d24ca-3ddf-4bc7-90da-1226723301d7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bbacc5160ff248eeb544911cb335720f', 'request_id': 'req-b34d24ca-3ddf-4bc7-90da-1226723301d7'} {{(pid=101893) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:13:06.013322 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.notifications [None req-b34d24ca-3ddf-4bc7-90da-1226723301d7 admin admin] The token cache is being invalidate because project bbacc5160ff248eeb544911cb335720f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=101893) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 25 15:13:06.013615 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.notifications [None req-b34d24ca-3ddf-4bc7-90da-1226723301d7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=101893) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:13:06.024225 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.notifications [None req-b34d24ca-3ddf-4bc7-90da-1226723301d7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=101893) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:13:06.038335 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43df48ab-f386-4d0b-8a63-15b36f3fd941 service neutron] Authenticating user token {{(pid=101892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:13:06.047969 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 1339/2653] 10.222.0.84 () {58 vars in 1232 bytes} [Wed May 25 15:13:05 2022] DELETE /identity/v3/projects/bbacc5160ff248eeb544911cb335720f => generated 0 bytes in 362 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 15:13:06.052610 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43df48ab-f386-4d0b-8a63-15b36f3fd941 service neutron] Validating token access rules against request {{(pid=101892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:13:06.211724 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9301a741-5ad7-491f-a7f2-a10c58b2c2e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cec56f74b2fa4826a506dc7b919465be', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:13:06.212929 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9301a741-5ad7-491f-a7f2-a10c58b2c2e9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:13:06.213162 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9301a741-5ad7-491f-a7f2-a10c58b2c2e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:13:06.213475 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9301a741-5ad7-491f-a7f2-a10c58b2c2e9 admin admin] PATH_INFO: `/v3/users/ecc3de83558b447cafa1fa882e354bf7` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:13:06.214718 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9301a741-5ad7-491f-a7f2-a10c58b2c2e9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ecc3de83558b447cafa1fa882e354bf7)` {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:13:06.216731 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9301a741-5ad7-491f-a7f2-a10c58b2c2e9 admin admin] RBAC: Authorization granted {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:13:06.443189 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.notifications [None req-9301a741-5ad7-491f-a7f2-a10c58b2c2e9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ecc3de83558b447cafa1fa882e354bf7'} {{(pid=101892) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:13:06.451366 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.notifications [None req-9301a741-5ad7-491f-a7f2-a10c58b2c2e9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ecc3de83558b447cafa1fa882e354bf7'} {{(pid=101892) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:13:06.465848 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.notifications [None req-9301a741-5ad7-491f-a7f2-a10c58b2c2e9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ecc3de83558b447cafa1fa882e354bf7'} {{(pid=101892) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:13:06.466616 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.notifications [None req-9301a741-5ad7-491f-a7f2-a10c58b2c2e9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ecc3de83558b447cafa1fa882e354bf7'} {{(pid=101892) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:13:06.539081 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.notifications [None req-9301a741-5ad7-491f-a7f2-a10c58b2c2e9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ecc3de83558b447cafa1fa882e354bf7'} {{(pid=101892) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:13:06.547048 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 1315/2654] 10.222.0.84 () {58 vars in 1223 bytes} [Wed May 25 15:13:06 2022] DELETE /identity/v3/users/ecc3de83558b447cafa1fa882e354bf7 => generated 0 bytes in 514 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 15:13:07.088789 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b34d24ca-3ddf-4bc7-90da-1226723301d7 admin admin] Authenticating user token {{(pid=101893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:13:07.091004 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.fernet_utils [None req-b34d24ca-3ddf-4bc7-90da-1226723301d7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=101893) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:13:07.114394 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b34d24ca-3ddf-4bc7-90da-1226723301d7 admin admin] Validating token access rules against request {{(pid=101893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:13:07.197741 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6321276b-655a-4bff-9ea6-5ac68166cd56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cec56f74b2fa4826a506dc7b919465be', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:13:07.198788 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6321276b-655a-4bff-9ea6-5ac68166cd56 admin admin] REQUEST_METHOD: `DELETE` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:13:07.199138 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6321276b-655a-4bff-9ea6-5ac68166cd56 admin admin] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:13:07.200510 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6321276b-655a-4bff-9ea6-5ac68166cd56 admin admin] PATH_INFO: `/v3/projects/e32f99280ad547c79aff420e60c20000` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:13:07.201859 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6321276b-655a-4bff-9ea6-5ac68166cd56 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e32f99280ad547c79aff420e60c20000)` {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:13:07.204311 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6321276b-655a-4bff-9ea6-5ac68166cd56 admin admin] RBAC: Authorization granted {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:13:07.370471 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.notifications [None req-6321276b-655a-4bff-9ea6-5ac68166cd56 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e32f99280ad547c79aff420e60c20000', 'request_id': 'req-6321276b-655a-4bff-9ea6-5ac68166cd56'} {{(pid=101893) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:13:07.381755 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.notifications [None req-6321276b-655a-4bff-9ea6-5ac68166cd56 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e32f99280ad547c79aff420e60c20000', 'request_id': 'req-6321276b-655a-4bff-9ea6-5ac68166cd56'} {{(pid=101893) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:13:07.398428 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.notifications [None req-6321276b-655a-4bff-9ea6-5ac68166cd56 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e32f99280ad547c79aff420e60c20000', 'request_id': 'req-6321276b-655a-4bff-9ea6-5ac68166cd56'} {{(pid=101893) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:13:07.487720 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.notifications [None req-6321276b-655a-4bff-9ea6-5ac68166cd56 admin admin] The token cache is being invalidate because project e32f99280ad547c79aff420e60c20000 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=101893) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 25 15:13:07.488032 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.notifications [None req-6321276b-655a-4bff-9ea6-5ac68166cd56 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=101893) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:13:07.488795 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.notifications [None req-6321276b-655a-4bff-9ea6-5ac68166cd56 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=101893) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:13:07.495288 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9301a741-5ad7-491f-a7f2-a10c58b2c2e9 admin admin] Authenticating user token {{(pid=101892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:13:07.498360 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.fernet_utils [None req-9301a741-5ad7-491f-a7f2-a10c58b2c2e9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=101892) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:13:07.500549 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 1340/2655] 10.222.0.84 () {58 vars in 1232 bytes} [Wed May 25 15:13:07 2022] DELETE /identity/v3/projects/e32f99280ad547c79aff420e60c20000 => generated 0 bytes in 402 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 15:13:07.528780 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9301a741-5ad7-491f-a7f2-a10c58b2c2e9 admin admin] Validating token access rules against request {{(pid=101892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:13:07.638609 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG dbcounter [-] [101892] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=101892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:13:07.663927 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7126cd5-0cd4-4dd8-af62-c556cf97d24b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cec56f74b2fa4826a506dc7b919465be', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:13:07.665815 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7126cd5-0cd4-4dd8-af62-c556cf97d24b admin admin] REQUEST_METHOD: `DELETE` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:13:07.666106 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7126cd5-0cd4-4dd8-af62-c556cf97d24b admin admin] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:13:07.666387 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7126cd5-0cd4-4dd8-af62-c556cf97d24b admin admin] PATH_INFO: `/v3/users/5b64b07c162f4fbaa710bdb21596ed60` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:13:07.670454 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7126cd5-0cd4-4dd8-af62-c556cf97d24b admin admin] RBAC: Authorizing `identity:delete_user(user_id=5b64b07c162f4fbaa710bdb21596ed60)` {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:13:07.674945 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7126cd5-0cd4-4dd8-af62-c556cf97d24b admin admin] RBAC: Authorization granted {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:13:07.893756 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.notifications [None req-c7126cd5-0cd4-4dd8-af62-c556cf97d24b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5b64b07c162f4fbaa710bdb21596ed60'} {{(pid=101892) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:13:07.904881 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.notifications [None req-c7126cd5-0cd4-4dd8-af62-c556cf97d24b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5b64b07c162f4fbaa710bdb21596ed60'} {{(pid=101892) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:13:07.935472 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.notifications [None req-c7126cd5-0cd4-4dd8-af62-c556cf97d24b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5b64b07c162f4fbaa710bdb21596ed60'} {{(pid=101892) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:13:07.936244 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.notifications [None req-c7126cd5-0cd4-4dd8-af62-c556cf97d24b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5b64b07c162f4fbaa710bdb21596ed60'} {{(pid=101892) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:13:08.040806 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.notifications [None req-c7126cd5-0cd4-4dd8-af62-c556cf97d24b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5b64b07c162f4fbaa710bdb21596ed60'} {{(pid=101892) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:13:08.050737 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 1316/2656] 10.222.0.84 () {58 vars in 1223 bytes} [Wed May 25 15:13:07 2022] DELETE /identity/v3/users/5b64b07c162f4fbaa710bdb21596ed60 => generated 0 bytes in 556 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 15:13:08.660530 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6321276b-655a-4bff-9ea6-5ac68166cd56 admin admin] Authenticating user token {{(pid=101893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:13:08.661416 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.fernet_utils [None req-6321276b-655a-4bff-9ea6-5ac68166cd56 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=101893) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:13:08.678737 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6321276b-655a-4bff-9ea6-5ac68166cd56 admin admin] Validating token access rules against request {{(pid=101893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:13:08.739098 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG dbcounter [-] [101893] Writing DB stats keystone:SELECT=87,keystone:DELETE=11,keystone:INSERT=2 {{(pid=101893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:13:08.745343 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7370ade6-5c31-47b3-83d8-3eac75c16e92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cec56f74b2fa4826a506dc7b919465be', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:13:08.753065 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7370ade6-5c31-47b3-83d8-3eac75c16e92 admin admin] REQUEST_METHOD: `DELETE` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:13:08.753065 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7370ade6-5c31-47b3-83d8-3eac75c16e92 admin admin] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:13:08.753065 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7370ade6-5c31-47b3-83d8-3eac75c16e92 admin admin] PATH_INFO: `/v3/projects/e0ccea6819624886b212ac7c95070b51` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:13:08.753065 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7370ade6-5c31-47b3-83d8-3eac75c16e92 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e0ccea6819624886b212ac7c95070b51)` {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:13:08.753065 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7370ade6-5c31-47b3-83d8-3eac75c16e92 admin admin] RBAC: Authorization granted {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:13:08.894401 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.notifications [None req-7370ade6-5c31-47b3-83d8-3eac75c16e92 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e0ccea6819624886b212ac7c95070b51', 'request_id': 'req-7370ade6-5c31-47b3-83d8-3eac75c16e92'} {{(pid=101893) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:13:08.900656 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.notifications [None req-7370ade6-5c31-47b3-83d8-3eac75c16e92 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e0ccea6819624886b212ac7c95070b51', 'request_id': 'req-7370ade6-5c31-47b3-83d8-3eac75c16e92'} {{(pid=101893) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:13:08.906887 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.notifications [None req-7370ade6-5c31-47b3-83d8-3eac75c16e92 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e0ccea6819624886b212ac7c95070b51', 'request_id': 'req-7370ade6-5c31-47b3-83d8-3eac75c16e92'} {{(pid=101893) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:13:08.972996 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.notifications [None req-7370ade6-5c31-47b3-83d8-3eac75c16e92 admin admin] The token cache is being invalidate because project e0ccea6819624886b212ac7c95070b51 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=101893) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 25 15:13:08.973298 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.notifications [None req-7370ade6-5c31-47b3-83d8-3eac75c16e92 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=101893) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:13:08.973952 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.notifications [None req-7370ade6-5c31-47b3-83d8-3eac75c16e92 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=101893) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:13:08.975512 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 1341/2657] 10.222.0.84 () {58 vars in 1232 bytes} [Wed May 25 15:13:08 2022] DELETE /identity/v3/projects/e0ccea6819624886b212ac7c95070b51 => generated 0 bytes in 317 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 15:13:08.981852 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dbadae0-0c65-4639-9a72-69df960986a6 None None] REQUEST_METHOD: `POST` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:13:08.982350 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dbadae0-0c65-4639-9a72-69df960986a6 None None] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:13:08.982525 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dbadae0-0c65-4639-9a72-69df960986a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:13:09.003693 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.auth.core [None req-6dbadae0-0c65-4639-9a72-69df960986a6 None None] MFA Rules not processed for user `05d87e87798e429aa1c10b24391f915e`. Rule list: `[]` (Enabled: `True`). {{(pid=101892) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:13:09.003693 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.fernet_utils [None req-6dbadae0-0c65-4639-9a72-69df960986a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=101892) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:13:09.067485 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 1317/2658] 10.222.0.84 () {58 vars in 957 bytes} [Wed May 25 15:13:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 25 15:13:09.077605 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e2849b-fd7b-4a61-9e26-cd9956f2c29a None None] REQUEST_METHOD: `POST` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:13:09.077902 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e2849b-fd7b-4a61-9e26-cd9956f2c29a None None] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:13:09.078186 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e2849b-fd7b-4a61-9e26-cd9956f2c29a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:13:09.083536 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6170cc29-ab88-4fc4-a865-29bb4a105170 None None] REQUEST_METHOD: `POST` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:13:09.084052 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6170cc29-ab88-4fc4-a865-29bb4a105170 None None] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:13:09.084339 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6170cc29-ab88-4fc4-a865-29bb4a105170 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:13:09.104832 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.auth.core [None req-14e2849b-fd7b-4a61-9e26-cd9956f2c29a None None] MFA Rules not processed for user `05d87e87798e429aa1c10b24391f915e`. Rule list: `[]` (Enabled: `True`). {{(pid=101893) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:13:09.106649 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.fernet_utils [None req-14e2849b-fd7b-4a61-9e26-cd9956f2c29a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=101893) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:13:09.108247 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.auth.core [None req-6170cc29-ab88-4fc4-a865-29bb4a105170 None None] MFA Rules not processed for user `4e3b076bde0145559e76d607a7d2cf81`. Rule list: `[]` (Enabled: `True`). {{(pid=101892) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:13:09.109476 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.fernet_utils [None req-6170cc29-ab88-4fc4-a865-29bb4a105170 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=101892) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:13:09.118919 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 1342/2659] 10.222.0.84 () {58 vars in 957 bytes} [Wed May 25 15:13:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 15:13:09.121275 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14e2849b-fd7b-4a61-9e26-cd9956f2c29a None None] Authenticating user token {{(pid=101893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:13:09.134651 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14e2849b-fd7b-4a61-9e26-cd9956f2c29a None None] Validating token access rules against request {{(pid=101893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:13:09.141683 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc55b41-0557-4345-bad9-a658a1396c52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cec56f74b2fa4826a506dc7b919465be', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:13:09.142394 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc55b41-0557-4345-bad9-a658a1396c52 admin admin] REQUEST_METHOD: `GET` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:13:09.142834 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc55b41-0557-4345-bad9-a658a1396c52 admin admin] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:13:09.143137 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc55b41-0557-4345-bad9-a658a1396c52 admin admin] PATH_INFO: `/v3/domains` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:13:09.144209 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adc55b41-0557-4345-bad9-a658a1396c52 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=101893) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 15:13:09.144586 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adc55b41-0557-4345-bad9-a658a1396c52 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:13:09.146168 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adc55b41-0557-4345-bad9-a658a1396c52 admin admin] RBAC: Authorization granted {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:13:09.165354 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 1343/2660] 10.222.0.84 () {58 vars in 1152 bytes} [Wed May 25 15:13:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 15:13:09.166521 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc55b41-0557-4345-bad9-a658a1396c52 admin admin] Authenticating user token {{(pid=101893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:13:09.178051 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc55b41-0557-4345-bad9-a658a1396c52 admin admin] Validating token access rules against request {{(pid=101893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:13:09.183416 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54184b8e-09d1-4b8e-b077-3a6968d507b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cec56f74b2fa4826a506dc7b919465be', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:13:09.189037 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54184b8e-09d1-4b8e-b077-3a6968d507b7 admin admin] REQUEST_METHOD: `POST` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:13:09.189037 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54184b8e-09d1-4b8e-b077-3a6968d507b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:13:09.189037 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54184b8e-09d1-4b8e-b077-3a6968d507b7 admin admin] PATH_INFO: `/v3/projects` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:13:09.189037 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54184b8e-09d1-4b8e-b077-3a6968d507b7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:13:09.189037 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54184b8e-09d1-4b8e-b077-3a6968d507b7 admin admin] RBAC: Authorization granted {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:13:09.192063 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 1318/2661] 10.222.0.84 () {58 vars in 957 bytes} [Wed May 25 15:13:09 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 25 15:13:09.280883 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 1344/2662] 10.222.0.84 () {60 vars in 1152 bytes} [Wed May 25 15:13:09 2022] POST /identity/v3/projects => generated 409 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 15:13:09.282134 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6170cc29-ab88-4fc4-a865-29bb4a105170 None None] Authenticating user token {{(pid=101892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:13:09.294325 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6170cc29-ab88-4fc4-a865-29bb4a105170 None None] Validating token access rules against request {{(pid=101892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:13:09.306262 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG dbcounter [-] [101892] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=101892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:13:09.356289 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-710234c6-d3f5-481f-8994-a64454380b81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cec56f74b2fa4826a506dc7b919465be', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:13:09.356289 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-710234c6-d3f5-481f-8994-a64454380b81 admin admin] REQUEST_METHOD: `POST` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:13:09.356289 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-710234c6-d3f5-481f-8994-a64454380b81 admin admin] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:13:09.356289 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-710234c6-d3f5-481f-8994-a64454380b81 admin admin] PATH_INFO: `/v3/users` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:13:09.356645 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-710234c6-d3f5-481f-8994-a64454380b81 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:13:09.357640 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-710234c6-d3f5-481f-8994-a64454380b81 admin admin] RBAC: Authorization granted {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:13:09.437750 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 1319/2663] 10.222.0.84 () {60 vars in 1143 bytes} [Wed May 25 15:13:09 2022] POST /identity/v3/users => generated 305 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 15:13:09.440064 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54184b8e-09d1-4b8e-b077-3a6968d507b7 admin admin] Authenticating user token {{(pid=101893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:13:09.450862 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54184b8e-09d1-4b8e-b077-3a6968d507b7 admin admin] Validating token access rules against request {{(pid=101893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:13:09.455659 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83080f8a-7358-4cec-9ec2-f31a03d5a318 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cec56f74b2fa4826a506dc7b919465be', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:13:09.456332 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83080f8a-7358-4cec-9ec2-f31a03d5a318 admin admin] REQUEST_METHOD: `GET` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:13:09.456729 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83080f8a-7358-4cec-9ec2-f31a03d5a318 admin admin] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:13:09.456895 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83080f8a-7358-4cec-9ec2-f31a03d5a318 admin admin] PATH_INFO: `/v3/roles` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:13:09.457687 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83080f8a-7358-4cec-9ec2-f31a03d5a318 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:13:09.459302 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83080f8a-7358-4cec-9ec2-f31a03d5a318 admin admin] RBAC: Authorization granted {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:13:09.470349 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 1345/2664] 10.222.0.84 () {58 vars in 1121 bytes} [Wed May 25 15:13:09 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 25 15:13:09.474362 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-710234c6-d3f5-481f-8994-a64454380b81 admin admin] Authenticating user token {{(pid=101892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:13:09.485674 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-710234c6-d3f5-481f-8994-a64454380b81 admin admin] Validating token access rules against request {{(pid=101892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:13:09.490720 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38543827-d03f-47f2-93c2-19b0f72f9e95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cec56f74b2fa4826a506dc7b919465be', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:13:09.493028 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38543827-d03f-47f2-93c2-19b0f72f9e95 admin admin] REQUEST_METHOD: `GET` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:13:09.493028 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38543827-d03f-47f2-93c2-19b0f72f9e95 admin admin] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:13:09.493028 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38543827-d03f-47f2-93c2-19b0f72f9e95 admin admin] PATH_INFO: `/v3/roles` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:13:09.493028 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38543827-d03f-47f2-93c2-19b0f72f9e95 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:13:09.494385 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38543827-d03f-47f2-93c2-19b0f72f9e95 admin admin] RBAC: Authorization granted {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:13:09.504936 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 1320/2665] 10.222.0.84 () {58 vars in 1121 bytes} [Wed May 25 15:13:09 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 15:13:09.509182 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83080f8a-7358-4cec-9ec2-f31a03d5a318 admin admin] Authenticating user token {{(pid=101893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:13:09.519277 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83080f8a-7358-4cec-9ec2-f31a03d5a318 admin admin] Validating token access rules against request {{(pid=101893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:13:09.523948 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66fef814-6431-44c4-87d0-af7177b6e2b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cec56f74b2fa4826a506dc7b919465be', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:13:09.524824 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66fef814-6431-44c4-87d0-af7177b6e2b2 admin admin] REQUEST_METHOD: `PUT` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:13:09.525135 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66fef814-6431-44c4-87d0-af7177b6e2b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:13:09.525408 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66fef814-6431-44c4-87d0-af7177b6e2b2 admin admin] PATH_INFO: `/v3/projects/ff13d177b6ec4d6caa22431eac0e0530/users/b1a223787054469b8e1816453b975090/roles/ff664fa0db7e4262a5accde96c3df4c3` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:13:09.540979 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66fef814-6431-44c4-87d0-af7177b6e2b2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ff13d177b6ec4d6caa22431eac0e0530, user_id=b1a223787054469b8e1816453b975090, role_id=ff664fa0db7e4262a5accde96c3df4c3)` {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:13:09.544344 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66fef814-6431-44c4-87d0-af7177b6e2b2 admin admin] RBAC: Authorization granted {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:13:09.629110 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 1346/2666] 10.222.0.84 () {60 vars in 1482 bytes} [Wed May 25 15:13:09 2022] PUT /identity/v3/projects/ff13d177b6ec4d6caa22431eac0e0530/users/b1a223787054469b8e1816453b975090/roles/ff664fa0db7e4262a5accde96c3df4c3 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 15:13:09.640579 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6d5b2c-8787-4c40-976a-a23c6cc86cf2 None None] REQUEST_METHOD: `POST` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:13:09.640579 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6d5b2c-8787-4c40-976a-a23c6cc86cf2 None None] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:13:09.640791 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6d5b2c-8787-4c40-976a-a23c6cc86cf2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:13:09.675693 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.auth.core [None req-fa6d5b2c-8787-4c40-976a-a23c6cc86cf2 None None] MFA Rules not processed for user `b1a223787054469b8e1816453b975090`. Rule list: `[]` (Enabled: `True`). {{(pid=101892) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:13:09.676976 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.fernet_utils [None req-fa6d5b2c-8787-4c40-976a-a23c6cc86cf2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=101892) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:13:09.789408 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 1321/2667] 10.222.0.84 () {58 vars in 957 bytes} [Wed May 25 15:13:09 2022] POST /identity/v3/auth/tokens => generated 3276 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 25 15:13:09.794228 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66fef814-6431-44c4-87d0-af7177b6e2b2 admin admin] Authenticating user token {{(pid=101893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:13:09.855093 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66fef814-6431-44c4-87d0-af7177b6e2b2 admin admin] Validating token access rules against request {{(pid=101893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:13:09.859846 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-954087b2-07f6-496f-8b10-4e8774cfea01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cec56f74b2fa4826a506dc7b919465be', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:13:09.860502 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954087b2-07f6-496f-8b10-4e8774cfea01 admin admin] REQUEST_METHOD: `POST` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:13:09.860787 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954087b2-07f6-496f-8b10-4e8774cfea01 admin admin] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:13:09.861064 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954087b2-07f6-496f-8b10-4e8774cfea01 admin admin] PATH_INFO: `/v3/projects` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:13:09.861757 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-954087b2-07f6-496f-8b10-4e8774cfea01 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:13:09.863704 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-954087b2-07f6-496f-8b10-4e8774cfea01 admin admin] RBAC: Authorization granted {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:13:09.877792 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG dbcounter [-] [101893] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=101893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:13:10.015410 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 1347/2668] 10.222.0.84 () {60 vars in 1152 bytes} [Wed May 25 15:13:09 2022] POST /identity/v3/projects => generated 409 bytes in 219 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 15:13:10.016623 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa6d5b2c-8787-4c40-976a-a23c6cc86cf2 None None] Authenticating user token {{(pid=101892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:13:10.028928 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa6d5b2c-8787-4c40-976a-a23c6cc86cf2 None None] Validating token access rules against request {{(pid=101892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:13:10.095851 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c81f805-c4ce-4b71-8705-ebf94a790c4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cec56f74b2fa4826a506dc7b919465be', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:13:10.096589 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c81f805-c4ce-4b71-8705-ebf94a790c4b admin admin] REQUEST_METHOD: `POST` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:13:10.096870 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c81f805-c4ce-4b71-8705-ebf94a790c4b admin admin] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:13:10.097176 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c81f805-c4ce-4b71-8705-ebf94a790c4b admin admin] PATH_INFO: `/v3/users` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:13:10.097895 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c81f805-c4ce-4b71-8705-ebf94a790c4b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:13:10.099968 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c81f805-c4ce-4b71-8705-ebf94a790c4b admin admin] RBAC: Authorization granted {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:13:10.224696 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 1322/2669] 10.222.0.84 () {60 vars in 1143 bytes} [Wed May 25 15:13:10 2022] POST /identity/v3/users => generated 311 bytes in 208 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 15:13:10.228803 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-954087b2-07f6-496f-8b10-4e8774cfea01 admin admin] Authenticating user token {{(pid=101893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:13:10.239247 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-954087b2-07f6-496f-8b10-4e8774cfea01 admin admin] Validating token access rules against request {{(pid=101893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:13:10.244158 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-618518d1-314b-413f-b278-52e48887651f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cec56f74b2fa4826a506dc7b919465be', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:13:10.244846 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618518d1-314b-413f-b278-52e48887651f admin admin] REQUEST_METHOD: `GET` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:13:10.245408 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618518d1-314b-413f-b278-52e48887651f admin admin] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:13:10.245516 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618518d1-314b-413f-b278-52e48887651f admin admin] PATH_INFO: `/v3/roles` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:13:10.246810 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-618518d1-314b-413f-b278-52e48887651f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:13:10.248491 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-618518d1-314b-413f-b278-52e48887651f admin admin] RBAC: Authorization granted {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:13:10.259324 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 1348/2670] 10.222.0.84 () {58 vars in 1121 bytes} [Wed May 25 15:13:10 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 15:13:10.264033 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c81f805-c4ce-4b71-8705-ebf94a790c4b admin admin] Authenticating user token {{(pid=101892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:13:10.274987 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c81f805-c4ce-4b71-8705-ebf94a790c4b admin admin] Validating token access rules against request {{(pid=101892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:13:10.279687 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81383d8e-2fd5-48d6-ad5c-b0d59636f97a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cec56f74b2fa4826a506dc7b919465be', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:13:10.280566 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81383d8e-2fd5-48d6-ad5c-b0d59636f97a admin admin] REQUEST_METHOD: `PUT` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:13:10.280862 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81383d8e-2fd5-48d6-ad5c-b0d59636f97a admin admin] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:13:10.281142 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81383d8e-2fd5-48d6-ad5c-b0d59636f97a admin admin] PATH_INFO: `/v3/projects/210f45eff62b4371a63f112c5dccdc69/users/ce85dea177654023983cf75474a7bd36/roles/a3b78e7d547d4d2d998b4c99a4396bba` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:13:10.292716 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG dbcounter [-] [101892] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=101892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:13:10.297092 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81383d8e-2fd5-48d6-ad5c-b0d59636f97a admin admin] RBAC: Authorizing `identity:create_grant(project_id=210f45eff62b4371a63f112c5dccdc69, user_id=ce85dea177654023983cf75474a7bd36, role_id=a3b78e7d547d4d2d998b4c99a4396bba)` {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:13:10.300043 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81383d8e-2fd5-48d6-ad5c-b0d59636f97a admin admin] RBAC: Authorization granted {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:13:10.384223 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 1323/2671] 10.222.0.84 () {60 vars in 1482 bytes} [Wed May 25 15:13:10 2022] PUT /identity/v3/projects/210f45eff62b4371a63f112c5dccdc69/users/ce85dea177654023983cf75474a7bd36/roles/a3b78e7d547d4d2d998b4c99a4396bba => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 15:13:10.388766 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-618518d1-314b-413f-b278-52e48887651f admin admin] Authenticating user token {{(pid=101893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:13:10.398880 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-618518d1-314b-413f-b278-52e48887651f admin admin] Validating token access rules against request {{(pid=101893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:13:10.456071 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d05aebc-304c-4759-9df5-e47e9aa45fe4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cec56f74b2fa4826a506dc7b919465be', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:13:10.456732 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d05aebc-304c-4759-9df5-e47e9aa45fe4 admin admin] REQUEST_METHOD: `GET` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:13:10.457017 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d05aebc-304c-4759-9df5-e47e9aa45fe4 admin admin] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:13:10.457287 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d05aebc-304c-4759-9df5-e47e9aa45fe4 admin admin] PATH_INFO: `/v3/roles` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:13:10.458002 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d05aebc-304c-4759-9df5-e47e9aa45fe4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:13:10.459620 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d05aebc-304c-4759-9df5-e47e9aa45fe4 admin admin] RBAC: Authorization granted {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:13:10.469283 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 1349/2672] 10.222.0.84 () {58 vars in 1121 bytes} [Wed May 25 15:13:10 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 15:13:10.473462 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81383d8e-2fd5-48d6-ad5c-b0d59636f97a admin admin] Authenticating user token {{(pid=101892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:13:10.484825 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81383d8e-2fd5-48d6-ad5c-b0d59636f97a admin admin] Validating token access rules against request {{(pid=101892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:13:10.490319 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56929b4c-7242-42cf-9d55-802f0de4f92b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cec56f74b2fa4826a506dc7b919465be', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:13:10.491116 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56929b4c-7242-42cf-9d55-802f0de4f92b admin admin] REQUEST_METHOD: `PUT` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:13:10.491445 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56929b4c-7242-42cf-9d55-802f0de4f92b admin admin] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:13:10.491758 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56929b4c-7242-42cf-9d55-802f0de4f92b admin admin] PATH_INFO: `/v3/projects/210f45eff62b4371a63f112c5dccdc69/users/ce85dea177654023983cf75474a7bd36/roles/a3b78e7d547d4d2d998b4c99a4396bba` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:13:10.493983 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56929b4c-7242-42cf-9d55-802f0de4f92b admin admin] RBAC: Authorizing `identity:create_grant(project_id=210f45eff62b4371a63f112c5dccdc69, user_id=ce85dea177654023983cf75474a7bd36, role_id=a3b78e7d547d4d2d998b4c99a4396bba)` {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:13:10.497537 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56929b4c-7242-42cf-9d55-802f0de4f92b admin admin] RBAC: Authorization granted {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:13:10.508772 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 1324/2673] 10.222.0.84 () {60 vars in 1482 bytes} [Wed May 25 15:13:10 2022] PUT /identity/v3/projects/210f45eff62b4371a63f112c5dccdc69/users/ce85dea177654023983cf75474a7bd36/roles/a3b78e7d547d4d2d998b4c99a4396bba => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 15:13:10.519108 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b9fa1d-0c71-4724-812b-87e727bf60d9 None None] REQUEST_METHOD: `POST` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:13:10.519429 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b9fa1d-0c71-4724-812b-87e727bf60d9 None None] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:13:10.519748 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b9fa1d-0c71-4724-812b-87e727bf60d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:13:10.549976 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.auth.core [None req-d1b9fa1d-0c71-4724-812b-87e727bf60d9 None None] MFA Rules not processed for user `ce85dea177654023983cf75474a7bd36`. Rule list: `[]` (Enabled: `True`). {{(pid=101893) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:13:10.551359 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.fernet_utils [None req-d1b9fa1d-0c71-4724-812b-87e727bf60d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=101893) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:13:10.623025 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 1350/2674] 10.222.0.84 () {58 vars in 957 bytes} [Wed May 25 15:13:10 2022] POST /identity/v3/auth/tokens => generated 3343 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 25 15:13:10.633668 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56929b4c-7242-42cf-9d55-802f0de4f92b admin admin] Authenticating user token {{(pid=101892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:13:10.635412 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.fernet_utils [None req-56929b4c-7242-42cf-9d55-802f0de4f92b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=101892) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:13:10.696795 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56929b4c-7242-42cf-9d55-802f0de4f92b admin admin] Validating token access rules against request {{(pid=101892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:13:10.701275 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ed7a18-f5ac-4029-86c9-83af4f9dae06 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e079f89a5e524ab6ad4183e4f690de07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a000829c658c4a7cab67f7b6353ba3fa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:13:10.701943 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ed7a18-f5ac-4029-86c9-83af4f9dae06 service cinder] REQUEST_METHOD: `GET` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:13:10.702220 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ed7a18-f5ac-4029-86c9-83af4f9dae06 service cinder] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:13:10.702510 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ed7a18-f5ac-4029-86c9-83af4f9dae06 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:13:10.713338 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07ed7a18-f5ac-4029-86c9-83af4f9dae06 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:13:10.714931 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07ed7a18-f5ac-4029-86c9-83af4f9dae06 service cinder] RBAC: Authorization granted {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:13:10.725187 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 1325/2675] 10.222.0.84 () {60 vars in 1365 bytes} [Wed May 25 15:13:10 2022] GET /identity/v3/auth/tokens => generated 3343 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 15:13:11.099406 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1b9fa1d-0c71-4724-812b-87e727bf60d9 None None] Authenticating user token {{(pid=101893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:13:11.100893 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.fernet_utils [None req-d1b9fa1d-0c71-4724-812b-87e727bf60d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=101893) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:13:11.118255 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1b9fa1d-0c71-4724-812b-87e727bf60d9 None None] Validating token access rules against request {{(pid=101893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:13:11.122154 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebeaa8bc-dee9-4fb4-a4d9-313b93a1dcba service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e079f89a5e524ab6ad4183e4f690de07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a000829c658c4a7cab67f7b6353ba3fa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:13:11.125432 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebeaa8bc-dee9-4fb4-a4d9-313b93a1dcba service cinder] REQUEST_METHOD: `GET` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:13:11.125432 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebeaa8bc-dee9-4fb4-a4d9-313b93a1dcba service cinder] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:13:11.125432 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebeaa8bc-dee9-4fb4-a4d9-313b93a1dcba service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:13:11.149581 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ed7a18-f5ac-4029-86c9-83af4f9dae06 service cinder] Authenticating user token {{(pid=101892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:13:11.151162 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.fernet_utils [None req-07ed7a18-f5ac-4029-86c9-83af4f9dae06 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=101892) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:13:11.197179 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebeaa8bc-dee9-4fb4-a4d9-313b93a1dcba service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:13:11.198644 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebeaa8bc-dee9-4fb4-a4d9-313b93a1dcba service cinder] RBAC: Authorization granted {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:13:11.208754 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 1351/2676] 10.222.0.84 () {60 vars in 1365 bytes} [Wed May 25 15:13:11 2022] GET /identity/v3/auth/tokens => generated 3276 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 15:13:11.222209 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ed7a18-f5ac-4029-86c9-83af4f9dae06 service cinder] Validating token access rules against request {{(pid=101892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:13:11.226179 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-739e18bd-1e0c-4f5f-9c04-2a779b250f30 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ce28b25b907473588ccb87dc4acc06a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a000829c658c4a7cab67f7b6353ba3fa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:13:11.226837 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739e18bd-1e0c-4f5f-9c04-2a779b250f30 service neutron] REQUEST_METHOD: `GET` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:13:11.227147 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739e18bd-1e0c-4f5f-9c04-2a779b250f30 service neutron] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:13:11.227423 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739e18bd-1e0c-4f5f-9c04-2a779b250f30 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:13:11.229411 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.fernet_utils [None req-739e18bd-1e0c-4f5f-9c04-2a779b250f30 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=101892) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:13:11.301006 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-739e18bd-1e0c-4f5f-9c04-2a779b250f30 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:13:11.303237 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-739e18bd-1e0c-4f5f-9c04-2a779b250f30 service neutron] RBAC: Authorization granted {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:13:11.313443 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 1326/2677] 10.222.0.84 () {60 vars in 1365 bytes} [Wed May 25 15:13:11 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 164 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 25 15:13:14.874610 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebeaa8bc-dee9-4fb4-a4d9-313b93a1dcba service cinder] Authenticating user token {{(pid=101893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:13:14.876688 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.fernet_utils [None req-ebeaa8bc-dee9-4fb4-a4d9-313b93a1dcba service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=101893) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:13:14.888300 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG dbcounter [-] [101893] Writing DB stats keystone:SELECT=100 {{(pid=101893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:13:14.896395 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebeaa8bc-dee9-4fb4-a4d9-313b93a1dcba service cinder] Validating token access rules against request {{(pid=101893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:13:14.903514 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6546758-f646-44c2-a6c7-14a0012453db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cec56f74b2fa4826a506dc7b919465be', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:13:14.903514 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6546758-f646-44c2-a6c7-14a0012453db admin admin] REQUEST_METHOD: `DELETE` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:13:14.903514 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6546758-f646-44c2-a6c7-14a0012453db admin admin] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:13:14.903514 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6546758-f646-44c2-a6c7-14a0012453db admin admin] PATH_INFO: `/v3/users/43dce6e81a7c43819d2041bd6c2ad783` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:13:14.919744 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6546758-f646-44c2-a6c7-14a0012453db admin admin] RBAC: Authorizing `identity:delete_user(user_id=43dce6e81a7c43819d2041bd6c2ad783)` {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:13:14.922225 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6546758-f646-44c2-a6c7-14a0012453db admin admin] RBAC: Authorization granted {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:13:15.143115 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.notifications [None req-e6546758-f646-44c2-a6c7-14a0012453db admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '43dce6e81a7c43819d2041bd6c2ad783'} {{(pid=101893) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:13:15.154177 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.notifications [None req-e6546758-f646-44c2-a6c7-14a0012453db admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '43dce6e81a7c43819d2041bd6c2ad783'} {{(pid=101893) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:13:15.167113 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.notifications [None req-e6546758-f646-44c2-a6c7-14a0012453db admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '43dce6e81a7c43819d2041bd6c2ad783'} {{(pid=101893) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:13:15.168361 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.notifications [None req-e6546758-f646-44c2-a6c7-14a0012453db admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '43dce6e81a7c43819d2041bd6c2ad783'} {{(pid=101893) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:13:15.168987 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.notifications [None req-e6546758-f646-44c2-a6c7-14a0012453db admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '43dce6e81a7c43819d2041bd6c2ad783'} {{(pid=101893) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:13:15.253233 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 1352/2678] 10.222.0.84 () {58 vars in 1223 bytes} [Wed May 25 15:13:14 2022] DELETE /identity/v3/users/43dce6e81a7c43819d2041bd6c2ad783 => generated 0 bytes in 379 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 15:13:15.548560 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-739e18bd-1e0c-4f5f-9c04-2a779b250f30 service neutron] Authenticating user token {{(pid=101892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:13:15.558611 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-739e18bd-1e0c-4f5f-9c04-2a779b250f30 service neutron] Validating token access rules against request {{(pid=101892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:13:15.592806 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG dbcounter [-] [101892] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=101892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:13:15.623972 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5445dbd4-998e-44be-8b34-ccc75d5bd52a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cec56f74b2fa4826a506dc7b919465be', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:13:15.624756 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5445dbd4-998e-44be-8b34-ccc75d5bd52a admin admin] REQUEST_METHOD: `DELETE` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:13:15.625040 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5445dbd4-998e-44be-8b34-ccc75d5bd52a admin admin] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:13:15.625312 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5445dbd4-998e-44be-8b34-ccc75d5bd52a admin admin] PATH_INFO: `/v3/projects/31414400f2114ed9abdf300fb08e1592` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:13:15.636853 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5445dbd4-998e-44be-8b34-ccc75d5bd52a admin admin] RBAC: Authorizing `identity:delete_project(project_id=31414400f2114ed9abdf300fb08e1592)` {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:13:15.638955 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5445dbd4-998e-44be-8b34-ccc75d5bd52a admin admin] RBAC: Authorization granted {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:13:15.738160 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.notifications [None req-5445dbd4-998e-44be-8b34-ccc75d5bd52a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '31414400f2114ed9abdf300fb08e1592', 'request_id': 'req-5445dbd4-998e-44be-8b34-ccc75d5bd52a'} {{(pid=101892) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:13:15.744836 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.notifications [None req-5445dbd4-998e-44be-8b34-ccc75d5bd52a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '31414400f2114ed9abdf300fb08e1592', 'request_id': 'req-5445dbd4-998e-44be-8b34-ccc75d5bd52a'} {{(pid=101892) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:13:15.750966 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.notifications [None req-5445dbd4-998e-44be-8b34-ccc75d5bd52a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '31414400f2114ed9abdf300fb08e1592', 'request_id': 'req-5445dbd4-998e-44be-8b34-ccc75d5bd52a'} {{(pid=101892) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:13:15.812994 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.notifications [None req-5445dbd4-998e-44be-8b34-ccc75d5bd52a admin admin] The token cache is being invalidate because project 31414400f2114ed9abdf300fb08e1592 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=101892) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 25 15:13:15.813314 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.notifications [None req-5445dbd4-998e-44be-8b34-ccc75d5bd52a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=101892) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:13:15.813960 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.notifications [None req-5445dbd4-998e-44be-8b34-ccc75d5bd52a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=101892) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:13:15.816028 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 1327/2679] 10.222.0.84 () {58 vars in 1232 bytes} [Wed May 25 15:13:15 2022] DELETE /identity/v3/projects/31414400f2114ed9abdf300fb08e1592 => generated 0 bytes in 268 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 15:13:15.821169 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8cc088-85b5-4e68-91ac-845c0f414582 None None] REQUEST_METHOD: `POST` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:13:15.821462 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8cc088-85b5-4e68-91ac-845c0f414582 None None] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:13:15.821739 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8cc088-85b5-4e68-91ac-845c0f414582 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:13:15.841065 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.auth.core [None req-1e8cc088-85b5-4e68-91ac-845c0f414582 None None] MFA Rules not processed for user `05d87e87798e429aa1c10b24391f915e`. Rule list: `[]` (Enabled: `True`). {{(pid=101893) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:13:15.842271 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.fernet_utils [None req-1e8cc088-85b5-4e68-91ac-845c0f414582 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=101893) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:13:15.905055 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 1353/2680] 10.222.0.84 () {58 vars in 957 bytes} [Wed May 25 15:13:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 15:13:15.913204 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f1a12e-5dbf-4a29-9406-0335b7325975 None None] REQUEST_METHOD: `POST` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:13:15.913470 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f1a12e-5dbf-4a29-9406-0335b7325975 None None] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:13:15.913753 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f1a12e-5dbf-4a29-9406-0335b7325975 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:13:15.934115 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.auth.core [None req-58f1a12e-5dbf-4a29-9406-0335b7325975 None None] MFA Rules not processed for user `05d87e87798e429aa1c10b24391f915e`. Rule list: `[]` (Enabled: `True`). {{(pid=101892) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:13:15.935331 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.fernet_utils [None req-58f1a12e-5dbf-4a29-9406-0335b7325975 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=101892) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:13:15.943642 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 1328/2681] 10.222.0.84 () {58 vars in 957 bytes} [Wed May 25 15:13:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 15:13:15.947889 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e8cc088-85b5-4e68-91ac-845c0f414582 None None] Authenticating user token {{(pid=101893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:13:15.958274 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e8cc088-85b5-4e68-91ac-845c0f414582 None None] Validating token access rules against request {{(pid=101893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:13:15.963075 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-183b750e-6035-45db-a9c8-aa81a881988b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cec56f74b2fa4826a506dc7b919465be', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:13:15.963771 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183b750e-6035-45db-a9c8-aa81a881988b admin admin] REQUEST_METHOD: `GET` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:13:15.964081 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183b750e-6035-45db-a9c8-aa81a881988b admin admin] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:13:15.964450 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183b750e-6035-45db-a9c8-aa81a881988b admin admin] PATH_INFO: `/v3/domains` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:13:15.965840 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-183b750e-6035-45db-a9c8-aa81a881988b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=101893) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 15:13:15.966151 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-183b750e-6035-45db-a9c8-aa81a881988b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:13:15.967827 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-183b750e-6035-45db-a9c8-aa81a881988b admin admin] RBAC: Authorization granted {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:13:15.979645 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 1354/2682] 10.222.0.84 () {58 vars in 1152 bytes} [Wed May 25 15:13:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 15:13:15.984015 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58f1a12e-5dbf-4a29-9406-0335b7325975 None None] Authenticating user token {{(pid=101892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:13:15.993718 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58f1a12e-5dbf-4a29-9406-0335b7325975 None None] Validating token access rules against request {{(pid=101892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:13:15.998441 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f314709b-d19f-41b2-bd43-f67ed598378e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cec56f74b2fa4826a506dc7b919465be', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:13:15.999103 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f314709b-d19f-41b2-bd43-f67ed598378e admin admin] REQUEST_METHOD: `POST` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:13:15.999388 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f314709b-d19f-41b2-bd43-f67ed598378e admin admin] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:13:15.999701 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f314709b-d19f-41b2-bd43-f67ed598378e admin admin] PATH_INFO: `/v3/projects` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:13:16.000407 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f314709b-d19f-41b2-bd43-f67ed598378e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:13:16.002307 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f314709b-d19f-41b2-bd43-f67ed598378e admin admin] RBAC: Authorization granted {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:13:16.100918 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 1329/2683] 10.222.0.84 () {60 vars in 1152 bytes} [Wed May 25 15:13:15 2022] POST /identity/v3/projects => generated 383 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 15:13:16.105096 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-183b750e-6035-45db-a9c8-aa81a881988b admin admin] Authenticating user token {{(pid=101893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:13:16.115155 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-183b750e-6035-45db-a9c8-aa81a881988b admin admin] Validating token access rules against request {{(pid=101893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:13:16.167765 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG dbcounter [-] [101893] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=101893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:13:16.177956 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca6a2c9e-ba57-4af9-83b2-68f8bcfa27e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cec56f74b2fa4826a506dc7b919465be', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:13:16.178644 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6a2c9e-ba57-4af9-83b2-68f8bcfa27e0 admin admin] REQUEST_METHOD: `POST` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:13:16.183011 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6a2c9e-ba57-4af9-83b2-68f8bcfa27e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:13:16.183011 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6a2c9e-ba57-4af9-83b2-68f8bcfa27e0 admin admin] PATH_INFO: `/v3/users` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:13:16.183011 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca6a2c9e-ba57-4af9-83b2-68f8bcfa27e0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:13:16.183011 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca6a2c9e-ba57-4af9-83b2-68f8bcfa27e0 admin admin] RBAC: Authorization granted {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:13:16.248437 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 1355/2684] 10.222.0.84 () {60 vars in 1143 bytes} [Wed May 25 15:13:16 2022] POST /identity/v3/users => generated 292 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 15:13:16.252604 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f314709b-d19f-41b2-bd43-f67ed598378e admin admin] Authenticating user token {{(pid=101892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:13:16.263082 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f314709b-d19f-41b2-bd43-f67ed598378e admin admin] Validating token access rules against request {{(pid=101892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:13:16.273234 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a42df5-5d40-4ea4-a6ee-a99f8f55fd3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cec56f74b2fa4826a506dc7b919465be', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:13:16.273921 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a42df5-5d40-4ea4-a6ee-a99f8f55fd3f admin admin] REQUEST_METHOD: `GET` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:13:16.274207 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a42df5-5d40-4ea4-a6ee-a99f8f55fd3f admin admin] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:13:16.274485 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a42df5-5d40-4ea4-a6ee-a99f8f55fd3f admin admin] PATH_INFO: `/v3/roles` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:13:16.275222 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02a42df5-5d40-4ea4-a6ee-a99f8f55fd3f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:13:16.277094 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02a42df5-5d40-4ea4-a6ee-a99f8f55fd3f admin admin] RBAC: Authorization granted {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:13:16.288555 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 1330/2685] 10.222.0.84 () {58 vars in 1121 bytes} [Wed May 25 15:13:16 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 15:13:16.293598 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca6a2c9e-ba57-4af9-83b2-68f8bcfa27e0 admin admin] Authenticating user token {{(pid=101893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:13:16.305805 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca6a2c9e-ba57-4af9-83b2-68f8bcfa27e0 admin admin] Validating token access rules against request {{(pid=101893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:13:16.311046 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a826ee-a29c-40a8-a29d-62f9f0a68aa5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cec56f74b2fa4826a506dc7b919465be', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:13:16.311732 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a826ee-a29c-40a8-a29d-62f9f0a68aa5 admin admin] REQUEST_METHOD: `GET` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:13:16.312023 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a826ee-a29c-40a8-a29d-62f9f0a68aa5 admin admin] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:13:16.312343 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a826ee-a29c-40a8-a29d-62f9f0a68aa5 admin admin] PATH_INFO: `/v3/roles` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:13:16.313030 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75a826ee-a29c-40a8-a29d-62f9f0a68aa5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:13:16.314636 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75a826ee-a29c-40a8-a29d-62f9f0a68aa5 admin admin] RBAC: Authorization granted {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:13:16.326390 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 1356/2686] 10.222.0.84 () {58 vars in 1121 bytes} [Wed May 25 15:13:16 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 15:13:16.330694 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a42df5-5d40-4ea4-a6ee-a99f8f55fd3f admin admin] Authenticating user token {{(pid=101892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:13:16.340733 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a42df5-5d40-4ea4-a6ee-a99f8f55fd3f admin admin] Validating token access rules against request {{(pid=101892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:13:16.345352 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-263a5fb1-20a6-47db-8604-d64bb07fe046 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cec56f74b2fa4826a506dc7b919465be', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:13:16.346227 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263a5fb1-20a6-47db-8604-d64bb07fe046 admin admin] REQUEST_METHOD: `PUT` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:13:16.346514 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263a5fb1-20a6-47db-8604-d64bb07fe046 admin admin] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:13:16.346793 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263a5fb1-20a6-47db-8604-d64bb07fe046 admin admin] PATH_INFO: `/v3/projects/c2b03e6160e9458580f35df18b1c4c89/users/fd6b19da07a9426c858bb6cee27c9dfb/roles/ff664fa0db7e4262a5accde96c3df4c3` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:13:16.361692 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-263a5fb1-20a6-47db-8604-d64bb07fe046 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c2b03e6160e9458580f35df18b1c4c89, user_id=fd6b19da07a9426c858bb6cee27c9dfb, role_id=ff664fa0db7e4262a5accde96c3df4c3)` {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:13:16.364554 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-263a5fb1-20a6-47db-8604-d64bb07fe046 admin admin] RBAC: Authorization granted {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:13:16.430012 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 1331/2687] 10.222.0.84 () {60 vars in 1482 bytes} [Wed May 25 15:13:16 2022] PUT /identity/v3/projects/c2b03e6160e9458580f35df18b1c4c89/users/fd6b19da07a9426c858bb6cee27c9dfb/roles/ff664fa0db7e4262a5accde96c3df4c3 => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 15:13:16.441244 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6bab6f-8d60-46fc-a423-91479481472b None None] REQUEST_METHOD: `POST` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:13:16.441539 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6bab6f-8d60-46fc-a423-91479481472b None None] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:13:16.441820 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6bab6f-8d60-46fc-a423-91479481472b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:13:16.471477 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.auth.core [None req-ad6bab6f-8d60-46fc-a423-91479481472b None None] MFA Rules not processed for user `fd6b19da07a9426c858bb6cee27c9dfb`. Rule list: `[]` (Enabled: `True`). {{(pid=101893) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:13:16.473259 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.fernet_utils [None req-ad6bab6f-8d60-46fc-a423-91479481472b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=101893) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:13:16.537560 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 1357/2688] 10.222.0.84 () {58 vars in 957 bytes} [Wed May 25 15:13:16 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 15:13:16.550096 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-263a5fb1-20a6-47db-8604-d64bb07fe046 admin admin] Authenticating user token {{(pid=101892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:13:16.551941 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.fernet_utils [None req-263a5fb1-20a6-47db-8604-d64bb07fe046 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=101892) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:13:16.611642 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG dbcounter [-] [101892] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=101892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:13:16.637045 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-263a5fb1-20a6-47db-8604-d64bb07fe046 admin admin] Validating token access rules against request {{(pid=101892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:13:16.642585 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01c7579d-7f60-472a-8613-cc5dec0ba647 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2aeb182e6a5b43cfb0cc347ec847c848', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a000829c658c4a7cab67f7b6353ba3fa', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:13:16.643280 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c7579d-7f60-472a-8613-cc5dec0ba647 service nova] REQUEST_METHOD: `GET` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:13:16.643572 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c7579d-7f60-472a-8613-cc5dec0ba647 service nova] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:13:16.643860 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c7579d-7f60-472a-8613-cc5dec0ba647 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:13:16.651457 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01c7579d-7f60-472a-8613-cc5dec0ba647 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:13:16.653113 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01c7579d-7f60-472a-8613-cc5dec0ba647 service nova] RBAC: Authorization granted {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:13:16.662076 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 1332/2689] 10.222.0.84 () {60 vars in 1365 bytes} [Wed May 25 15:13:16 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 15:13:18.225966 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad6bab6f-8d60-46fc-a423-91479481472b None None] Authenticating user token {{(pid=101893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:13:18.228798 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.fernet_utils [None req-ad6bab6f-8d60-46fc-a423-91479481472b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=101893) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:13:18.294596 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad6bab6f-8d60-46fc-a423-91479481472b None None] Validating token access rules against request {{(pid=101893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:13:18.299119 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba64bcd5-7460-43b3-9097-3449cf3b1ef3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cec56f74b2fa4826a506dc7b919465be', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:13:18.300022 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba64bcd5-7460-43b3-9097-3449cf3b1ef3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:13:18.300309 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba64bcd5-7460-43b3-9097-3449cf3b1ef3 admin admin] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:13:18.300587 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba64bcd5-7460-43b3-9097-3449cf3b1ef3 admin admin] PATH_INFO: `/v3/users/b1a223787054469b8e1816453b975090` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:13:18.301777 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba64bcd5-7460-43b3-9097-3449cf3b1ef3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b1a223787054469b8e1816453b975090)` {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:13:18.303813 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba64bcd5-7460-43b3-9097-3449cf3b1ef3 admin admin] RBAC: Authorization granted {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:13:18.507303 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.notifications [None req-ba64bcd5-7460-43b3-9097-3449cf3b1ef3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b1a223787054469b8e1816453b975090'} {{(pid=101893) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:13:18.516145 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.notifications [None req-ba64bcd5-7460-43b3-9097-3449cf3b1ef3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b1a223787054469b8e1816453b975090'} {{(pid=101893) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:13:18.523053 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG dbcounter [-] [101893] Writing DB stats keystone:SELECT=89,keystone:INSERT=3,keystone:DELETE=8 {{(pid=101893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:13:18.530744 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.notifications [None req-ba64bcd5-7460-43b3-9097-3449cf3b1ef3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b1a223787054469b8e1816453b975090'} {{(pid=101893) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:13:18.531484 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.notifications [None req-ba64bcd5-7460-43b3-9097-3449cf3b1ef3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b1a223787054469b8e1816453b975090'} {{(pid=101893) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:13:18.532200 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.notifications [None req-ba64bcd5-7460-43b3-9097-3449cf3b1ef3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b1a223787054469b8e1816453b975090'} {{(pid=101893) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:13:18.632969 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 1358/2690] 10.222.0.84 () {58 vars in 1223 bytes} [Wed May 25 15:13:18 2022] DELETE /identity/v3/users/b1a223787054469b8e1816453b975090 => generated 0 bytes in 408 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 15:13:18.637532 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0367d300-feba-4369-be32-65a5e5e60133 None None] REQUEST_METHOD: `POST` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:13:18.638031 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0367d300-feba-4369-be32-65a5e5e60133 None None] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:13:18.638154 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0367d300-feba-4369-be32-65a5e5e60133 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:13:18.658626 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.auth.core [None req-0367d300-feba-4369-be32-65a5e5e60133 None None] MFA Rules not processed for user `05d87e87798e429aa1c10b24391f915e`. Rule list: `[]` (Enabled: `True`). {{(pid=101892) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:13:18.659951 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.fernet_utils [None req-0367d300-feba-4369-be32-65a5e5e60133 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=101892) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:13:18.721291 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 1333/2691] 10.222.0.84 () {58 vars in 957 bytes} [Wed May 25 15:13:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 25 15:13:18.730996 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba64bcd5-7460-43b3-9097-3449cf3b1ef3 admin admin] Authenticating user token {{(pid=101893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:13:18.732424 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.fernet_utils [None req-ba64bcd5-7460-43b3-9097-3449cf3b1ef3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=101893) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:13:18.791889 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba64bcd5-7460-43b3-9097-3449cf3b1ef3 admin admin] Validating token access rules against request {{(pid=101893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:13:18.795689 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31ac975f-4b22-4fc7-afd1-c7ca180d2f8a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ce28b25b907473588ccb87dc4acc06a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a000829c658c4a7cab67f7b6353ba3fa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:13:18.796422 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ac975f-4b22-4fc7-afd1-c7ca180d2f8a service neutron] REQUEST_METHOD: `GET` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:13:18.796707 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ac975f-4b22-4fc7-afd1-c7ca180d2f8a service neutron] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:13:18.796981 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ac975f-4b22-4fc7-afd1-c7ca180d2f8a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:13:18.806462 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31ac975f-4b22-4fc7-afd1-c7ca180d2f8a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:13:18.807957 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31ac975f-4b22-4fc7-afd1-c7ca180d2f8a service neutron] RBAC: Authorization granted {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:13:18.817625 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 1359/2692] 10.222.0.84 () {60 vars in 1365 bytes} [Wed May 25 15:13:18 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 15:13:19.528375 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0367d300-feba-4369-be32-65a5e5e60133 None None] Authenticating user token {{(pid=101892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:13:19.528375 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.fernet_utils [None req-0367d300-feba-4369-be32-65a5e5e60133 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=101892) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:13:19.535936 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0367d300-feba-4369-be32-65a5e5e60133 None None] Validating token access rules against request {{(pid=101892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:13:19.540651 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd5cd578-a0ac-4576-8463-ce28f223cf73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cec56f74b2fa4826a506dc7b919465be', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:13:19.541522 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5cd578-a0ac-4576-8463-ce28f223cf73 admin admin] REQUEST_METHOD: `DELETE` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:13:19.541803 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5cd578-a0ac-4576-8463-ce28f223cf73 admin admin] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:13:19.542080 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5cd578-a0ac-4576-8463-ce28f223cf73 admin admin] PATH_INFO: `/v3/projects/ff13d177b6ec4d6caa22431eac0e0530` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:13:19.544609 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd5cd578-a0ac-4576-8463-ce28f223cf73 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ff13d177b6ec4d6caa22431eac0e0530)` {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:13:19.547806 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd5cd578-a0ac-4576-8463-ce28f223cf73 admin admin] RBAC: Authorization granted {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:13:19.671543 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.notifications [None req-dd5cd578-a0ac-4576-8463-ce28f223cf73 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ff13d177b6ec4d6caa22431eac0e0530', 'request_id': 'req-dd5cd578-a0ac-4576-8463-ce28f223cf73'} {{(pid=101892) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:13:19.679216 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.notifications [None req-dd5cd578-a0ac-4576-8463-ce28f223cf73 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ff13d177b6ec4d6caa22431eac0e0530', 'request_id': 'req-dd5cd578-a0ac-4576-8463-ce28f223cf73'} {{(pid=101892) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:13:19.684921 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.notifications [None req-dd5cd578-a0ac-4576-8463-ce28f223cf73 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ff13d177b6ec4d6caa22431eac0e0530', 'request_id': 'req-dd5cd578-a0ac-4576-8463-ce28f223cf73'} {{(pid=101892) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:13:19.759714 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.notifications [None req-dd5cd578-a0ac-4576-8463-ce28f223cf73 admin admin] The token cache is being invalidate because project ff13d177b6ec4d6caa22431eac0e0530 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=101892) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 25 15:13:19.760005 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.notifications [None req-dd5cd578-a0ac-4576-8463-ce28f223cf73 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=101892) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:13:19.760631 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.notifications [None req-dd5cd578-a0ac-4576-8463-ce28f223cf73 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=101892) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:13:19.762185 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 1334/2693] 10.222.0.84 () {58 vars in 1232 bytes} [Wed May 25 15:13:19 2022] DELETE /identity/v3/projects/ff13d177b6ec4d6caa22431eac0e0530 => generated 0 bytes in 241 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 15:13:19.766372 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31ac975f-4b22-4fc7-afd1-c7ca180d2f8a service neutron] Authenticating user token {{(pid=101893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:13:19.776048 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31ac975f-4b22-4fc7-afd1-c7ca180d2f8a service neutron] Validating token access rules against request {{(pid=101893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:13:19.851989 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33ac8281-782a-4ed2-89f9-155c632574fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cec56f74b2fa4826a506dc7b919465be', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:13:19.852819 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ac8281-782a-4ed2-89f9-155c632574fb admin admin] REQUEST_METHOD: `DELETE` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:13:19.853094 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ac8281-782a-4ed2-89f9-155c632574fb admin admin] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:13:19.853376 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ac8281-782a-4ed2-89f9-155c632574fb admin admin] PATH_INFO: `/v3/users/ce85dea177654023983cf75474a7bd36` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:13:19.854573 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33ac8281-782a-4ed2-89f9-155c632574fb admin admin] RBAC: Authorizing `identity:delete_user(user_id=ce85dea177654023983cf75474a7bd36)` {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:13:19.857159 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33ac8281-782a-4ed2-89f9-155c632574fb admin admin] RBAC: Authorization granted {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:13:20.056950 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.notifications [None req-33ac8281-782a-4ed2-89f9-155c632574fb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ce85dea177654023983cf75474a7bd36'} {{(pid=101893) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:13:20.064716 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.notifications [None req-33ac8281-782a-4ed2-89f9-155c632574fb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ce85dea177654023983cf75474a7bd36'} {{(pid=101893) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:13:20.076575 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.notifications [None req-33ac8281-782a-4ed2-89f9-155c632574fb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ce85dea177654023983cf75474a7bd36'} {{(pid=101893) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:13:20.077309 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.notifications [None req-33ac8281-782a-4ed2-89f9-155c632574fb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ce85dea177654023983cf75474a7bd36'} {{(pid=101893) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:13:20.077916 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.notifications [None req-33ac8281-782a-4ed2-89f9-155c632574fb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ce85dea177654023983cf75474a7bd36'} {{(pid=101893) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:13:20.166626 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 1360/2694] 10.222.0.84 () {58 vars in 1223 bytes} [Wed May 25 15:13:19 2022] DELETE /identity/v3/users/ce85dea177654023983cf75474a7bd36 => generated 0 bytes in 401 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 15:13:20.636454 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd5cd578-a0ac-4576-8463-ce28f223cf73 admin admin] Authenticating user token {{(pid=101892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:13:20.638550 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.fernet_utils [None req-dd5cd578-a0ac-4576-8463-ce28f223cf73 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=101892) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:13:20.651612 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd5cd578-a0ac-4576-8463-ce28f223cf73 admin admin] Validating token access rules against request {{(pid=101892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:13:20.706826 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG dbcounter [-] [101892] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=101892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:13:20.713746 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca5610c9-411d-460d-a74f-c9c3c22f3a99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cec56f74b2fa4826a506dc7b919465be', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:13:20.715114 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5610c9-411d-460d-a74f-c9c3c22f3a99 admin admin] REQUEST_METHOD: `DELETE` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:13:20.715394 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5610c9-411d-460d-a74f-c9c3c22f3a99 admin admin] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:13:20.715773 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5610c9-411d-460d-a74f-c9c3c22f3a99 admin admin] PATH_INFO: `/v3/projects/210f45eff62b4371a63f112c5dccdc69` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:13:20.716963 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca5610c9-411d-460d-a74f-c9c3c22f3a99 admin admin] RBAC: Authorizing `identity:delete_project(project_id=210f45eff62b4371a63f112c5dccdc69)` {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:13:20.719033 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca5610c9-411d-460d-a74f-c9c3c22f3a99 admin admin] RBAC: Authorization granted {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:13:20.858242 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.notifications [None req-ca5610c9-411d-460d-a74f-c9c3c22f3a99 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '210f45eff62b4371a63f112c5dccdc69', 'request_id': 'req-ca5610c9-411d-460d-a74f-c9c3c22f3a99'} {{(pid=101892) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:13:20.865007 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.notifications [None req-ca5610c9-411d-460d-a74f-c9c3c22f3a99 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '210f45eff62b4371a63f112c5dccdc69', 'request_id': 'req-ca5610c9-411d-460d-a74f-c9c3c22f3a99'} {{(pid=101892) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:13:20.870447 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.notifications [None req-ca5610c9-411d-460d-a74f-c9c3c22f3a99 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '210f45eff62b4371a63f112c5dccdc69', 'request_id': 'req-ca5610c9-411d-460d-a74f-c9c3c22f3a99'} {{(pid=101892) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:13:20.956582 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.notifications [None req-ca5610c9-411d-460d-a74f-c9c3c22f3a99 admin admin] The token cache is being invalidate because project 210f45eff62b4371a63f112c5dccdc69 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=101892) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 25 15:13:20.956783 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.notifications [None req-ca5610c9-411d-460d-a74f-c9c3c22f3a99 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=101892) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:13:20.957402 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.notifications [None req-ca5610c9-411d-460d-a74f-c9c3c22f3a99 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=101892) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:13:20.958969 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 1335/2695] 10.222.0.84 () {58 vars in 1232 bytes} [Wed May 25 15:13:20 2022] DELETE /identity/v3/projects/210f45eff62b4371a63f112c5dccdc69 => generated 0 bytes in 323 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 15:13:20.963864 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ef64d3-64fb-49aa-88a2-76236e916c0c None None] REQUEST_METHOD: `POST` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:13:20.964346 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ef64d3-64fb-49aa-88a2-76236e916c0c None None] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:13:20.964555 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ef64d3-64fb-49aa-88a2-76236e916c0c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:13:20.972012 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG dbcounter [-] [101893] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=101893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:13:20.984351 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.auth.core [None req-32ef64d3-64fb-49aa-88a2-76236e916c0c None None] MFA Rules not processed for user `05d87e87798e429aa1c10b24391f915e`. Rule list: `[]` (Enabled: `True`). {{(pid=101893) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:13:20.985600 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.fernet_utils [None req-32ef64d3-64fb-49aa-88a2-76236e916c0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=101893) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:13:21.044089 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 1361/2696] 10.222.0.84 () {58 vars in 957 bytes} [Wed May 25 15:13:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 15:13:21.052057 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2da044-e25d-49f8-a79b-aab046f4843c None None] REQUEST_METHOD: `POST` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:13:21.052350 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2da044-e25d-49f8-a79b-aab046f4843c None None] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:13:21.052627 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2da044-e25d-49f8-a79b-aab046f4843c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:13:21.070266 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.auth.core [None req-bb2da044-e25d-49f8-a79b-aab046f4843c None None] MFA Rules not processed for user `05d87e87798e429aa1c10b24391f915e`. Rule list: `[]` (Enabled: `True`). {{(pid=101892) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:13:21.071458 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.fernet_utils [None req-bb2da044-e25d-49f8-a79b-aab046f4843c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=101892) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:13:21.079893 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 1336/2697] 10.222.0.84 () {58 vars in 957 bytes} [Wed May 25 15:13:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 15:13:21.083953 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ef64d3-64fb-49aa-88a2-76236e916c0c None None] Authenticating user token {{(pid=101893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:13:21.094176 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ef64d3-64fb-49aa-88a2-76236e916c0c None None] Validating token access rules against request {{(pid=101893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:13:21.099140 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4465cdc-88a5-48de-8a68-02fd081498c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cec56f74b2fa4826a506dc7b919465be', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:13:21.099856 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4465cdc-88a5-48de-8a68-02fd081498c9 admin admin] REQUEST_METHOD: `GET` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:13:21.100403 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4465cdc-88a5-48de-8a68-02fd081498c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:13:21.101865 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4465cdc-88a5-48de-8a68-02fd081498c9 admin admin] PATH_INFO: `/v3/domains` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:13:21.101865 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4465cdc-88a5-48de-8a68-02fd081498c9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=101893) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 15:13:21.102091 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4465cdc-88a5-48de-8a68-02fd081498c9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:13:21.103722 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4465cdc-88a5-48de-8a68-02fd081498c9 admin admin] RBAC: Authorization granted {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:13:21.116120 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 1362/2698] 10.222.0.84 () {58 vars in 1152 bytes} [Wed May 25 15:13:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 15:13:21.120543 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb2da044-e25d-49f8-a79b-aab046f4843c None None] Authenticating user token {{(pid=101892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:13:21.129711 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb2da044-e25d-49f8-a79b-aab046f4843c None None] Validating token access rules against request {{(pid=101892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:13:21.134814 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d32ca7a5-4457-45d8-afb7-67e2ad2aa768 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cec56f74b2fa4826a506dc7b919465be', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:13:21.135622 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32ca7a5-4457-45d8-afb7-67e2ad2aa768 admin admin] REQUEST_METHOD: `POST` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:13:21.135902 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32ca7a5-4457-45d8-afb7-67e2ad2aa768 admin admin] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:13:21.136193 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32ca7a5-4457-45d8-afb7-67e2ad2aa768 admin admin] PATH_INFO: `/v3/projects` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:13:21.137413 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d32ca7a5-4457-45d8-afb7-67e2ad2aa768 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:13:21.139408 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d32ca7a5-4457-45d8-afb7-67e2ad2aa768 admin admin] RBAC: Authorization granted {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:13:21.254932 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 1337/2699] 10.222.0.84 () {60 vars in 1152 bytes} [Wed May 25 15:13:21 2022] POST /identity/v3/projects => generated 375 bytes in 134 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 15:13:21.258700 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4465cdc-88a5-48de-8a68-02fd081498c9 admin admin] Authenticating user token {{(pid=101893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:13:21.269012 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4465cdc-88a5-48de-8a68-02fd081498c9 admin admin] Validating token access rules against request {{(pid=101893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:13:21.348558 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc005168-3810-411f-be7e-c49bb34b7739 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cec56f74b2fa4826a506dc7b919465be', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:13:21.351710 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc005168-3810-411f-be7e-c49bb34b7739 admin admin] REQUEST_METHOD: `POST` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:13:21.351710 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc005168-3810-411f-be7e-c49bb34b7739 admin admin] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:13:21.351710 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc005168-3810-411f-be7e-c49bb34b7739 admin admin] PATH_INFO: `/v3/users` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:13:21.351710 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc005168-3810-411f-be7e-c49bb34b7739 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:13:21.352382 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc005168-3810-411f-be7e-c49bb34b7739 admin admin] RBAC: Authorization granted {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:13:21.434025 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 1363/2700] 10.222.0.84 () {60 vars in 1143 bytes} [Wed May 25 15:13:21 2022] POST /identity/v3/users => generated 288 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 15:13:21.438144 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d32ca7a5-4457-45d8-afb7-67e2ad2aa768 admin admin] Authenticating user token {{(pid=101892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:13:21.448797 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d32ca7a5-4457-45d8-afb7-67e2ad2aa768 admin admin] Validating token access rules against request {{(pid=101892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:13:21.453685 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8dc81f6-5d5c-4045-a533-1f3df58e92cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cec56f74b2fa4826a506dc7b919465be', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:13:21.454344 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8dc81f6-5d5c-4045-a533-1f3df58e92cb admin admin] REQUEST_METHOD: `GET` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:13:21.454628 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8dc81f6-5d5c-4045-a533-1f3df58e92cb admin admin] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:13:21.454921 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8dc81f6-5d5c-4045-a533-1f3df58e92cb admin admin] PATH_INFO: `/v3/roles` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:13:21.455823 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8dc81f6-5d5c-4045-a533-1f3df58e92cb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:13:21.457570 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8dc81f6-5d5c-4045-a533-1f3df58e92cb admin admin] RBAC: Authorization granted {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:13:21.470291 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 1338/2701] 10.222.0.84 () {58 vars in 1121 bytes} [Wed May 25 15:13:21 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 15:13:21.474126 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc005168-3810-411f-be7e-c49bb34b7739 admin admin] Authenticating user token {{(pid=101893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:13:21.485742 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc005168-3810-411f-be7e-c49bb34b7739 admin admin] Validating token access rules against request {{(pid=101893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:13:21.495094 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f6d43d-0668-4646-a9ff-36920d5c554d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cec56f74b2fa4826a506dc7b919465be', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:13:21.495094 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f6d43d-0668-4646-a9ff-36920d5c554d admin admin] REQUEST_METHOD: `GET` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:13:21.495094 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f6d43d-0668-4646-a9ff-36920d5c554d admin admin] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:13:21.495094 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f6d43d-0668-4646-a9ff-36920d5c554d admin admin] PATH_INFO: `/v3/roles` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:13:21.495438 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1f6d43d-0668-4646-a9ff-36920d5c554d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:13:21.495438 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1f6d43d-0668-4646-a9ff-36920d5c554d admin admin] RBAC: Authorization granted {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:13:21.511705 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 1364/2702] 10.222.0.84 () {58 vars in 1121 bytes} [Wed May 25 15:13:21 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 15:13:21.512968 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8dc81f6-5d5c-4045-a533-1f3df58e92cb admin admin] Authenticating user token {{(pid=101892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:13:21.522951 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8dc81f6-5d5c-4045-a533-1f3df58e92cb admin admin] Validating token access rules against request {{(pid=101892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:13:21.528139 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfc11066-be52-496a-bf3e-e5ab8d92861e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cec56f74b2fa4826a506dc7b919465be', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:13:21.529012 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc11066-be52-496a-bf3e-e5ab8d92861e admin admin] REQUEST_METHOD: `PUT` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:13:21.529295 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc11066-be52-496a-bf3e-e5ab8d92861e admin admin] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:13:21.529578 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc11066-be52-496a-bf3e-e5ab8d92861e admin admin] PATH_INFO: `/v3/projects/bc8de1bcef11466f99b5a32f98dd7dfe/users/8164ade7533548f8b4d175fdee800f5c/roles/ff664fa0db7e4262a5accde96c3df4c3` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:13:21.544220 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfc11066-be52-496a-bf3e-e5ab8d92861e admin admin] RBAC: Authorizing `identity:create_grant(project_id=bc8de1bcef11466f99b5a32f98dd7dfe, user_id=8164ade7533548f8b4d175fdee800f5c, role_id=ff664fa0db7e4262a5accde96c3df4c3)` {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:13:21.546938 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfc11066-be52-496a-bf3e-e5ab8d92861e admin admin] RBAC: Authorization granted {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:13:21.628841 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 1339/2703] 10.222.0.84 () {60 vars in 1482 bytes} [Wed May 25 15:13:21 2022] PUT /identity/v3/projects/bc8de1bcef11466f99b5a32f98dd7dfe/users/8164ade7533548f8b4d175fdee800f5c/roles/ff664fa0db7e4262a5accde96c3df4c3 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 15:13:21.640026 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3c7dd6-ef4c-4232-ab81-73fb80d50b72 None None] REQUEST_METHOD: `POST` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:13:21.640308 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3c7dd6-ef4c-4232-ab81-73fb80d50b72 None None] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:13:21.640581 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3c7dd6-ef4c-4232-ab81-73fb80d50b72 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:13:21.667047 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.auth.core [None req-ff3c7dd6-ef4c-4232-ab81-73fb80d50b72 None None] MFA Rules not processed for user `8164ade7533548f8b4d175fdee800f5c`. Rule list: `[]` (Enabled: `True`). {{(pid=101893) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:13:21.668290 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.fernet_utils [None req-ff3c7dd6-ef4c-4232-ab81-73fb80d50b72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=101893) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:13:21.728353 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG dbcounter [-] [101893] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=101893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:13:21.733918 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 1365/2704] 10.222.0.84 () {58 vars in 957 bytes} [Wed May 25 15:13:21 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 15:13:21.738405 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfc11066-be52-496a-bf3e-e5ab8d92861e admin admin] Authenticating user token {{(pid=101892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:13:21.799063 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfc11066-be52-496a-bf3e-e5ab8d92861e admin admin] Validating token access rules against request {{(pid=101892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:13:21.803689 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bc8cd7e-d5c4-4360-acf6-a7610d532ecc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cec56f74b2fa4826a506dc7b919465be', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:13:21.804343 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc8cd7e-d5c4-4360-acf6-a7610d532ecc admin admin] REQUEST_METHOD: `POST` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:13:21.804628 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc8cd7e-d5c4-4360-acf6-a7610d532ecc admin admin] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:13:21.804906 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc8cd7e-d5c4-4360-acf6-a7610d532ecc admin admin] PATH_INFO: `/v3/projects` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:13:21.805629 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bc8cd7e-d5c4-4360-acf6-a7610d532ecc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:13:21.807531 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bc8cd7e-d5c4-4360-acf6-a7610d532ecc admin admin] RBAC: Authorization granted {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:13:21.934552 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 1340/2705] 10.222.0.84 () {60 vars in 1152 bytes} [Wed May 25 15:13:21 2022] POST /identity/v3/projects => generated 377 bytes in 197 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 15:13:21.938600 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff3c7dd6-ef4c-4232-ab81-73fb80d50b72 None None] Authenticating user token {{(pid=101893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:13:21.949626 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff3c7dd6-ef4c-4232-ab81-73fb80d50b72 None None] Validating token access rules against request {{(pid=101893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:13:22.005584 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dd4f877-98f9-44eb-8f13-374dc6d6a46f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cec56f74b2fa4826a506dc7b919465be', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:13:22.006251 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd4f877-98f9-44eb-8f13-374dc6d6a46f admin admin] REQUEST_METHOD: `POST` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:13:22.006533 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd4f877-98f9-44eb-8f13-374dc6d6a46f admin admin] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:13:22.006813 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd4f877-98f9-44eb-8f13-374dc6d6a46f admin admin] PATH_INFO: `/v3/users` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:13:22.007511 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dd4f877-98f9-44eb-8f13-374dc6d6a46f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:13:22.009466 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dd4f877-98f9-44eb-8f13-374dc6d6a46f admin admin] RBAC: Authorization granted {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:13:22.075660 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 1366/2706] 10.222.0.84 () {60 vars in 1143 bytes} [Wed May 25 15:13:21 2022] POST /identity/v3/users => generated 289 bytes in 137 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 15:13:22.079538 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bc8cd7e-d5c4-4360-acf6-a7610d532ecc admin admin] Authenticating user token {{(pid=101892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:13:22.090573 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bc8cd7e-d5c4-4360-acf6-a7610d532ecc admin admin] Validating token access rules against request {{(pid=101892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:13:22.095285 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2b5768f-a400-408e-bf07-ab405df26df9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cec56f74b2fa4826a506dc7b919465be', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:13:22.096000 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b5768f-a400-408e-bf07-ab405df26df9 admin admin] REQUEST_METHOD: `GET` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:13:22.096325 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b5768f-a400-408e-bf07-ab405df26df9 admin admin] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:13:22.096627 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b5768f-a400-408e-bf07-ab405df26df9 admin admin] PATH_INFO: `/v3/roles` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:13:22.099379 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2b5768f-a400-408e-bf07-ab405df26df9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:13:22.099379 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2b5768f-a400-408e-bf07-ab405df26df9 admin admin] RBAC: Authorization granted {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:13:22.100318 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG dbcounter [-] [101892] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=101892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:13:22.112882 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 1341/2707] 10.222.0.84 () {58 vars in 1121 bytes} [Wed May 25 15:13:22 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 15:13:22.117005 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dd4f877-98f9-44eb-8f13-374dc6d6a46f admin admin] Authenticating user token {{(pid=101893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:13:22.127154 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dd4f877-98f9-44eb-8f13-374dc6d6a46f admin admin] Validating token access rules against request {{(pid=101893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:13:22.131889 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c7e704-46af-455c-9854-0b9a48226873 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cec56f74b2fa4826a506dc7b919465be', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:13:22.132545 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c7e704-46af-455c-9854-0b9a48226873 admin admin] REQUEST_METHOD: `GET` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:13:22.132835 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c7e704-46af-455c-9854-0b9a48226873 admin admin] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:13:22.133118 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c7e704-46af-455c-9854-0b9a48226873 admin admin] PATH_INFO: `/v3/roles` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:13:22.133964 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40c7e704-46af-455c-9854-0b9a48226873 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:13:22.135635 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40c7e704-46af-455c-9854-0b9a48226873 admin admin] RBAC: Authorization granted {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:13:22.145726 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 1367/2708] 10.222.0.84 () {58 vars in 1121 bytes} [Wed May 25 15:13:22 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 15:13:22.149762 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2b5768f-a400-408e-bf07-ab405df26df9 admin admin] Authenticating user token {{(pid=101892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:13:22.160274 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2b5768f-a400-408e-bf07-ab405df26df9 admin admin] Validating token access rules against request {{(pid=101892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:13:22.164892 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24bdbf7c-c0f9-42af-95dd-cfd46c808051 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cec56f74b2fa4826a506dc7b919465be', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:13:22.165793 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24bdbf7c-c0f9-42af-95dd-cfd46c808051 admin admin] REQUEST_METHOD: `PUT` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:13:22.166075 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24bdbf7c-c0f9-42af-95dd-cfd46c808051 admin admin] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:13:22.166349 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24bdbf7c-c0f9-42af-95dd-cfd46c808051 admin admin] PATH_INFO: `/v3/projects/bce90d80bb9746cd83a7cf95e07a4302/users/ec4a51e9cb764efa88a8c07c84b2cdcc/roles/ff664fa0db7e4262a5accde96c3df4c3` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:13:22.181393 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24bdbf7c-c0f9-42af-95dd-cfd46c808051 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bce90d80bb9746cd83a7cf95e07a4302, user_id=ec4a51e9cb764efa88a8c07c84b2cdcc, role_id=ff664fa0db7e4262a5accde96c3df4c3)` {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:13:22.184260 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24bdbf7c-c0f9-42af-95dd-cfd46c808051 admin admin] RBAC: Authorization granted {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:13:22.310558 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 1342/2709] 10.222.0.84 () {60 vars in 1482 bytes} [Wed May 25 15:13:22 2022] PUT /identity/v3/projects/bce90d80bb9746cd83a7cf95e07a4302/users/ec4a51e9cb764efa88a8c07c84b2cdcc/roles/ff664fa0db7e4262a5accde96c3df4c3 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 15:13:22.374027 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4732fc7d-8b6f-417c-9e69-3becd45edd04 None None] REQUEST_METHOD: `POST` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:13:22.374321 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4732fc7d-8b6f-417c-9e69-3becd45edd04 None None] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:13:22.374603 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4732fc7d-8b6f-417c-9e69-3becd45edd04 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:13:22.400170 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.auth.core [None req-4732fc7d-8b6f-417c-9e69-3becd45edd04 None None] MFA Rules not processed for user `ec4a51e9cb764efa88a8c07c84b2cdcc`. Rule list: `[]` (Enabled: `True`). {{(pid=101893) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:13:22.401379 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.fernet_utils [None req-4732fc7d-8b6f-417c-9e69-3becd45edd04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=101893) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:13:22.465084 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 1368/2710] 10.222.0.84 () {58 vars in 957 bytes} [Wed May 25 15:13:22 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 15:13:22.469461 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24bdbf7c-c0f9-42af-95dd-cfd46c808051 admin admin] Authenticating user token {{(pid=101892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:13:22.531992 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24bdbf7c-c0f9-42af-95dd-cfd46c808051 admin admin] Validating token access rules against request {{(pid=101892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:13:22.536931 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-350abeff-f5fe-4916-a65e-da07f81103b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cec56f74b2fa4826a506dc7b919465be', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:13:22.539681 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-350abeff-f5fe-4916-a65e-da07f81103b1 admin admin] REQUEST_METHOD: `POST` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:13:22.539681 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-350abeff-f5fe-4916-a65e-da07f81103b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:13:22.539681 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-350abeff-f5fe-4916-a65e-da07f81103b1 admin admin] PATH_INFO: `/v3/projects` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:13:22.539681 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-350abeff-f5fe-4916-a65e-da07f81103b1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:13:22.540755 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-350abeff-f5fe-4916-a65e-da07f81103b1 admin admin] RBAC: Authorization granted {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:13:22.648488 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 1343/2711] 10.222.0.84 () {60 vars in 1152 bytes} [Wed May 25 15:13:22 2022] POST /identity/v3/projects => generated 377 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 15:13:22.652645 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4732fc7d-8b6f-417c-9e69-3becd45edd04 None None] Authenticating user token {{(pid=101893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:13:22.664183 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4732fc7d-8b6f-417c-9e69-3becd45edd04 None None] Validating token access rules against request {{(pid=101893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:13:22.721884 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dbfad86-ad54-433d-b67d-0351999c869a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cec56f74b2fa4826a506dc7b919465be', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:13:22.722561 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dbfad86-ad54-433d-b67d-0351999c869a admin admin] REQUEST_METHOD: `POST` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:13:22.722846 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dbfad86-ad54-433d-b67d-0351999c869a admin admin] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:13:22.723128 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dbfad86-ad54-433d-b67d-0351999c869a admin admin] PATH_INFO: `/v3/users` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:13:22.723958 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dbfad86-ad54-433d-b67d-0351999c869a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:13:22.725928 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dbfad86-ad54-433d-b67d-0351999c869a admin admin] RBAC: Authorization granted {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:13:22.735862 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG dbcounter [-] [101893] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=101893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:13:22.848219 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 1369/2712] 10.222.0.84 () {60 vars in 1143 bytes} [Wed May 25 15:13:22 2022] POST /identity/v3/users => generated 295 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 15:13:22.853688 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-350abeff-f5fe-4916-a65e-da07f81103b1 admin admin] Authenticating user token {{(pid=101892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:13:22.864622 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-350abeff-f5fe-4916-a65e-da07f81103b1 admin admin] Validating token access rules against request {{(pid=101892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:13:22.869124 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0410245a-bcb5-4fa9-866e-506af96cfd9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cec56f74b2fa4826a506dc7b919465be', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:13:22.869788 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0410245a-bcb5-4fa9-866e-506af96cfd9e admin admin] REQUEST_METHOD: `GET` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:13:22.870076 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0410245a-bcb5-4fa9-866e-506af96cfd9e admin admin] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:13:22.870359 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0410245a-bcb5-4fa9-866e-506af96cfd9e admin admin] PATH_INFO: `/v3/roles` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:13:22.871102 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0410245a-bcb5-4fa9-866e-506af96cfd9e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:13:22.872736 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0410245a-bcb5-4fa9-866e-506af96cfd9e admin admin] RBAC: Authorization granted {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:13:22.883514 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 1344/2713] 10.222.0.84 () {58 vars in 1121 bytes} [Wed May 25 15:13:22 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 15:13:22.887703 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dbfad86-ad54-433d-b67d-0351999c869a admin admin] Authenticating user token {{(pid=101893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:13:22.897522 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dbfad86-ad54-433d-b67d-0351999c869a admin admin] Validating token access rules against request {{(pid=101893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:13:22.902644 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aa4028c-8fe8-43ca-841a-7981b0937e25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cec56f74b2fa4826a506dc7b919465be', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:13:22.903463 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa4028c-8fe8-43ca-841a-7981b0937e25 admin admin] REQUEST_METHOD: `PUT` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:13:22.903780 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa4028c-8fe8-43ca-841a-7981b0937e25 admin admin] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:13:22.904060 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa4028c-8fe8-43ca-841a-7981b0937e25 admin admin] PATH_INFO: `/v3/projects/87623417129f4f13807275f40a2b252b/users/aa583519e4034d27a1bf9930a5ec4428/roles/a3b78e7d547d4d2d998b4c99a4396bba` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:13:22.919134 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aa4028c-8fe8-43ca-841a-7981b0937e25 admin admin] RBAC: Authorizing `identity:create_grant(project_id=87623417129f4f13807275f40a2b252b, user_id=aa583519e4034d27a1bf9930a5ec4428, role_id=a3b78e7d547d4d2d998b4c99a4396bba)` {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:13:22.921872 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aa4028c-8fe8-43ca-841a-7981b0937e25 admin admin] RBAC: Authorization granted {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:13:23.000791 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 1370/2714] 10.222.0.84 () {60 vars in 1482 bytes} [Wed May 25 15:13:22 2022] PUT /identity/v3/projects/87623417129f4f13807275f40a2b252b/users/aa583519e4034d27a1bf9930a5ec4428/roles/a3b78e7d547d4d2d998b4c99a4396bba => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 15:13:23.004813 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0410245a-bcb5-4fa9-866e-506af96cfd9e admin admin] Authenticating user token {{(pid=101892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:13:23.015119 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0410245a-bcb5-4fa9-866e-506af96cfd9e admin admin] Validating token access rules against request {{(pid=101892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:13:23.071663 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25ef0d17-42ba-465a-aadd-966e6fc16f36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cec56f74b2fa4826a506dc7b919465be', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:13:23.072329 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ef0d17-42ba-465a-aadd-966e6fc16f36 admin admin] REQUEST_METHOD: `GET` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:13:23.072612 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ef0d17-42ba-465a-aadd-966e6fc16f36 admin admin] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:13:23.072889 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ef0d17-42ba-465a-aadd-966e6fc16f36 admin admin] PATH_INFO: `/v3/roles` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:13:23.073608 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25ef0d17-42ba-465a-aadd-966e6fc16f36 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:13:23.075275 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25ef0d17-42ba-465a-aadd-966e6fc16f36 admin admin] RBAC: Authorization granted {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:13:23.085348 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 1345/2715] 10.222.0.84 () {58 vars in 1121 bytes} [Wed May 25 15:13:23 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 15:13:23.090021 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aa4028c-8fe8-43ca-841a-7981b0937e25 admin admin] Authenticating user token {{(pid=101893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:13:23.102784 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aa4028c-8fe8-43ca-841a-7981b0937e25 admin admin] Validating token access rules against request {{(pid=101893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:13:23.108676 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c21bbd4-8bd2-41f7-acb6-9be951a2b16a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cec56f74b2fa4826a506dc7b919465be', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:13:23.109566 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c21bbd4-8bd2-41f7-acb6-9be951a2b16a admin admin] REQUEST_METHOD: `PUT` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:13:23.109854 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c21bbd4-8bd2-41f7-acb6-9be951a2b16a admin admin] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:13:23.110130 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c21bbd4-8bd2-41f7-acb6-9be951a2b16a admin admin] PATH_INFO: `/v3/projects/87623417129f4f13807275f40a2b252b/users/aa583519e4034d27a1bf9930a5ec4428/roles/a3b78e7d547d4d2d998b4c99a4396bba` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:13:23.112332 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c21bbd4-8bd2-41f7-acb6-9be951a2b16a admin admin] RBAC: Authorizing `identity:create_grant(project_id=87623417129f4f13807275f40a2b252b, user_id=aa583519e4034d27a1bf9930a5ec4428, role_id=a3b78e7d547d4d2d998b4c99a4396bba)` {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:13:23.115853 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c21bbd4-8bd2-41f7-acb6-9be951a2b16a admin admin] RBAC: Authorization granted {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:13:23.126442 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 1371/2716] 10.222.0.84 () {60 vars in 1482 bytes} [Wed May 25 15:13:23 2022] PUT /identity/v3/projects/87623417129f4f13807275f40a2b252b/users/aa583519e4034d27a1bf9930a5ec4428/roles/a3b78e7d547d4d2d998b4c99a4396bba => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 15:13:23.136376 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac712eb-2119-441d-b4e2-b71fe430efb3 None None] REQUEST_METHOD: `POST` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:13:23.145119 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac712eb-2119-441d-b4e2-b71fe430efb3 None None] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:13:23.145119 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac712eb-2119-441d-b4e2-b71fe430efb3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:13:23.164258 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.auth.core [None req-7ac712eb-2119-441d-b4e2-b71fe430efb3 None None] MFA Rules not processed for user `aa583519e4034d27a1bf9930a5ec4428`. Rule list: `[]` (Enabled: `True`). {{(pid=101892) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:13:23.165396 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.fernet_utils [None req-7ac712eb-2119-441d-b4e2-b71fe430efb3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=101892) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:13:23.195183 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG dbcounter [-] [101892] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=101892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:13:23.233584 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 1346/2717] 10.222.0.84 () {58 vars in 957 bytes} [Wed May 25 15:13:23 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 15:13:23.245479 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c21bbd4-8bd2-41f7-acb6-9be951a2b16a admin admin] Authenticating user token {{(pid=101893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:13:23.247217 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.fernet_utils [None req-3c21bbd4-8bd2-41f7-acb6-9be951a2b16a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=101893) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:13:23.304861 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c21bbd4-8bd2-41f7-acb6-9be951a2b16a admin admin] Validating token access rules against request {{(pid=101893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:13:23.308652 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c835a174-1021-4477-b329-0256ef79e31f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e079f89a5e524ab6ad4183e4f690de07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a000829c658c4a7cab67f7b6353ba3fa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:13:23.309287 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c835a174-1021-4477-b329-0256ef79e31f service cinder] REQUEST_METHOD: `GET` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:13:23.309568 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c835a174-1021-4477-b329-0256ef79e31f service cinder] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:13:23.309837 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c835a174-1021-4477-b329-0256ef79e31f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:13:23.369896 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c835a174-1021-4477-b329-0256ef79e31f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:13:23.371406 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c835a174-1021-4477-b329-0256ef79e31f service cinder] RBAC: Authorization granted {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:13:23.380265 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 1372/2718] 10.222.0.84 () {60 vars in 1365 bytes} [Wed May 25 15:13:23 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 135 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 15:13:23.964305 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ac712eb-2119-441d-b4e2-b71fe430efb3 None None] Authenticating user token {{(pid=101892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:13:23.964305 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.fernet_utils [None req-7ac712eb-2119-441d-b4e2-b71fe430efb3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=101892) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:13:24.030904 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ac712eb-2119-441d-b4e2-b71fe430efb3 None None] Validating token access rules against request {{(pid=101892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:13:24.035623 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8fab326-6311-4740-8397-6b22ab33b248 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cec56f74b2fa4826a506dc7b919465be', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:13:24.036517 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8fab326-6311-4740-8397-6b22ab33b248 admin admin] REQUEST_METHOD: `DELETE` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:13:24.036802 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8fab326-6311-4740-8397-6b22ab33b248 admin admin] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:13:24.037212 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8fab326-6311-4740-8397-6b22ab33b248 admin admin] PATH_INFO: `/v3/users/fd6b19da07a9426c858bb6cee27c9dfb` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:13:24.038508 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8fab326-6311-4740-8397-6b22ab33b248 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fd6b19da07a9426c858bb6cee27c9dfb)` {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:13:24.040563 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8fab326-6311-4740-8397-6b22ab33b248 admin admin] RBAC: Authorization granted {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:13:24.259318 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.notifications [None req-c8fab326-6311-4740-8397-6b22ab33b248 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fd6b19da07a9426c858bb6cee27c9dfb'} {{(pid=101892) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:13:24.265997 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.notifications [None req-c8fab326-6311-4740-8397-6b22ab33b248 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fd6b19da07a9426c858bb6cee27c9dfb'} {{(pid=101892) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:13:24.277909 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.notifications [None req-c8fab326-6311-4740-8397-6b22ab33b248 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fd6b19da07a9426c858bb6cee27c9dfb'} {{(pid=101892) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:13:24.278576 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.notifications [None req-c8fab326-6311-4740-8397-6b22ab33b248 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fd6b19da07a9426c858bb6cee27c9dfb'} {{(pid=101892) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:13:24.342450 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.notifications [None req-c8fab326-6311-4740-8397-6b22ab33b248 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fd6b19da07a9426c858bb6cee27c9dfb'} {{(pid=101892) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:13:24.348851 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 1347/2719] 10.222.0.84 () {58 vars in 1223 bytes} [Wed May 25 15:13:23 2022] DELETE /identity/v3/users/fd6b19da07a9426c858bb6cee27c9dfb => generated 0 bytes in 387 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 15:13:24.353393 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c730b6d-2066-4145-b418-0a02dc89222d None None] REQUEST_METHOD: `POST` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:13:24.353832 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c730b6d-2066-4145-b418-0a02dc89222d None None] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:13:24.353931 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c730b6d-2066-4145-b418-0a02dc89222d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:13:24.371620 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.auth.core [None req-3c730b6d-2066-4145-b418-0a02dc89222d None None] MFA Rules not processed for user `05d87e87798e429aa1c10b24391f915e`. Rule list: `[]` (Enabled: `True`). {{(pid=101893) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:13:24.372896 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.fernet_utils [None req-3c730b6d-2066-4145-b418-0a02dc89222d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=101893) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:13:24.431449 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 1373/2720] 10.222.0.84 () {58 vars in 957 bytes} [Wed May 25 15:13:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 15:13:24.441537 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8fab326-6311-4740-8397-6b22ab33b248 admin admin] Authenticating user token {{(pid=101892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:13:24.442971 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.fernet_utils [None req-c8fab326-6311-4740-8397-6b22ab33b248 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=101892) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:13:24.494171 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG dbcounter [-] [101892] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=101892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:13:24.500251 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8fab326-6311-4740-8397-6b22ab33b248 admin admin] Validating token access rules against request {{(pid=101892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:13:24.504044 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef4316f6-1426-4e9c-a832-b6c975cd5fe1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ce28b25b907473588ccb87dc4acc06a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a000829c658c4a7cab67f7b6353ba3fa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:13:24.506349 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef4316f6-1426-4e9c-a832-b6c975cd5fe1 service neutron] REQUEST_METHOD: `GET` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:13:24.506349 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef4316f6-1426-4e9c-a832-b6c975cd5fe1 service neutron] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:13:24.506349 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef4316f6-1426-4e9c-a832-b6c975cd5fe1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:13:24.514872 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef4316f6-1426-4e9c-a832-b6c975cd5fe1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:13:24.516344 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef4316f6-1426-4e9c-a832-b6c975cd5fe1 service neutron] RBAC: Authorization granted {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:13:24.526482 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 1348/2721] 10.222.0.84 () {60 vars in 1365 bytes} [Wed May 25 15:13:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 15:13:24.921855 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c730b6d-2066-4145-b418-0a02dc89222d None None] Authenticating user token {{(pid=101893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:13:24.923423 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.fernet_utils [None req-3c730b6d-2066-4145-b418-0a02dc89222d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=101893) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:13:24.935770 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c730b6d-2066-4145-b418-0a02dc89222d None None] Validating token access rules against request {{(pid=101893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:13:24.941639 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deb4a3ec-67dc-418d-815b-3cf20198adf0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cec56f74b2fa4826a506dc7b919465be', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:13:24.942527 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb4a3ec-67dc-418d-815b-3cf20198adf0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:13:24.942805 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb4a3ec-67dc-418d-815b-3cf20198adf0 admin admin] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:13:24.943081 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb4a3ec-67dc-418d-815b-3cf20198adf0 admin admin] PATH_INFO: `/v3/projects/c2b03e6160e9458580f35df18b1c4c89` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:13:24.944361 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deb4a3ec-67dc-418d-815b-3cf20198adf0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c2b03e6160e9458580f35df18b1c4c89)` {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:13:24.946346 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deb4a3ec-67dc-418d-815b-3cf20198adf0 admin admin] RBAC: Authorization granted {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:13:24.956446 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG dbcounter [-] [101893] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=101893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:13:25.065835 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.notifications [None req-deb4a3ec-67dc-418d-815b-3cf20198adf0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c2b03e6160e9458580f35df18b1c4c89', 'request_id': 'req-deb4a3ec-67dc-418d-815b-3cf20198adf0'} {{(pid=101893) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:13:25.072630 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.notifications [None req-deb4a3ec-67dc-418d-815b-3cf20198adf0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c2b03e6160e9458580f35df18b1c4c89', 'request_id': 'req-deb4a3ec-67dc-418d-815b-3cf20198adf0'} {{(pid=101893) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:13:25.080446 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.notifications [None req-deb4a3ec-67dc-418d-815b-3cf20198adf0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c2b03e6160e9458580f35df18b1c4c89', 'request_id': 'req-deb4a3ec-67dc-418d-815b-3cf20198adf0'} {{(pid=101893) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:13:25.177366 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.notifications [None req-deb4a3ec-67dc-418d-815b-3cf20198adf0 admin admin] The token cache is being invalidate because project c2b03e6160e9458580f35df18b1c4c89 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=101893) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 25 15:13:25.177725 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.notifications [None req-deb4a3ec-67dc-418d-815b-3cf20198adf0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=101893) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:13:25.178351 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.notifications [None req-deb4a3ec-67dc-418d-815b-3cf20198adf0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=101893) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:13:25.179966 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 1374/2722] 10.222.0.84 () {58 vars in 1232 bytes} [Wed May 25 15:13:24 2022] DELETE /identity/v3/projects/c2b03e6160e9458580f35df18b1c4c89 => generated 0 bytes in 259 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 15:13:25.185294 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b2360d-3cef-4360-8fa7-9d89a5ad9df3 None None] REQUEST_METHOD: `POST` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:13:25.185781 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b2360d-3cef-4360-8fa7-9d89a5ad9df3 None None] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:13:25.185882 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b2360d-3cef-4360-8fa7-9d89a5ad9df3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:13:25.204289 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.auth.core [None req-09b2360d-3cef-4360-8fa7-9d89a5ad9df3 None None] MFA Rules not processed for user `05d87e87798e429aa1c10b24391f915e`. Rule list: `[]` (Enabled: `True`). {{(pid=101892) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:13:25.205486 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.fernet_utils [None req-09b2360d-3cef-4360-8fa7-9d89a5ad9df3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=101892) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:13:25.265117 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 1349/2723] 10.222.0.84 () {58 vars in 957 bytes} [Wed May 25 15:13:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 15:13:25.272974 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34dc81b-31b4-4802-b361-1289c310a0d8 None None] REQUEST_METHOD: `POST` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:13:25.273268 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34dc81b-31b4-4802-b361-1289c310a0d8 None None] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:13:25.273549 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34dc81b-31b4-4802-b361-1289c310a0d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:13:25.291719 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.auth.core [None req-c34dc81b-31b4-4802-b361-1289c310a0d8 None None] MFA Rules not processed for user `05d87e87798e429aa1c10b24391f915e`. Rule list: `[]` (Enabled: `True`). {{(pid=101893) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:13:25.296025 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.fernet_utils [None req-c34dc81b-31b4-4802-b361-1289c310a0d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=101893) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:13:25.309685 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 1375/2724] 10.222.0.84 () {58 vars in 957 bytes} [Wed May 25 15:13:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 15:13:25.314215 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09b2360d-3cef-4360-8fa7-9d89a5ad9df3 None None] Authenticating user token {{(pid=101892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:13:25.330297 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09b2360d-3cef-4360-8fa7-9d89a5ad9df3 None None] Validating token access rules against request {{(pid=101892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:13:25.330297 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d60cbe2-e33b-492e-9385-0f48fce1faca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cec56f74b2fa4826a506dc7b919465be', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:13:25.330297 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d60cbe2-e33b-492e-9385-0f48fce1faca admin admin] REQUEST_METHOD: `GET` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:13:25.330682 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d60cbe2-e33b-492e-9385-0f48fce1faca admin admin] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:13:25.330779 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d60cbe2-e33b-492e-9385-0f48fce1faca admin admin] PATH_INFO: `/v3/domains` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:13:25.331462 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d60cbe2-e33b-492e-9385-0f48fce1faca admin admin] RBAC: Adding query filter params (name=Default) {{(pid=101892) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 15:13:25.331797 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d60cbe2-e33b-492e-9385-0f48fce1faca admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:13:25.333376 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d60cbe2-e33b-492e-9385-0f48fce1faca admin admin] RBAC: Authorization granted {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:13:25.345247 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 1350/2725] 10.222.0.84 () {58 vars in 1152 bytes} [Wed May 25 15:13:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 15:13:25.349471 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c34dc81b-31b4-4802-b361-1289c310a0d8 None None] Authenticating user token {{(pid=101893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:13:25.358858 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c34dc81b-31b4-4802-b361-1289c310a0d8 None None] Validating token access rules against request {{(pid=101893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:13:25.363724 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ded7ae-8d46-4431-a25f-fcd677d26b9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cec56f74b2fa4826a506dc7b919465be', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:13:25.364845 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ded7ae-8d46-4431-a25f-fcd677d26b9e admin admin] REQUEST_METHOD: `POST` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:13:25.364845 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ded7ae-8d46-4431-a25f-fcd677d26b9e admin admin] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:13:25.365052 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ded7ae-8d46-4431-a25f-fcd677d26b9e admin admin] PATH_INFO: `/v3/projects` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:13:25.365670 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2ded7ae-8d46-4431-a25f-fcd677d26b9e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:13:25.367593 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2ded7ae-8d46-4431-a25f-fcd677d26b9e admin admin] RBAC: Authorization granted {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:13:25.442469 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 1376/2726] 10.222.0.84 () {60 vars in 1152 bytes} [Wed May 25 15:13:25 2022] POST /identity/v3/projects => generated 377 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 25 15:13:25.446584 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d60cbe2-e33b-492e-9385-0f48fce1faca admin admin] Authenticating user token {{(pid=101892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:13:25.457237 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d60cbe2-e33b-492e-9385-0f48fce1faca admin admin] Validating token access rules against request {{(pid=101892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:13:25.515118 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b874de0-8d3d-49a0-afac-9d3b2755e067 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cec56f74b2fa4826a506dc7b919465be', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:13:25.515819 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b874de0-8d3d-49a0-afac-9d3b2755e067 admin admin] REQUEST_METHOD: `POST` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:13:25.516106 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b874de0-8d3d-49a0-afac-9d3b2755e067 admin admin] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:13:25.516381 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b874de0-8d3d-49a0-afac-9d3b2755e067 admin admin] PATH_INFO: `/v3/users` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:13:25.517078 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b874de0-8d3d-49a0-afac-9d3b2755e067 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:13:25.518985 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b874de0-8d3d-49a0-afac-9d3b2755e067 admin admin] RBAC: Authorization granted {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:13:25.589390 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 1351/2727] 10.222.0.84 () {60 vars in 1143 bytes} [Wed May 25 15:13:25 2022] POST /identity/v3/users => generated 289 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 15:13:25.593405 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ded7ae-8d46-4431-a25f-fcd677d26b9e admin admin] Authenticating user token {{(pid=101893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:13:25.603939 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ded7ae-8d46-4431-a25f-fcd677d26b9e admin admin] Validating token access rules against request {{(pid=101893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:13:25.609308 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-311f4a2e-4bfc-4811-8b0d-9d536fff5b4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cec56f74b2fa4826a506dc7b919465be', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:13:25.609990 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311f4a2e-4bfc-4811-8b0d-9d536fff5b4b admin admin] REQUEST_METHOD: `GET` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:13:25.610272 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311f4a2e-4bfc-4811-8b0d-9d536fff5b4b admin admin] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:13:25.610544 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311f4a2e-4bfc-4811-8b0d-9d536fff5b4b admin admin] PATH_INFO: `/v3/roles` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:13:25.611263 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-311f4a2e-4bfc-4811-8b0d-9d536fff5b4b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:13:25.612922 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-311f4a2e-4bfc-4811-8b0d-9d536fff5b4b admin admin] RBAC: Authorization granted {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:13:25.623498 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 1377/2728] 10.222.0.84 () {58 vars in 1121 bytes} [Wed May 25 15:13:25 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 15:13:25.627390 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b874de0-8d3d-49a0-afac-9d3b2755e067 admin admin] Authenticating user token {{(pid=101892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:13:25.638143 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b874de0-8d3d-49a0-afac-9d3b2755e067 admin admin] Validating token access rules against request {{(pid=101892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:13:25.642790 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bf63391-3d07-4704-878f-dd860f66a2c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cec56f74b2fa4826a506dc7b919465be', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:13:25.643450 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf63391-3d07-4704-878f-dd860f66a2c3 admin admin] REQUEST_METHOD: `GET` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:13:25.643762 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf63391-3d07-4704-878f-dd860f66a2c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:13:25.644044 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf63391-3d07-4704-878f-dd860f66a2c3 admin admin] PATH_INFO: `/v3/roles` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:13:25.644793 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bf63391-3d07-4704-878f-dd860f66a2c3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:13:25.646375 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bf63391-3d07-4704-878f-dd860f66a2c3 admin admin] RBAC: Authorization granted {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:13:25.656747 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 1352/2729] 10.222.0.84 () {58 vars in 1121 bytes} [Wed May 25 15:13:25 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 15:13:25.660645 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-311f4a2e-4bfc-4811-8b0d-9d536fff5b4b admin admin] Authenticating user token {{(pid=101893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:13:25.670906 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-311f4a2e-4bfc-4811-8b0d-9d536fff5b4b admin admin] Validating token access rules against request {{(pid=101893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:13:25.675514 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-028257f2-cc8c-4d3c-b006-4a86e99f9d7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cec56f74b2fa4826a506dc7b919465be', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:13:25.676487 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028257f2-cc8c-4d3c-b006-4a86e99f9d7f admin admin] REQUEST_METHOD: `PUT` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:13:25.676770 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028257f2-cc8c-4d3c-b006-4a86e99f9d7f admin admin] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:13:25.677048 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028257f2-cc8c-4d3c-b006-4a86e99f9d7f admin admin] PATH_INFO: `/v3/projects/966d69c120f0455599dfe9882da903ed/users/ed9fef0489ae4b72a0212a5e6bd81f54/roles/ff664fa0db7e4262a5accde96c3df4c3` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:13:25.691354 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-028257f2-cc8c-4d3c-b006-4a86e99f9d7f admin admin] RBAC: Authorizing `identity:create_grant(project_id=966d69c120f0455599dfe9882da903ed, user_id=ed9fef0489ae4b72a0212a5e6bd81f54, role_id=ff664fa0db7e4262a5accde96c3df4c3)` {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:13:25.694065 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-028257f2-cc8c-4d3c-b006-4a86e99f9d7f admin admin] RBAC: Authorization granted {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:13:25.749069 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 1378/2730] 10.222.0.84 () {60 vars in 1482 bytes} [Wed May 25 15:13:25 2022] PUT /identity/v3/projects/966d69c120f0455599dfe9882da903ed/users/ed9fef0489ae4b72a0212a5e6bd81f54/roles/ff664fa0db7e4262a5accde96c3df4c3 => generated 0 bytes in 89 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 15:13:25.760686 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62111b4-d433-4127-af5e-19dc49abd0f2 None None] REQUEST_METHOD: `POST` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:13:25.761028 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62111b4-d433-4127-af5e-19dc49abd0f2 None None] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:13:25.768112 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62111b4-d433-4127-af5e-19dc49abd0f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:13:25.788221 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.auth.core [None req-b62111b4-d433-4127-af5e-19dc49abd0f2 None None] MFA Rules not processed for user `ed9fef0489ae4b72a0212a5e6bd81f54`. Rule list: `[]` (Enabled: `True`). {{(pid=101892) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:13:25.789419 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.fernet_utils [None req-b62111b4-d433-4127-af5e-19dc49abd0f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=101892) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:13:25.835770 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG dbcounter [-] [101892] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=101892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:13:25.855830 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 1353/2731] 10.222.0.84 () {58 vars in 957 bytes} [Wed May 25 15:13:25 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 15:13:25.860277 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-028257f2-cc8c-4d3c-b006-4a86e99f9d7f admin admin] Authenticating user token {{(pid=101893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:13:25.938366 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-028257f2-cc8c-4d3c-b006-4a86e99f9d7f admin admin] Validating token access rules against request {{(pid=101893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:13:25.943405 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec241f04-609c-49d1-b974-41d889b0b0f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cec56f74b2fa4826a506dc7b919465be', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:13:25.944093 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec241f04-609c-49d1-b974-41d889b0b0f2 admin admin] REQUEST_METHOD: `POST` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:13:25.944383 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec241f04-609c-49d1-b974-41d889b0b0f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:13:25.944665 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec241f04-609c-49d1-b974-41d889b0b0f2 admin admin] PATH_INFO: `/v3/projects` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:13:25.945409 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec241f04-609c-49d1-b974-41d889b0b0f2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:13:25.947383 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec241f04-609c-49d1-b974-41d889b0b0f2 admin admin] RBAC: Authorization granted {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:13:26.081614 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 1379/2732] 10.222.0.84 () {60 vars in 1152 bytes} [Wed May 25 15:13:25 2022] POST /identity/v3/projects => generated 379 bytes in 222 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 15:13:26.085593 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b62111b4-d433-4127-af5e-19dc49abd0f2 None None] Authenticating user token {{(pid=101892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:13:26.096786 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b62111b4-d433-4127-af5e-19dc49abd0f2 None None] Validating token access rules against request {{(pid=101892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:13:26.154009 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ac18d9-0fe8-41f7-be90-73fa20f07441 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cec56f74b2fa4826a506dc7b919465be', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:13:26.156417 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ac18d9-0fe8-41f7-be90-73fa20f07441 admin admin] REQUEST_METHOD: `POST` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:13:26.156417 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ac18d9-0fe8-41f7-be90-73fa20f07441 admin admin] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:13:26.156417 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ac18d9-0fe8-41f7-be90-73fa20f07441 admin admin] PATH_INFO: `/v3/users` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:13:26.156417 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51ac18d9-0fe8-41f7-be90-73fa20f07441 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:13:26.158008 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51ac18d9-0fe8-41f7-be90-73fa20f07441 admin admin] RBAC: Authorization granted {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:13:26.236135 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 1354/2733] 10.222.0.84 () {60 vars in 1143 bytes} [Wed May 25 15:13:26 2022] POST /identity/v3/users => generated 296 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 15:13:26.240172 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec241f04-609c-49d1-b974-41d889b0b0f2 admin admin] Authenticating user token {{(pid=101893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:13:26.251367 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec241f04-609c-49d1-b974-41d889b0b0f2 admin admin] Validating token access rules against request {{(pid=101893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:13:26.256186 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d945e427-84d3-4c00-8e7c-1e1a82fda552 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cec56f74b2fa4826a506dc7b919465be', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:13:26.256852 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d945e427-84d3-4c00-8e7c-1e1a82fda552 admin admin] REQUEST_METHOD: `GET` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:13:26.261192 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d945e427-84d3-4c00-8e7c-1e1a82fda552 admin admin] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:13:26.261192 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d945e427-84d3-4c00-8e7c-1e1a82fda552 admin admin] PATH_INFO: `/v3/roles` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:13:26.261192 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d945e427-84d3-4c00-8e7c-1e1a82fda552 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:13:26.261192 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d945e427-84d3-4c00-8e7c-1e1a82fda552 admin admin] RBAC: Authorization granted {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:13:26.270414 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 1380/2734] 10.222.0.84 () {58 vars in 1121 bytes} [Wed May 25 15:13:26 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 15:13:26.274597 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ac18d9-0fe8-41f7-be90-73fa20f07441 admin admin] Authenticating user token {{(pid=101892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:13:26.284816 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ac18d9-0fe8-41f7-be90-73fa20f07441 admin admin] Validating token access rules against request {{(pid=101892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:13:26.289513 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f412b04-2374-4fe0-aa8d-75b15cb8a611 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cec56f74b2fa4826a506dc7b919465be', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:13:26.290379 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f412b04-2374-4fe0-aa8d-75b15cb8a611 admin admin] REQUEST_METHOD: `PUT` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:13:26.290726 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f412b04-2374-4fe0-aa8d-75b15cb8a611 admin admin] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:13:26.295677 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f412b04-2374-4fe0-aa8d-75b15cb8a611 admin admin] PATH_INFO: `/v3/projects/95b136737765457884f9163da02fced7/users/cf749a478d4645e8ad59ecd4f00be97c/roles/a3b78e7d547d4d2d998b4c99a4396bba` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:13:26.307733 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f412b04-2374-4fe0-aa8d-75b15cb8a611 admin admin] RBAC: Authorizing `identity:create_grant(project_id=95b136737765457884f9163da02fced7, user_id=cf749a478d4645e8ad59ecd4f00be97c, role_id=a3b78e7d547d4d2d998b4c99a4396bba)` {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:13:26.311062 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f412b04-2374-4fe0-aa8d-75b15cb8a611 admin admin] RBAC: Authorization granted {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:13:26.379477 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 1355/2735] 10.222.0.84 () {60 vars in 1482 bytes} [Wed May 25 15:13:26 2022] PUT /identity/v3/projects/95b136737765457884f9163da02fced7/users/cf749a478d4645e8ad59ecd4f00be97c/roles/a3b78e7d547d4d2d998b4c99a4396bba => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 15:13:26.384033 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d945e427-84d3-4c00-8e7c-1e1a82fda552 admin admin] Authenticating user token {{(pid=101893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:13:26.394154 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d945e427-84d3-4c00-8e7c-1e1a82fda552 admin admin] Validating token access rules against request {{(pid=101893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:13:26.397673 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG dbcounter [-] [101893] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=101893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:13:26.452954 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eece372-17ac-4f7b-ba55-5d0c1e332aca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cec56f74b2fa4826a506dc7b919465be', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:13:26.453655 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eece372-17ac-4f7b-ba55-5d0c1e332aca admin admin] REQUEST_METHOD: `GET` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:13:26.453948 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eece372-17ac-4f7b-ba55-5d0c1e332aca admin admin] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:13:26.454233 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eece372-17ac-4f7b-ba55-5d0c1e332aca admin admin] PATH_INFO: `/v3/roles` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:13:26.454965 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eece372-17ac-4f7b-ba55-5d0c1e332aca admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:13:26.456903 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eece372-17ac-4f7b-ba55-5d0c1e332aca admin admin] RBAC: Authorization granted {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:13:26.468683 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 1381/2736] 10.222.0.84 () {58 vars in 1121 bytes} [Wed May 25 15:13:26 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 15:13:26.477223 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f412b04-2374-4fe0-aa8d-75b15cb8a611 admin admin] Authenticating user token {{(pid=101892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:13:26.488628 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f412b04-2374-4fe0-aa8d-75b15cb8a611 admin admin] Validating token access rules against request {{(pid=101892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:13:26.494477 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b79c74f-4345-426d-8906-da0ea33c208d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cec56f74b2fa4826a506dc7b919465be', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:13:26.495392 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b79c74f-4345-426d-8906-da0ea33c208d admin admin] REQUEST_METHOD: `PUT` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:13:26.496271 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b79c74f-4345-426d-8906-da0ea33c208d admin admin] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:13:26.496566 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b79c74f-4345-426d-8906-da0ea33c208d admin admin] PATH_INFO: `/v3/projects/95b136737765457884f9163da02fced7/users/cf749a478d4645e8ad59ecd4f00be97c/roles/a3b78e7d547d4d2d998b4c99a4396bba` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:13:26.498671 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b79c74f-4345-426d-8906-da0ea33c208d admin admin] RBAC: Authorizing `identity:create_grant(project_id=95b136737765457884f9163da02fced7, user_id=cf749a478d4645e8ad59ecd4f00be97c, role_id=a3b78e7d547d4d2d998b4c99a4396bba)` {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:13:26.501369 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b79c74f-4345-426d-8906-da0ea33c208d admin admin] RBAC: Authorization granted {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:13:26.512270 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 1356/2737] 10.222.0.84 () {60 vars in 1482 bytes} [Wed May 25 15:13:26 2022] PUT /identity/v3/projects/95b136737765457884f9163da02fced7/users/cf749a478d4645e8ad59ecd4f00be97c/roles/a3b78e7d547d4d2d998b4c99a4396bba => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 15:13:26.514305 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eece372-17ac-4f7b-ba55-5d0c1e332aca admin admin] Authenticating user token {{(pid=101893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:13:26.516151 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.fernet_utils [None req-4eece372-17ac-4f7b-ba55-5d0c1e332aca admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=101893) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:13:26.522032 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f37efe1-08cf-43bc-9f44-fbbb37a18563 None None] REQUEST_METHOD: `POST` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:13:26.522449 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f37efe1-08cf-43bc-9f44-fbbb37a18563 None None] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:13:26.522736 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f37efe1-08cf-43bc-9f44-fbbb37a18563 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:13:26.549361 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.auth.core [None req-9f37efe1-08cf-43bc-9f44-fbbb37a18563 None None] MFA Rules not processed for user `cf749a478d4645e8ad59ecd4f00be97c`. Rule list: `[]` (Enabled: `True`). {{(pid=101892) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:13:26.550573 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.fernet_utils [None req-9f37efe1-08cf-43bc-9f44-fbbb37a18563 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=101892) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:13:26.580561 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eece372-17ac-4f7b-ba55-5d0c1e332aca admin admin] Validating token access rules against request {{(pid=101893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:13:26.626409 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 1357/2738] 10.222.0.84 () {58 vars in 957 bytes} [Wed May 25 15:13:26 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 25 15:13:26.631788 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b9e570d-8889-4554-8b1b-72989e451f41 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e079f89a5e524ab6ad4183e4f690de07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a000829c658c4a7cab67f7b6353ba3fa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:13:26.632371 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b9e570d-8889-4554-8b1b-72989e451f41 service cinder] REQUEST_METHOD: `GET` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:13:26.632654 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b9e570d-8889-4554-8b1b-72989e451f41 service cinder] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:13:26.632929 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b9e570d-8889-4554-8b1b-72989e451f41 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:13:26.634657 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f37efe1-08cf-43bc-9f44-fbbb37a18563 None None] Authenticating user token {{(pid=101892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:13:26.635363 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.fernet_utils [None req-4b9e570d-8889-4554-8b1b-72989e451f41 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=101893) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:13:26.636017 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.fernet_utils [None req-9f37efe1-08cf-43bc-9f44-fbbb37a18563 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=101892) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:13:26.647701 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f37efe1-08cf-43bc-9f44-fbbb37a18563 None None] Validating token access rules against request {{(pid=101892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:13:26.651343 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcddd66b-91c6-44e0-bb3e-a1c9a4dbafc6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e079f89a5e524ab6ad4183e4f690de07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a000829c658c4a7cab67f7b6353ba3fa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:13:26.652555 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcddd66b-91c6-44e0-bb3e-a1c9a4dbafc6 service cinder] REQUEST_METHOD: `GET` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:13:26.652835 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcddd66b-91c6-44e0-bb3e-a1c9a4dbafc6 service cinder] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:13:26.653107 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcddd66b-91c6-44e0-bb3e-a1c9a4dbafc6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:13:26.664248 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcddd66b-91c6-44e0-bb3e-a1c9a4dbafc6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:13:26.666133 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcddd66b-91c6-44e0-bb3e-a1c9a4dbafc6 service cinder] RBAC: Authorization granted {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:13:26.676771 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 1358/2739] 10.222.0.84 () {60 vars in 1365 bytes} [Wed May 25 15:13:26 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 25 15:13:26.701333 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b9e570d-8889-4554-8b1b-72989e451f41 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:13:26.707663 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b9e570d-8889-4554-8b1b-72989e451f41 service cinder] RBAC: Authorization granted {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:13:26.711617 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 1382/2740] 10.222.0.84 () {60 vars in 1365 bytes} [Wed May 25 15:13:26 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 198 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 15:13:26.881715 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcddd66b-91c6-44e0-bb3e-a1c9a4dbafc6 service cinder] Authenticating user token {{(pid=101892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:13:26.890402 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcddd66b-91c6-44e0-bb3e-a1c9a4dbafc6 service cinder] Validating token access rules against request {{(pid=101892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:13:26.894044 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a43c9e-f41a-4271-b3a0-4d40c9639a61 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e079f89a5e524ab6ad4183e4f690de07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a000829c658c4a7cab67f7b6353ba3fa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:13:26.900504 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a43c9e-f41a-4271-b3a0-4d40c9639a61 service cinder] REQUEST_METHOD: `GET` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:13:26.900504 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a43c9e-f41a-4271-b3a0-4d40c9639a61 service cinder] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:13:26.900504 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a43c9e-f41a-4271-b3a0-4d40c9639a61 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:13:26.900832 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG dbcounter [-] [101892] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=101892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:13:26.953653 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8a43c9e-f41a-4271-b3a0-4d40c9639a61 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:13:26.955084 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8a43c9e-f41a-4271-b3a0-4d40c9639a61 service cinder] RBAC: Authorization granted {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:13:26.964113 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 1359/2741] 10.222.0.84 () {60 vars in 1365 bytes} [Wed May 25 15:13:26 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 15:13:28.324788 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b9e570d-8889-4554-8b1b-72989e451f41 service cinder] Authenticating user token {{(pid=101893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:13:28.333516 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b9e570d-8889-4554-8b1b-72989e451f41 service cinder] Validating token access rules against request {{(pid=101893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:13:28.337141 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea7a4d2a-f349-4e8e-b942-68dc7d021415 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e079f89a5e524ab6ad4183e4f690de07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a000829c658c4a7cab67f7b6353ba3fa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:13:28.337774 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea7a4d2a-f349-4e8e-b942-68dc7d021415 service cinder] REQUEST_METHOD: `GET` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:13:28.338056 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea7a4d2a-f349-4e8e-b942-68dc7d021415 service cinder] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:13:28.338332 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea7a4d2a-f349-4e8e-b942-68dc7d021415 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:13:28.340668 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.fernet_utils [None req-ea7a4d2a-f349-4e8e-b942-68dc7d021415 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=101893) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:13:28.350801 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG dbcounter [-] [101893] Writing DB stats keystone:SELECT=100 {{(pid=101893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:13:28.403309 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea7a4d2a-f349-4e8e-b942-68dc7d021415 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:13:28.404774 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea7a4d2a-f349-4e8e-b942-68dc7d021415 service cinder] RBAC: Authorization granted {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:13:28.414659 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 1383/2742] 10.222.0.84 () {60 vars in 1365 bytes} [Wed May 25 15:13:28 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 15:13:33.291802 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a43c9e-f41a-4271-b3a0-4d40c9639a61 service cinder] Authenticating user token {{(pid=101892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:13:33.293382 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.fernet_utils [None req-d8a43c9e-f41a-4271-b3a0-4d40c9639a61 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=101892) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:13:33.358505 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a43c9e-f41a-4271-b3a0-4d40c9639a61 service cinder] Validating token access rules against request {{(pid=101892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:13:33.366478 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fec8651-e604-4716-9a66-d003c984a88a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ce28b25b907473588ccb87dc4acc06a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a000829c658c4a7cab67f7b6353ba3fa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:13:33.366478 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fec8651-e604-4716-9a66-d003c984a88a service neutron] REQUEST_METHOD: `GET` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:13:33.366478 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fec8651-e604-4716-9a66-d003c984a88a service neutron] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:13:33.366478 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fec8651-e604-4716-9a66-d003c984a88a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:13:33.367276 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.fernet_utils [None req-5fec8651-e604-4716-9a66-d003c984a88a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=101892) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:13:33.378325 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fec8651-e604-4716-9a66-d003c984a88a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:13:33.379894 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fec8651-e604-4716-9a66-d003c984a88a service neutron] RBAC: Authorization granted {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:13:33.390900 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 1360/2743] 10.222.0.84 () {60 vars in 1365 bytes} [Wed May 25 15:13:33 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 15:13:34.227446 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea7a4d2a-f349-4e8e-b942-68dc7d021415 service cinder] Authenticating user token {{(pid=101893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:13:34.229977 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.fernet_utils [None req-ea7a4d2a-f349-4e8e-b942-68dc7d021415 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=101893) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:13:34.312071 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea7a4d2a-f349-4e8e-b942-68dc7d021415 service cinder] Validating token access rules against request {{(pid=101893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:13:34.318108 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-750a22e2-319e-41b2-9f28-d682a9dc660a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2aeb182e6a5b43cfb0cc347ec847c848', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a000829c658c4a7cab67f7b6353ba3fa', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:13:34.319267 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-750a22e2-319e-41b2-9f28-d682a9dc660a service nova] REQUEST_METHOD: `GET` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:13:34.319267 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-750a22e2-319e-41b2-9f28-d682a9dc660a service nova] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:13:34.319488 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-750a22e2-319e-41b2-9f28-d682a9dc660a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:13:34.321287 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.fernet_utils [None req-750a22e2-319e-41b2-9f28-d682a9dc660a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=101893) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:13:34.335522 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-750a22e2-319e-41b2-9f28-d682a9dc660a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:13:34.337217 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-750a22e2-319e-41b2-9f28-d682a9dc660a service nova] RBAC: Authorization granted {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:13:34.349177 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 1384/2744] 10.222.0.84 () {60 vars in 1365 bytes} [Wed May 25 15:13:34 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 15:13:34.528447 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fec8651-e604-4716-9a66-d003c984a88a service neutron] Authenticating user token {{(pid=101892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:13:34.529924 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.fernet_utils [None req-5fec8651-e604-4716-9a66-d003c984a88a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=101892) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:13:34.601812 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fec8651-e604-4716-9a66-d003c984a88a service neutron] Validating token access rules against request {{(pid=101892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:13:34.606874 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b274b8c0-f746-48d5-81e1-313b04517cce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cec56f74b2fa4826a506dc7b919465be', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:13:34.607789 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b274b8c0-f746-48d5-81e1-313b04517cce admin admin] REQUEST_METHOD: `DELETE` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:13:34.608074 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b274b8c0-f746-48d5-81e1-313b04517cce admin admin] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:13:34.610410 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b274b8c0-f746-48d5-81e1-313b04517cce admin admin] PATH_INFO: `/v3/users/8164ade7533548f8b4d175fdee800f5c` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:13:34.610410 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b274b8c0-f746-48d5-81e1-313b04517cce admin admin] RBAC: Authorizing `identity:delete_user(user_id=8164ade7533548f8b4d175fdee800f5c)` {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:13:34.611487 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b274b8c0-f746-48d5-81e1-313b04517cce admin admin] RBAC: Authorization granted {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:13:34.821726 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.notifications [None req-b274b8c0-f746-48d5-81e1-313b04517cce admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8164ade7533548f8b4d175fdee800f5c'} {{(pid=101892) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:13:34.827047 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG dbcounter [-] [101892] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=101892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:13:34.829729 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.notifications [None req-b274b8c0-f746-48d5-81e1-313b04517cce admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8164ade7533548f8b4d175fdee800f5c'} {{(pid=101892) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:13:34.843382 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.notifications [None req-b274b8c0-f746-48d5-81e1-313b04517cce admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8164ade7533548f8b4d175fdee800f5c'} {{(pid=101892) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:13:34.844149 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.notifications [None req-b274b8c0-f746-48d5-81e1-313b04517cce admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8164ade7533548f8b4d175fdee800f5c'} {{(pid=101892) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:13:34.914673 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.notifications [None req-b274b8c0-f746-48d5-81e1-313b04517cce admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8164ade7533548f8b4d175fdee800f5c'} {{(pid=101892) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:13:34.921740 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 1361/2745] 10.222.0.84 () {58 vars in 1223 bytes} [Wed May 25 15:13:34 2022] DELETE /identity/v3/users/8164ade7533548f8b4d175fdee800f5c => generated 0 bytes in 394 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 15:13:34.926236 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6411054-d8c7-479c-9673-f659f4709465 None None] REQUEST_METHOD: `POST` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:13:34.926526 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6411054-d8c7-479c-9673-f659f4709465 None None] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:13:34.926811 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6411054-d8c7-479c-9673-f659f4709465 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:13:34.943916 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.auth.core [None req-b6411054-d8c7-479c-9673-f659f4709465 None None] MFA Rules not processed for user `05d87e87798e429aa1c10b24391f915e`. Rule list: `[]` (Enabled: `True`). {{(pid=101893) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:13:34.945104 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.fernet_utils [None req-b6411054-d8c7-479c-9673-f659f4709465 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=101893) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:13:35.004191 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 1385/2746] 10.222.0.84 () {58 vars in 957 bytes} [Wed May 25 15:13:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 15:13:35.013930 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b274b8c0-f746-48d5-81e1-313b04517cce admin admin] Authenticating user token {{(pid=101892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:13:35.015343 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.fernet_utils [None req-b274b8c0-f746-48d5-81e1-313b04517cce admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=101892) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:13:35.077586 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b274b8c0-f746-48d5-81e1-313b04517cce admin admin] Validating token access rules against request {{(pid=101892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:13:35.081405 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-810584ac-3c9f-43dc-aff3-5facdcf31789 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ce28b25b907473588ccb87dc4acc06a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a000829c658c4a7cab67f7b6353ba3fa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:13:35.082091 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810584ac-3c9f-43dc-aff3-5facdcf31789 service neutron] REQUEST_METHOD: `GET` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:13:35.082373 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810584ac-3c9f-43dc-aff3-5facdcf31789 service neutron] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:13:35.082654 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810584ac-3c9f-43dc-aff3-5facdcf31789 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:13:35.093787 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-810584ac-3c9f-43dc-aff3-5facdcf31789 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:13:35.095229 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-810584ac-3c9f-43dc-aff3-5facdcf31789 service neutron] RBAC: Authorization granted {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:13:35.106902 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 1362/2747] 10.222.0.84 () {60 vars in 1365 bytes} [Wed May 25 15:13:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 15:13:35.510549 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6411054-d8c7-479c-9673-f659f4709465 None None] Authenticating user token {{(pid=101893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:13:35.512752 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.fernet_utils [None req-b6411054-d8c7-479c-9673-f659f4709465 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=101893) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:13:35.525318 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6411054-d8c7-479c-9673-f659f4709465 None None] Validating token access rules against request {{(pid=101893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:13:35.530953 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-603544eb-6ad2-46a4-b3cc-3def86160657 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cec56f74b2fa4826a506dc7b919465be', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:13:35.531992 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603544eb-6ad2-46a4-b3cc-3def86160657 admin admin] REQUEST_METHOD: `DELETE` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:13:35.532274 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603544eb-6ad2-46a4-b3cc-3def86160657 admin admin] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:13:35.532551 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603544eb-6ad2-46a4-b3cc-3def86160657 admin admin] PATH_INFO: `/v3/projects/bc8de1bcef11466f99b5a32f98dd7dfe` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:13:35.533934 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-603544eb-6ad2-46a4-b3cc-3def86160657 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bc8de1bcef11466f99b5a32f98dd7dfe)` {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:13:35.536135 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-603544eb-6ad2-46a4-b3cc-3def86160657 admin admin] RBAC: Authorization granted {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:13:35.642995 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG dbcounter [-] [101893] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=101893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:13:35.657580 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.notifications [None req-603544eb-6ad2-46a4-b3cc-3def86160657 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bc8de1bcef11466f99b5a32f98dd7dfe', 'request_id': 'req-603544eb-6ad2-46a4-b3cc-3def86160657'} {{(pid=101893) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:13:35.663688 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.notifications [None req-603544eb-6ad2-46a4-b3cc-3def86160657 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bc8de1bcef11466f99b5a32f98dd7dfe', 'request_id': 'req-603544eb-6ad2-46a4-b3cc-3def86160657'} {{(pid=101893) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:13:35.669407 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.notifications [None req-603544eb-6ad2-46a4-b3cc-3def86160657 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bc8de1bcef11466f99b5a32f98dd7dfe', 'request_id': 'req-603544eb-6ad2-46a4-b3cc-3def86160657'} {{(pid=101893) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:13:35.766126 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.notifications [None req-603544eb-6ad2-46a4-b3cc-3def86160657 admin admin] The token cache is being invalidate because project bc8de1bcef11466f99b5a32f98dd7dfe was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=101893) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 25 15:13:35.766324 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.notifications [None req-603544eb-6ad2-46a4-b3cc-3def86160657 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=101893) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:13:35.766951 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.notifications [None req-603544eb-6ad2-46a4-b3cc-3def86160657 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=101893) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:13:35.768507 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 1386/2748] 10.222.0.84 () {58 vars in 1232 bytes} [Wed May 25 15:13:35 2022] DELETE /identity/v3/projects/bc8de1bcef11466f99b5a32f98dd7dfe => generated 0 bytes in 259 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 15:13:35.772616 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-810584ac-3c9f-43dc-aff3-5facdcf31789 service neutron] Authenticating user token {{(pid=101892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:13:35.782137 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-810584ac-3c9f-43dc-aff3-5facdcf31789 service neutron] Validating token access rules against request {{(pid=101892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:13:35.838579 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa8fc120-9913-4442-8bfc-b3aaa5875c0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cec56f74b2fa4826a506dc7b919465be', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:13:35.839458 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8fc120-9913-4442-8bfc-b3aaa5875c0e admin admin] REQUEST_METHOD: `DELETE` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:13:35.839777 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8fc120-9913-4442-8bfc-b3aaa5875c0e admin admin] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:13:35.840060 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8fc120-9913-4442-8bfc-b3aaa5875c0e admin admin] PATH_INFO: `/v3/users/ec4a51e9cb764efa88a8c07c84b2cdcc` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:13:35.841280 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa8fc120-9913-4442-8bfc-b3aaa5875c0e admin admin] RBAC: Authorizing `identity:delete_user(user_id=ec4a51e9cb764efa88a8c07c84b2cdcc)` {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:13:35.843215 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa8fc120-9913-4442-8bfc-b3aaa5875c0e admin admin] RBAC: Authorization granted {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:13:35.974556 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.notifications [None req-aa8fc120-9913-4442-8bfc-b3aaa5875c0e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ec4a51e9cb764efa88a8c07c84b2cdcc'} {{(pid=101892) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:13:35.982763 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.notifications [None req-aa8fc120-9913-4442-8bfc-b3aaa5875c0e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ec4a51e9cb764efa88a8c07c84b2cdcc'} {{(pid=101892) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:13:35.994833 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.notifications [None req-aa8fc120-9913-4442-8bfc-b3aaa5875c0e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ec4a51e9cb764efa88a8c07c84b2cdcc'} {{(pid=101892) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:13:35.996089 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.notifications [None req-aa8fc120-9913-4442-8bfc-b3aaa5875c0e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ec4a51e9cb764efa88a8c07c84b2cdcc'} {{(pid=101892) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:13:35.997861 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG dbcounter [-] [101892] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=101892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:13:36.041311 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.notifications [None req-aa8fc120-9913-4442-8bfc-b3aaa5875c0e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ec4a51e9cb764efa88a8c07c84b2cdcc'} {{(pid=101892) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:13:36.048011 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 1363/2749] 10.222.0.84 () {58 vars in 1223 bytes} [Wed May 25 15:13:35 2022] DELETE /identity/v3/users/ec4a51e9cb764efa88a8c07c84b2cdcc => generated 0 bytes in 276 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 15:13:36.451976 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-603544eb-6ad2-46a4-b3cc-3def86160657 admin admin] Authenticating user token {{(pid=101893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:13:36.453395 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.fernet_utils [None req-603544eb-6ad2-46a4-b3cc-3def86160657 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=101893) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:13:36.468428 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-603544eb-6ad2-46a4-b3cc-3def86160657 admin admin] Validating token access rules against request {{(pid=101893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:13:36.535175 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa8fc120-9913-4442-8bfc-b3aaa5875c0e admin admin] Authenticating user token {{(pid=101892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:13:36.536736 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.fernet_utils [None req-aa8fc120-9913-4442-8bfc-b3aaa5875c0e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=101892) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:13:36.538813 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e13acc4c-7108-44da-b560-607fc70587d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cec56f74b2fa4826a506dc7b919465be', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:13:36.542474 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13acc4c-7108-44da-b560-607fc70587d7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:13:36.542736 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13acc4c-7108-44da-b560-607fc70587d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:13:36.544583 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13acc4c-7108-44da-b560-607fc70587d7 admin admin] PATH_INFO: `/v3/users/ed9fef0489ae4b72a0212a5e6bd81f54` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:13:36.546362 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e13acc4c-7108-44da-b560-607fc70587d7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ed9fef0489ae4b72a0212a5e6bd81f54)` {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:13:36.549408 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e13acc4c-7108-44da-b560-607fc70587d7 admin admin] RBAC: Authorization granted {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:13:36.569469 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa8fc120-9913-4442-8bfc-b3aaa5875c0e admin admin] Validating token access rules against request {{(pid=101892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:13:36.569469 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20afb3e9-253e-4f57-ab01-a15dbfe7e836 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cec56f74b2fa4826a506dc7b919465be', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:13:36.570490 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20afb3e9-253e-4f57-ab01-a15dbfe7e836 admin admin] REQUEST_METHOD: `DELETE` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:13:36.570879 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20afb3e9-253e-4f57-ab01-a15dbfe7e836 admin admin] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:13:36.571023 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20afb3e9-253e-4f57-ab01-a15dbfe7e836 admin admin] PATH_INFO: `/v3/projects/bce90d80bb9746cd83a7cf95e07a4302` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:13:36.574632 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20afb3e9-253e-4f57-ab01-a15dbfe7e836 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bce90d80bb9746cd83a7cf95e07a4302)` {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:13:36.576827 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20afb3e9-253e-4f57-ab01-a15dbfe7e836 admin admin] RBAC: Authorization granted {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:13:36.763064 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.notifications [None req-20afb3e9-253e-4f57-ab01-a15dbfe7e836 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bce90d80bb9746cd83a7cf95e07a4302', 'request_id': 'req-20afb3e9-253e-4f57-ab01-a15dbfe7e836'} {{(pid=101892) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:13:36.766868 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.notifications [None req-e13acc4c-7108-44da-b560-607fc70587d7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ed9fef0489ae4b72a0212a5e6bd81f54'} {{(pid=101893) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:13:36.770177 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.notifications [None req-20afb3e9-253e-4f57-ab01-a15dbfe7e836 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bce90d80bb9746cd83a7cf95e07a4302', 'request_id': 'req-20afb3e9-253e-4f57-ab01-a15dbfe7e836'} {{(pid=101892) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:13:36.774809 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.notifications [None req-e13acc4c-7108-44da-b560-607fc70587d7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ed9fef0489ae4b72a0212a5e6bd81f54'} {{(pid=101893) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:13:36.784168 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.notifications [None req-20afb3e9-253e-4f57-ab01-a15dbfe7e836 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bce90d80bb9746cd83a7cf95e07a4302', 'request_id': 'req-20afb3e9-253e-4f57-ab01-a15dbfe7e836'} {{(pid=101892) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:13:36.793189 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.notifications [None req-e13acc4c-7108-44da-b560-607fc70587d7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ed9fef0489ae4b72a0212a5e6bd81f54'} {{(pid=101893) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:13:36.794020 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.notifications [None req-e13acc4c-7108-44da-b560-607fc70587d7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ed9fef0489ae4b72a0212a5e6bd81f54'} {{(pid=101893) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:13:36.794628 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.notifications [None req-e13acc4c-7108-44da-b560-607fc70587d7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ed9fef0489ae4b72a0212a5e6bd81f54'} {{(pid=101893) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:13:36.851531 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.notifications [None req-20afb3e9-253e-4f57-ab01-a15dbfe7e836 admin admin] The token cache is being invalidate because project bce90d80bb9746cd83a7cf95e07a4302 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=101892) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 25 15:13:36.851863 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.notifications [None req-20afb3e9-253e-4f57-ab01-a15dbfe7e836 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=101892) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:13:36.852494 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.notifications [None req-20afb3e9-253e-4f57-ab01-a15dbfe7e836 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=101892) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:13:36.854112 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 1364/2750] 10.222.0.84 () {58 vars in 1232 bytes} [Wed May 25 15:13:36 2022] DELETE /identity/v3/projects/bce90d80bb9746cd83a7cf95e07a4302 => generated 0 bytes in 319 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 15:13:36.858423 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20afb3e9-253e-4f57-ab01-a15dbfe7e836 admin admin] Authenticating user token {{(pid=101892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:13:36.862375 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.fernet_utils [None req-20afb3e9-253e-4f57-ab01-a15dbfe7e836 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=101892) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:13:36.919138 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 1387/2751] 10.222.0.84 () {58 vars in 1223 bytes} [Wed May 25 15:13:36 2022] DELETE /identity/v3/users/ed9fef0489ae4b72a0212a5e6bd81f54 => generated 0 bytes in 464 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 15:13:36.920886 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6d6604-700e-49e2-a0f0-dba0c65a2622 None None] REQUEST_METHOD: `POST` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:13:36.921265 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6d6604-700e-49e2-a0f0-dba0c65a2622 None None] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:13:36.924290 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6d6604-700e-49e2-a0f0-dba0c65a2622 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:13:36.936777 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20afb3e9-253e-4f57-ab01-a15dbfe7e836 admin admin] Validating token access rules against request {{(pid=101892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:13:36.948795 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.auth.core [None req-6b6d6604-700e-49e2-a0f0-dba0c65a2622 None None] MFA Rules not processed for user `05d87e87798e429aa1c10b24391f915e`. Rule list: `[]` (Enabled: `True`). {{(pid=101893) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:13:36.948795 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.fernet_utils [None req-6b6d6604-700e-49e2-a0f0-dba0c65a2622 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=101893) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:13:36.981151 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG dbcounter [-] [101893] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=101893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:13:36.999932 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa8dcb30-5f34-4072-b2e6-dca604a99df9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cec56f74b2fa4826a506dc7b919465be', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:13:37.005967 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8dcb30-5f34-4072-b2e6-dca604a99df9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:13:37.005967 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8dcb30-5f34-4072-b2e6-dca604a99df9 admin admin] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:13:37.005967 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8dcb30-5f34-4072-b2e6-dca604a99df9 admin admin] PATH_INFO: `/v3/users/aa583519e4034d27a1bf9930a5ec4428` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:13:37.005967 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa8dcb30-5f34-4072-b2e6-dca604a99df9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=aa583519e4034d27a1bf9930a5ec4428)` {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:13:37.005967 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa8dcb30-5f34-4072-b2e6-dca604a99df9 admin admin] RBAC: Authorization granted {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:13:37.011457 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 1388/2752] 10.222.0.84 () {58 vars in 957 bytes} [Wed May 25 15:13:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 15:13:37.022546 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b6d6604-700e-49e2-a0f0-dba0c65a2622 None None] Authenticating user token {{(pid=101893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:13:37.024812 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.fernet_utils [None req-6b6d6604-700e-49e2-a0f0-dba0c65a2622 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=101893) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:13:37.032578 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG dbcounter [-] [101892] Writing DB stats keystone:INSERT=2,keystone:DELETE=12,keystone:SELECT=86 {{(pid=101892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:13:37.087921 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b6d6604-700e-49e2-a0f0-dba0c65a2622 None None] Validating token access rules against request {{(pid=101893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:13:37.092049 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b0f2cb9-fdd8-418a-8eb3-ba34f98953aa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ce28b25b907473588ccb87dc4acc06a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a000829c658c4a7cab67f7b6353ba3fa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:13:37.092706 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0f2cb9-fdd8-418a-8eb3-ba34f98953aa service neutron] REQUEST_METHOD: `GET` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:13:37.092991 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0f2cb9-fdd8-418a-8eb3-ba34f98953aa service neutron] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:13:37.093266 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0f2cb9-fdd8-418a-8eb3-ba34f98953aa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:13:37.102862 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b0f2cb9-fdd8-418a-8eb3-ba34f98953aa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:13:37.107226 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b0f2cb9-fdd8-418a-8eb3-ba34f98953aa service neutron] RBAC: Authorization granted {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:13:37.114979 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 1389/2753] 10.222.0.84 () {60 vars in 1365 bytes} [Wed May 25 15:13:37 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 25 15:13:37.277333 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.notifications [None req-fa8dcb30-5f34-4072-b2e6-dca604a99df9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'aa583519e4034d27a1bf9930a5ec4428'} {{(pid=101892) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:13:37.284839 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.notifications [None req-fa8dcb30-5f34-4072-b2e6-dca604a99df9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'aa583519e4034d27a1bf9930a5ec4428'} {{(pid=101892) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:13:37.298113 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.notifications [None req-fa8dcb30-5f34-4072-b2e6-dca604a99df9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'aa583519e4034d27a1bf9930a5ec4428'} {{(pid=101892) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:13:37.304573 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.notifications [None req-fa8dcb30-5f34-4072-b2e6-dca604a99df9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'aa583519e4034d27a1bf9930a5ec4428'} {{(pid=101892) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:13:37.360409 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.notifications [None req-fa8dcb30-5f34-4072-b2e6-dca604a99df9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'aa583519e4034d27a1bf9930a5ec4428'} {{(pid=101892) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:13:37.369902 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 1365/2754] 10.222.0.84 () {58 vars in 1223 bytes} [Wed May 25 15:13:36 2022] DELETE /identity/v3/users/aa583519e4034d27a1bf9930a5ec4428 => generated 0 bytes in 512 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 25 15:13:37.561656 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b0f2cb9-fdd8-418a-8eb3-ba34f98953aa service neutron] Authenticating user token {{(pid=101893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:13:37.563343 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.fernet_utils [None req-1b0f2cb9-fdd8-418a-8eb3-ba34f98953aa service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=101893) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:13:37.599098 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b0f2cb9-fdd8-418a-8eb3-ba34f98953aa service neutron] Validating token access rules against request {{(pid=101893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:13:37.668959 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b15a617a-26b0-4691-86ec-d5757610b759 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cec56f74b2fa4826a506dc7b919465be', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:13:37.669866 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15a617a-26b0-4691-86ec-d5757610b759 admin admin] REQUEST_METHOD: `DELETE` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:13:37.670154 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15a617a-26b0-4691-86ec-d5757610b759 admin admin] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:13:37.670430 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15a617a-26b0-4691-86ec-d5757610b759 admin admin] PATH_INFO: `/v3/projects/966d69c120f0455599dfe9882da903ed` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:13:37.671753 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b15a617a-26b0-4691-86ec-d5757610b759 admin admin] RBAC: Authorizing `identity:delete_project(project_id=966d69c120f0455599dfe9882da903ed)` {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:13:37.673852 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b15a617a-26b0-4691-86ec-d5757610b759 admin admin] RBAC: Authorization granted {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:13:37.782459 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.notifications [None req-b15a617a-26b0-4691-86ec-d5757610b759 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '966d69c120f0455599dfe9882da903ed', 'request_id': 'req-b15a617a-26b0-4691-86ec-d5757610b759'} {{(pid=101893) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:13:37.788719 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.notifications [None req-b15a617a-26b0-4691-86ec-d5757610b759 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '966d69c120f0455599dfe9882da903ed', 'request_id': 'req-b15a617a-26b0-4691-86ec-d5757610b759'} {{(pid=101893) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:13:37.794760 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.notifications [None req-b15a617a-26b0-4691-86ec-d5757610b759 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '966d69c120f0455599dfe9882da903ed', 'request_id': 'req-b15a617a-26b0-4691-86ec-d5757610b759'} {{(pid=101893) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:13:37.860951 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa8dcb30-5f34-4072-b2e6-dca604a99df9 admin admin] Authenticating user token {{(pid=101892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:13:37.861454 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.fernet_utils [None req-fa8dcb30-5f34-4072-b2e6-dca604a99df9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=101892) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:13:37.874843 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa8dcb30-5f34-4072-b2e6-dca604a99df9 admin admin] Validating token access rules against request {{(pid=101892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:13:37.893129 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.notifications [None req-b15a617a-26b0-4691-86ec-d5757610b759 admin admin] The token cache is being invalidate because project 966d69c120f0455599dfe9882da903ed was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=101893) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 25 15:13:37.893129 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.notifications [None req-b15a617a-26b0-4691-86ec-d5757610b759 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=101893) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:13:37.893129 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.notifications [None req-b15a617a-26b0-4691-86ec-d5757610b759 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=101893) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:13:37.893129 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 1390/2755] 10.222.0.84 () {58 vars in 1232 bytes} [Wed May 25 15:13:37 2022] DELETE /identity/v3/projects/966d69c120f0455599dfe9882da903ed => generated 0 bytes in 328 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 15:13:37.895451 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b15a617a-26b0-4691-86ec-d5757610b759 admin admin] Authenticating user token {{(pid=101893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:13:37.897159 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.fernet_utils [None req-b15a617a-26b0-4691-86ec-d5757610b759 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=101893) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:13:37.908364 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG dbcounter [-] [101893] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=101893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:13:37.937711 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a0a7a10-fce5-4ff8-aeb1-b7221ecc5398 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cec56f74b2fa4826a506dc7b919465be', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:13:37.938681 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0a7a10-fce5-4ff8-aeb1-b7221ecc5398 admin admin] REQUEST_METHOD: `DELETE` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:13:37.938967 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0a7a10-fce5-4ff8-aeb1-b7221ecc5398 admin admin] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:13:37.939486 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0a7a10-fce5-4ff8-aeb1-b7221ecc5398 admin admin] PATH_INFO: `/v3/projects/87623417129f4f13807275f40a2b252b` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:13:37.940713 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a0a7a10-fce5-4ff8-aeb1-b7221ecc5398 admin admin] RBAC: Authorizing `identity:delete_project(project_id=87623417129f4f13807275f40a2b252b)` {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:13:37.943186 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a0a7a10-fce5-4ff8-aeb1-b7221ecc5398 admin admin] RBAC: Authorization granted {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:13:37.964568 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b15a617a-26b0-4691-86ec-d5757610b759 admin admin] Validating token access rules against request {{(pid=101893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:13:37.969915 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d9e21e-8f1b-4f33-8528-80099af5cf0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cec56f74b2fa4826a506dc7b919465be', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:13:37.970806 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d9e21e-8f1b-4f33-8528-80099af5cf0c admin admin] REQUEST_METHOD: `DELETE` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:13:37.971069 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d9e21e-8f1b-4f33-8528-80099af5cf0c admin admin] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:13:37.971339 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d9e21e-8f1b-4f33-8528-80099af5cf0c admin admin] PATH_INFO: `/v3/users/cf749a478d4645e8ad59ecd4f00be97c` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:13:37.972560 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8d9e21e-8f1b-4f33-8528-80099af5cf0c admin admin] RBAC: Authorizing `identity:delete_user(user_id=cf749a478d4645e8ad59ecd4f00be97c)` {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:13:37.974525 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8d9e21e-8f1b-4f33-8528-80099af5cf0c admin admin] RBAC: Authorization granted {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:13:38.029609 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.notifications [None req-3a0a7a10-fce5-4ff8-aeb1-b7221ecc5398 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '87623417129f4f13807275f40a2b252b', 'request_id': 'req-3a0a7a10-fce5-4ff8-aeb1-b7221ecc5398'} {{(pid=101892) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:13:38.035918 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.notifications [None req-3a0a7a10-fce5-4ff8-aeb1-b7221ecc5398 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '87623417129f4f13807275f40a2b252b', 'request_id': 'req-3a0a7a10-fce5-4ff8-aeb1-b7221ecc5398'} {{(pid=101892) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:13:38.041507 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.notifications [None req-3a0a7a10-fce5-4ff8-aeb1-b7221ecc5398 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '87623417129f4f13807275f40a2b252b', 'request_id': 'req-3a0a7a10-fce5-4ff8-aeb1-b7221ecc5398'} {{(pid=101892) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:13:38.091806 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.notifications [None req-3a0a7a10-fce5-4ff8-aeb1-b7221ecc5398 admin admin] The token cache is being invalidate because project 87623417129f4f13807275f40a2b252b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=101892) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 25 15:13:38.092092 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.notifications [None req-3a0a7a10-fce5-4ff8-aeb1-b7221ecc5398 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=101892) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:13:38.092710 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.notifications [None req-3a0a7a10-fce5-4ff8-aeb1-b7221ecc5398 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=101892) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:13:38.094279 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 1366/2756] 10.222.0.84 () {58 vars in 1232 bytes} [Wed May 25 15:13:37 2022] DELETE /identity/v3/projects/87623417129f4f13807275f40a2b252b => generated 0 bytes in 235 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 25 15:13:38.099287 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd1f0e5-a19e-4d44-9567-57fcea4727e6 None None] REQUEST_METHOD: `POST` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:13:38.099595 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd1f0e5-a19e-4d44-9567-57fcea4727e6 None None] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:13:38.099991 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd1f0e5-a19e-4d44-9567-57fcea4727e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:13:38.118115 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.notifications [None req-d8d9e21e-8f1b-4f33-8528-80099af5cf0c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cf749a478d4645e8ad59ecd4f00be97c'} {{(pid=101893) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:13:38.121686 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.auth.core [None req-cbd1f0e5-a19e-4d44-9567-57fcea4727e6 None None] MFA Rules not processed for user `05d87e87798e429aa1c10b24391f915e`. Rule list: `[]` (Enabled: `True`). {{(pid=101892) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:13:38.123084 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.fernet_utils [None req-cbd1f0e5-a19e-4d44-9567-57fcea4727e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=101892) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:13:38.126088 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.notifications [None req-d8d9e21e-8f1b-4f33-8528-80099af5cf0c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cf749a478d4645e8ad59ecd4f00be97c'} {{(pid=101893) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:13:38.138929 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.notifications [None req-d8d9e21e-8f1b-4f33-8528-80099af5cf0c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cf749a478d4645e8ad59ecd4f00be97c'} {{(pid=101893) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:13:38.139700 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.notifications [None req-d8d9e21e-8f1b-4f33-8528-80099af5cf0c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cf749a478d4645e8ad59ecd4f00be97c'} {{(pid=101893) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:13:38.140335 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.notifications [None req-d8d9e21e-8f1b-4f33-8528-80099af5cf0c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cf749a478d4645e8ad59ecd4f00be97c'} {{(pid=101893) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:13:38.149621 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG dbcounter [-] [101892] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=101892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:13:38.182711 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 1367/2757] 10.222.0.84 () {58 vars in 957 bytes} [Wed May 25 15:13:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 25 15:13:38.190538 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8abf7312-c45a-4ff6-8dc9-90feb1a33785 None None] REQUEST_METHOD: `POST` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:13:38.190824 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8abf7312-c45a-4ff6-8dc9-90feb1a33785 None None] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:13:38.191104 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8abf7312-c45a-4ff6-8dc9-90feb1a33785 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:13:38.209307 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.auth.core [None req-8abf7312-c45a-4ff6-8dc9-90feb1a33785 None None] MFA Rules not processed for user `05d87e87798e429aa1c10b24391f915e`. Rule list: `[]` (Enabled: `True`). {{(pid=101892) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:13:38.211494 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.fernet_utils [None req-8abf7312-c45a-4ff6-8dc9-90feb1a33785 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=101892) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:13:38.220096 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 1368/2758] 10.222.0.84 () {58 vars in 957 bytes} [Wed May 25 15:13:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 25 15:13:38.224202 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8abf7312-c45a-4ff6-8dc9-90feb1a33785 None None] Authenticating user token {{(pid=101892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:13:38.228968 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 1391/2759] 10.222.0.84 () {58 vars in 1223 bytes} [Wed May 25 15:13:37 2022] DELETE /identity/v3/users/cf749a478d4645e8ad59ecd4f00be97c => generated 0 bytes in 334 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 25 15:13:38.233193 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8abf7312-c45a-4ff6-8dc9-90feb1a33785 None None] Validating token access rules against request {{(pid=101892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:13:38.291210 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-200b37ef-fe7c-4c71-8d08-6368d705cfa5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cec56f74b2fa4826a506dc7b919465be', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:13:38.293053 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200b37ef-fe7c-4c71-8d08-6368d705cfa5 admin admin] REQUEST_METHOD: `GET` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:13:38.293053 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200b37ef-fe7c-4c71-8d08-6368d705cfa5 admin admin] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:13:38.293053 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200b37ef-fe7c-4c71-8d08-6368d705cfa5 admin admin] PATH_INFO: `/v3/domains` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:13:38.293343 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-200b37ef-fe7c-4c71-8d08-6368d705cfa5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=101892) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 15:13:38.293608 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-200b37ef-fe7c-4c71-8d08-6368d705cfa5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:13:38.295201 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-200b37ef-fe7c-4c71-8d08-6368d705cfa5 admin admin] RBAC: Authorization granted {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:13:38.306551 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 1369/2760] 10.222.0.84 () {58 vars in 1152 bytes} [Wed May 25 15:13:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 15:13:38.311019 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d9e21e-8f1b-4f33-8528-80099af5cf0c admin admin] Authenticating user token {{(pid=101893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:13:38.321684 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d9e21e-8f1b-4f33-8528-80099af5cf0c admin admin] Validating token access rules against request {{(pid=101893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:13:38.327341 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cabcf3c-4cd6-4810-99ec-1dfe60a5e55e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cec56f74b2fa4826a506dc7b919465be', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:13:38.328060 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cabcf3c-4cd6-4810-99ec-1dfe60a5e55e admin admin] REQUEST_METHOD: `POST` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:13:38.328345 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cabcf3c-4cd6-4810-99ec-1dfe60a5e55e admin admin] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:13:38.328621 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cabcf3c-4cd6-4810-99ec-1dfe60a5e55e admin admin] PATH_INFO: `/v3/projects` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:13:38.329319 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cabcf3c-4cd6-4810-99ec-1dfe60a5e55e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:13:38.331254 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cabcf3c-4cd6-4810-99ec-1dfe60a5e55e admin admin] RBAC: Authorization granted {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:13:38.430341 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 1392/2761] 10.222.0.84 () {60 vars in 1152 bytes} [Wed May 25 15:13:38 2022] POST /identity/v3/projects => generated 383 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 15:13:38.434555 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-200b37ef-fe7c-4c71-8d08-6368d705cfa5 admin admin] Authenticating user token {{(pid=101892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:13:38.444939 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-200b37ef-fe7c-4c71-8d08-6368d705cfa5 admin admin] Validating token access rules against request {{(pid=101892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:13:38.503792 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7518c514-de4d-4f16-bd1d-6da8b4d01f0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cec56f74b2fa4826a506dc7b919465be', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:13:38.504479 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7518c514-de4d-4f16-bd1d-6da8b4d01f0c admin admin] REQUEST_METHOD: `POST` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:13:38.504768 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7518c514-de4d-4f16-bd1d-6da8b4d01f0c admin admin] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:13:38.505076 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7518c514-de4d-4f16-bd1d-6da8b4d01f0c admin admin] PATH_INFO: `/v3/users` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:13:38.505816 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7518c514-de4d-4f16-bd1d-6da8b4d01f0c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:13:38.507876 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7518c514-de4d-4f16-bd1d-6da8b4d01f0c admin admin] RBAC: Authorization granted {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:13:38.628867 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 1370/2762] 10.222.0.84 () {60 vars in 1143 bytes} [Wed May 25 15:13:38 2022] POST /identity/v3/users => generated 292 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 15:13:38.632996 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cabcf3c-4cd6-4810-99ec-1dfe60a5e55e admin admin] Authenticating user token {{(pid=101893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:13:38.643798 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7518c514-de4d-4f16-bd1d-6da8b4d01f0c admin admin] Authenticating user token {{(pid=101892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:13:38.646990 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cabcf3c-4cd6-4810-99ec-1dfe60a5e55e admin admin] Validating token access rules against request {{(pid=101893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:13:38.649090 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.fernet_utils [None req-7518c514-de4d-4f16-bd1d-6da8b4d01f0c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=101892) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:13:38.656289 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b938aa61-4af7-45fb-ba8f-f45545560c8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cec56f74b2fa4826a506dc7b919465be', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:13:38.657334 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b938aa61-4af7-45fb-ba8f-f45545560c8c admin admin] REQUEST_METHOD: `GET` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:13:38.657334 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b938aa61-4af7-45fb-ba8f-f45545560c8c admin admin] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:13:38.657573 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b938aa61-4af7-45fb-ba8f-f45545560c8c admin admin] PATH_INFO: `/v3/roles` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:13:38.658422 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b938aa61-4af7-45fb-ba8f-f45545560c8c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:13:38.659942 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b938aa61-4af7-45fb-ba8f-f45545560c8c admin admin] RBAC: Authorization granted {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:13:38.662022 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7518c514-de4d-4f16-bd1d-6da8b4d01f0c admin admin] Validating token access rules against request {{(pid=101892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:13:38.667731 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e86d1ab0-199d-413a-9fa9-b2f013ae0d9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cec56f74b2fa4826a506dc7b919465be', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:13:38.668514 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86d1ab0-199d-413a-9fa9-b2f013ae0d9c admin admin] REQUEST_METHOD: `DELETE` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:13:38.668789 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86d1ab0-199d-413a-9fa9-b2f013ae0d9c admin admin] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:13:38.669075 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86d1ab0-199d-413a-9fa9-b2f013ae0d9c admin admin] PATH_INFO: `/v3/projects/95b136737765457884f9163da02fced7` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:13:38.670301 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e86d1ab0-199d-413a-9fa9-b2f013ae0d9c admin admin] RBAC: Authorizing `identity:delete_project(project_id=95b136737765457884f9163da02fced7)` {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:13:38.672346 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e86d1ab0-199d-413a-9fa9-b2f013ae0d9c admin admin] RBAC: Authorization granted {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:13:38.677587 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 1393/2763] 10.222.0.84 () {58 vars in 1121 bytes} [Wed May 25 15:13:38 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 15:13:38.680801 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b938aa61-4af7-45fb-ba8f-f45545560c8c admin admin] Authenticating user token {{(pid=101893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:13:38.694496 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b938aa61-4af7-45fb-ba8f-f45545560c8c admin admin] Validating token access rules against request {{(pid=101893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:13:38.700746 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0151cfd-a424-4843-9496-1f03d5e236d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cec56f74b2fa4826a506dc7b919465be', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:13:38.701543 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0151cfd-a424-4843-9496-1f03d5e236d8 admin admin] REQUEST_METHOD: `GET` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:13:38.701845 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0151cfd-a424-4843-9496-1f03d5e236d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:13:38.702269 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0151cfd-a424-4843-9496-1f03d5e236d8 admin admin] PATH_INFO: `/v3/roles` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:13:38.703078 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0151cfd-a424-4843-9496-1f03d5e236d8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:13:38.704779 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0151cfd-a424-4843-9496-1f03d5e236d8 admin admin] RBAC: Authorization granted {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:13:38.717988 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 1394/2764] 10.222.0.84 () {58 vars in 1121 bytes} [Wed May 25 15:13:38 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 15:13:38.720920 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0151cfd-a424-4843-9496-1f03d5e236d8 admin admin] Authenticating user token {{(pid=101893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:13:38.731363 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0151cfd-a424-4843-9496-1f03d5e236d8 admin admin] Validating token access rules against request {{(pid=101893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:13:38.736212 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d46549-bf5e-47cd-a529-aecef5b4a1d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cec56f74b2fa4826a506dc7b919465be', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:13:38.740646 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d46549-bf5e-47cd-a529-aecef5b4a1d8 admin admin] REQUEST_METHOD: `PUT` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:13:38.740646 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d46549-bf5e-47cd-a529-aecef5b4a1d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:13:38.740646 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d46549-bf5e-47cd-a529-aecef5b4a1d8 admin admin] PATH_INFO: `/v3/projects/09eb3a6076f44594ac17a95808adbf3f/users/b10a635f6de642899fff0cc0c79ac38e/roles/ff664fa0db7e4262a5accde96c3df4c3` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:13:38.753807 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2d46549-bf5e-47cd-a529-aecef5b4a1d8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=09eb3a6076f44594ac17a95808adbf3f, user_id=b10a635f6de642899fff0cc0c79ac38e, role_id=ff664fa0db7e4262a5accde96c3df4c3)` {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:13:38.756513 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2d46549-bf5e-47cd-a529-aecef5b4a1d8 admin admin] RBAC: Authorization granted {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:13:38.857248 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 1395/2765] 10.222.0.84 () {60 vars in 1482 bytes} [Wed May 25 15:13:38 2022] PUT /identity/v3/projects/09eb3a6076f44594ac17a95808adbf3f/users/b10a635f6de642899fff0cc0c79ac38e/roles/ff664fa0db7e4262a5accde96c3df4c3 => generated 0 bytes in 136 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 25 15:13:38.859217 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG dbcounter [-] [101892] Writing DB stats keystone:SELECT=94,keystone:INSERT=3,keystone:DELETE=3 {{(pid=101892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:13:38.868597 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245ab891-9e78-46ea-b610-5011294dc062 None None] REQUEST_METHOD: `POST` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:13:38.869443 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245ab891-9e78-46ea-b610-5011294dc062 None None] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:13:38.869846 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245ab891-9e78-46ea-b610-5011294dc062 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:13:38.871069 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.notifications [None req-e86d1ab0-199d-413a-9fa9-b2f013ae0d9c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '95b136737765457884f9163da02fced7', 'request_id': 'req-e86d1ab0-199d-413a-9fa9-b2f013ae0d9c'} {{(pid=101892) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:13:38.880487 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.notifications [None req-e86d1ab0-199d-413a-9fa9-b2f013ae0d9c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '95b136737765457884f9163da02fced7', 'request_id': 'req-e86d1ab0-199d-413a-9fa9-b2f013ae0d9c'} {{(pid=101892) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:13:38.888320 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.notifications [None req-e86d1ab0-199d-413a-9fa9-b2f013ae0d9c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '95b136737765457884f9163da02fced7', 'request_id': 'req-e86d1ab0-199d-413a-9fa9-b2f013ae0d9c'} {{(pid=101892) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:13:38.900535 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.auth.core [None req-245ab891-9e78-46ea-b610-5011294dc062 None None] MFA Rules not processed for user `b10a635f6de642899fff0cc0c79ac38e`. Rule list: `[]` (Enabled: `True`). {{(pid=101893) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:13:38.901805 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.fernet_utils [None req-245ab891-9e78-46ea-b610-5011294dc062 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=101893) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:13:38.914059 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG dbcounter [-] [101893] Writing DB stats keystone:SELECT=87,keystone:DELETE=10,keystone:INSERT=3 {{(pid=101893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:13:38.966350 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.notifications [None req-e86d1ab0-199d-413a-9fa9-b2f013ae0d9c admin admin] The token cache is being invalidate because project 95b136737765457884f9163da02fced7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=101892) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 25 15:13:38.966350 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.notifications [None req-e86d1ab0-199d-413a-9fa9-b2f013ae0d9c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=101892) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:13:38.966350 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.notifications [None req-e86d1ab0-199d-413a-9fa9-b2f013ae0d9c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=101892) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:13:38.967307 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 1371/2766] 10.222.0.84 () {58 vars in 1232 bytes} [Wed May 25 15:13:38 2022] DELETE /identity/v3/projects/95b136737765457884f9163da02fced7 => generated 0 bytes in 324 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 15:13:38.972174 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea66031-193d-4062-aa60-942222e371e9 None None] REQUEST_METHOD: `POST` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:13:38.972652 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea66031-193d-4062-aa60-942222e371e9 None None] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:13:38.973049 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea66031-193d-4062-aa60-942222e371e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:13:38.974913 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 1396/2767] 10.222.0.84 () {58 vars in 957 bytes} [Wed May 25 15:13:38 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 15:13:38.986971 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-245ab891-9e78-46ea-b610-5011294dc062 None None] Authenticating user token {{(pid=101893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:13:38.988860 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.fernet_utils [None req-245ab891-9e78-46ea-b610-5011294dc062 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=101893) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:13:38.993510 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.auth.core [None req-cea66031-193d-4062-aa60-942222e371e9 None None] MFA Rules not processed for user `05d87e87798e429aa1c10b24391f915e`. Rule list: `[]` (Enabled: `True`). {{(pid=101892) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:13:38.994734 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.fernet_utils [None req-cea66031-193d-4062-aa60-942222e371e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=101892) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:13:39.056671 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-245ab891-9e78-46ea-b610-5011294dc062 None None] Validating token access rules against request {{(pid=101893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:13:39.063788 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23bc2150-8787-4003-bbfb-00478a2b2280 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e079f89a5e524ab6ad4183e4f690de07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a000829c658c4a7cab67f7b6353ba3fa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:13:39.063928 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 1372/2768] 10.222.0.84 () {58 vars in 957 bytes} [Wed May 25 15:13:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 25 15:13:39.064042 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23bc2150-8787-4003-bbfb-00478a2b2280 service cinder] REQUEST_METHOD: `GET` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:13:39.064042 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23bc2150-8787-4003-bbfb-00478a2b2280 service cinder] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:13:39.064042 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23bc2150-8787-4003-bbfb-00478a2b2280 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:13:39.064042 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.fernet_utils [None req-23bc2150-8787-4003-bbfb-00478a2b2280 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=101893) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:13:39.069786 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e040f9d-660f-4785-9189-d8796967f460 None None] REQUEST_METHOD: `POST` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:13:39.070081 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e040f9d-660f-4785-9189-d8796967f460 None None] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:13:39.070362 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e040f9d-660f-4785-9189-d8796967f460 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:13:39.076939 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23bc2150-8787-4003-bbfb-00478a2b2280 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:13:39.078433 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23bc2150-8787-4003-bbfb-00478a2b2280 service cinder] RBAC: Authorization granted {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:13:39.087543 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 1397/2769] 10.222.0.84 () {60 vars in 1365 bytes} [Wed May 25 15:13:38 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 25 15:13:39.090755 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.auth.core [None req-3e040f9d-660f-4785-9189-d8796967f460 None None] MFA Rules not processed for user `05d87e87798e429aa1c10b24391f915e`. Rule list: `[]` (Enabled: `True`). {{(pid=101892) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:13:39.091997 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.fernet_utils [None req-3e040f9d-660f-4785-9189-d8796967f460 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=101892) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:13:39.100565 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 1373/2770] 10.222.0.84 () {58 vars in 957 bytes} [Wed May 25 15:13:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 25 15:13:39.104790 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23bc2150-8787-4003-bbfb-00478a2b2280 service cinder] Authenticating user token {{(pid=101893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:13:39.116257 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23bc2150-8787-4003-bbfb-00478a2b2280 service cinder] Validating token access rules against request {{(pid=101893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:13:39.121345 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12d7e790-0039-44e5-9fc9-19208fa94b7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cec56f74b2fa4826a506dc7b919465be', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:13:39.121999 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d7e790-0039-44e5-9fc9-19208fa94b7c admin admin] REQUEST_METHOD: `GET` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:13:39.122284 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d7e790-0039-44e5-9fc9-19208fa94b7c admin admin] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:13:39.122699 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d7e790-0039-44e5-9fc9-19208fa94b7c admin admin] PATH_INFO: `/v3/domains` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:13:39.123290 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12d7e790-0039-44e5-9fc9-19208fa94b7c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=101893) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 15:13:39.123640 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12d7e790-0039-44e5-9fc9-19208fa94b7c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:13:39.125246 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12d7e790-0039-44e5-9fc9-19208fa94b7c admin admin] RBAC: Authorization granted {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:13:39.139208 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 1398/2771] 10.222.0.84 () {58 vars in 1152 bytes} [Wed May 25 15:13:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 15:13:39.143619 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e040f9d-660f-4785-9189-d8796967f460 None None] Authenticating user token {{(pid=101892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:13:39.153317 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e040f9d-660f-4785-9189-d8796967f460 None None] Validating token access rules against request {{(pid=101892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:13:39.158351 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e9d1cc0-6269-4729-ad9a-7ee04921e22e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cec56f74b2fa4826a506dc7b919465be', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:13:39.159013 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9d1cc0-6269-4729-ad9a-7ee04921e22e admin admin] REQUEST_METHOD: `POST` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:13:39.159307 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9d1cc0-6269-4729-ad9a-7ee04921e22e admin admin] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:13:39.159613 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9d1cc0-6269-4729-ad9a-7ee04921e22e admin admin] PATH_INFO: `/v3/projects` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:13:39.160305 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e9d1cc0-6269-4729-ad9a-7ee04921e22e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:13:39.162212 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e9d1cc0-6269-4729-ad9a-7ee04921e22e admin admin] RBAC: Authorization granted {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:13:39.270828 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 1374/2772] 10.222.0.84 () {60 vars in 1152 bytes} [Wed May 25 15:13:39 2022] POST /identity/v3/projects => generated 365 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 15:13:39.275042 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12d7e790-0039-44e5-9fc9-19208fa94b7c admin admin] Authenticating user token {{(pid=101893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:13:39.285826 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12d7e790-0039-44e5-9fc9-19208fa94b7c admin admin] Validating token access rules against request {{(pid=101893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:13:39.343206 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd924508-16aa-4df7-8f98-ecd5ab1734b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cec56f74b2fa4826a506dc7b919465be', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:13:39.343943 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd924508-16aa-4df7-8f98-ecd5ab1734b7 admin admin] REQUEST_METHOD: `POST` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:13:39.344238 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd924508-16aa-4df7-8f98-ecd5ab1734b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:13:39.344512 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd924508-16aa-4df7-8f98-ecd5ab1734b7 admin admin] PATH_INFO: `/v3/users` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:13:39.345226 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd924508-16aa-4df7-8f98-ecd5ab1734b7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:13:39.348234 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd924508-16aa-4df7-8f98-ecd5ab1734b7 admin admin] RBAC: Authorization granted {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:13:39.458382 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 1399/2773] 10.222.0.84 () {60 vars in 1143 bytes} [Wed May 25 15:13:39 2022] POST /identity/v3/users => generated 283 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 15:13:39.462755 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e9d1cc0-6269-4729-ad9a-7ee04921e22e admin admin] Authenticating user token {{(pid=101892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:13:39.474135 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e9d1cc0-6269-4729-ad9a-7ee04921e22e admin admin] Validating token access rules against request {{(pid=101892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:13:39.479096 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68eb3ac6-96ef-4379-a32b-6c25e08b621f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cec56f74b2fa4826a506dc7b919465be', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:13:39.479867 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68eb3ac6-96ef-4379-a32b-6c25e08b621f admin admin] REQUEST_METHOD: `GET` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:13:39.480288 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68eb3ac6-96ef-4379-a32b-6c25e08b621f admin admin] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:13:39.480578 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68eb3ac6-96ef-4379-a32b-6c25e08b621f admin admin] PATH_INFO: `/v3/roles` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:13:39.481395 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68eb3ac6-96ef-4379-a32b-6c25e08b621f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:13:39.483019 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68eb3ac6-96ef-4379-a32b-6c25e08b621f admin admin] RBAC: Authorization granted {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:13:39.493885 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 1375/2774] 10.222.0.84 () {58 vars in 1121 bytes} [Wed May 25 15:13:39 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 25 15:13:39.498603 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd924508-16aa-4df7-8f98-ecd5ab1734b7 admin admin] Authenticating user token {{(pid=101893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:13:39.508955 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd924508-16aa-4df7-8f98-ecd5ab1734b7 admin admin] Validating token access rules against request {{(pid=101893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:13:39.514293 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dee8d2c-8b6c-4892-b57f-87634fbaee91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cec56f74b2fa4826a506dc7b919465be', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:13:39.518879 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dee8d2c-8b6c-4892-b57f-87634fbaee91 admin admin] REQUEST_METHOD: `GET` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:13:39.518879 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dee8d2c-8b6c-4892-b57f-87634fbaee91 admin admin] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:13:39.518879 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dee8d2c-8b6c-4892-b57f-87634fbaee91 admin admin] PATH_INFO: `/v3/roles` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:13:39.518879 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dee8d2c-8b6c-4892-b57f-87634fbaee91 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:13:39.518879 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dee8d2c-8b6c-4892-b57f-87634fbaee91 admin admin] RBAC: Authorization granted {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:13:39.531782 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 1400/2775] 10.222.0.84 () {58 vars in 1121 bytes} [Wed May 25 15:13:39 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 15:13:39.533410 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68eb3ac6-96ef-4379-a32b-6c25e08b621f admin admin] Authenticating user token {{(pid=101892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:13:39.546337 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68eb3ac6-96ef-4379-a32b-6c25e08b621f admin admin] Validating token access rules against request {{(pid=101892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:13:39.553280 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4943fb62-2686-4701-a606-739f95eba921 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cec56f74b2fa4826a506dc7b919465be', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:13:39.554279 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4943fb62-2686-4701-a606-739f95eba921 admin admin] REQUEST_METHOD: `PUT` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:13:39.554395 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4943fb62-2686-4701-a606-739f95eba921 admin admin] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:13:39.554581 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4943fb62-2686-4701-a606-739f95eba921 admin admin] PATH_INFO: `/v3/projects/f40747a721774906b9208fef961e2732/users/de6304a06d68499ba630a521f710a7b5/roles/ff664fa0db7e4262a5accde96c3df4c3` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:13:39.575654 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4943fb62-2686-4701-a606-739f95eba921 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f40747a721774906b9208fef961e2732, user_id=de6304a06d68499ba630a521f710a7b5, role_id=ff664fa0db7e4262a5accde96c3df4c3)` {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:13:39.579037 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4943fb62-2686-4701-a606-739f95eba921 admin admin] RBAC: Authorization granted {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:13:39.646329 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 1376/2776] 10.222.0.84 () {60 vars in 1482 bytes} [Wed May 25 15:13:39 2022] PUT /identity/v3/projects/f40747a721774906b9208fef961e2732/users/de6304a06d68499ba630a521f710a7b5/roles/ff664fa0db7e4262a5accde96c3df4c3 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 15:13:39.656785 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14f134b-6855-4464-8e6b-a22e6de289c2 None None] REQUEST_METHOD: `POST` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:13:39.657331 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14f134b-6855-4464-8e6b-a22e6de289c2 None None] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:13:39.657905 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14f134b-6855-4464-8e6b-a22e6de289c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:13:39.685334 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.auth.core [None req-f14f134b-6855-4464-8e6b-a22e6de289c2 None None] MFA Rules not processed for user `de6304a06d68499ba630a521f710a7b5`. Rule list: `[]` (Enabled: `True`). {{(pid=101893) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:13:39.686543 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.fernet_utils [None req-f14f134b-6855-4464-8e6b-a22e6de289c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=101893) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:13:39.691945 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG dbcounter [-] [101893] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=101893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:13:39.754618 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 1401/2777] 10.222.0.84 () {58 vars in 957 bytes} [Wed May 25 15:13:39 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 15:13:39.759465 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4943fb62-2686-4701-a606-739f95eba921 admin admin] Authenticating user token {{(pid=101892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:13:39.825882 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4943fb62-2686-4701-a606-739f95eba921 admin admin] Validating token access rules against request {{(pid=101892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:13:39.831725 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c043831-0f3f-4123-a510-ae54bf0326bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cec56f74b2fa4826a506dc7b919465be', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:13:39.832266 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c043831-0f3f-4123-a510-ae54bf0326bf admin admin] REQUEST_METHOD: `POST` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:13:39.832554 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c043831-0f3f-4123-a510-ae54bf0326bf admin admin] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:13:39.832896 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c043831-0f3f-4123-a510-ae54bf0326bf admin admin] PATH_INFO: `/v3/projects` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:13:39.833517 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c043831-0f3f-4123-a510-ae54bf0326bf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:13:39.835420 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c043831-0f3f-4123-a510-ae54bf0326bf admin admin] RBAC: Authorization granted {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:13:39.849818 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG dbcounter [-] [101892] Writing DB stats keystone:SELECT=93,keystone:DELETE=4,keystone:INSERT=3 {{(pid=101892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:13:39.937877 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 1377/2778] 10.222.0.84 () {60 vars in 1152 bytes} [Wed May 25 15:13:39 2022] POST /identity/v3/projects => generated 365 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 15:13:39.942351 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f14f134b-6855-4464-8e6b-a22e6de289c2 None None] Authenticating user token {{(pid=101893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:13:39.953544 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f14f134b-6855-4464-8e6b-a22e6de289c2 None None] Validating token access rules against request {{(pid=101893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:13:40.012998 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d68a3290-0fa5-4e92-8373-91946cfe59c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cec56f74b2fa4826a506dc7b919465be', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:13:40.013675 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d68a3290-0fa5-4e92-8373-91946cfe59c8 admin admin] REQUEST_METHOD: `POST` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:13:40.013962 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d68a3290-0fa5-4e92-8373-91946cfe59c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:13:40.014244 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d68a3290-0fa5-4e92-8373-91946cfe59c8 admin admin] PATH_INFO: `/v3/users` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:13:40.014982 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d68a3290-0fa5-4e92-8373-91946cfe59c8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:13:40.016958 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d68a3290-0fa5-4e92-8373-91946cfe59c8 admin admin] RBAC: Authorization granted {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:13:40.124913 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 1402/2779] 10.222.0.84 () {60 vars in 1143 bytes} [Wed May 25 15:13:39 2022] POST /identity/v3/users => generated 289 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 15:13:40.126474 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c043831-0f3f-4123-a510-ae54bf0326bf admin admin] Authenticating user token {{(pid=101892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:13:40.138076 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c043831-0f3f-4123-a510-ae54bf0326bf admin admin] Validating token access rules against request {{(pid=101892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:13:40.143469 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa9f7708-bb02-4bbf-a7a0-30a44106b6f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cec56f74b2fa4826a506dc7b919465be', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:13:40.147102 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9f7708-bb02-4bbf-a7a0-30a44106b6f0 admin admin] REQUEST_METHOD: `GET` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:13:40.147102 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9f7708-bb02-4bbf-a7a0-30a44106b6f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:13:40.147102 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9f7708-bb02-4bbf-a7a0-30a44106b6f0 admin admin] PATH_INFO: `/v3/roles` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:13:40.147102 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa9f7708-bb02-4bbf-a7a0-30a44106b6f0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:13:40.147782 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa9f7708-bb02-4bbf-a7a0-30a44106b6f0 admin admin] RBAC: Authorization granted {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:13:40.158911 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 1378/2780] 10.222.0.84 () {58 vars in 1121 bytes} [Wed May 25 15:13:40 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 25 15:13:40.163173 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d68a3290-0fa5-4e92-8373-91946cfe59c8 admin admin] Authenticating user token {{(pid=101893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:13:40.173634 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d68a3290-0fa5-4e92-8373-91946cfe59c8 admin admin] Validating token access rules against request {{(pid=101893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:13:40.178254 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8d760d1-52cf-4ab3-a829-f160c48414d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cec56f74b2fa4826a506dc7b919465be', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:13:40.179128 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d760d1-52cf-4ab3-a829-f160c48414d7 admin admin] REQUEST_METHOD: `PUT` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:13:40.179427 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d760d1-52cf-4ab3-a829-f160c48414d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:13:40.179727 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d760d1-52cf-4ab3-a829-f160c48414d7 admin admin] PATH_INFO: `/v3/projects/ed3571a23652406ba6f25964b1fee198/users/eede3386012540d89c451446af4117c1/roles/a3b78e7d547d4d2d998b4c99a4396bba` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:13:40.195014 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8d760d1-52cf-4ab3-a829-f160c48414d7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ed3571a23652406ba6f25964b1fee198, user_id=eede3386012540d89c451446af4117c1, role_id=a3b78e7d547d4d2d998b4c99a4396bba)` {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:13:40.197749 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8d760d1-52cf-4ab3-a829-f160c48414d7 admin admin] RBAC: Authorization granted {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:13:40.297121 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 1403/2781] 10.222.0.84 () {60 vars in 1482 bytes} [Wed May 25 15:13:40 2022] PUT /identity/v3/projects/ed3571a23652406ba6f25964b1fee198/users/eede3386012540d89c451446af4117c1/roles/a3b78e7d547d4d2d998b4c99a4396bba => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 15:13:40.301022 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa9f7708-bb02-4bbf-a7a0-30a44106b6f0 admin admin] Authenticating user token {{(pid=101892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:13:40.311667 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa9f7708-bb02-4bbf-a7a0-30a44106b6f0 admin admin] Validating token access rules against request {{(pid=101892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:13:40.368994 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5e7199c-9ba6-46bc-bde4-5e8874767ff8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cec56f74b2fa4826a506dc7b919465be', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:13:40.369713 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e7199c-9ba6-46bc-bde4-5e8874767ff8 admin admin] REQUEST_METHOD: `GET` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:13:40.370559 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e7199c-9ba6-46bc-bde4-5e8874767ff8 admin admin] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:13:40.370847 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e7199c-9ba6-46bc-bde4-5e8874767ff8 admin admin] PATH_INFO: `/v3/roles` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:13:40.371591 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5e7199c-9ba6-46bc-bde4-5e8874767ff8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:13:40.373240 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5e7199c-9ba6-46bc-bde4-5e8874767ff8 admin admin] RBAC: Authorization granted {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:13:40.382936 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 1379/2782] 10.222.0.84 () {58 vars in 1121 bytes} [Wed May 25 15:13:40 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 15:13:40.387805 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8d760d1-52cf-4ab3-a829-f160c48414d7 admin admin] Authenticating user token {{(pid=101893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:13:40.398051 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8d760d1-52cf-4ab3-a829-f160c48414d7 admin admin] Validating token access rules against request {{(pid=101893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:13:40.403213 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c9f2b4-667e-4301-8064-ec576f43bfd9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cec56f74b2fa4826a506dc7b919465be', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:13:40.404115 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c9f2b4-667e-4301-8064-ec576f43bfd9 admin admin] REQUEST_METHOD: `PUT` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:13:40.404398 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c9f2b4-667e-4301-8064-ec576f43bfd9 admin admin] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:13:40.404703 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c9f2b4-667e-4301-8064-ec576f43bfd9 admin admin] PATH_INFO: `/v3/projects/ed3571a23652406ba6f25964b1fee198/users/eede3386012540d89c451446af4117c1/roles/a3b78e7d547d4d2d998b4c99a4396bba` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:13:40.406639 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49c9f2b4-667e-4301-8064-ec576f43bfd9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ed3571a23652406ba6f25964b1fee198, user_id=eede3386012540d89c451446af4117c1, role_id=a3b78e7d547d4d2d998b4c99a4396bba)` {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:13:40.409342 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49c9f2b4-667e-4301-8064-ec576f43bfd9 admin admin] RBAC: Authorization granted {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:13:40.419993 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 1404/2783] 10.222.0.84 () {60 vars in 1482 bytes} [Wed May 25 15:13:40 2022] PUT /identity/v3/projects/ed3571a23652406ba6f25964b1fee198/users/eede3386012540d89c451446af4117c1/roles/a3b78e7d547d4d2d998b4c99a4396bba => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 15:13:40.430117 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c150711f-e7c0-40ac-b9eb-c94750947d16 None None] REQUEST_METHOD: `POST` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:13:40.430410 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c150711f-e7c0-40ac-b9eb-c94750947d16 None None] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:13:40.430699 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c150711f-e7c0-40ac-b9eb-c94750947d16 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:13:40.458330 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.auth.core [None req-c150711f-e7c0-40ac-b9eb-c94750947d16 None None] MFA Rules not processed for user `eede3386012540d89c451446af4117c1`. Rule list: `[]` (Enabled: `True`). {{(pid=101892) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:13:40.459630 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.fernet_utils [None req-c150711f-e7c0-40ac-b9eb-c94750947d16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=101892) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:13:40.526789 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 1380/2784] 10.222.0.84 () {58 vars in 957 bytes} [Wed May 25 15:13:40 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 15:13:40.539882 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c9f2b4-667e-4301-8064-ec576f43bfd9 admin admin] Authenticating user token {{(pid=101893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:13:40.541664 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.fernet_utils [None req-49c9f2b4-667e-4301-8064-ec576f43bfd9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=101893) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:13:40.602603 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c9f2b4-667e-4301-8064-ec576f43bfd9 admin admin] Validating token access rules against request {{(pid=101893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:13:40.607113 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c71c69d4-ced6-4e96-a430-19137b5bb4d6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e079f89a5e524ab6ad4183e4f690de07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a000829c658c4a7cab67f7b6353ba3fa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:13:40.607802 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c71c69d4-ced6-4e96-a430-19137b5bb4d6 service cinder] REQUEST_METHOD: `GET` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:13:40.608087 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c71c69d4-ced6-4e96-a430-19137b5bb4d6 service cinder] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:13:40.608363 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c71c69d4-ced6-4e96-a430-19137b5bb4d6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:13:40.617402 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c71c69d4-ced6-4e96-a430-19137b5bb4d6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:13:40.618845 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c71c69d4-ced6-4e96-a430-19137b5bb4d6 service cinder] RBAC: Authorization granted {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:13:40.629011 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 1405/2785] 10.222.0.84 () {60 vars in 1365 bytes} [Wed May 25 15:13:40 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 15:13:40.785360 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c150711f-e7c0-40ac-b9eb-c94750947d16 None None] Authenticating user token {{(pid=101892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:13:40.797858 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c150711f-e7c0-40ac-b9eb-c94750947d16 None None] Validating token access rules against request {{(pid=101892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:13:40.803432 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac3188bb-c0bc-4f43-a986-e1e5057f0b14 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e079f89a5e524ab6ad4183e4f690de07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a000829c658c4a7cab67f7b6353ba3fa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:13:40.804187 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3188bb-c0bc-4f43-a986-e1e5057f0b14 service cinder] REQUEST_METHOD: `GET` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:13:40.804545 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3188bb-c0bc-4f43-a986-e1e5057f0b14 service cinder] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:13:40.804895 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3188bb-c0bc-4f43-a986-e1e5057f0b14 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:13:40.873473 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac3188bb-c0bc-4f43-a986-e1e5057f0b14 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:13:40.885001 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac3188bb-c0bc-4f43-a986-e1e5057f0b14 service cinder] RBAC: Authorization granted {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:13:40.901681 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 1381/2786] 10.222.0.84 () {60 vars in 1365 bytes} [Wed May 25 15:13:40 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 15:13:42.253390 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c71c69d4-ced6-4e96-a430-19137b5bb4d6 service cinder] Authenticating user token {{(pid=101893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:13:42.254786 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.fernet_utils [None req-c71c69d4-ced6-4e96-a430-19137b5bb4d6 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=101893) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:13:42.260219 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG dbcounter [-] [101893] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=101893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:13:42.320280 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c71c69d4-ced6-4e96-a430-19137b5bb4d6 service cinder] Validating token access rules against request {{(pid=101893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:13:42.324977 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe805b81-f2b5-438b-b441-6ceb31e314de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cec56f74b2fa4826a506dc7b919465be', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:13:42.325859 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe805b81-f2b5-438b-b441-6ceb31e314de admin admin] REQUEST_METHOD: `DELETE` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:13:42.326145 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe805b81-f2b5-438b-b441-6ceb31e314de admin admin] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:13:42.326449 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe805b81-f2b5-438b-b441-6ceb31e314de admin admin] PATH_INFO: `/v3/users/b10a635f6de642899fff0cc0c79ac38e` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:13:42.327682 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe805b81-f2b5-438b-b441-6ceb31e314de admin admin] RBAC: Authorizing `identity:delete_user(user_id=b10a635f6de642899fff0cc0c79ac38e)` {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:13:42.329656 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe805b81-f2b5-438b-b441-6ceb31e314de admin admin] RBAC: Authorization granted {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:13:42.508682 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.notifications [None req-fe805b81-f2b5-438b-b441-6ceb31e314de admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b10a635f6de642899fff0cc0c79ac38e'} {{(pid=101893) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:13:42.518402 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.notifications [None req-fe805b81-f2b5-438b-b441-6ceb31e314de admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b10a635f6de642899fff0cc0c79ac38e'} {{(pid=101893) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:13:42.530372 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.notifications [None req-fe805b81-f2b5-438b-b441-6ceb31e314de admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b10a635f6de642899fff0cc0c79ac38e'} {{(pid=101893) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:13:42.531104 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.notifications [None req-fe805b81-f2b5-438b-b441-6ceb31e314de admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b10a635f6de642899fff0cc0c79ac38e'} {{(pid=101893) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:13:42.531758 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.notifications [None req-fe805b81-f2b5-438b-b441-6ceb31e314de admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b10a635f6de642899fff0cc0c79ac38e'} {{(pid=101893) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:13:42.634520 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 1406/2787] 10.222.0.84 () {58 vars in 1223 bytes} [Wed May 25 15:13:42 2022] DELETE /identity/v3/users/b10a635f6de642899fff0cc0c79ac38e => generated 0 bytes in 382 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 15:13:42.639710 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bceadbc6-5582-4d3f-a270-9178aa7268a1 None None] REQUEST_METHOD: `POST` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:13:42.640198 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bceadbc6-5582-4d3f-a270-9178aa7268a1 None None] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:13:42.640304 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bceadbc6-5582-4d3f-a270-9178aa7268a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:13:42.646059 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG dbcounter [-] [101892] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=101892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:13:42.658179 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.auth.core [None req-bceadbc6-5582-4d3f-a270-9178aa7268a1 None None] MFA Rules not processed for user `05d87e87798e429aa1c10b24391f915e`. Rule list: `[]` (Enabled: `True`). {{(pid=101892) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:13:42.661324 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.fernet_utils [None req-bceadbc6-5582-4d3f-a270-9178aa7268a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=101892) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:13:42.718297 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 1382/2788] 10.222.0.84 () {58 vars in 957 bytes} [Wed May 25 15:13:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 15:13:42.727929 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe805b81-f2b5-438b-b441-6ceb31e314de admin admin] Authenticating user token {{(pid=101893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:13:42.729900 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.fernet_utils [None req-fe805b81-f2b5-438b-b441-6ceb31e314de admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=101893) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:13:42.788495 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe805b81-f2b5-438b-b441-6ceb31e314de admin admin] Validating token access rules against request {{(pid=101893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:13:42.792222 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b6f3277-e62f-4773-8941-5f37701fc598 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ce28b25b907473588ccb87dc4acc06a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a000829c658c4a7cab67f7b6353ba3fa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:13:42.793044 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6f3277-e62f-4773-8941-5f37701fc598 service neutron] REQUEST_METHOD: `GET` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:13:42.793288 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6f3277-e62f-4773-8941-5f37701fc598 service neutron] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:13:42.793578 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6f3277-e62f-4773-8941-5f37701fc598 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:13:42.802800 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b6f3277-e62f-4773-8941-5f37701fc598 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:13:42.804259 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b6f3277-e62f-4773-8941-5f37701fc598 service neutron] RBAC: Authorization granted {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:13:42.813839 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 1407/2789] 10.222.0.84 () {60 vars in 1365 bytes} [Wed May 25 15:13:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 15:13:43.270309 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bceadbc6-5582-4d3f-a270-9178aa7268a1 None None] Authenticating user token {{(pid=101892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:13:43.273607 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.fernet_utils [None req-bceadbc6-5582-4d3f-a270-9178aa7268a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=101892) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:13:43.286325 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bceadbc6-5582-4d3f-a270-9178aa7268a1 None None] Validating token access rules against request {{(pid=101892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:13:43.294011 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6db298fe-9660-4398-9622-6b38979bd7b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cec56f74b2fa4826a506dc7b919465be', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:13:43.294743 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db298fe-9660-4398-9622-6b38979bd7b6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:13:43.295051 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db298fe-9660-4398-9622-6b38979bd7b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:13:43.295301 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db298fe-9660-4398-9622-6b38979bd7b6 admin admin] PATH_INFO: `/v3/projects/09eb3a6076f44594ac17a95808adbf3f` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:13:43.296666 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6db298fe-9660-4398-9622-6b38979bd7b6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=09eb3a6076f44594ac17a95808adbf3f)` {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:13:43.298584 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6db298fe-9660-4398-9622-6b38979bd7b6 admin admin] RBAC: Authorization granted {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:13:43.437701 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.notifications [None req-6db298fe-9660-4398-9622-6b38979bd7b6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '09eb3a6076f44594ac17a95808adbf3f', 'request_id': 'req-6db298fe-9660-4398-9622-6b38979bd7b6'} {{(pid=101892) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:13:43.444739 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.notifications [None req-6db298fe-9660-4398-9622-6b38979bd7b6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '09eb3a6076f44594ac17a95808adbf3f', 'request_id': 'req-6db298fe-9660-4398-9622-6b38979bd7b6'} {{(pid=101892) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:13:43.451907 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.notifications [None req-6db298fe-9660-4398-9622-6b38979bd7b6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '09eb3a6076f44594ac17a95808adbf3f', 'request_id': 'req-6db298fe-9660-4398-9622-6b38979bd7b6'} {{(pid=101892) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:13:43.543663 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.notifications [None req-6db298fe-9660-4398-9622-6b38979bd7b6 admin admin] The token cache is being invalidate because project 09eb3a6076f44594ac17a95808adbf3f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=101892) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 25 15:13:43.543663 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.notifications [None req-6db298fe-9660-4398-9622-6b38979bd7b6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=101892) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:13:43.543663 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.notifications [None req-6db298fe-9660-4398-9622-6b38979bd7b6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=101892) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:13:43.543663 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 1383/2790] 10.222.0.84 () {58 vars in 1232 bytes} [Wed May 25 15:13:43 2022] DELETE /identity/v3/projects/09eb3a6076f44594ac17a95808adbf3f => generated 0 bytes in 269 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 15:13:43.857068 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b6f3277-e62f-4773-8941-5f37701fc598 service neutron] Authenticating user token {{(pid=101893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:13:43.858507 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.fernet_utils [None req-6b6f3277-e62f-4773-8941-5f37701fc598 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=101893) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:13:43.869608 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b6f3277-e62f-4773-8941-5f37701fc598 service neutron] Validating token access rules against request {{(pid=101893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:13:43.889924 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG dbcounter [-] [101893] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=101893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:13:43.917891 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33322736-1f84-4241-a21d-3c83a1e21d96 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ce28b25b907473588ccb87dc4acc06a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a000829c658c4a7cab67f7b6353ba3fa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:13:43.918702 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33322736-1f84-4241-a21d-3c83a1e21d96 service neutron] REQUEST_METHOD: `GET` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:13:43.918996 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33322736-1f84-4241-a21d-3c83a1e21d96 service neutron] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:13:43.919302 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33322736-1f84-4241-a21d-3c83a1e21d96 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:13:43.921125 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.fernet_utils [None req-33322736-1f84-4241-a21d-3c83a1e21d96 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=101893) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:13:43.984154 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33322736-1f84-4241-a21d-3c83a1e21d96 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:13:43.985591 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33322736-1f84-4241-a21d-3c83a1e21d96 service neutron] RBAC: Authorization granted {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:13:43.995447 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 1408/2791] 10.222.0.84 () {60 vars in 1365 bytes} [Wed May 25 15:13:43 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 139 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 15:13:45.946989 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6db298fe-9660-4398-9622-6b38979bd7b6 admin admin] Authenticating user token {{(pid=101892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:13:45.949368 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.fernet_utils [None req-6db298fe-9660-4398-9622-6b38979bd7b6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=101892) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:13:46.055889 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6db298fe-9660-4398-9622-6b38979bd7b6 admin admin] Validating token access rules against request {{(pid=101892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:13:46.062289 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ea82180-2b95-4161-bb73-05296a1b6b7a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2aeb182e6a5b43cfb0cc347ec847c848', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a000829c658c4a7cab67f7b6353ba3fa', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:13:46.062956 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea82180-2b95-4161-bb73-05296a1b6b7a service nova] REQUEST_METHOD: `GET` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:13:46.063288 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea82180-2b95-4161-bb73-05296a1b6b7a service nova] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:13:46.063588 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea82180-2b95-4161-bb73-05296a1b6b7a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:13:46.065687 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.fernet_utils [None req-8ea82180-2b95-4161-bb73-05296a1b6b7a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=101892) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:13:46.079622 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ea82180-2b95-4161-bb73-05296a1b6b7a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:13:46.081268 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ea82180-2b95-4161-bb73-05296a1b6b7a service nova] RBAC: Authorization granted {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:13:46.093420 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 1384/2792] 10.222.0.84 () {60 vars in 1365 bytes} [Wed May 25 15:13:45 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 147 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 15:13:49.683859 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33322736-1f84-4241-a21d-3c83a1e21d96 service neutron] Authenticating user token {{(pid=101893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:13:49.685270 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.fernet_utils [None req-33322736-1f84-4241-a21d-3c83a1e21d96 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=101893) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:13:49.747713 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33322736-1f84-4241-a21d-3c83a1e21d96 service neutron] Validating token access rules against request {{(pid=101893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:13:49.752130 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d2bd63c-9b4d-4b4b-9538-477befd89ad4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cec56f74b2fa4826a506dc7b919465be', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:13:49.752990 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2bd63c-9b4d-4b4b-9538-477befd89ad4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:13:49.753269 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2bd63c-9b4d-4b4b-9538-477befd89ad4 admin admin] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:13:49.753540 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2bd63c-9b4d-4b4b-9538-477befd89ad4 admin admin] PATH_INFO: `/v3/users/de6304a06d68499ba630a521f710a7b5` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:13:49.754693 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d2bd63c-9b4d-4b4b-9538-477befd89ad4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=de6304a06d68499ba630a521f710a7b5)` {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:13:49.756641 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d2bd63c-9b4d-4b4b-9538-477befd89ad4 admin admin] RBAC: Authorization granted {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:13:49.928118 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.notifications [None req-4d2bd63c-9b4d-4b4b-9538-477befd89ad4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'de6304a06d68499ba630a521f710a7b5'} {{(pid=101893) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:13:49.935038 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.notifications [None req-4d2bd63c-9b4d-4b4b-9538-477befd89ad4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'de6304a06d68499ba630a521f710a7b5'} {{(pid=101893) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:13:49.947187 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.notifications [None req-4d2bd63c-9b4d-4b4b-9538-477befd89ad4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'de6304a06d68499ba630a521f710a7b5'} {{(pid=101893) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:13:49.948065 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.notifications [None req-4d2bd63c-9b4d-4b4b-9538-477befd89ad4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'de6304a06d68499ba630a521f710a7b5'} {{(pid=101893) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:13:49.948649 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.notifications [None req-4d2bd63c-9b4d-4b4b-9538-477befd89ad4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'de6304a06d68499ba630a521f710a7b5'} {{(pid=101893) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:13:49.951383 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG dbcounter [-] [101893] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=101893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:13:50.091734 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 1409/2793] 10.222.0.84 () {58 vars in 1223 bytes} [Wed May 25 15:13:49 2022] DELETE /identity/v3/users/de6304a06d68499ba630a521f710a7b5 => generated 0 bytes in 409 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 15:13:50.096274 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6be8161-d294-4f50-a1a5-64d649cdea1e None None] REQUEST_METHOD: `POST` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:13:50.096775 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6be8161-d294-4f50-a1a5-64d649cdea1e None None] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:13:50.096879 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6be8161-d294-4f50-a1a5-64d649cdea1e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:13:50.115265 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.auth.core [None req-c6be8161-d294-4f50-a1a5-64d649cdea1e None None] MFA Rules not processed for user `05d87e87798e429aa1c10b24391f915e`. Rule list: `[]` (Enabled: `True`). {{(pid=101892) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:13:50.116595 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.fernet_utils [None req-c6be8161-d294-4f50-a1a5-64d649cdea1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=101892) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:13:50.121838 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG dbcounter [-] [101892] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=101892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:13:50.177404 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 1385/2794] 10.222.0.84 () {58 vars in 957 bytes} [Wed May 25 15:13:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 15:13:50.187016 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d2bd63c-9b4d-4b4b-9538-477befd89ad4 admin admin] Authenticating user token {{(pid=101893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:13:50.188645 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.fernet_utils [None req-4d2bd63c-9b4d-4b4b-9538-477befd89ad4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=101893) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:13:50.249036 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d2bd63c-9b4d-4b4b-9538-477befd89ad4 admin admin] Validating token access rules against request {{(pid=101893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:13:50.252783 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-061220e7-aff1-4e47-94c7-7375a9657258 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ce28b25b907473588ccb87dc4acc06a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a000829c658c4a7cab67f7b6353ba3fa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:13:50.253439 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061220e7-aff1-4e47-94c7-7375a9657258 service neutron] REQUEST_METHOD: `GET` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:13:50.253725 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061220e7-aff1-4e47-94c7-7375a9657258 service neutron] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:13:50.254006 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061220e7-aff1-4e47-94c7-7375a9657258 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:13:50.263046 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-061220e7-aff1-4e47-94c7-7375a9657258 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:13:50.264540 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-061220e7-aff1-4e47-94c7-7375a9657258 service neutron] RBAC: Authorization granted {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:13:50.273839 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 1410/2795] 10.222.0.84 () {60 vars in 1365 bytes} [Wed May 25 15:13:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 15:13:50.686451 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6be8161-d294-4f50-a1a5-64d649cdea1e None None] Authenticating user token {{(pid=101892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:13:50.687928 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.fernet_utils [None req-c6be8161-d294-4f50-a1a5-64d649cdea1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=101892) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:13:50.700552 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6be8161-d294-4f50-a1a5-64d649cdea1e None None] Validating token access rules against request {{(pid=101892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:13:50.705222 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b001e337-dd2a-45ed-a1c3-6a8c8eda1151 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cec56f74b2fa4826a506dc7b919465be', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:13:50.706137 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b001e337-dd2a-45ed-a1c3-6a8c8eda1151 admin admin] REQUEST_METHOD: `DELETE` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:13:50.706423 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b001e337-dd2a-45ed-a1c3-6a8c8eda1151 admin admin] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:13:50.706702 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b001e337-dd2a-45ed-a1c3-6a8c8eda1151 admin admin] PATH_INFO: `/v3/projects/f40747a721774906b9208fef961e2732` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:13:50.708369 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b001e337-dd2a-45ed-a1c3-6a8c8eda1151 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f40747a721774906b9208fef961e2732)` {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:13:50.710416 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b001e337-dd2a-45ed-a1c3-6a8c8eda1151 admin admin] RBAC: Authorization granted {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:13:50.810221 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.notifications [None req-b001e337-dd2a-45ed-a1c3-6a8c8eda1151 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f40747a721774906b9208fef961e2732', 'request_id': 'req-b001e337-dd2a-45ed-a1c3-6a8c8eda1151'} {{(pid=101892) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:13:50.816614 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.notifications [None req-b001e337-dd2a-45ed-a1c3-6a8c8eda1151 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f40747a721774906b9208fef961e2732', 'request_id': 'req-b001e337-dd2a-45ed-a1c3-6a8c8eda1151'} {{(pid=101892) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:13:50.822152 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.notifications [None req-b001e337-dd2a-45ed-a1c3-6a8c8eda1151 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f40747a721774906b9208fef961e2732', 'request_id': 'req-b001e337-dd2a-45ed-a1c3-6a8c8eda1151'} {{(pid=101892) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:13:50.884731 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.notifications [None req-b001e337-dd2a-45ed-a1c3-6a8c8eda1151 admin admin] The token cache is being invalidate because project f40747a721774906b9208fef961e2732 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=101892) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 25 15:13:50.885016 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.notifications [None req-b001e337-dd2a-45ed-a1c3-6a8c8eda1151 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=101892) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:13:50.885627 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.notifications [None req-b001e337-dd2a-45ed-a1c3-6a8c8eda1151 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=101892) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:13:50.887207 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 1386/2796] 10.222.0.84 () {58 vars in 1232 bytes} [Wed May 25 15:13:50 2022] DELETE /identity/v3/projects/f40747a721774906b9208fef961e2732 => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 15:13:50.891201 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-061220e7-aff1-4e47-94c7-7375a9657258 service neutron] Authenticating user token {{(pid=101893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:13:50.901352 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-061220e7-aff1-4e47-94c7-7375a9657258 service neutron] Validating token access rules against request {{(pid=101893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:13:50.957746 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-450b790c-93e1-400a-a3c8-a6fc253309e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cec56f74b2fa4826a506dc7b919465be', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:13:50.958609 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-450b790c-93e1-400a-a3c8-a6fc253309e9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:13:50.958893 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-450b790c-93e1-400a-a3c8-a6fc253309e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:13:50.959162 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-450b790c-93e1-400a-a3c8-a6fc253309e9 admin admin] PATH_INFO: `/v3/users/eede3386012540d89c451446af4117c1` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:13:50.960388 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-450b790c-93e1-400a-a3c8-a6fc253309e9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=eede3386012540d89c451446af4117c1)` {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:13:50.962298 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-450b790c-93e1-400a-a3c8-a6fc253309e9 admin admin] RBAC: Authorization granted {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:13:51.121434 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.notifications [None req-450b790c-93e1-400a-a3c8-a6fc253309e9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'eede3386012540d89c451446af4117c1'} {{(pid=101893) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:13:51.128604 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.notifications [None req-450b790c-93e1-400a-a3c8-a6fc253309e9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'eede3386012540d89c451446af4117c1'} {{(pid=101893) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:13:51.141472 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.notifications [None req-450b790c-93e1-400a-a3c8-a6fc253309e9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'eede3386012540d89c451446af4117c1'} {{(pid=101893) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:13:51.142224 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.notifications [None req-450b790c-93e1-400a-a3c8-a6fc253309e9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'eede3386012540d89c451446af4117c1'} {{(pid=101893) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:13:51.142946 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.notifications [None req-450b790c-93e1-400a-a3c8-a6fc253309e9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'eede3386012540d89c451446af4117c1'} {{(pid=101893) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:13:51.211076 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 1411/2797] 10.222.0.84 () {58 vars in 1223 bytes} [Wed May 25 15:13:50 2022] DELETE /identity/v3/users/eede3386012540d89c451446af4117c1 => generated 0 bytes in 320 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 15:13:51.636461 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b001e337-dd2a-45ed-a1c3-6a8c8eda1151 admin admin] Authenticating user token {{(pid=101892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:13:51.637902 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.fernet_utils [None req-b001e337-dd2a-45ed-a1c3-6a8c8eda1151 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=101892) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:13:51.652639 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b001e337-dd2a-45ed-a1c3-6a8c8eda1151 admin admin] Validating token access rules against request {{(pid=101892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:13:51.711199 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bd9954c-6623-401b-bfae-6ad6648dae80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cec56f74b2fa4826a506dc7b919465be', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:13:51.712090 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd9954c-6623-401b-bfae-6ad6648dae80 admin admin] REQUEST_METHOD: `DELETE` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:13:51.712367 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd9954c-6623-401b-bfae-6ad6648dae80 admin admin] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:13:51.712718 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd9954c-6623-401b-bfae-6ad6648dae80 admin admin] PATH_INFO: `/v3/projects/ed3571a23652406ba6f25964b1fee198` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:13:51.713895 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bd9954c-6623-401b-bfae-6ad6648dae80 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ed3571a23652406ba6f25964b1fee198)` {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:13:51.715809 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bd9954c-6623-401b-bfae-6ad6648dae80 admin admin] RBAC: Authorization granted {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:13:51.831263 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG dbcounter [-] [101892] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=101892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:13:51.839572 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.notifications [None req-3bd9954c-6623-401b-bfae-6ad6648dae80 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ed3571a23652406ba6f25964b1fee198', 'request_id': 'req-3bd9954c-6623-401b-bfae-6ad6648dae80'} {{(pid=101892) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:13:51.845646 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.notifications [None req-3bd9954c-6623-401b-bfae-6ad6648dae80 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ed3571a23652406ba6f25964b1fee198', 'request_id': 'req-3bd9954c-6623-401b-bfae-6ad6648dae80'} {{(pid=101892) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:13:51.850981 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.notifications [None req-3bd9954c-6623-401b-bfae-6ad6648dae80 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ed3571a23652406ba6f25964b1fee198', 'request_id': 'req-3bd9954c-6623-401b-bfae-6ad6648dae80'} {{(pid=101892) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:13:51.941346 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.notifications [None req-3bd9954c-6623-401b-bfae-6ad6648dae80 admin admin] The token cache is being invalidate because project ed3571a23652406ba6f25964b1fee198 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=101892) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 25 15:13:51.941564 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.notifications [None req-3bd9954c-6623-401b-bfae-6ad6648dae80 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=101892) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:13:51.942179 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.notifications [None req-3bd9954c-6623-401b-bfae-6ad6648dae80 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=101892) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:13:51.943758 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 1387/2798] 10.222.0.84 () {58 vars in 1232 bytes} [Wed May 25 15:13:51 2022] DELETE /identity/v3/projects/ed3571a23652406ba6f25964b1fee198 => generated 0 bytes in 309 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 15:13:51.948837 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ceff7c4-bf8d-4aca-a275-24e7291b8343 None None] REQUEST_METHOD: `POST` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:13:51.949312 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ceff7c4-bf8d-4aca-a275-24e7291b8343 None None] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:13:51.953145 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ceff7c4-bf8d-4aca-a275-24e7291b8343 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:13:51.967504 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.auth.core [None req-5ceff7c4-bf8d-4aca-a275-24e7291b8343 None None] MFA Rules not processed for user `05d87e87798e429aa1c10b24391f915e`. Rule list: `[]` (Enabled: `True`). {{(pid=101893) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:13:51.968731 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.fernet_utils [None req-5ceff7c4-bf8d-4aca-a275-24e7291b8343 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=101893) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:13:51.978075 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG dbcounter [-] [101893] Writing DB stats keystone:DELETE=11,keystone:SELECT=88,keystone:INSERT=1 {{(pid=101893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:13:52.026582 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 1412/2799] 10.222.0.84 () {58 vars in 957 bytes} [Wed May 25 15:13:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 15:13:52.034561 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90a8168-7ae7-4eac-be97-87709449a8f1 None None] REQUEST_METHOD: `POST` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:13:52.034953 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90a8168-7ae7-4eac-be97-87709449a8f1 None None] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:13:52.035235 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90a8168-7ae7-4eac-be97-87709449a8f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:13:52.054134 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.auth.core [None req-b90a8168-7ae7-4eac-be97-87709449a8f1 None None] MFA Rules not processed for user `05d87e87798e429aa1c10b24391f915e`. Rule list: `[]` (Enabled: `True`). {{(pid=101892) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:13:52.055332 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.fernet_utils [None req-b90a8168-7ae7-4eac-be97-87709449a8f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=101892) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:13:52.064224 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 1388/2800] 10.222.0.84 () {58 vars in 957 bytes} [Wed May 25 15:13:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 25 15:13:52.068429 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ceff7c4-bf8d-4aca-a275-24e7291b8343 None None] Authenticating user token {{(pid=101893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:13:52.078008 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ceff7c4-bf8d-4aca-a275-24e7291b8343 None None] Validating token access rules against request {{(pid=101893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:13:52.082521 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7606bc49-212c-49cc-921b-52575f25721c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cec56f74b2fa4826a506dc7b919465be', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:13:52.083170 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7606bc49-212c-49cc-921b-52575f25721c admin admin] REQUEST_METHOD: `GET` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:13:52.083448 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7606bc49-212c-49cc-921b-52575f25721c admin admin] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:13:52.083749 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7606bc49-212c-49cc-921b-52575f25721c admin admin] PATH_INFO: `/v3/domains` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:13:52.084510 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7606bc49-212c-49cc-921b-52575f25721c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=101893) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 15:13:52.085041 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7606bc49-212c-49cc-921b-52575f25721c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:13:52.086960 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7606bc49-212c-49cc-921b-52575f25721c admin admin] RBAC: Authorization granted {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:13:52.099140 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 1413/2801] 10.222.0.84 () {58 vars in 1152 bytes} [Wed May 25 15:13:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 15:13:52.103296 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b90a8168-7ae7-4eac-be97-87709449a8f1 None None] Authenticating user token {{(pid=101892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:13:52.112919 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b90a8168-7ae7-4eac-be97-87709449a8f1 None None] Validating token access rules against request {{(pid=101892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:13:52.117595 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0cfade1-8321-4a30-af71-5df2be573081 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cec56f74b2fa4826a506dc7b919465be', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:13:52.118244 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0cfade1-8321-4a30-af71-5df2be573081 admin admin] REQUEST_METHOD: `POST` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:13:52.118533 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0cfade1-8321-4a30-af71-5df2be573081 admin admin] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:13:52.118814 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0cfade1-8321-4a30-af71-5df2be573081 admin admin] PATH_INFO: `/v3/projects` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:13:52.120208 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0cfade1-8321-4a30-af71-5df2be573081 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:13:52.122165 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0cfade1-8321-4a30-af71-5df2be573081 admin admin] RBAC: Authorization granted {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:13:52.200106 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 1389/2802] 10.222.0.84 () {60 vars in 1152 bytes} [Wed May 25 15:13:52 2022] POST /identity/v3/projects => generated 377 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 15:13:52.204184 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7606bc49-212c-49cc-921b-52575f25721c admin admin] Authenticating user token {{(pid=101893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:13:52.214632 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7606bc49-212c-49cc-921b-52575f25721c admin admin] Validating token access rules against request {{(pid=101893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:13:52.276739 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d93e1b8-1611-462a-9d67-9aa17ab8cd8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cec56f74b2fa4826a506dc7b919465be', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:13:52.277407 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d93e1b8-1611-462a-9d67-9aa17ab8cd8f admin admin] REQUEST_METHOD: `POST` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:13:52.278224 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d93e1b8-1611-462a-9d67-9aa17ab8cd8f admin admin] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:13:52.278502 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d93e1b8-1611-462a-9d67-9aa17ab8cd8f admin admin] PATH_INFO: `/v3/users` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:13:52.279589 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d93e1b8-1611-462a-9d67-9aa17ab8cd8f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:13:52.281621 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d93e1b8-1611-462a-9d67-9aa17ab8cd8f admin admin] RBAC: Authorization granted {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:13:52.360011 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 1414/2803] 10.222.0.84 () {60 vars in 1143 bytes} [Wed May 25 15:13:52 2022] POST /identity/v3/users => generated 289 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 15:13:52.364215 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0cfade1-8321-4a30-af71-5df2be573081 admin admin] Authenticating user token {{(pid=101892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:13:52.374555 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0cfade1-8321-4a30-af71-5df2be573081 admin admin] Validating token access rules against request {{(pid=101892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:13:52.379304 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1944ae64-187d-4dde-a3ab-b1a6e35006cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cec56f74b2fa4826a506dc7b919465be', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:13:52.380027 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1944ae64-187d-4dde-a3ab-b1a6e35006cf admin admin] REQUEST_METHOD: `GET` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:13:52.380313 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1944ae64-187d-4dde-a3ab-b1a6e35006cf admin admin] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:13:52.380594 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1944ae64-187d-4dde-a3ab-b1a6e35006cf admin admin] PATH_INFO: `/v3/roles` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:13:52.381313 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1944ae64-187d-4dde-a3ab-b1a6e35006cf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:13:52.383951 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1944ae64-187d-4dde-a3ab-b1a6e35006cf admin admin] RBAC: Authorization granted {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:13:52.393379 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 1390/2804] 10.222.0.84 () {58 vars in 1121 bytes} [Wed May 25 15:13:52 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 15:13:52.397393 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d93e1b8-1611-462a-9d67-9aa17ab8cd8f admin admin] Authenticating user token {{(pid=101893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:13:52.407753 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d93e1b8-1611-462a-9d67-9aa17ab8cd8f admin admin] Validating token access rules against request {{(pid=101893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:13:52.412295 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b0a115c-1031-4fdb-bac2-5cf65bb5b09e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cec56f74b2fa4826a506dc7b919465be', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:13:52.412956 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b0a115c-1031-4fdb-bac2-5cf65bb5b09e admin admin] REQUEST_METHOD: `GET` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:13:52.413236 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b0a115c-1031-4fdb-bac2-5cf65bb5b09e admin admin] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:13:52.413508 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b0a115c-1031-4fdb-bac2-5cf65bb5b09e admin admin] PATH_INFO: `/v3/roles` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:13:52.414219 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b0a115c-1031-4fdb-bac2-5cf65bb5b09e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:13:52.415845 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b0a115c-1031-4fdb-bac2-5cf65bb5b09e admin admin] RBAC: Authorization granted {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:13:52.428104 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 1415/2805] 10.222.0.84 () {58 vars in 1121 bytes} [Wed May 25 15:13:52 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 15:13:52.432199 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1944ae64-187d-4dde-a3ab-b1a6e35006cf admin admin] Authenticating user token {{(pid=101892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:13:52.446246 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1944ae64-187d-4dde-a3ab-b1a6e35006cf admin admin] Validating token access rules against request {{(pid=101892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:13:52.453919 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04c68d07-bedf-46d0-aa98-62a42135d7b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cec56f74b2fa4826a506dc7b919465be', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:13:52.454724 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c68d07-bedf-46d0-aa98-62a42135d7b4 admin admin] REQUEST_METHOD: `PUT` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:13:52.455017 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c68d07-bedf-46d0-aa98-62a42135d7b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:13:52.455303 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c68d07-bedf-46d0-aa98-62a42135d7b4 admin admin] PATH_INFO: `/v3/projects/37feed232acc40f58b6d793ea0570c11/users/bbb21eae6add42f3a91e3c5934117127/roles/ff664fa0db7e4262a5accde96c3df4c3` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:13:52.470866 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04c68d07-bedf-46d0-aa98-62a42135d7b4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=37feed232acc40f58b6d793ea0570c11, user_id=bbb21eae6add42f3a91e3c5934117127, role_id=ff664fa0db7e4262a5accde96c3df4c3)` {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:13:52.473661 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04c68d07-bedf-46d0-aa98-62a42135d7b4 admin admin] RBAC: Authorization granted {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:13:52.531745 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 1391/2806] 10.222.0.84 () {60 vars in 1482 bytes} [Wed May 25 15:13:52 2022] PUT /identity/v3/projects/37feed232acc40f58b6d793ea0570c11/users/bbb21eae6add42f3a91e3c5934117127/roles/ff664fa0db7e4262a5accde96c3df4c3 => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 15:13:52.541980 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd07b02-6aed-4c7b-a884-025e287eaf32 None None] REQUEST_METHOD: `POST` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:13:52.542282 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd07b02-6aed-4c7b-a884-025e287eaf32 None None] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:13:52.542562 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd07b02-6aed-4c7b-a884-025e287eaf32 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:13:52.570300 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.auth.core [None req-2fd07b02-6aed-4c7b-a884-025e287eaf32 None None] MFA Rules not processed for user `bbb21eae6add42f3a91e3c5934117127`. Rule list: `[]` (Enabled: `True`). {{(pid=101893) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:13:52.571513 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.fernet_utils [None req-2fd07b02-6aed-4c7b-a884-025e287eaf32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=101893) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:13:52.634158 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 1416/2807] 10.222.0.84 () {58 vars in 957 bytes} [Wed May 25 15:13:52 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 15:13:52.639192 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04c68d07-bedf-46d0-aa98-62a42135d7b4 admin admin] Authenticating user token {{(pid=101892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:13:52.700529 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04c68d07-bedf-46d0-aa98-62a42135d7b4 admin admin] Validating token access rules against request {{(pid=101892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:13:52.705215 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-764324b0-d519-4400-9331-ff134f5f5e80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cec56f74b2fa4826a506dc7b919465be', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:13:52.705808 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764324b0-d519-4400-9331-ff134f5f5e80 admin admin] REQUEST_METHOD: `POST` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:13:52.706091 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764324b0-d519-4400-9331-ff134f5f5e80 admin admin] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:13:52.706370 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764324b0-d519-4400-9331-ff134f5f5e80 admin admin] PATH_INFO: `/v3/projects` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:13:52.707042 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-764324b0-d519-4400-9331-ff134f5f5e80 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:13:52.708973 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-764324b0-d519-4400-9331-ff134f5f5e80 admin admin] RBAC: Authorization granted {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:13:52.815601 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 1392/2808] 10.222.0.84 () {60 vars in 1152 bytes} [Wed May 25 15:13:52 2022] POST /identity/v3/projects => generated 379 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 15:13:52.817411 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd07b02-6aed-4c7b-a884-025e287eaf32 None None] Authenticating user token {{(pid=101893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:13:52.828876 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd07b02-6aed-4c7b-a884-025e287eaf32 None None] Validating token access rules against request {{(pid=101893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:13:52.836643 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG dbcounter [-] [101893] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=101893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:13:52.884820 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a3ab58-c8aa-45c6-9e6c-ade2748c77a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cec56f74b2fa4826a506dc7b919465be', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:13:52.886038 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a3ab58-c8aa-45c6-9e6c-ade2748c77a9 admin admin] REQUEST_METHOD: `POST` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:13:52.886323 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a3ab58-c8aa-45c6-9e6c-ade2748c77a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:13:52.886601 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a3ab58-c8aa-45c6-9e6c-ade2748c77a9 admin admin] PATH_INFO: `/v3/users` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:13:52.887539 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2a3ab58-c8aa-45c6-9e6c-ade2748c77a9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:13:52.890139 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2a3ab58-c8aa-45c6-9e6c-ade2748c77a9 admin admin] RBAC: Authorization granted {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:13:52.954016 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 1417/2809] 10.222.0.84 () {60 vars in 1143 bytes} [Wed May 25 15:13:52 2022] POST /identity/v3/users => generated 290 bytes in 137 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 15:13:52.961135 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-764324b0-d519-4400-9331-ff134f5f5e80 admin admin] Authenticating user token {{(pid=101892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:13:52.968411 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-764324b0-d519-4400-9331-ff134f5f5e80 admin admin] Validating token access rules against request {{(pid=101892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:13:52.972965 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29c48e92-561f-403a-9309-2239e5658d48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cec56f74b2fa4826a506dc7b919465be', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:13:52.973620 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c48e92-561f-403a-9309-2239e5658d48 admin admin] REQUEST_METHOD: `GET` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:13:52.973934 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c48e92-561f-403a-9309-2239e5658d48 admin admin] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:13:52.974213 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c48e92-561f-403a-9309-2239e5658d48 admin admin] PATH_INFO: `/v3/roles` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:13:52.974925 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29c48e92-561f-403a-9309-2239e5658d48 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:13:52.976594 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29c48e92-561f-403a-9309-2239e5658d48 admin admin] RBAC: Authorization granted {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:13:52.987097 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 1393/2810] 10.222.0.84 () {58 vars in 1121 bytes} [Wed May 25 15:13:52 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 15:13:52.991016 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a3ab58-c8aa-45c6-9e6c-ade2748c77a9 admin admin] Authenticating user token {{(pid=101893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:13:53.002273 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a3ab58-c8aa-45c6-9e6c-ade2748c77a9 admin admin] Validating token access rules against request {{(pid=101893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:13:53.006883 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-606c6362-0fed-4995-9f22-06eab0d0a8da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cec56f74b2fa4826a506dc7b919465be', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:13:53.007536 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606c6362-0fed-4995-9f22-06eab0d0a8da admin admin] REQUEST_METHOD: `GET` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:13:53.007849 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606c6362-0fed-4995-9f22-06eab0d0a8da admin admin] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:13:53.008124 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606c6362-0fed-4995-9f22-06eab0d0a8da admin admin] PATH_INFO: `/v3/roles` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:13:53.008842 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-606c6362-0fed-4995-9f22-06eab0d0a8da admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:13:53.011056 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-606c6362-0fed-4995-9f22-06eab0d0a8da admin admin] RBAC: Authorization granted {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:13:53.020873 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 1418/2811] 10.222.0.84 () {58 vars in 1121 bytes} [Wed May 25 15:13:52 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 15:13:53.024970 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29c48e92-561f-403a-9309-2239e5658d48 admin admin] Authenticating user token {{(pid=101892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:13:53.035101 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29c48e92-561f-403a-9309-2239e5658d48 admin admin] Validating token access rules against request {{(pid=101892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:13:53.039731 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85fd579c-f7b0-4914-ada6-8d5ff9cc2cc7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cec56f74b2fa4826a506dc7b919465be', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:13:53.040600 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85fd579c-f7b0-4914-ada6-8d5ff9cc2cc7 admin admin] REQUEST_METHOD: `PUT` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:13:53.040882 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85fd579c-f7b0-4914-ada6-8d5ff9cc2cc7 admin admin] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:13:53.041160 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85fd579c-f7b0-4914-ada6-8d5ff9cc2cc7 admin admin] PATH_INFO: `/v3/projects/774b6743ca704c0890fdc2fde5d9f8c6/users/51e29ad23606437092efab7d60d1bc33/roles/ff664fa0db7e4262a5accde96c3df4c3` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:13:53.055516 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85fd579c-f7b0-4914-ada6-8d5ff9cc2cc7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=774b6743ca704c0890fdc2fde5d9f8c6, user_id=51e29ad23606437092efab7d60d1bc33, role_id=ff664fa0db7e4262a5accde96c3df4c3)` {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:13:53.058736 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85fd579c-f7b0-4914-ada6-8d5ff9cc2cc7 admin admin] RBAC: Authorization granted {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:13:53.113599 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 1394/2812] 10.222.0.84 () {60 vars in 1482 bytes} [Wed May 25 15:13:53 2022] PUT /identity/v3/projects/774b6743ca704c0890fdc2fde5d9f8c6/users/51e29ad23606437092efab7d60d1bc33/roles/ff664fa0db7e4262a5accde96c3df4c3 => generated 0 bytes in 89 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 25 15:13:53.124636 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c652c0a8-77ec-4dee-8f99-21d9c0a2f267 None None] REQUEST_METHOD: `POST` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:13:53.124944 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c652c0a8-77ec-4dee-8f99-21d9c0a2f267 None None] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:13:53.125219 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c652c0a8-77ec-4dee-8f99-21d9c0a2f267 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:13:53.151474 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.auth.core [None req-c652c0a8-77ec-4dee-8f99-21d9c0a2f267 None None] MFA Rules not processed for user `51e29ad23606437092efab7d60d1bc33`. Rule list: `[]` (Enabled: `True`). {{(pid=101893) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:13:53.152711 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.fernet_utils [None req-c652c0a8-77ec-4dee-8f99-21d9c0a2f267 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=101893) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:13:53.215813 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 1419/2813] 10.222.0.84 () {58 vars in 957 bytes} [Wed May 25 15:13:53 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 15:13:53.220273 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85fd579c-f7b0-4914-ada6-8d5ff9cc2cc7 admin admin] Authenticating user token {{(pid=101892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:13:53.232815 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG dbcounter [-] [101892] Writing DB stats keystone:SELECT=91,keystone:DELETE=4,keystone:INSERT=5 {{(pid=101892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:13:53.281480 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85fd579c-f7b0-4914-ada6-8d5ff9cc2cc7 admin admin] Validating token access rules against request {{(pid=101892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:13:53.286071 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe4bc016-0796-46af-9e10-251934659250 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cec56f74b2fa4826a506dc7b919465be', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:13:53.286720 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe4bc016-0796-46af-9e10-251934659250 admin admin] REQUEST_METHOD: `POST` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:13:53.287000 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe4bc016-0796-46af-9e10-251934659250 admin admin] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:13:53.287275 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe4bc016-0796-46af-9e10-251934659250 admin admin] PATH_INFO: `/v3/projects` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:13:53.288054 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe4bc016-0796-46af-9e10-251934659250 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:13:53.290008 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe4bc016-0796-46af-9e10-251934659250 admin admin] RBAC: Authorization granted {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:13:53.383378 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 1395/2814] 10.222.0.84 () {60 vars in 1152 bytes} [Wed May 25 15:13:53 2022] POST /identity/v3/projects => generated 379 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 15:13:53.387997 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c652c0a8-77ec-4dee-8f99-21d9c0a2f267 None None] Authenticating user token {{(pid=101893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:13:53.398636 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c652c0a8-77ec-4dee-8f99-21d9c0a2f267 None None] Validating token access rules against request {{(pid=101893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:13:53.454301 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c8e81a6-d165-4bc0-beed-7a4e40289743 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cec56f74b2fa4826a506dc7b919465be', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:13:53.454971 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8e81a6-d165-4bc0-beed-7a4e40289743 admin admin] REQUEST_METHOD: `POST` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:13:53.455258 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8e81a6-d165-4bc0-beed-7a4e40289743 admin admin] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:13:53.455539 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8e81a6-d165-4bc0-beed-7a4e40289743 admin admin] PATH_INFO: `/v3/users` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:13:53.456273 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c8e81a6-d165-4bc0-beed-7a4e40289743 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:13:53.458197 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c8e81a6-d165-4bc0-beed-7a4e40289743 admin admin] RBAC: Authorization granted {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:13:53.531059 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 1420/2815] 10.222.0.84 () {60 vars in 1143 bytes} [Wed May 25 15:13:53 2022] POST /identity/v3/users => generated 296 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 15:13:53.534938 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe4bc016-0796-46af-9e10-251934659250 admin admin] Authenticating user token {{(pid=101892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:13:53.545893 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe4bc016-0796-46af-9e10-251934659250 admin admin] Validating token access rules against request {{(pid=101892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:13:53.550526 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8196057-e7ee-44a9-ab2b-9e2d47102f45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cec56f74b2fa4826a506dc7b919465be', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:13:53.551183 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8196057-e7ee-44a9-ab2b-9e2d47102f45 admin admin] REQUEST_METHOD: `GET` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:13:53.551472 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8196057-e7ee-44a9-ab2b-9e2d47102f45 admin admin] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:13:53.551781 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8196057-e7ee-44a9-ab2b-9e2d47102f45 admin admin] PATH_INFO: `/v3/roles` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:13:53.552509 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8196057-e7ee-44a9-ab2b-9e2d47102f45 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:13:53.554132 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8196057-e7ee-44a9-ab2b-9e2d47102f45 admin admin] RBAC: Authorization granted {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:13:53.566114 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 1396/2816] 10.222.0.84 () {58 vars in 1121 bytes} [Wed May 25 15:13:53 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 15:13:53.570423 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c8e81a6-d165-4bc0-beed-7a4e40289743 admin admin] Authenticating user token {{(pid=101893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:13:53.580460 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c8e81a6-d165-4bc0-beed-7a4e40289743 admin admin] Validating token access rules against request {{(pid=101893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:13:53.585075 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f5c2a20-155d-48be-9109-5bdaf42f3312 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cec56f74b2fa4826a506dc7b919465be', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:13:53.585946 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f5c2a20-155d-48be-9109-5bdaf42f3312 admin admin] REQUEST_METHOD: `PUT` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:13:53.586230 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f5c2a20-155d-48be-9109-5bdaf42f3312 admin admin] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:13:53.586505 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f5c2a20-155d-48be-9109-5bdaf42f3312 admin admin] PATH_INFO: `/v3/projects/c9aaa6705b964b96a5bad2bbcb10bf8b/users/ca34857d506a4675a60fcc336809505b/roles/a3b78e7d547d4d2d998b4c99a4396bba` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:13:53.590087 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG dbcounter [-] [101893] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=101893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:13:53.601419 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f5c2a20-155d-48be-9109-5bdaf42f3312 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c9aaa6705b964b96a5bad2bbcb10bf8b, user_id=ca34857d506a4675a60fcc336809505b, role_id=a3b78e7d547d4d2d998b4c99a4396bba)` {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:13:53.604788 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f5c2a20-155d-48be-9109-5bdaf42f3312 admin admin] RBAC: Authorization granted {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:13:53.679171 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 1421/2817] 10.222.0.84 () {60 vars in 1482 bytes} [Wed May 25 15:13:53 2022] PUT /identity/v3/projects/c9aaa6705b964b96a5bad2bbcb10bf8b/users/ca34857d506a4675a60fcc336809505b/roles/a3b78e7d547d4d2d998b4c99a4396bba => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 15:13:53.683245 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8196057-e7ee-44a9-ab2b-9e2d47102f45 admin admin] Authenticating user token {{(pid=101892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:13:53.693784 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8196057-e7ee-44a9-ab2b-9e2d47102f45 admin admin] Validating token access rules against request {{(pid=101892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:13:53.754226 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f281fa-606b-4166-bf48-5e24ed8d7973 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cec56f74b2fa4826a506dc7b919465be', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:13:53.754893 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f281fa-606b-4166-bf48-5e24ed8d7973 admin admin] REQUEST_METHOD: `GET` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:13:53.755180 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f281fa-606b-4166-bf48-5e24ed8d7973 admin admin] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:13:53.755461 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f281fa-606b-4166-bf48-5e24ed8d7973 admin admin] PATH_INFO: `/v3/roles` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:13:53.756218 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0f281fa-606b-4166-bf48-5e24ed8d7973 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:13:53.757820 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0f281fa-606b-4166-bf48-5e24ed8d7973 admin admin] RBAC: Authorization granted {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:13:53.767373 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 1397/2818] 10.222.0.84 () {58 vars in 1121 bytes} [Wed May 25 15:13:53 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 15:13:53.771717 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f5c2a20-155d-48be-9109-5bdaf42f3312 admin admin] Authenticating user token {{(pid=101893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:13:53.782456 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f5c2a20-155d-48be-9109-5bdaf42f3312 admin admin] Validating token access rules against request {{(pid=101893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:13:53.786944 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42434552-d371-4cdc-b987-3576e4d24ac5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cec56f74b2fa4826a506dc7b919465be', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:13:53.787845 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42434552-d371-4cdc-b987-3576e4d24ac5 admin admin] REQUEST_METHOD: `PUT` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:13:53.788124 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42434552-d371-4cdc-b987-3576e4d24ac5 admin admin] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:13:53.788395 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42434552-d371-4cdc-b987-3576e4d24ac5 admin admin] PATH_INFO: `/v3/projects/c9aaa6705b964b96a5bad2bbcb10bf8b/users/ca34857d506a4675a60fcc336809505b/roles/a3b78e7d547d4d2d998b4c99a4396bba` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:13:53.790372 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42434552-d371-4cdc-b987-3576e4d24ac5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c9aaa6705b964b96a5bad2bbcb10bf8b, user_id=ca34857d506a4675a60fcc336809505b, role_id=a3b78e7d547d4d2d998b4c99a4396bba)` {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:13:53.793657 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42434552-d371-4cdc-b987-3576e4d24ac5 admin admin] RBAC: Authorization granted {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:13:53.803648 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 1422/2819] 10.222.0.84 () {60 vars in 1482 bytes} [Wed May 25 15:13:53 2022] PUT /identity/v3/projects/c9aaa6705b964b96a5bad2bbcb10bf8b/users/ca34857d506a4675a60fcc336809505b/roles/a3b78e7d547d4d2d998b4c99a4396bba => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 15:13:53.813527 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6f58b3-6196-4c5b-b8df-d2a1799a4966 None None] REQUEST_METHOD: `POST` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:13:53.814086 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6f58b3-6196-4c5b-b8df-d2a1799a4966 None None] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:13:53.814370 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6f58b3-6196-4c5b-b8df-d2a1799a4966 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:13:53.840583 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.auth.core [None req-ce6f58b3-6196-4c5b-b8df-d2a1799a4966 None None] MFA Rules not processed for user `ca34857d506a4675a60fcc336809505b`. Rule list: `[]` (Enabled: `True`). {{(pid=101892) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:13:53.841788 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.fernet_utils [None req-ce6f58b3-6196-4c5b-b8df-d2a1799a4966 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=101892) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:13:53.908884 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 1398/2820] 10.222.0.84 () {58 vars in 957 bytes} [Wed May 25 15:13:53 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 15:13:53.921318 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42434552-d371-4cdc-b987-3576e4d24ac5 admin admin] Authenticating user token {{(pid=101893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:13:53.923081 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.fernet_utils [None req-42434552-d371-4cdc-b987-3576e4d24ac5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=101893) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:13:53.979825 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42434552-d371-4cdc-b987-3576e4d24ac5 admin admin] Validating token access rules against request {{(pid=101893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:13:53.983523 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a5a7eb4-db1b-45a6-b81d-90e24aaeb2b7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e079f89a5e524ab6ad4183e4f690de07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a000829c658c4a7cab67f7b6353ba3fa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:13:53.984195 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5a7eb4-db1b-45a6-b81d-90e24aaeb2b7 service cinder] REQUEST_METHOD: `GET` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:13:53.984481 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5a7eb4-db1b-45a6-b81d-90e24aaeb2b7 service cinder] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:13:53.984759 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5a7eb4-db1b-45a6-b81d-90e24aaeb2b7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:13:53.993650 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a5a7eb4-db1b-45a6-b81d-90e24aaeb2b7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:13:53.995109 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a5a7eb4-db1b-45a6-b81d-90e24aaeb2b7 service cinder] RBAC: Authorization granted {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:13:54.004837 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 1423/2821] 10.222.0.84 () {60 vars in 1365 bytes} [Wed May 25 15:13:53 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 15:13:54.159819 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce6f58b3-6196-4c5b-b8df-d2a1799a4966 None None] Authenticating user token {{(pid=101892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:13:54.161220 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.fernet_utils [None req-ce6f58b3-6196-4c5b-b8df-d2a1799a4966 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=101892) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:13:54.173641 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce6f58b3-6196-4c5b-b8df-d2a1799a4966 None None] Validating token access rules against request {{(pid=101892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:13:54.177294 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-512c3ad3-30ad-469d-93c2-6fc0d5be0ae5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e079f89a5e524ab6ad4183e4f690de07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a000829c658c4a7cab67f7b6353ba3fa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:13:54.177930 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-512c3ad3-30ad-469d-93c2-6fc0d5be0ae5 service cinder] REQUEST_METHOD: `GET` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:13:54.178212 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-512c3ad3-30ad-469d-93c2-6fc0d5be0ae5 service cinder] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:13:54.178488 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-512c3ad3-30ad-469d-93c2-6fc0d5be0ae5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:13:54.182669 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG dbcounter [-] [101892] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=101892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:13:54.235181 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-512c3ad3-30ad-469d-93c2-6fc0d5be0ae5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:13:54.236703 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-512c3ad3-30ad-469d-93c2-6fc0d5be0ae5 service cinder] RBAC: Authorization granted {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:13:54.245647 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 1399/2822] 10.222.0.84 () {60 vars in 1365 bytes} [Wed May 25 15:13:54 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 15:13:58.133448 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a5a7eb4-db1b-45a6-b81d-90e24aaeb2b7 service cinder] Authenticating user token {{(pid=101893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:13:58.195675 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a5a7eb4-db1b-45a6-b81d-90e24aaeb2b7 service cinder] Validating token access rules against request {{(pid=101893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:13:58.200743 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8c60d35-fcc9-4520-abed-45cd38793ead admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cec56f74b2fa4826a506dc7b919465be', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:13:58.201613 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c60d35-fcc9-4520-abed-45cd38793ead admin admin] REQUEST_METHOD: `DELETE` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:13:58.201896 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c60d35-fcc9-4520-abed-45cd38793ead admin admin] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:13:58.202174 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c60d35-fcc9-4520-abed-45cd38793ead admin admin] PATH_INFO: `/v3/users/bbb21eae6add42f3a91e3c5934117127` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:13:58.203424 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8c60d35-fcc9-4520-abed-45cd38793ead admin admin] RBAC: Authorizing `identity:delete_user(user_id=bbb21eae6add42f3a91e3c5934117127)` {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:13:58.205472 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8c60d35-fcc9-4520-abed-45cd38793ead admin admin] RBAC: Authorization granted {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:13:58.442243 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.notifications [None req-f8c60d35-fcc9-4520-abed-45cd38793ead admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bbb21eae6add42f3a91e3c5934117127'} {{(pid=101893) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:13:58.450147 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.notifications [None req-f8c60d35-fcc9-4520-abed-45cd38793ead admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bbb21eae6add42f3a91e3c5934117127'} {{(pid=101893) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:13:58.461858 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.notifications [None req-f8c60d35-fcc9-4520-abed-45cd38793ead admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bbb21eae6add42f3a91e3c5934117127'} {{(pid=101893) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:13:58.462525 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.notifications [None req-f8c60d35-fcc9-4520-abed-45cd38793ead admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bbb21eae6add42f3a91e3c5934117127'} {{(pid=101893) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:13:58.463173 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.notifications [None req-f8c60d35-fcc9-4520-abed-45cd38793ead admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bbb21eae6add42f3a91e3c5934117127'} {{(pid=101893) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:13:58.466105 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG dbcounter [-] [101893] Writing DB stats keystone:SELECT=88,keystone:INSERT=3,keystone:DELETE=9 {{(pid=101893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:13:58.542412 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 1424/2823] 10.222.0.84 () {58 vars in 1223 bytes} [Wed May 25 15:13:58 2022] DELETE /identity/v3/users/bbb21eae6add42f3a91e3c5934117127 => generated 0 bytes in 409 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 15:13:58.547177 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a39cfc-ee6c-4629-85ca-c04f17262dbd None None] REQUEST_METHOD: `POST` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:13:58.547690 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a39cfc-ee6c-4629-85ca-c04f17262dbd None None] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:13:58.547811 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a39cfc-ee6c-4629-85ca-c04f17262dbd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:13:58.566183 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.auth.core [None req-00a39cfc-ee6c-4629-85ca-c04f17262dbd None None] MFA Rules not processed for user `05d87e87798e429aa1c10b24391f915e`. Rule list: `[]` (Enabled: `True`). {{(pid=101892) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:13:58.567419 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.fernet_utils [None req-00a39cfc-ee6c-4629-85ca-c04f17262dbd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=101892) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:13:58.625529 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 1400/2824] 10.222.0.84 () {58 vars in 957 bytes} [Wed May 25 15:13:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 15:13:58.635325 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8c60d35-fcc9-4520-abed-45cd38793ead admin admin] Authenticating user token {{(pid=101893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:13:58.636806 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.fernet_utils [None req-f8c60d35-fcc9-4520-abed-45cd38793ead admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=101893) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:13:58.692733 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8c60d35-fcc9-4520-abed-45cd38793ead admin admin] Validating token access rules against request {{(pid=101893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:13:58.696137 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6446bfa4-b0c4-4d52-ab01-d53ec75920e4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ce28b25b907473588ccb87dc4acc06a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a000829c658c4a7cab67f7b6353ba3fa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:13:58.696771 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6446bfa4-b0c4-4d52-ab01-d53ec75920e4 service neutron] REQUEST_METHOD: `GET` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:13:58.697056 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6446bfa4-b0c4-4d52-ab01-d53ec75920e4 service neutron] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:13:58.697849 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6446bfa4-b0c4-4d52-ab01-d53ec75920e4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:13:58.707009 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6446bfa4-b0c4-4d52-ab01-d53ec75920e4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:13:58.708516 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6446bfa4-b0c4-4d52-ab01-d53ec75920e4 service neutron] RBAC: Authorization granted {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:13:58.719680 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 1425/2825] 10.222.0.84 () {60 vars in 1365 bytes} [Wed May 25 15:13:58 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 15:13:59.138986 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a39cfc-ee6c-4629-85ca-c04f17262dbd None None] Authenticating user token {{(pid=101892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:13:59.140561 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.fernet_utils [None req-00a39cfc-ee6c-4629-85ca-c04f17262dbd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=101892) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:13:59.155300 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a39cfc-ee6c-4629-85ca-c04f17262dbd None None] Validating token access rules against request {{(pid=101892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:13:59.161293 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-683994ac-0f9e-4964-9ffa-93ff1d3040b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cec56f74b2fa4826a506dc7b919465be', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:13:59.162367 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683994ac-0f9e-4964-9ffa-93ff1d3040b7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:13:59.162650 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683994ac-0f9e-4964-9ffa-93ff1d3040b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:13:59.162929 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683994ac-0f9e-4964-9ffa-93ff1d3040b7 admin admin] PATH_INFO: `/v3/projects/37feed232acc40f58b6d793ea0570c11` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:13:59.170561 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-683994ac-0f9e-4964-9ffa-93ff1d3040b7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=37feed232acc40f58b6d793ea0570c11)` {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:13:59.170561 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-683994ac-0f9e-4964-9ffa-93ff1d3040b7 admin admin] RBAC: Authorization granted {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:13:59.290675 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.notifications [None req-683994ac-0f9e-4964-9ffa-93ff1d3040b7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '37feed232acc40f58b6d793ea0570c11', 'request_id': 'req-683994ac-0f9e-4964-9ffa-93ff1d3040b7'} {{(pid=101892) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:13:59.297234 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.notifications [None req-683994ac-0f9e-4964-9ffa-93ff1d3040b7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '37feed232acc40f58b6d793ea0570c11', 'request_id': 'req-683994ac-0f9e-4964-9ffa-93ff1d3040b7'} {{(pid=101892) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:13:59.302663 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.notifications [None req-683994ac-0f9e-4964-9ffa-93ff1d3040b7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '37feed232acc40f58b6d793ea0570c11', 'request_id': 'req-683994ac-0f9e-4964-9ffa-93ff1d3040b7'} {{(pid=101892) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:13:59.370379 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.notifications [None req-683994ac-0f9e-4964-9ffa-93ff1d3040b7 admin admin] The token cache is being invalidate because project 37feed232acc40f58b6d793ea0570c11 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=101892) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 25 15:13:59.370667 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.notifications [None req-683994ac-0f9e-4964-9ffa-93ff1d3040b7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=101892) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:13:59.371309 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.notifications [None req-683994ac-0f9e-4964-9ffa-93ff1d3040b7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=101892) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:13:59.372986 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 1401/2826] 10.222.0.84 () {58 vars in 1232 bytes} [Wed May 25 15:13:59 2022] DELETE /identity/v3/projects/37feed232acc40f58b6d793ea0570c11 => generated 0 bytes in 235 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 15:13:59.380197 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6446bfa4-b0c4-4d52-ab01-d53ec75920e4 service neutron] Authenticating user token {{(pid=101893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:13:59.389836 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6446bfa4-b0c4-4d52-ab01-d53ec75920e4 service neutron] Validating token access rules against request {{(pid=101893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:13:59.450913 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b6833ab-ee5e-4a0f-976a-f1d2ebf82fe6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cec56f74b2fa4826a506dc7b919465be', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:13:59.451815 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6833ab-ee5e-4a0f-976a-f1d2ebf82fe6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:13:59.452101 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6833ab-ee5e-4a0f-976a-f1d2ebf82fe6 admin admin] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:13:59.452382 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6833ab-ee5e-4a0f-976a-f1d2ebf82fe6 admin admin] PATH_INFO: `/v3/users/51e29ad23606437092efab7d60d1bc33` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:13:59.453563 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b6833ab-ee5e-4a0f-976a-f1d2ebf82fe6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=51e29ad23606437092efab7d60d1bc33)` {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:13:59.455483 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b6833ab-ee5e-4a0f-976a-f1d2ebf82fe6 admin admin] RBAC: Authorization granted {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:13:59.613470 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.notifications [None req-2b6833ab-ee5e-4a0f-976a-f1d2ebf82fe6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '51e29ad23606437092efab7d60d1bc33'} {{(pid=101893) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:13:59.620325 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.notifications [None req-2b6833ab-ee5e-4a0f-976a-f1d2ebf82fe6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '51e29ad23606437092efab7d60d1bc33'} {{(pid=101893) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:13:59.632016 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.notifications [None req-2b6833ab-ee5e-4a0f-976a-f1d2ebf82fe6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '51e29ad23606437092efab7d60d1bc33'} {{(pid=101893) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:13:59.632688 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.notifications [None req-2b6833ab-ee5e-4a0f-976a-f1d2ebf82fe6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '51e29ad23606437092efab7d60d1bc33'} {{(pid=101893) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:13:59.633293 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.notifications [None req-2b6833ab-ee5e-4a0f-976a-f1d2ebf82fe6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '51e29ad23606437092efab7d60d1bc33'} {{(pid=101893) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:13:59.684888 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 1426/2827] 10.222.0.84 () {58 vars in 1223 bytes} [Wed May 25 15:13:59 2022] DELETE /identity/v3/users/51e29ad23606437092efab7d60d1bc33 => generated 0 bytes in 305 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 25 15:14:00.097925 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-683994ac-0f9e-4964-9ffa-93ff1d3040b7 admin admin] Authenticating user token {{(pid=101892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:14:00.099375 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.fernet_utils [None req-683994ac-0f9e-4964-9ffa-93ff1d3040b7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=101892) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:14:00.116265 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-683994ac-0f9e-4964-9ffa-93ff1d3040b7 admin admin] Validating token access rules against request {{(pid=101892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:14:00.143775 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG dbcounter [-] [101892] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=101892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:14:00.173037 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f773ae-e9dd-4c50-a532-d20d28879be3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cec56f74b2fa4826a506dc7b919465be', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:14:00.173894 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f773ae-e9dd-4c50-a532-d20d28879be3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:14:00.174177 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f773ae-e9dd-4c50-a532-d20d28879be3 admin admin] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:14:00.174454 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f773ae-e9dd-4c50-a532-d20d28879be3 admin admin] PATH_INFO: `/v3/projects/774b6743ca704c0890fdc2fde5d9f8c6` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:14:00.175663 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93f773ae-e9dd-4c50-a532-d20d28879be3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=774b6743ca704c0890fdc2fde5d9f8c6)` {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:14:00.177561 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93f773ae-e9dd-4c50-a532-d20d28879be3 admin admin] RBAC: Authorization granted {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:14:00.262063 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.notifications [None req-93f773ae-e9dd-4c50-a532-d20d28879be3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '774b6743ca704c0890fdc2fde5d9f8c6', 'request_id': 'req-93f773ae-e9dd-4c50-a532-d20d28879be3'} {{(pid=101892) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:14:00.268415 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.notifications [None req-93f773ae-e9dd-4c50-a532-d20d28879be3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '774b6743ca704c0890fdc2fde5d9f8c6', 'request_id': 'req-93f773ae-e9dd-4c50-a532-d20d28879be3'} {{(pid=101892) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:14:00.273769 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.notifications [None req-93f773ae-e9dd-4c50-a532-d20d28879be3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '774b6743ca704c0890fdc2fde5d9f8c6', 'request_id': 'req-93f773ae-e9dd-4c50-a532-d20d28879be3'} {{(pid=101892) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:14:00.341155 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.notifications [None req-93f773ae-e9dd-4c50-a532-d20d28879be3 admin admin] The token cache is being invalidate because project 774b6743ca704c0890fdc2fde5d9f8c6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=101892) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 25 15:14:00.341406 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.notifications [None req-93f773ae-e9dd-4c50-a532-d20d28879be3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=101892) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:14:00.342020 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.notifications [None req-93f773ae-e9dd-4c50-a532-d20d28879be3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=101892) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:14:00.343592 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 1402/2828] 10.222.0.84 () {58 vars in 1232 bytes} [Wed May 25 15:14:00 2022] DELETE /identity/v3/projects/774b6743ca704c0890fdc2fde5d9f8c6 => generated 0 bytes in 246 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 15:14:00.347551 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b6833ab-ee5e-4a0f-976a-f1d2ebf82fe6 admin admin] Authenticating user token {{(pid=101893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:14:00.349682 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.fernet_utils [None req-2b6833ab-ee5e-4a0f-976a-f1d2ebf82fe6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=101893) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:14:00.363921 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b6833ab-ee5e-4a0f-976a-f1d2ebf82fe6 admin admin] Validating token access rules against request {{(pid=101893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:14:00.376650 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG dbcounter [-] [101893] Writing DB stats keystone:DELETE=11,keystone:SELECT=88,keystone:INSERT=1 {{(pid=101893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:14:00.420670 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae135bd-9fae-4e17-b0a1-26551658d150 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cec56f74b2fa4826a506dc7b919465be', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:14:00.421557 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae135bd-9fae-4e17-b0a1-26551658d150 admin admin] REQUEST_METHOD: `DELETE` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:14:00.421833 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae135bd-9fae-4e17-b0a1-26551658d150 admin admin] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:14:00.422104 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae135bd-9fae-4e17-b0a1-26551658d150 admin admin] PATH_INFO: `/v3/users/ca34857d506a4675a60fcc336809505b` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:14:00.423293 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ae135bd-9fae-4e17-b0a1-26551658d150 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ca34857d506a4675a60fcc336809505b)` {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:14:00.425256 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ae135bd-9fae-4e17-b0a1-26551658d150 admin admin] RBAC: Authorization granted {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:14:00.612914 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.notifications [None req-6ae135bd-9fae-4e17-b0a1-26551658d150 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ca34857d506a4675a60fcc336809505b'} {{(pid=101893) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:14:00.620304 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.notifications [None req-6ae135bd-9fae-4e17-b0a1-26551658d150 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ca34857d506a4675a60fcc336809505b'} {{(pid=101893) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:14:00.632045 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.notifications [None req-6ae135bd-9fae-4e17-b0a1-26551658d150 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ca34857d506a4675a60fcc336809505b'} {{(pid=101893) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:14:00.632716 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.notifications [None req-6ae135bd-9fae-4e17-b0a1-26551658d150 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ca34857d506a4675a60fcc336809505b'} {{(pid=101893) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:14:00.633312 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.notifications [None req-6ae135bd-9fae-4e17-b0a1-26551658d150 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ca34857d506a4675a60fcc336809505b'} {{(pid=101893) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:14:00.702177 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 1427/2829] 10.222.0.84 () {58 vars in 1223 bytes} [Wed May 25 15:14:00 2022] DELETE /identity/v3/users/ca34857d506a4675a60fcc336809505b => generated 0 bytes in 355 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 15:14:01.150054 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f773ae-e9dd-4c50-a532-d20d28879be3 admin admin] Authenticating user token {{(pid=101892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:14:01.152131 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.fernet_utils [None req-93f773ae-e9dd-4c50-a532-d20d28879be3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=101892) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:14:01.202087 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f773ae-e9dd-4c50-a532-d20d28879be3 admin admin] Validating token access rules against request {{(pid=101892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:14:01.256216 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3daa594-27e0-480a-a4da-14f69abfcc03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cec56f74b2fa4826a506dc7b919465be', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:14:01.257075 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3daa594-27e0-480a-a4da-14f69abfcc03 admin admin] REQUEST_METHOD: `DELETE` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:14:01.257359 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3daa594-27e0-480a-a4da-14f69abfcc03 admin admin] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:14:01.257635 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3daa594-27e0-480a-a4da-14f69abfcc03 admin admin] PATH_INFO: `/v3/projects/c9aaa6705b964b96a5bad2bbcb10bf8b` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:14:01.258806 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3daa594-27e0-480a-a4da-14f69abfcc03 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c9aaa6705b964b96a5bad2bbcb10bf8b)` {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:14:01.260795 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3daa594-27e0-480a-a4da-14f69abfcc03 admin admin] RBAC: Authorization granted {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:14:01.361974 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG dbcounter [-] [101892] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=101892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:14:01.377063 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.notifications [None req-d3daa594-27e0-480a-a4da-14f69abfcc03 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c9aaa6705b964b96a5bad2bbcb10bf8b', 'request_id': 'req-d3daa594-27e0-480a-a4da-14f69abfcc03'} {{(pid=101892) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:14:01.383205 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.notifications [None req-d3daa594-27e0-480a-a4da-14f69abfcc03 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c9aaa6705b964b96a5bad2bbcb10bf8b', 'request_id': 'req-d3daa594-27e0-480a-a4da-14f69abfcc03'} {{(pid=101892) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:14:01.388658 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.notifications [None req-d3daa594-27e0-480a-a4da-14f69abfcc03 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c9aaa6705b964b96a5bad2bbcb10bf8b', 'request_id': 'req-d3daa594-27e0-480a-a4da-14f69abfcc03'} {{(pid=101892) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:14:01.525118 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.notifications [None req-d3daa594-27e0-480a-a4da-14f69abfcc03 admin admin] The token cache is being invalidate because project c9aaa6705b964b96a5bad2bbcb10bf8b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=101892) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 25 15:14:01.528841 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.notifications [None req-d3daa594-27e0-480a-a4da-14f69abfcc03 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=101892) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:14:01.528841 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.notifications [None req-d3daa594-27e0-480a-a4da-14f69abfcc03 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=101892) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:14:01.528841 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 1403/2830] 10.222.0.84 () {58 vars in 1232 bytes} [Wed May 25 15:14:01 2022] DELETE /identity/v3/projects/c9aaa6705b964b96a5bad2bbcb10bf8b => generated 0 bytes in 379 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 15:14:01.534165 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2af8b9-2c50-4296-9805-bbfa08a985c9 None None] REQUEST_METHOD: `POST` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:14:01.534790 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2af8b9-2c50-4296-9805-bbfa08a985c9 None None] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:14:01.534790 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2af8b9-2c50-4296-9805-bbfa08a985c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:14:01.552240 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.auth.core [None req-dc2af8b9-2c50-4296-9805-bbfa08a985c9 None None] MFA Rules not processed for user `05d87e87798e429aa1c10b24391f915e`. Rule list: `[]` (Enabled: `True`). {{(pid=101893) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:14:01.553466 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.fernet_utils [None req-dc2af8b9-2c50-4296-9805-bbfa08a985c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=101893) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:14:01.612073 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 1428/2831] 10.222.0.84 () {58 vars in 957 bytes} [Wed May 25 15:14:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 15:14:01.620372 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8217f0aa-5c17-42df-8264-91d663280065 None None] REQUEST_METHOD: `POST` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:14:01.620662 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8217f0aa-5c17-42df-8264-91d663280065 None None] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:14:01.620941 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8217f0aa-5c17-42df-8264-91d663280065 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:14:01.639817 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.auth.core [None req-8217f0aa-5c17-42df-8264-91d663280065 None None] MFA Rules not processed for user `05d87e87798e429aa1c10b24391f915e`. Rule list: `[]` (Enabled: `True`). {{(pid=101892) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:14:01.641021 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.fernet_utils [None req-8217f0aa-5c17-42df-8264-91d663280065 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=101892) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:14:01.648875 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 1404/2832] 10.222.0.84 () {58 vars in 957 bytes} [Wed May 25 15:14:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 15:14:01.653512 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc2af8b9-2c50-4296-9805-bbfa08a985c9 None None] Authenticating user token {{(pid=101893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:14:01.663122 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc2af8b9-2c50-4296-9805-bbfa08a985c9 None None] Validating token access rules against request {{(pid=101893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:14:01.668221 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d29a940-8c36-4d85-969f-9cff466167d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cec56f74b2fa4826a506dc7b919465be', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:14:01.668881 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d29a940-8c36-4d85-969f-9cff466167d0 admin admin] REQUEST_METHOD: `GET` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:14:01.669166 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d29a940-8c36-4d85-969f-9cff466167d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:14:01.669443 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d29a940-8c36-4d85-969f-9cff466167d0 admin admin] PATH_INFO: `/v3/domains` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:14:01.670174 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d29a940-8c36-4d85-969f-9cff466167d0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=101893) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 15:14:01.670483 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d29a940-8c36-4d85-969f-9cff466167d0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:14:01.672208 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d29a940-8c36-4d85-969f-9cff466167d0 admin admin] RBAC: Authorization granted {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:14:01.683691 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 1429/2833] 10.222.0.84 () {58 vars in 1152 bytes} [Wed May 25 15:14:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 15:14:01.687980 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8217f0aa-5c17-42df-8264-91d663280065 None None] Authenticating user token {{(pid=101892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:14:01.698018 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8217f0aa-5c17-42df-8264-91d663280065 None None] Validating token access rules against request {{(pid=101892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:14:01.702661 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f7ddfd9-d162-4665-90b3-6dc467d7243e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cec56f74b2fa4826a506dc7b919465be', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:14:01.703344 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f7ddfd9-d162-4665-90b3-6dc467d7243e admin admin] REQUEST_METHOD: `POST` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:14:01.703670 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f7ddfd9-d162-4665-90b3-6dc467d7243e admin admin] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:14:01.703951 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f7ddfd9-d162-4665-90b3-6dc467d7243e admin admin] PATH_INFO: `/v3/projects` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:14:01.704646 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f7ddfd9-d162-4665-90b3-6dc467d7243e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:14:01.706564 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f7ddfd9-d162-4665-90b3-6dc467d7243e admin admin] RBAC: Authorization granted {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:14:01.798536 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 1405/2834] 10.222.0.84 () {60 vars in 1152 bytes} [Wed May 25 15:14:01 2022] POST /identity/v3/projects => generated 383 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 25 15:14:01.799545 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d29a940-8c36-4d85-969f-9cff466167d0 admin admin] Authenticating user token {{(pid=101893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:14:01.819110 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d29a940-8c36-4d85-969f-9cff466167d0 admin admin] Validating token access rules against request {{(pid=101893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:14:01.862712 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG dbcounter [-] [101893] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=101893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:14:01.901313 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f600b6f-096b-4586-a4ea-70da483662d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cec56f74b2fa4826a506dc7b919465be', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:14:01.901997 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f600b6f-096b-4586-a4ea-70da483662d9 admin admin] REQUEST_METHOD: `POST` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:14:01.902307 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f600b6f-096b-4586-a4ea-70da483662d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:14:01.902588 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f600b6f-096b-4586-a4ea-70da483662d9 admin admin] PATH_INFO: `/v3/users` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:14:01.903316 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f600b6f-096b-4586-a4ea-70da483662d9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:14:01.905450 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f600b6f-096b-4586-a4ea-70da483662d9 admin admin] RBAC: Authorization granted {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:14:02.131181 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 1430/2835] 10.222.0.84 () {60 vars in 1143 bytes} [Wed May 25 15:14:01 2022] POST /identity/v3/users => generated 292 bytes in 332 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 15:14:02.139337 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f7ddfd9-d162-4665-90b3-6dc467d7243e admin admin] Authenticating user token {{(pid=101892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:14:02.145883 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f7ddfd9-d162-4665-90b3-6dc467d7243e admin admin] Validating token access rules against request {{(pid=101892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:14:02.151189 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dfc8fb7-24f2-4d56-8465-876d11600f7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cec56f74b2fa4826a506dc7b919465be', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:14:02.152085 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dfc8fb7-24f2-4d56-8465-876d11600f7b admin admin] REQUEST_METHOD: `GET` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:14:02.152463 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dfc8fb7-24f2-4d56-8465-876d11600f7b admin admin] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:14:02.152652 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dfc8fb7-24f2-4d56-8465-876d11600f7b admin admin] PATH_INFO: `/v3/roles` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:14:02.153375 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dfc8fb7-24f2-4d56-8465-876d11600f7b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:14:02.154966 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dfc8fb7-24f2-4d56-8465-876d11600f7b admin admin] RBAC: Authorization granted {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:14:02.167081 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 1406/2836] 10.222.0.84 () {58 vars in 1121 bytes} [Wed May 25 15:14:02 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 15:14:02.171074 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f600b6f-096b-4586-a4ea-70da483662d9 admin admin] Authenticating user token {{(pid=101893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:14:02.181495 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f600b6f-096b-4586-a4ea-70da483662d9 admin admin] Validating token access rules against request {{(pid=101893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:14:02.186900 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c12b84-f609-4654-8104-a6cc2748d757 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cec56f74b2fa4826a506dc7b919465be', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:14:02.186900 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c12b84-f609-4654-8104-a6cc2748d757 admin admin] REQUEST_METHOD: `GET` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:14:02.187171 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c12b84-f609-4654-8104-a6cc2748d757 admin admin] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:14:02.187399 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c12b84-f609-4654-8104-a6cc2748d757 admin admin] PATH_INFO: `/v3/roles` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:14:02.188153 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22c12b84-f609-4654-8104-a6cc2748d757 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:14:02.190102 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22c12b84-f609-4654-8104-a6cc2748d757 admin admin] RBAC: Authorization granted {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:14:02.200639 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 1431/2837] 10.222.0.84 () {58 vars in 1121 bytes} [Wed May 25 15:14:02 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 15:14:02.204897 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dfc8fb7-24f2-4d56-8465-876d11600f7b admin admin] Authenticating user token {{(pid=101892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:14:02.215679 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dfc8fb7-24f2-4d56-8465-876d11600f7b admin admin] Validating token access rules against request {{(pid=101892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:14:02.220294 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc6da8c3-c05d-45d7-99a5-f6a8f819a268 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cec56f74b2fa4826a506dc7b919465be', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:14:02.221207 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6da8c3-c05d-45d7-99a5-f6a8f819a268 admin admin] REQUEST_METHOD: `PUT` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:14:02.221495 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6da8c3-c05d-45d7-99a5-f6a8f819a268 admin admin] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:14:02.221776 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6da8c3-c05d-45d7-99a5-f6a8f819a268 admin admin] PATH_INFO: `/v3/projects/01ebfea52ded468bb322cbfa55e82f68/users/d955905b09b74b5680d2891175326d5f/roles/ff664fa0db7e4262a5accde96c3df4c3` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:14:02.236235 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc6da8c3-c05d-45d7-99a5-f6a8f819a268 admin admin] RBAC: Authorizing `identity:create_grant(project_id=01ebfea52ded468bb322cbfa55e82f68, user_id=d955905b09b74b5680d2891175326d5f, role_id=ff664fa0db7e4262a5accde96c3df4c3)` {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:14:02.238885 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc6da8c3-c05d-45d7-99a5-f6a8f819a268 admin admin] RBAC: Authorization granted {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:14:02.296182 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 1407/2838] 10.222.0.84 () {60 vars in 1482 bytes} [Wed May 25 15:14:02 2022] PUT /identity/v3/projects/01ebfea52ded468bb322cbfa55e82f68/users/d955905b09b74b5680d2891175326d5f/roles/ff664fa0db7e4262a5accde96c3df4c3 => generated 0 bytes in 92 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 15:14:02.308570 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c524c5f-4965-424e-87fa-74055f7d721d None None] REQUEST_METHOD: `POST` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:14:02.308884 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c524c5f-4965-424e-87fa-74055f7d721d None None] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:14:02.309204 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c524c5f-4965-424e-87fa-74055f7d721d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:14:02.336251 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.auth.core [None req-4c524c5f-4965-424e-87fa-74055f7d721d None None] MFA Rules not processed for user `d955905b09b74b5680d2891175326d5f`. Rule list: `[]` (Enabled: `True`). {{(pid=101893) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:14:02.337447 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.fernet_utils [None req-4c524c5f-4965-424e-87fa-74055f7d721d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=101893) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:14:02.404090 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 1432/2839] 10.222.0.84 () {58 vars in 957 bytes} [Wed May 25 15:14:02 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 15:14:02.408585 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc6da8c3-c05d-45d7-99a5-f6a8f819a268 admin admin] Authenticating user token {{(pid=101892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:14:02.469857 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc6da8c3-c05d-45d7-99a5-f6a8f819a268 admin admin] Validating token access rules against request {{(pid=101892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:14:02.474420 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b8dd67d-9f54-4b84-bc39-e46e688c988b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cec56f74b2fa4826a506dc7b919465be', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:14:02.475072 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8dd67d-9f54-4b84-bc39-e46e688c988b admin admin] REQUEST_METHOD: `POST` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:14:02.475353 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8dd67d-9f54-4b84-bc39-e46e688c988b admin admin] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:14:02.475659 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8dd67d-9f54-4b84-bc39-e46e688c988b admin admin] PATH_INFO: `/v3/projects` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:14:02.476349 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b8dd67d-9f54-4b84-bc39-e46e688c988b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:14:02.478235 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b8dd67d-9f54-4b84-bc39-e46e688c988b admin admin] RBAC: Authorization granted {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:14:02.577961 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 1408/2840] 10.222.0.84 () {60 vars in 1152 bytes} [Wed May 25 15:14:02 2022] POST /identity/v3/projects => generated 383 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 15:14:02.581955 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c524c5f-4965-424e-87fa-74055f7d721d None None] Authenticating user token {{(pid=101893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:14:02.592465 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c524c5f-4965-424e-87fa-74055f7d721d None None] Validating token access rules against request {{(pid=101893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:14:02.647911 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2938ee7-5a73-41bc-b960-bd4976903953 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cec56f74b2fa4826a506dc7b919465be', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:14:02.648581 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2938ee7-5a73-41bc-b960-bd4976903953 admin admin] REQUEST_METHOD: `POST` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:14:02.648865 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2938ee7-5a73-41bc-b960-bd4976903953 admin admin] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:14:02.649139 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2938ee7-5a73-41bc-b960-bd4976903953 admin admin] PATH_INFO: `/v3/users` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:14:02.649830 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2938ee7-5a73-41bc-b960-bd4976903953 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:14:02.651776 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2938ee7-5a73-41bc-b960-bd4976903953 admin admin] RBAC: Authorization granted {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:14:02.759131 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 1433/2841] 10.222.0.84 () {60 vars in 1143 bytes} [Wed May 25 15:14:02 2022] POST /identity/v3/users => generated 298 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 15:14:02.763626 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b8dd67d-9f54-4b84-bc39-e46e688c988b admin admin] Authenticating user token {{(pid=101892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:14:02.773847 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b8dd67d-9f54-4b84-bc39-e46e688c988b admin admin] Validating token access rules against request {{(pid=101892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:14:02.778529 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f92004d9-6c21-4b35-b121-604ad0e6fff7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cec56f74b2fa4826a506dc7b919465be', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:14:02.779180 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f92004d9-6c21-4b35-b121-604ad0e6fff7 admin admin] REQUEST_METHOD: `GET` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:14:02.779462 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f92004d9-6c21-4b35-b121-604ad0e6fff7 admin admin] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:14:02.779777 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f92004d9-6c21-4b35-b121-604ad0e6fff7 admin admin] PATH_INFO: `/v3/roles` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:14:02.780494 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f92004d9-6c21-4b35-b121-604ad0e6fff7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:14:02.782149 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f92004d9-6c21-4b35-b121-604ad0e6fff7 admin admin] RBAC: Authorization granted {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:14:02.792452 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 1409/2842] 10.222.0.84 () {58 vars in 1121 bytes} [Wed May 25 15:14:02 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 15:14:02.796612 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2938ee7-5a73-41bc-b960-bd4976903953 admin admin] Authenticating user token {{(pid=101893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:14:02.807069 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2938ee7-5a73-41bc-b960-bd4976903953 admin admin] Validating token access rules against request {{(pid=101893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:14:02.811835 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bcf247d-366c-4957-90f4-7453e43df6cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cec56f74b2fa4826a506dc7b919465be', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:14:02.812740 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bcf247d-366c-4957-90f4-7453e43df6cc admin admin] REQUEST_METHOD: `PUT` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:14:02.813028 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bcf247d-366c-4957-90f4-7453e43df6cc admin admin] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:14:02.813310 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bcf247d-366c-4957-90f4-7453e43df6cc admin admin] PATH_INFO: `/v3/projects/d929858da7b940579d3763e46ffa3a89/users/d1e1d1980f9a48d088b7363985bb0cd4/roles/a3b78e7d547d4d2d998b4c99a4396bba` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:14:02.828716 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bcf247d-366c-4957-90f4-7453e43df6cc admin admin] RBAC: Authorizing `identity:create_grant(project_id=d929858da7b940579d3763e46ffa3a89, user_id=d1e1d1980f9a48d088b7363985bb0cd4, role_id=a3b78e7d547d4d2d998b4c99a4396bba)` {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:14:02.831426 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bcf247d-366c-4957-90f4-7453e43df6cc admin admin] RBAC: Authorization granted {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:14:02.834510 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG dbcounter [-] [101893] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=101893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:14:02.919738 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 1434/2843] 10.222.0.84 () {60 vars in 1482 bytes} [Wed May 25 15:14:02 2022] PUT /identity/v3/projects/d929858da7b940579d3763e46ffa3a89/users/d1e1d1980f9a48d088b7363985bb0cd4/roles/a3b78e7d547d4d2d998b4c99a4396bba => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 15:14:02.923934 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f92004d9-6c21-4b35-b121-604ad0e6fff7 admin admin] Authenticating user token {{(pid=101892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:14:02.934567 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f92004d9-6c21-4b35-b121-604ad0e6fff7 admin admin] Validating token access rules against request {{(pid=101892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:14:02.959141 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG dbcounter [-] [101892] Writing DB stats keystone:SELECT=91,keystone:DELETE=5,keystone:INSERT=4 {{(pid=101892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:14:02.991674 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52ed04f1-a0e9-41b4-8d66-bb0df8c514e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cec56f74b2fa4826a506dc7b919465be', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:14:02.992404 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ed04f1-a0e9-41b4-8d66-bb0df8c514e4 admin admin] REQUEST_METHOD: `GET` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:14:02.992688 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ed04f1-a0e9-41b4-8d66-bb0df8c514e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:14:02.992989 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ed04f1-a0e9-41b4-8d66-bb0df8c514e4 admin admin] PATH_INFO: `/v3/roles` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:14:02.993705 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52ed04f1-a0e9-41b4-8d66-bb0df8c514e4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:14:02.996228 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52ed04f1-a0e9-41b4-8d66-bb0df8c514e4 admin admin] RBAC: Authorization granted {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:14:03.006455 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 1410/2844] 10.222.0.84 () {58 vars in 1121 bytes} [Wed May 25 15:14:02 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 15:14:03.011407 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bcf247d-366c-4957-90f4-7453e43df6cc admin admin] Authenticating user token {{(pid=101893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:14:03.021856 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bcf247d-366c-4957-90f4-7453e43df6cc admin admin] Validating token access rules against request {{(pid=101893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:14:03.027410 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efbcfa9d-6229-4b1e-86d4-f97b4940be13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cec56f74b2fa4826a506dc7b919465be', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:14:03.031193 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efbcfa9d-6229-4b1e-86d4-f97b4940be13 admin admin] REQUEST_METHOD: `PUT` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:14:03.031193 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efbcfa9d-6229-4b1e-86d4-f97b4940be13 admin admin] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:14:03.031193 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efbcfa9d-6229-4b1e-86d4-f97b4940be13 admin admin] PATH_INFO: `/v3/projects/d929858da7b940579d3763e46ffa3a89/users/d1e1d1980f9a48d088b7363985bb0cd4/roles/a3b78e7d547d4d2d998b4c99a4396bba` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:14:03.031193 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efbcfa9d-6229-4b1e-86d4-f97b4940be13 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d929858da7b940579d3763e46ffa3a89, user_id=d1e1d1980f9a48d088b7363985bb0cd4, role_id=a3b78e7d547d4d2d998b4c99a4396bba)` {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:14:03.033690 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efbcfa9d-6229-4b1e-86d4-f97b4940be13 admin admin] RBAC: Authorization granted {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:14:03.043948 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 1435/2845] 10.222.0.84 () {60 vars in 1482 bytes} [Wed May 25 15:14:03 2022] PUT /identity/v3/projects/d929858da7b940579d3763e46ffa3a89/users/d1e1d1980f9a48d088b7363985bb0cd4/roles/a3b78e7d547d4d2d998b4c99a4396bba => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 15:14:03.054076 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cfe9ec0-eb8d-4dd5-b726-1f9b1cfdb032 None None] REQUEST_METHOD: `POST` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:14:03.054514 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cfe9ec0-eb8d-4dd5-b726-1f9b1cfdb032 None None] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:14:03.054799 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cfe9ec0-eb8d-4dd5-b726-1f9b1cfdb032 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:14:03.081868 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.auth.core [None req-5cfe9ec0-eb8d-4dd5-b726-1f9b1cfdb032 None None] MFA Rules not processed for user `d1e1d1980f9a48d088b7363985bb0cd4`. Rule list: `[]` (Enabled: `True`). {{(pid=101892) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:14:03.083052 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.fernet_utils [None req-5cfe9ec0-eb8d-4dd5-b726-1f9b1cfdb032 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=101892) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:14:03.151351 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 1411/2846] 10.222.0.84 () {58 vars in 957 bytes} [Wed May 25 15:14:03 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 25 15:14:03.162165 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efbcfa9d-6229-4b1e-86d4-f97b4940be13 admin admin] Authenticating user token {{(pid=101893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:14:03.163946 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.fernet_utils [None req-efbcfa9d-6229-4b1e-86d4-f97b4940be13 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=101893) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:14:03.267748 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efbcfa9d-6229-4b1e-86d4-f97b4940be13 admin admin] Validating token access rules against request {{(pid=101893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:14:03.271379 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04e78f45-4bc8-4188-98d5-612a58c71d36 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e079f89a5e524ab6ad4183e4f690de07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a000829c658c4a7cab67f7b6353ba3fa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:14:03.272056 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e78f45-4bc8-4188-98d5-612a58c71d36 service cinder] REQUEST_METHOD: `GET` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:14:03.272343 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e78f45-4bc8-4188-98d5-612a58c71d36 service cinder] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:14:03.272623 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e78f45-4bc8-4188-98d5-612a58c71d36 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:14:03.329950 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04e78f45-4bc8-4188-98d5-612a58c71d36 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:14:03.331392 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04e78f45-4bc8-4188-98d5-612a58c71d36 service cinder] RBAC: Authorization granted {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:14:03.340538 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 1436/2847] 10.222.0.84 () {60 vars in 1365 bytes} [Wed May 25 15:14:03 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 179 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 15:14:08.236888 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cfe9ec0-eb8d-4dd5-b726-1f9b1cfdb032 None None] Authenticating user token {{(pid=101892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:14:08.238442 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.fernet_utils [None req-5cfe9ec0-eb8d-4dd5-b726-1f9b1cfdb032 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=101892) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:14:08.251538 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cfe9ec0-eb8d-4dd5-b726-1f9b1cfdb032 None None] Validating token access rules against request {{(pid=101892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:14:08.255110 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e045bdb-15bb-4aa5-a8cd-f7e8ace921d4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e079f89a5e524ab6ad4183e4f690de07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a000829c658c4a7cab67f7b6353ba3fa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:14:08.255801 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e045bdb-15bb-4aa5-a8cd-f7e8ace921d4 service cinder] REQUEST_METHOD: `GET` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:14:08.256081 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e045bdb-15bb-4aa5-a8cd-f7e8ace921d4 service cinder] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:14:08.256363 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e045bdb-15bb-4aa5-a8cd-f7e8ace921d4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:14:08.265812 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e045bdb-15bb-4aa5-a8cd-f7e8ace921d4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:14:08.267235 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e045bdb-15bb-4aa5-a8cd-f7e8ace921d4 service cinder] RBAC: Authorization granted {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:14:08.277192 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 1412/2848] 10.222.0.84 () {60 vars in 1365 bytes} [Wed May 25 15:14:08 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 15:14:13.336349 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG dbcounter [-] [101893] Writing DB stats keystone:SELECT=62,keystone:INSERT=1 {{(pid=101893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:14:14.041580 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04e78f45-4bc8-4188-98d5-612a58c71d36 service cinder] Authenticating user token {{(pid=101893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:14:14.124384 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04e78f45-4bc8-4188-98d5-612a58c71d36 service cinder] Validating token access rules against request {{(pid=101893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:14:14.129021 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afc23073-e4bb-4e6a-a376-e34d1498a3c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cec56f74b2fa4826a506dc7b919465be', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:14:14.129898 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc23073-e4bb-4e6a-a376-e34d1498a3c7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:14:14.130216 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc23073-e4bb-4e6a-a376-e34d1498a3c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:14:14.130481 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc23073-e4bb-4e6a-a376-e34d1498a3c7 admin admin] PATH_INFO: `/v3/users/d955905b09b74b5680d2891175326d5f` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:14:14.131715 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afc23073-e4bb-4e6a-a376-e34d1498a3c7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d955905b09b74b5680d2891175326d5f)` {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:14:14.133651 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afc23073-e4bb-4e6a-a376-e34d1498a3c7 admin admin] RBAC: Authorization granted {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:14:14.321305 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.notifications [None req-afc23073-e4bb-4e6a-a376-e34d1498a3c7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd955905b09b74b5680d2891175326d5f'} {{(pid=101893) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:14:14.328395 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.notifications [None req-afc23073-e4bb-4e6a-a376-e34d1498a3c7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd955905b09b74b5680d2891175326d5f'} {{(pid=101893) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:14:14.340088 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.notifications [None req-afc23073-e4bb-4e6a-a376-e34d1498a3c7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd955905b09b74b5680d2891175326d5f'} {{(pid=101893) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:14:14.340770 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.notifications [None req-afc23073-e4bb-4e6a-a376-e34d1498a3c7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd955905b09b74b5680d2891175326d5f'} {{(pid=101893) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:14:14.341376 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.notifications [None req-afc23073-e4bb-4e6a-a376-e34d1498a3c7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd955905b09b74b5680d2891175326d5f'} {{(pid=101893) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:14:14.397979 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 1437/2849] 10.222.0.84 () {58 vars in 1223 bytes} [Wed May 25 15:14:14 2022] DELETE /identity/v3/users/d955905b09b74b5680d2891175326d5f => generated 0 bytes in 357 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 15:14:14.402447 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1fec35-02bb-47cc-ac99-378c0b9ef8f0 None None] REQUEST_METHOD: `POST` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:14:14.402913 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1fec35-02bb-47cc-ac99-378c0b9ef8f0 None None] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:14:14.403048 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1fec35-02bb-47cc-ac99-378c0b9ef8f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:14:14.441147 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.auth.core [None req-0c1fec35-02bb-47cc-ac99-378c0b9ef8f0 None None] MFA Rules not processed for user `05d87e87798e429aa1c10b24391f915e`. Rule list: `[]` (Enabled: `True`). {{(pid=101892) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:14:14.442339 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.fernet_utils [None req-0c1fec35-02bb-47cc-ac99-378c0b9ef8f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=101892) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:14:14.499538 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 1413/2850] 10.222.0.84 () {58 vars in 957 bytes} [Wed May 25 15:14:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 15:14:14.509066 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afc23073-e4bb-4e6a-a376-e34d1498a3c7 admin admin] Authenticating user token {{(pid=101893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:14:14.510560 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.fernet_utils [None req-afc23073-e4bb-4e6a-a376-e34d1498a3c7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=101893) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:14:14.596048 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG dbcounter [-] [101893] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=101893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:14:14.609244 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afc23073-e4bb-4e6a-a376-e34d1498a3c7 admin admin] Validating token access rules against request {{(pid=101893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:14:14.612893 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9dbfa98-71c7-44d7-b237-97f0a0946b1f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ce28b25b907473588ccb87dc4acc06a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a000829c658c4a7cab67f7b6353ba3fa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:14:14.613547 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9dbfa98-71c7-44d7-b237-97f0a0946b1f service neutron] REQUEST_METHOD: `GET` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:14:14.613998 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9dbfa98-71c7-44d7-b237-97f0a0946b1f service neutron] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:14:14.614284 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9dbfa98-71c7-44d7-b237-97f0a0946b1f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:14:14.623816 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9dbfa98-71c7-44d7-b237-97f0a0946b1f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:14:14.625260 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9dbfa98-71c7-44d7-b237-97f0a0946b1f service neutron] RBAC: Authorization granted {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:14:14.635230 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 1438/2851] 10.222.0.84 () {60 vars in 1365 bytes} [Wed May 25 15:14:14 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 127 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 15:14:15.103095 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c1fec35-02bb-47cc-ac99-378c0b9ef8f0 None None] Authenticating user token {{(pid=101892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:14:15.104569 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.fernet_utils [None req-0c1fec35-02bb-47cc-ac99-378c0b9ef8f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=101892) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:14:15.118462 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c1fec35-02bb-47cc-ac99-378c0b9ef8f0 None None] Validating token access rules against request {{(pid=101892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:14:15.123195 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-515a8d47-511d-408d-8039-8e5232fa7715 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cec56f74b2fa4826a506dc7b919465be', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:14:15.124929 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515a8d47-511d-408d-8039-8e5232fa7715 admin admin] REQUEST_METHOD: `DELETE` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:14:15.125218 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515a8d47-511d-408d-8039-8e5232fa7715 admin admin] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:14:15.125577 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515a8d47-511d-408d-8039-8e5232fa7715 admin admin] PATH_INFO: `/v3/projects/01ebfea52ded468bb322cbfa55e82f68` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:14:15.126684 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-515a8d47-511d-408d-8039-8e5232fa7715 admin admin] RBAC: Authorizing `identity:delete_project(project_id=01ebfea52ded468bb322cbfa55e82f68)` {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:14:15.128637 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-515a8d47-511d-408d-8039-8e5232fa7715 admin admin] RBAC: Authorization granted {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:14:15.141556 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG dbcounter [-] [101892] Writing DB stats keystone:SELECT=100 {{(pid=101892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:14:15.278898 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.notifications [None req-515a8d47-511d-408d-8039-8e5232fa7715 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '01ebfea52ded468bb322cbfa55e82f68', 'request_id': 'req-515a8d47-511d-408d-8039-8e5232fa7715'} {{(pid=101892) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:14:15.285143 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.notifications [None req-515a8d47-511d-408d-8039-8e5232fa7715 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '01ebfea52ded468bb322cbfa55e82f68', 'request_id': 'req-515a8d47-511d-408d-8039-8e5232fa7715'} {{(pid=101892) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:14:15.290586 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.notifications [None req-515a8d47-511d-408d-8039-8e5232fa7715 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '01ebfea52ded468bb322cbfa55e82f68', 'request_id': 'req-515a8d47-511d-408d-8039-8e5232fa7715'} {{(pid=101892) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:14:15.363583 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.notifications [None req-515a8d47-511d-408d-8039-8e5232fa7715 admin admin] The token cache is being invalidate because project 01ebfea52ded468bb322cbfa55e82f68 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=101892) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 25 15:14:15.363893 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.notifications [None req-515a8d47-511d-408d-8039-8e5232fa7715 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=101892) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:14:15.364507 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.notifications [None req-515a8d47-511d-408d-8039-8e5232fa7715 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=101892) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:14:15.366032 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 1414/2852] 10.222.0.84 () {58 vars in 1232 bytes} [Wed May 25 15:14:15 2022] DELETE /identity/v3/projects/01ebfea52ded468bb322cbfa55e82f68 => generated 0 bytes in 263 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 15:14:15.370490 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9dbfa98-71c7-44d7-b237-97f0a0946b1f service neutron] Authenticating user token {{(pid=101893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:14:15.380232 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9dbfa98-71c7-44d7-b237-97f0a0946b1f service neutron] Validating token access rules against request {{(pid=101893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:14:15.437174 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f808a53-ecb1-4d46-a231-37a16d7f483f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cec56f74b2fa4826a506dc7b919465be', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:14:15.438305 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f808a53-ecb1-4d46-a231-37a16d7f483f admin admin] REQUEST_METHOD: `DELETE` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:14:15.438598 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f808a53-ecb1-4d46-a231-37a16d7f483f admin admin] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:14:15.438872 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f808a53-ecb1-4d46-a231-37a16d7f483f admin admin] PATH_INFO: `/v3/users/d1e1d1980f9a48d088b7363985bb0cd4` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:14:15.440091 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f808a53-ecb1-4d46-a231-37a16d7f483f admin admin] RBAC: Authorizing `identity:delete_user(user_id=d1e1d1980f9a48d088b7363985bb0cd4)` {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:14:15.442044 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f808a53-ecb1-4d46-a231-37a16d7f483f admin admin] RBAC: Authorization granted {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:14:15.595003 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.notifications [None req-2f808a53-ecb1-4d46-a231-37a16d7f483f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd1e1d1980f9a48d088b7363985bb0cd4'} {{(pid=101893) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:14:15.602015 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.notifications [None req-2f808a53-ecb1-4d46-a231-37a16d7f483f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd1e1d1980f9a48d088b7363985bb0cd4'} {{(pid=101893) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:14:15.613784 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.notifications [None req-2f808a53-ecb1-4d46-a231-37a16d7f483f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd1e1d1980f9a48d088b7363985bb0cd4'} {{(pid=101893) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:14:15.614407 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.notifications [None req-2f808a53-ecb1-4d46-a231-37a16d7f483f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd1e1d1980f9a48d088b7363985bb0cd4'} {{(pid=101893) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:14:15.615017 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.notifications [None req-2f808a53-ecb1-4d46-a231-37a16d7f483f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd1e1d1980f9a48d088b7363985bb0cd4'} {{(pid=101893) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:14:15.695595 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 1439/2853] 10.222.0.84 () {58 vars in 1223 bytes} [Wed May 25 15:14:15 2022] DELETE /identity/v3/users/d1e1d1980f9a48d088b7363985bb0cd4 => generated 0 bytes in 325 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 15:14:16.092202 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-515a8d47-511d-408d-8039-8e5232fa7715 admin admin] Authenticating user token {{(pid=101892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:14:16.093666 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.fernet_utils [None req-515a8d47-511d-408d-8039-8e5232fa7715 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=101892) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:14:16.109603 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-515a8d47-511d-408d-8039-8e5232fa7715 admin admin] Validating token access rules against request {{(pid=101892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:14:16.168107 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba27dc39-2948-4245-beb5-500fc352a891 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cec56f74b2fa4826a506dc7b919465be', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:14:16.168977 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba27dc39-2948-4245-beb5-500fc352a891 admin admin] REQUEST_METHOD: `DELETE` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:14:16.169262 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba27dc39-2948-4245-beb5-500fc352a891 admin admin] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:14:16.169542 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba27dc39-2948-4245-beb5-500fc352a891 admin admin] PATH_INFO: `/v3/projects/d929858da7b940579d3763e46ffa3a89` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:14:16.170736 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba27dc39-2948-4245-beb5-500fc352a891 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d929858da7b940579d3763e46ffa3a89)` {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:14:16.172685 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba27dc39-2948-4245-beb5-500fc352a891 admin admin] RBAC: Authorization granted {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:14:16.322741 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.notifications [None req-ba27dc39-2948-4245-beb5-500fc352a891 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd929858da7b940579d3763e46ffa3a89', 'request_id': 'req-ba27dc39-2948-4245-beb5-500fc352a891'} {{(pid=101892) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:14:16.331243 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.notifications [None req-ba27dc39-2948-4245-beb5-500fc352a891 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd929858da7b940579d3763e46ffa3a89', 'request_id': 'req-ba27dc39-2948-4245-beb5-500fc352a891'} {{(pid=101892) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:14:16.338099 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.notifications [None req-ba27dc39-2948-4245-beb5-500fc352a891 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd929858da7b940579d3763e46ffa3a89', 'request_id': 'req-ba27dc39-2948-4245-beb5-500fc352a891'} {{(pid=101892) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:14:16.409434 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.notifications [None req-ba27dc39-2948-4245-beb5-500fc352a891 admin admin] The token cache is being invalidate because project d929858da7b940579d3763e46ffa3a89 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=101892) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 25 15:14:16.409664 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.notifications [None req-ba27dc39-2948-4245-beb5-500fc352a891 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=101892) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:14:16.410234 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.notifications [None req-ba27dc39-2948-4245-beb5-500fc352a891 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=101892) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:14:16.411793 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 1415/2854] 10.222.0.84 () {58 vars in 1232 bytes} [Wed May 25 15:14:16 2022] DELETE /identity/v3/projects/d929858da7b940579d3763e46ffa3a89 => generated 0 bytes in 320 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 15:14:16.418649 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef4f68b-1286-4b9d-90db-382d7f5f3790 None None] REQUEST_METHOD: `POST` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:14:16.419113 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef4f68b-1286-4b9d-90db-382d7f5f3790 None None] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:14:16.419214 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef4f68b-1286-4b9d-90db-382d7f5f3790 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:14:16.456039 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.auth.core [None req-5ef4f68b-1286-4b9d-90db-382d7f5f3790 None None] MFA Rules not processed for user `05d87e87798e429aa1c10b24391f915e`. Rule list: `[]` (Enabled: `True`). {{(pid=101893) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:14:16.457219 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.fernet_utils [None req-5ef4f68b-1286-4b9d-90db-382d7f5f3790 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=101893) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:14:16.500205 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG dbcounter [-] [101893] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=101893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:14:16.515286 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 1440/2855] 10.222.0.84 () {58 vars in 957 bytes} [Wed May 25 15:14:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 15:14:16.527810 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-055e6294-8177-43e7-afa7-21d229faeb1d None None] REQUEST_METHOD: `POST` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:14:16.528108 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-055e6294-8177-43e7-afa7-21d229faeb1d None None] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:14:16.528393 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-055e6294-8177-43e7-afa7-21d229faeb1d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:14:16.547824 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.auth.core [None req-055e6294-8177-43e7-afa7-21d229faeb1d None None] MFA Rules not processed for user `05d87e87798e429aa1c10b24391f915e`. Rule list: `[]` (Enabled: `True`). {{(pid=101892) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:14:16.549043 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.fernet_utils [None req-055e6294-8177-43e7-afa7-21d229faeb1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=101892) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:14:16.557254 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 1416/2856] 10.222.0.84 () {58 vars in 957 bytes} [Wed May 25 15:14:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 15:14:16.561623 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ef4f68b-1286-4b9d-90db-382d7f5f3790 None None] Authenticating user token {{(pid=101893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:14:16.572631 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ef4f68b-1286-4b9d-90db-382d7f5f3790 None None] Validating token access rules against request {{(pid=101893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:14:16.577161 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e8dcacc-1fe2-42fc-9914-92cb4fa9a794 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cec56f74b2fa4826a506dc7b919465be', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:14:16.577812 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8dcacc-1fe2-42fc-9914-92cb4fa9a794 admin admin] REQUEST_METHOD: `GET` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:14:16.578099 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8dcacc-1fe2-42fc-9914-92cb4fa9a794 admin admin] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:14:16.578380 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8dcacc-1fe2-42fc-9914-92cb4fa9a794 admin admin] PATH_INFO: `/v3/domains` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:14:16.579106 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e8dcacc-1fe2-42fc-9914-92cb4fa9a794 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=101893) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 15:14:16.579416 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e8dcacc-1fe2-42fc-9914-92cb4fa9a794 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:14:16.581055 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e8dcacc-1fe2-42fc-9914-92cb4fa9a794 admin admin] RBAC: Authorization granted {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:14:16.592892 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 1441/2857] 10.222.0.84 () {58 vars in 1152 bytes} [Wed May 25 15:14:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 15:14:16.597449 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-055e6294-8177-43e7-afa7-21d229faeb1d None None] Authenticating user token {{(pid=101892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:14:16.608893 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-055e6294-8177-43e7-afa7-21d229faeb1d None None] Validating token access rules against request {{(pid=101892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:14:16.617215 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0946bdae-0483-487c-a461-3f2db43954a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cec56f74b2fa4826a506dc7b919465be', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:14:16.618352 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0946bdae-0483-487c-a461-3f2db43954a5 admin admin] REQUEST_METHOD: `POST` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:14:16.619539 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0946bdae-0483-487c-a461-3f2db43954a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:14:16.620089 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0946bdae-0483-487c-a461-3f2db43954a5 admin admin] PATH_INFO: `/v3/projects` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:14:16.621403 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0946bdae-0483-487c-a461-3f2db43954a5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:14:16.625268 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0946bdae-0483-487c-a461-3f2db43954a5 admin admin] RBAC: Authorization granted {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:14:16.709243 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 1417/2858] 10.222.0.84 () {60 vars in 1152 bytes} [Wed May 25 15:14:16 2022] POST /identity/v3/projects => generated 383 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 25 15:14:16.713407 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e8dcacc-1fe2-42fc-9914-92cb4fa9a794 admin admin] Authenticating user token {{(pid=101893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:14:16.723541 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e8dcacc-1fe2-42fc-9914-92cb4fa9a794 admin admin] Validating token access rules against request {{(pid=101893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:14:16.779466 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4cfe334-6d61-4a05-babe-8bcd39e59b0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cec56f74b2fa4826a506dc7b919465be', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:14:16.780158 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4cfe334-6d61-4a05-babe-8bcd39e59b0a admin admin] REQUEST_METHOD: `POST` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:14:16.780449 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4cfe334-6d61-4a05-babe-8bcd39e59b0a admin admin] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:14:16.780731 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4cfe334-6d61-4a05-babe-8bcd39e59b0a admin admin] PATH_INFO: `/v3/users` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:14:16.781420 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4cfe334-6d61-4a05-babe-8bcd39e59b0a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:14:16.783356 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4cfe334-6d61-4a05-babe-8bcd39e59b0a admin admin] RBAC: Authorization granted {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:14:16.884981 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 1442/2859] 10.222.0.84 () {60 vars in 1143 bytes} [Wed May 25 15:14:16 2022] POST /identity/v3/users => generated 292 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 15:14:16.888993 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0946bdae-0483-487c-a461-3f2db43954a5 admin admin] Authenticating user token {{(pid=101892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:14:16.894595 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG dbcounter [-] [101892] Writing DB stats keystone:SELECT=83,keystone:DELETE=14,keystone:INSERT=3 {{(pid=101892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:14:16.900688 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0946bdae-0483-487c-a461-3f2db43954a5 admin admin] Validating token access rules against request {{(pid=101892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:14:16.905547 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7273f45e-2c5c-482b-ab9d-4626c07cb32e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cec56f74b2fa4826a506dc7b919465be', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:14:16.908898 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7273f45e-2c5c-482b-ab9d-4626c07cb32e admin admin] REQUEST_METHOD: `GET` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:14:16.908898 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7273f45e-2c5c-482b-ab9d-4626c07cb32e admin admin] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:14:16.908898 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7273f45e-2c5c-482b-ab9d-4626c07cb32e admin admin] PATH_INFO: `/v3/roles` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:14:16.908898 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7273f45e-2c5c-482b-ab9d-4626c07cb32e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:14:16.909316 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7273f45e-2c5c-482b-ab9d-4626c07cb32e admin admin] RBAC: Authorization granted {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:14:16.920098 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 1418/2860] 10.222.0.84 () {58 vars in 1121 bytes} [Wed May 25 15:14:16 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 15:14:16.924130 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4cfe334-6d61-4a05-babe-8bcd39e59b0a admin admin] Authenticating user token {{(pid=101893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:14:16.934177 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4cfe334-6d61-4a05-babe-8bcd39e59b0a admin admin] Validating token access rules against request {{(pid=101893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:14:16.939142 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acc2be51-f6c5-40a8-a11c-1848ae8bd679 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cec56f74b2fa4826a506dc7b919465be', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:14:16.939831 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc2be51-f6c5-40a8-a11c-1848ae8bd679 admin admin] REQUEST_METHOD: `GET` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:14:16.940120 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc2be51-f6c5-40a8-a11c-1848ae8bd679 admin admin] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:14:16.940400 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc2be51-f6c5-40a8-a11c-1848ae8bd679 admin admin] PATH_INFO: `/v3/roles` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:14:16.941157 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acc2be51-f6c5-40a8-a11c-1848ae8bd679 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:14:16.942755 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acc2be51-f6c5-40a8-a11c-1848ae8bd679 admin admin] RBAC: Authorization granted {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:14:16.953371 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 1443/2861] 10.222.0.84 () {58 vars in 1121 bytes} [Wed May 25 15:14:16 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 15:14:16.957377 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7273f45e-2c5c-482b-ab9d-4626c07cb32e admin admin] Authenticating user token {{(pid=101892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:14:16.972018 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7273f45e-2c5c-482b-ab9d-4626c07cb32e admin admin] Validating token access rules against request {{(pid=101892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:14:16.974452 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c10223b-c0a9-4abb-837e-3f7e47e21413 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cec56f74b2fa4826a506dc7b919465be', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:14:16.975363 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c10223b-c0a9-4abb-837e-3f7e47e21413 admin admin] REQUEST_METHOD: `PUT` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:14:16.975677 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c10223b-c0a9-4abb-837e-3f7e47e21413 admin admin] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:14:16.975972 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c10223b-c0a9-4abb-837e-3f7e47e21413 admin admin] PATH_INFO: `/v3/projects/05ecbbe553fb4f79ae891d75e2837af0/users/329746f491774318983d66a5c0799de3/roles/ff664fa0db7e4262a5accde96c3df4c3` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:14:16.992776 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c10223b-c0a9-4abb-837e-3f7e47e21413 admin admin] RBAC: Authorizing `identity:create_grant(project_id=05ecbbe553fb4f79ae891d75e2837af0, user_id=329746f491774318983d66a5c0799de3, role_id=ff664fa0db7e4262a5accde96c3df4c3)` {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:14:16.995861 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c10223b-c0a9-4abb-837e-3f7e47e21413 admin admin] RBAC: Authorization granted {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:14:17.051182 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 1419/2862] 10.222.0.84 () {60 vars in 1482 bytes} [Wed May 25 15:14:16 2022] PUT /identity/v3/projects/05ecbbe553fb4f79ae891d75e2837af0/users/329746f491774318983d66a5c0799de3/roles/ff664fa0db7e4262a5accde96c3df4c3 => generated 0 bytes in 94 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 25 15:14:17.064010 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3f8fa5-e597-4f12-b30d-c4a3dc30bfd0 None None] REQUEST_METHOD: `POST` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:14:17.064335 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3f8fa5-e597-4f12-b30d-c4a3dc30bfd0 None None] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:14:17.064621 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3f8fa5-e597-4f12-b30d-c4a3dc30bfd0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:14:17.091889 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.auth.core [None req-eb3f8fa5-e597-4f12-b30d-c4a3dc30bfd0 None None] MFA Rules not processed for user `329746f491774318983d66a5c0799de3`. Rule list: `[]` (Enabled: `True`). {{(pid=101893) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:14:17.093102 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.fernet_utils [None req-eb3f8fa5-e597-4f12-b30d-c4a3dc30bfd0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=101893) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:14:17.155627 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 1444/2863] 10.222.0.84 () {58 vars in 957 bytes} [Wed May 25 15:14:17 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 15:14:17.160282 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c10223b-c0a9-4abb-837e-3f7e47e21413 admin admin] Authenticating user token {{(pid=101892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:14:17.222826 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c10223b-c0a9-4abb-837e-3f7e47e21413 admin admin] Validating token access rules against request {{(pid=101892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:14:17.227377 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97d728fb-c6b2-436c-9ffd-222d405fc62f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cec56f74b2fa4826a506dc7b919465be', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:14:17.228066 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d728fb-c6b2-436c-9ffd-222d405fc62f admin admin] REQUEST_METHOD: `POST` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:14:17.228356 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d728fb-c6b2-436c-9ffd-222d405fc62f admin admin] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:14:17.228637 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d728fb-c6b2-436c-9ffd-222d405fc62f admin admin] PATH_INFO: `/v3/projects` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:14:17.229356 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97d728fb-c6b2-436c-9ffd-222d405fc62f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:14:17.231255 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97d728fb-c6b2-436c-9ffd-222d405fc62f admin admin] RBAC: Authorization granted {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:14:17.331504 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 1420/2864] 10.222.0.84 () {60 vars in 1152 bytes} [Wed May 25 15:14:17 2022] POST /identity/v3/projects => generated 385 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 15:14:17.335513 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb3f8fa5-e597-4f12-b30d-c4a3dc30bfd0 None None] Authenticating user token {{(pid=101893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:14:17.346953 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb3f8fa5-e597-4f12-b30d-c4a3dc30bfd0 None None] Validating token access rules against request {{(pid=101893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:14:17.390914 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG dbcounter [-] [101893] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=101893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:14:17.406382 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c042c99e-ebd3-4474-976f-4b705e7495db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cec56f74b2fa4826a506dc7b919465be', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:14:17.407047 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c042c99e-ebd3-4474-976f-4b705e7495db admin admin] REQUEST_METHOD: `POST` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:14:17.407328 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c042c99e-ebd3-4474-976f-4b705e7495db admin admin] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:14:17.407627 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c042c99e-ebd3-4474-976f-4b705e7495db admin admin] PATH_INFO: `/v3/users` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:14:17.408314 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c042c99e-ebd3-4474-976f-4b705e7495db admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:14:17.410339 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c042c99e-ebd3-4474-976f-4b705e7495db admin admin] RBAC: Authorization granted {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:14:17.549013 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 1445/2865] 10.222.0.84 () {60 vars in 1143 bytes} [Wed May 25 15:14:17 2022] POST /identity/v3/users => generated 293 bytes in 214 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 25 15:14:17.552948 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97d728fb-c6b2-436c-9ffd-222d405fc62f admin admin] Authenticating user token {{(pid=101892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:14:17.566425 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97d728fb-c6b2-436c-9ffd-222d405fc62f admin admin] Validating token access rules against request {{(pid=101892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:14:17.570991 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da32ece4-9229-4593-ab8c-204d3393ef27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cec56f74b2fa4826a506dc7b919465be', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:14:17.572303 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da32ece4-9229-4593-ab8c-204d3393ef27 admin admin] REQUEST_METHOD: `GET` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:14:17.572591 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da32ece4-9229-4593-ab8c-204d3393ef27 admin admin] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:14:17.572868 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da32ece4-9229-4593-ab8c-204d3393ef27 admin admin] PATH_INFO: `/v3/roles` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:14:17.573593 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da32ece4-9229-4593-ab8c-204d3393ef27 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:14:17.575189 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da32ece4-9229-4593-ab8c-204d3393ef27 admin admin] RBAC: Authorization granted {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:14:17.585544 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 1421/2866] 10.222.0.84 () {58 vars in 1121 bytes} [Wed May 25 15:14:17 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 15:14:17.589664 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c042c99e-ebd3-4474-976f-4b705e7495db admin admin] Authenticating user token {{(pid=101893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:14:17.599386 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c042c99e-ebd3-4474-976f-4b705e7495db admin admin] Validating token access rules against request {{(pid=101893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:14:17.604018 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32c45cde-2575-499a-8ee9-07b48aea4213 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cec56f74b2fa4826a506dc7b919465be', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:14:17.604673 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c45cde-2575-499a-8ee9-07b48aea4213 admin admin] REQUEST_METHOD: `GET` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:14:17.604960 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c45cde-2575-499a-8ee9-07b48aea4213 admin admin] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:14:17.605238 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c45cde-2575-499a-8ee9-07b48aea4213 admin admin] PATH_INFO: `/v3/roles` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:14:17.605959 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32c45cde-2575-499a-8ee9-07b48aea4213 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:14:17.607555 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32c45cde-2575-499a-8ee9-07b48aea4213 admin admin] RBAC: Authorization granted {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:14:17.617259 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 1446/2867] 10.222.0.84 () {58 vars in 1121 bytes} [Wed May 25 15:14:17 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 25 15:14:17.621714 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da32ece4-9229-4593-ab8c-204d3393ef27 admin admin] Authenticating user token {{(pid=101892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:14:17.631488 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da32ece4-9229-4593-ab8c-204d3393ef27 admin admin] Validating token access rules against request {{(pid=101892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:14:17.636170 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de9948cc-22c0-46f1-a2fd-6531925b1535 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cec56f74b2fa4826a506dc7b919465be', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:14:17.637027 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9948cc-22c0-46f1-a2fd-6531925b1535 admin admin] REQUEST_METHOD: `PUT` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:14:17.637305 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9948cc-22c0-46f1-a2fd-6531925b1535 admin admin] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:14:17.637576 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9948cc-22c0-46f1-a2fd-6531925b1535 admin admin] PATH_INFO: `/v3/projects/18b8054623254fa2ab5a11f9a66b1050/users/67b866b59e1b48c790b4e63e282ee075/roles/ff664fa0db7e4262a5accde96c3df4c3` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:14:17.652098 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de9948cc-22c0-46f1-a2fd-6531925b1535 admin admin] RBAC: Authorizing `identity:create_grant(project_id=18b8054623254fa2ab5a11f9a66b1050, user_id=67b866b59e1b48c790b4e63e282ee075, role_id=ff664fa0db7e4262a5accde96c3df4c3)` {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:14:17.654712 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de9948cc-22c0-46f1-a2fd-6531925b1535 admin admin] RBAC: Authorization granted {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:14:17.724432 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 1422/2868] 10.222.0.84 () {60 vars in 1482 bytes} [Wed May 25 15:14:17 2022] PUT /identity/v3/projects/18b8054623254fa2ab5a11f9a66b1050/users/67b866b59e1b48c790b4e63e282ee075/roles/ff664fa0db7e4262a5accde96c3df4c3 => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 25 15:14:17.735048 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002a7475-b028-4a5e-9155-aa6f8ad5253b None None] REQUEST_METHOD: `POST` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:14:17.735337 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002a7475-b028-4a5e-9155-aa6f8ad5253b None None] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:14:17.735734 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002a7475-b028-4a5e-9155-aa6f8ad5253b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:14:17.762663 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.auth.core [None req-002a7475-b028-4a5e-9155-aa6f8ad5253b None None] MFA Rules not processed for user `67b866b59e1b48c790b4e63e282ee075`. Rule list: `[]` (Enabled: `True`). {{(pid=101893) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:14:17.763968 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.fernet_utils [None req-002a7475-b028-4a5e-9155-aa6f8ad5253b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=101893) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:14:17.827305 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 1447/2869] 10.222.0.84 () {58 vars in 957 bytes} [Wed May 25 15:14:17 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 15:14:17.831696 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de9948cc-22c0-46f1-a2fd-6531925b1535 admin admin] Authenticating user token {{(pid=101892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:14:17.892343 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de9948cc-22c0-46f1-a2fd-6531925b1535 admin admin] Validating token access rules against request {{(pid=101892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:14:17.897066 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06424a44-120b-42a5-b85f-4874473943a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cec56f74b2fa4826a506dc7b919465be', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:14:17.897723 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06424a44-120b-42a5-b85f-4874473943a1 admin admin] REQUEST_METHOD: `POST` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:14:17.898092 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06424a44-120b-42a5-b85f-4874473943a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:14:17.898372 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06424a44-120b-42a5-b85f-4874473943a1 admin admin] PATH_INFO: `/v3/projects` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:14:17.899066 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06424a44-120b-42a5-b85f-4874473943a1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:14:17.901491 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06424a44-120b-42a5-b85f-4874473943a1 admin admin] RBAC: Authorization granted {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:14:17.988355 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 1423/2870] 10.222.0.84 () {60 vars in 1152 bytes} [Wed May 25 15:14:17 2022] POST /identity/v3/projects => generated 385 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 15:14:17.992434 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-002a7475-b028-4a5e-9155-aa6f8ad5253b None None] Authenticating user token {{(pid=101893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:14:18.003166 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-002a7475-b028-4a5e-9155-aa6f8ad5253b None None] Validating token access rules against request {{(pid=101893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:14:18.058844 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b5dca95-fd43-44e4-a474-4547e4500744 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cec56f74b2fa4826a506dc7b919465be', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:14:18.059512 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5dca95-fd43-44e4-a474-4547e4500744 admin admin] REQUEST_METHOD: `POST` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:14:18.059831 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5dca95-fd43-44e4-a474-4547e4500744 admin admin] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:14:18.060116 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5dca95-fd43-44e4-a474-4547e4500744 admin admin] PATH_INFO: `/v3/users` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:14:18.060813 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b5dca95-fd43-44e4-a474-4547e4500744 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:14:18.062743 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b5dca95-fd43-44e4-a474-4547e4500744 admin admin] RBAC: Authorization granted {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:14:18.181791 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 1448/2871] 10.222.0.84 () {60 vars in 1143 bytes} [Wed May 25 15:14:17 2022] POST /identity/v3/users => generated 299 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 15:14:18.200421 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06424a44-120b-42a5-b85f-4874473943a1 admin admin] Authenticating user token {{(pid=101892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:14:18.205990 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG dbcounter [-] [101892] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=101892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:14:18.211305 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06424a44-120b-42a5-b85f-4874473943a1 admin admin] Validating token access rules against request {{(pid=101892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:14:18.216484 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8058379e-5299-4088-a9a6-d22de4f40a34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cec56f74b2fa4826a506dc7b919465be', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:14:18.217143 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8058379e-5299-4088-a9a6-d22de4f40a34 admin admin] REQUEST_METHOD: `GET` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:14:18.217425 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8058379e-5299-4088-a9a6-d22de4f40a34 admin admin] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:14:18.217703 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8058379e-5299-4088-a9a6-d22de4f40a34 admin admin] PATH_INFO: `/v3/roles` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:14:18.218425 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8058379e-5299-4088-a9a6-d22de4f40a34 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:14:18.220136 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8058379e-5299-4088-a9a6-d22de4f40a34 admin admin] RBAC: Authorization granted {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:14:18.230558 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 1424/2872] 10.222.0.84 () {58 vars in 1121 bytes} [Wed May 25 15:14:18 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 15:14:18.234683 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b5dca95-fd43-44e4-a474-4547e4500744 admin admin] Authenticating user token {{(pid=101893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:14:18.244838 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b5dca95-fd43-44e4-a474-4547e4500744 admin admin] Validating token access rules against request {{(pid=101893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:14:18.249425 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d74b80d-6e87-47bd-9ce7-b7cda60bfa45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cec56f74b2fa4826a506dc7b919465be', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:14:18.250289 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d74b80d-6e87-47bd-9ce7-b7cda60bfa45 admin admin] REQUEST_METHOD: `PUT` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:14:18.250568 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d74b80d-6e87-47bd-9ce7-b7cda60bfa45 admin admin] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:14:18.250843 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d74b80d-6e87-47bd-9ce7-b7cda60bfa45 admin admin] PATH_INFO: `/v3/projects/41cacee1acd24d25b7e4170c62eee7eb/users/88ccb7e712eb4c9ca6f2beef9fda7a52/roles/a3b78e7d547d4d2d998b4c99a4396bba` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:14:18.265960 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d74b80d-6e87-47bd-9ce7-b7cda60bfa45 admin admin] RBAC: Authorizing `identity:create_grant(project_id=41cacee1acd24d25b7e4170c62eee7eb, user_id=88ccb7e712eb4c9ca6f2beef9fda7a52, role_id=a3b78e7d547d4d2d998b4c99a4396bba)` {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:14:18.268648 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d74b80d-6e87-47bd-9ce7-b7cda60bfa45 admin admin] RBAC: Authorization granted {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:14:18.313552 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 1449/2873] 10.222.0.84 () {60 vars in 1482 bytes} [Wed May 25 15:14:18 2022] PUT /identity/v3/projects/41cacee1acd24d25b7e4170c62eee7eb/users/88ccb7e712eb4c9ca6f2beef9fda7a52/roles/a3b78e7d547d4d2d998b4c99a4396bba => generated 0 bytes in 79 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 15:14:18.317426 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8058379e-5299-4088-a9a6-d22de4f40a34 admin admin] Authenticating user token {{(pid=101892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:14:18.327742 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8058379e-5299-4088-a9a6-d22de4f40a34 admin admin] Validating token access rules against request {{(pid=101892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:14:18.382710 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d535ccb5-9928-43a8-b864-04d1b2e06d39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cec56f74b2fa4826a506dc7b919465be', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:14:18.383375 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d535ccb5-9928-43a8-b864-04d1b2e06d39 admin admin] REQUEST_METHOD: `GET` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:14:18.383689 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d535ccb5-9928-43a8-b864-04d1b2e06d39 admin admin] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:14:18.383986 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d535ccb5-9928-43a8-b864-04d1b2e06d39 admin admin] PATH_INFO: `/v3/roles` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:14:18.385242 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d535ccb5-9928-43a8-b864-04d1b2e06d39 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:14:18.386835 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d535ccb5-9928-43a8-b864-04d1b2e06d39 admin admin] RBAC: Authorization granted {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:14:18.397023 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 1425/2874] 10.222.0.84 () {58 vars in 1121 bytes} [Wed May 25 15:14:18 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 15:14:18.401217 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d74b80d-6e87-47bd-9ce7-b7cda60bfa45 admin admin] Authenticating user token {{(pid=101893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:14:18.412020 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d74b80d-6e87-47bd-9ce7-b7cda60bfa45 admin admin] Validating token access rules against request {{(pid=101893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:14:18.417162 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f4aeddd-83ba-4223-803b-91d7b0a3b82e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cec56f74b2fa4826a506dc7b919465be', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:14:18.418047 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f4aeddd-83ba-4223-803b-91d7b0a3b82e admin admin] REQUEST_METHOD: `PUT` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:14:18.418333 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f4aeddd-83ba-4223-803b-91d7b0a3b82e admin admin] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:14:18.418607 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f4aeddd-83ba-4223-803b-91d7b0a3b82e admin admin] PATH_INFO: `/v3/projects/41cacee1acd24d25b7e4170c62eee7eb/users/88ccb7e712eb4c9ca6f2beef9fda7a52/roles/a3b78e7d547d4d2d998b4c99a4396bba` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:14:18.420730 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f4aeddd-83ba-4223-803b-91d7b0a3b82e admin admin] RBAC: Authorizing `identity:create_grant(project_id=41cacee1acd24d25b7e4170c62eee7eb, user_id=88ccb7e712eb4c9ca6f2beef9fda7a52, role_id=a3b78e7d547d4d2d998b4c99a4396bba)` {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:14:18.423871 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f4aeddd-83ba-4223-803b-91d7b0a3b82e admin admin] RBAC: Authorization granted {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:14:18.434640 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 1450/2875] 10.222.0.84 () {60 vars in 1482 bytes} [Wed May 25 15:14:18 2022] PUT /identity/v3/projects/41cacee1acd24d25b7e4170c62eee7eb/users/88ccb7e712eb4c9ca6f2beef9fda7a52/roles/a3b78e7d547d4d2d998b4c99a4396bba => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 15:14:18.498466 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e897135e-1f07-485a-a273-48d2cc527e3e None None] REQUEST_METHOD: `POST` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:14:18.498760 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e897135e-1f07-485a-a273-48d2cc527e3e None None] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:14:18.499045 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e897135e-1f07-485a-a273-48d2cc527e3e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:14:18.525687 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.auth.core [None req-e897135e-1f07-485a-a273-48d2cc527e3e None None] MFA Rules not processed for user `88ccb7e712eb4c9ca6f2beef9fda7a52`. Rule list: `[]` (Enabled: `True`). {{(pid=101892) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:14:18.526909 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.fernet_utils [None req-e897135e-1f07-485a-a273-48d2cc527e3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=101892) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:14:18.595110 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 1426/2876] 10.222.0.84 () {58 vars in 957 bytes} [Wed May 25 15:14:18 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 15:14:18.606890 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f4aeddd-83ba-4223-803b-91d7b0a3b82e admin admin] Authenticating user token {{(pid=101893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:14:18.608660 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.fernet_utils [None req-1f4aeddd-83ba-4223-803b-91d7b0a3b82e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=101893) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:14:18.615175 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG dbcounter [-] [101893] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=101893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:14:18.673020 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f4aeddd-83ba-4223-803b-91d7b0a3b82e admin admin] Validating token access rules against request {{(pid=101893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:14:18.676592 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afcb75a5-508b-4833-bae1-be2f241345a1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e079f89a5e524ab6ad4183e4f690de07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a000829c658c4a7cab67f7b6353ba3fa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:14:18.677233 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afcb75a5-508b-4833-bae1-be2f241345a1 service cinder] REQUEST_METHOD: `GET` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:14:18.677517 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afcb75a5-508b-4833-bae1-be2f241345a1 service cinder] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:14:18.677794 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afcb75a5-508b-4833-bae1-be2f241345a1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:14:18.741169 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afcb75a5-508b-4833-bae1-be2f241345a1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:14:18.742625 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afcb75a5-508b-4833-bae1-be2f241345a1 service cinder] RBAC: Authorization granted {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:14:18.752171 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 1451/2877] 10.222.0.84 () {60 vars in 1365 bytes} [Wed May 25 15:14:18 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 146 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 15:14:20.676293 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e897135e-1f07-485a-a273-48d2cc527e3e None None] Authenticating user token {{(pid=101892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:14:20.677743 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.fernet_utils [None req-e897135e-1f07-485a-a273-48d2cc527e3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=101892) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:14:20.690403 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e897135e-1f07-485a-a273-48d2cc527e3e None None] Validating token access rules against request {{(pid=101892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:14:20.693964 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75e0f23e-3e81-49bc-960e-157c9ae57515 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e079f89a5e524ab6ad4183e4f690de07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a000829c658c4a7cab67f7b6353ba3fa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:14:20.694604 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e0f23e-3e81-49bc-960e-157c9ae57515 service cinder] REQUEST_METHOD: `GET` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:14:20.694892 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e0f23e-3e81-49bc-960e-157c9ae57515 service cinder] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:14:20.695173 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e0f23e-3e81-49bc-960e-157c9ae57515 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:14:20.751241 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75e0f23e-3e81-49bc-960e-157c9ae57515 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:14:20.752709 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75e0f23e-3e81-49bc-960e-157c9ae57515 service cinder] RBAC: Authorization granted {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:14:20.762130 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 1427/2878] 10.222.0.84 () {60 vars in 1365 bytes} [Wed May 25 15:14:20 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 15:14:22.083847 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afcb75a5-508b-4833-bae1-be2f241345a1 service cinder] Authenticating user token {{(pid=101893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:14:22.089584 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afcb75a5-508b-4833-bae1-be2f241345a1 service cinder] Validating token access rules against request {{(pid=101893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:14:22.093226 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f282384b-8de5-4fd8-b02b-3a31f3f3a317 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e079f89a5e524ab6ad4183e4f690de07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a000829c658c4a7cab67f7b6353ba3fa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:14:22.093948 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f282384b-8de5-4fd8-b02b-3a31f3f3a317 service cinder] REQUEST_METHOD: `GET` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:14:22.094237 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f282384b-8de5-4fd8-b02b-3a31f3f3a317 service cinder] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:14:22.094517 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f282384b-8de5-4fd8-b02b-3a31f3f3a317 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:14:22.103935 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f282384b-8de5-4fd8-b02b-3a31f3f3a317 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:14:22.105422 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f282384b-8de5-4fd8-b02b-3a31f3f3a317 service cinder] RBAC: Authorization granted {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:14:22.114932 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 1452/2879] 10.222.0.84 () {60 vars in 1365 bytes} [Wed May 25 15:14:22 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 15:14:26.698680 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75e0f23e-3e81-49bc-960e-157c9ae57515 service cinder] Authenticating user token {{(pid=101892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:14:26.710640 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG dbcounter [-] [101892] Writing DB stats keystone:SELECT=100 {{(pid=101892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:14:26.768075 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75e0f23e-3e81-49bc-960e-157c9ae57515 service cinder] Validating token access rules against request {{(pid=101892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:14:26.772638 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e39c942d-0f32-4ec9-b0d8-4fac1d3c12ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cec56f74b2fa4826a506dc7b919465be', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:14:26.773503 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39c942d-0f32-4ec9-b0d8-4fac1d3c12ca admin admin] REQUEST_METHOD: `DELETE` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:14:26.773791 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39c942d-0f32-4ec9-b0d8-4fac1d3c12ca admin admin] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:14:26.774065 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39c942d-0f32-4ec9-b0d8-4fac1d3c12ca admin admin] PATH_INFO: `/v3/users/329746f491774318983d66a5c0799de3` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:14:26.775879 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e39c942d-0f32-4ec9-b0d8-4fac1d3c12ca admin admin] RBAC: Authorizing `identity:delete_user(user_id=329746f491774318983d66a5c0799de3)` {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:14:26.777805 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e39c942d-0f32-4ec9-b0d8-4fac1d3c12ca admin admin] RBAC: Authorization granted {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:14:26.949439 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.notifications [None req-e39c942d-0f32-4ec9-b0d8-4fac1d3c12ca admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '329746f491774318983d66a5c0799de3'} {{(pid=101892) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:14:26.956247 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.notifications [None req-e39c942d-0f32-4ec9-b0d8-4fac1d3c12ca admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '329746f491774318983d66a5c0799de3'} {{(pid=101892) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:14:26.968779 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.notifications [None req-e39c942d-0f32-4ec9-b0d8-4fac1d3c12ca admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '329746f491774318983d66a5c0799de3'} {{(pid=101892) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:14:26.969448 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.notifications [None req-e39c942d-0f32-4ec9-b0d8-4fac1d3c12ca admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '329746f491774318983d66a5c0799de3'} {{(pid=101892) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:14:27.055687 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.notifications [None req-e39c942d-0f32-4ec9-b0d8-4fac1d3c12ca admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '329746f491774318983d66a5c0799de3'} {{(pid=101892) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:14:27.062024 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 1428/2880] 10.222.0.84 () {58 vars in 1223 bytes} [Wed May 25 15:14:26 2022] DELETE /identity/v3/users/329746f491774318983d66a5c0799de3 => generated 0 bytes in 364 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 15:14:27.066942 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75be9e1b-e9ee-4894-b794-0be3e042ed45 None None] REQUEST_METHOD: `POST` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:14:27.067425 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75be9e1b-e9ee-4894-b794-0be3e042ed45 None None] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:14:27.067550 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75be9e1b-e9ee-4894-b794-0be3e042ed45 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:14:27.084805 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.auth.core [None req-75be9e1b-e9ee-4894-b794-0be3e042ed45 None None] MFA Rules not processed for user `05d87e87798e429aa1c10b24391f915e`. Rule list: `[]` (Enabled: `True`). {{(pid=101893) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:14:27.086009 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.fernet_utils [None req-75be9e1b-e9ee-4894-b794-0be3e042ed45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=101893) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:14:27.144049 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 1453/2881] 10.222.0.84 () {58 vars in 957 bytes} [Wed May 25 15:14:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 15:14:27.154472 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e39c942d-0f32-4ec9-b0d8-4fac1d3c12ca admin admin] Authenticating user token {{(pid=101892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:14:27.156052 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.fernet_utils [None req-e39c942d-0f32-4ec9-b0d8-4fac1d3c12ca admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=101892) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:14:27.213246 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e39c942d-0f32-4ec9-b0d8-4fac1d3c12ca admin admin] Validating token access rules against request {{(pid=101892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:14:27.216774 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a8fd7c3-96b8-4a74-8268-ff8b4a14831f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ce28b25b907473588ccb87dc4acc06a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a000829c658c4a7cab67f7b6353ba3fa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:14:27.217412 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8fd7c3-96b8-4a74-8268-ff8b4a14831f service neutron] REQUEST_METHOD: `GET` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:14:27.217692 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8fd7c3-96b8-4a74-8268-ff8b4a14831f service neutron] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:14:27.217966 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8fd7c3-96b8-4a74-8268-ff8b4a14831f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:14:27.226823 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a8fd7c3-96b8-4a74-8268-ff8b4a14831f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:14:27.228382 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a8fd7c3-96b8-4a74-8268-ff8b4a14831f service neutron] RBAC: Authorization granted {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:14:27.237962 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 1429/2882] 10.222.0.84 () {60 vars in 1365 bytes} [Wed May 25 15:14:27 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 15:14:27.616738 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75be9e1b-e9ee-4894-b794-0be3e042ed45 None None] Authenticating user token {{(pid=101893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:14:27.618816 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.fernet_utils [None req-75be9e1b-e9ee-4894-b794-0be3e042ed45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=101893) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:14:27.632954 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75be9e1b-e9ee-4894-b794-0be3e042ed45 None None] Validating token access rules against request {{(pid=101893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:14:27.638180 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f55e0c46-6efd-4ca3-9b65-0ebbe081f04f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cec56f74b2fa4826a506dc7b919465be', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:14:27.639078 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55e0c46-6efd-4ca3-9b65-0ebbe081f04f admin admin] REQUEST_METHOD: `DELETE` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:14:27.643098 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55e0c46-6efd-4ca3-9b65-0ebbe081f04f admin admin] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:14:27.643098 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55e0c46-6efd-4ca3-9b65-0ebbe081f04f admin admin] PATH_INFO: `/v3/projects/05ecbbe553fb4f79ae891d75e2837af0` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:14:27.643098 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f55e0c46-6efd-4ca3-9b65-0ebbe081f04f admin admin] RBAC: Authorizing `identity:delete_project(project_id=05ecbbe553fb4f79ae891d75e2837af0)` {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:14:27.643098 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f55e0c46-6efd-4ca3-9b65-0ebbe081f04f admin admin] RBAC: Authorization granted {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:14:27.735881 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG dbcounter [-] [101893] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=101893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:14:27.741862 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.notifications [None req-f55e0c46-6efd-4ca3-9b65-0ebbe081f04f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '05ecbbe553fb4f79ae891d75e2837af0', 'request_id': 'req-f55e0c46-6efd-4ca3-9b65-0ebbe081f04f'} {{(pid=101893) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:14:27.748474 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.notifications [None req-f55e0c46-6efd-4ca3-9b65-0ebbe081f04f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '05ecbbe553fb4f79ae891d75e2837af0', 'request_id': 'req-f55e0c46-6efd-4ca3-9b65-0ebbe081f04f'} {{(pid=101893) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:14:27.753922 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.notifications [None req-f55e0c46-6efd-4ca3-9b65-0ebbe081f04f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '05ecbbe553fb4f79ae891d75e2837af0', 'request_id': 'req-f55e0c46-6efd-4ca3-9b65-0ebbe081f04f'} {{(pid=101893) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:14:27.832245 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.notifications [None req-f55e0c46-6efd-4ca3-9b65-0ebbe081f04f admin admin] The token cache is being invalidate because project 05ecbbe553fb4f79ae891d75e2837af0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=101893) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 25 15:14:27.832545 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.notifications [None req-f55e0c46-6efd-4ca3-9b65-0ebbe081f04f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=101893) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:14:27.833205 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.notifications [None req-f55e0c46-6efd-4ca3-9b65-0ebbe081f04f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=101893) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:14:27.834760 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 1454/2883] 10.222.0.84 () {58 vars in 1232 bytes} [Wed May 25 15:14:27 2022] DELETE /identity/v3/projects/05ecbbe553fb4f79ae891d75e2837af0 => generated 0 bytes in 219 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 25 15:14:27.843472 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a8fd7c3-96b8-4a74-8268-ff8b4a14831f service neutron] Authenticating user token {{(pid=101892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:14:27.854005 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a8fd7c3-96b8-4a74-8268-ff8b4a14831f service neutron] Validating token access rules against request {{(pid=101892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:14:27.886641 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG dbcounter [-] [101892] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=101892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:14:27.916963 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7faf70c-ba1e-485f-acd5-0ea88d0605e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cec56f74b2fa4826a506dc7b919465be', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:14:27.917850 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7faf70c-ba1e-485f-acd5-0ea88d0605e4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:14:27.918131 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7faf70c-ba1e-485f-acd5-0ea88d0605e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:14:27.918411 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7faf70c-ba1e-485f-acd5-0ea88d0605e4 admin admin] PATH_INFO: `/v3/users/67b866b59e1b48c790b4e63e282ee075` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:14:27.919654 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7faf70c-ba1e-485f-acd5-0ea88d0605e4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=67b866b59e1b48c790b4e63e282ee075)` {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:14:27.921630 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7faf70c-ba1e-485f-acd5-0ea88d0605e4 admin admin] RBAC: Authorization granted {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:14:28.200723 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.notifications [None req-a7faf70c-ba1e-485f-acd5-0ea88d0605e4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '67b866b59e1b48c790b4e63e282ee075'} {{(pid=101892) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:14:28.207657 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.notifications [None req-a7faf70c-ba1e-485f-acd5-0ea88d0605e4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '67b866b59e1b48c790b4e63e282ee075'} {{(pid=101892) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:14:28.219545 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.notifications [None req-a7faf70c-ba1e-485f-acd5-0ea88d0605e4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '67b866b59e1b48c790b4e63e282ee075'} {{(pid=101892) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:14:28.220224 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.notifications [None req-a7faf70c-ba1e-485f-acd5-0ea88d0605e4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '67b866b59e1b48c790b4e63e282ee075'} {{(pid=101892) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:14:28.294856 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.notifications [None req-a7faf70c-ba1e-485f-acd5-0ea88d0605e4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '67b866b59e1b48c790b4e63e282ee075'} {{(pid=101892) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:14:28.300983 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 1430/2884] 10.222.0.84 () {58 vars in 1223 bytes} [Wed May 25 15:14:27 2022] DELETE /identity/v3/users/67b866b59e1b48c790b4e63e282ee075 => generated 0 bytes in 458 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 15:14:28.691132 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f55e0c46-6efd-4ca3-9b65-0ebbe081f04f admin admin] Authenticating user token {{(pid=101893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:14:28.692710 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.fernet_utils [None req-f55e0c46-6efd-4ca3-9b65-0ebbe081f04f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=101893) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:14:28.707232 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f55e0c46-6efd-4ca3-9b65-0ebbe081f04f admin admin] Validating token access rules against request {{(pid=101893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:14:28.776039 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b22bf00f-b82a-4796-a327-36b6848411cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cec56f74b2fa4826a506dc7b919465be', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:14:28.778166 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22bf00f-b82a-4796-a327-36b6848411cb admin admin] REQUEST_METHOD: `DELETE` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:14:28.778461 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22bf00f-b82a-4796-a327-36b6848411cb admin admin] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:14:28.778749 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22bf00f-b82a-4796-a327-36b6848411cb admin admin] PATH_INFO: `/v3/projects/18b8054623254fa2ab5a11f9a66b1050` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:14:28.780703 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b22bf00f-b82a-4796-a327-36b6848411cb admin admin] RBAC: Authorizing `identity:delete_project(project_id=18b8054623254fa2ab5a11f9a66b1050)` {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:14:28.786121 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b22bf00f-b82a-4796-a327-36b6848411cb admin admin] RBAC: Authorization granted {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:14:28.884849 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.notifications [None req-b22bf00f-b82a-4796-a327-36b6848411cb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '18b8054623254fa2ab5a11f9a66b1050', 'request_id': 'req-b22bf00f-b82a-4796-a327-36b6848411cb'} {{(pid=101893) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:14:28.891109 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.notifications [None req-b22bf00f-b82a-4796-a327-36b6848411cb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '18b8054623254fa2ab5a11f9a66b1050', 'request_id': 'req-b22bf00f-b82a-4796-a327-36b6848411cb'} {{(pid=101893) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:14:28.896598 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.notifications [None req-b22bf00f-b82a-4796-a327-36b6848411cb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '18b8054623254fa2ab5a11f9a66b1050', 'request_id': 'req-b22bf00f-b82a-4796-a327-36b6848411cb'} {{(pid=101893) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:14:28.992343 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.notifications [None req-b22bf00f-b82a-4796-a327-36b6848411cb admin admin] The token cache is being invalidate because project 18b8054623254fa2ab5a11f9a66b1050 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=101893) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 25 15:14:28.992573 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.notifications [None req-b22bf00f-b82a-4796-a327-36b6848411cb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=101893) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:14:28.993283 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.notifications [None req-b22bf00f-b82a-4796-a327-36b6848411cb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=101893) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:14:28.994822 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 1455/2885] 10.222.0.84 () {58 vars in 1232 bytes} [Wed May 25 15:14:28 2022] DELETE /identity/v3/projects/18b8054623254fa2ab5a11f9a66b1050 => generated 0 bytes in 304 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 15:14:28.998773 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7faf70c-ba1e-485f-acd5-0ea88d0605e4 admin admin] Authenticating user token {{(pid=101892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:14:29.002342 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.fernet_utils [None req-a7faf70c-ba1e-485f-acd5-0ea88d0605e4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=101892) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:14:29.012930 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7faf70c-ba1e-485f-acd5-0ea88d0605e4 admin admin] Validating token access rules against request {{(pid=101892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:14:29.081142 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-020f0752-2fb7-40ac-a4ff-95d15a170841 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cec56f74b2fa4826a506dc7b919465be', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:14:29.082023 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020f0752-2fb7-40ac-a4ff-95d15a170841 admin admin] REQUEST_METHOD: `DELETE` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:14:29.082400 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020f0752-2fb7-40ac-a4ff-95d15a170841 admin admin] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:14:29.082692 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020f0752-2fb7-40ac-a4ff-95d15a170841 admin admin] PATH_INFO: `/v3/users/88ccb7e712eb4c9ca6f2beef9fda7a52` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:14:29.083948 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-020f0752-2fb7-40ac-a4ff-95d15a170841 admin admin] RBAC: Authorizing `identity:delete_user(user_id=88ccb7e712eb4c9ca6f2beef9fda7a52)` {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:14:29.086002 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-020f0752-2fb7-40ac-a4ff-95d15a170841 admin admin] RBAC: Authorization granted {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:14:29.228420 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.notifications [None req-020f0752-2fb7-40ac-a4ff-95d15a170841 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '88ccb7e712eb4c9ca6f2beef9fda7a52'} {{(pid=101892) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:14:29.233593 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG dbcounter [-] [101892] Writing DB stats keystone:SELECT=82,keystone:DELETE=17,keystone:INSERT=1 {{(pid=101892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:14:29.235681 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.notifications [None req-020f0752-2fb7-40ac-a4ff-95d15a170841 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '88ccb7e712eb4c9ca6f2beef9fda7a52'} {{(pid=101892) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:14:29.247450 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.notifications [None req-020f0752-2fb7-40ac-a4ff-95d15a170841 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '88ccb7e712eb4c9ca6f2beef9fda7a52'} {{(pid=101892) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:14:29.248092 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.notifications [None req-020f0752-2fb7-40ac-a4ff-95d15a170841 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '88ccb7e712eb4c9ca6f2beef9fda7a52'} {{(pid=101892) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:14:29.300428 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.notifications [None req-020f0752-2fb7-40ac-a4ff-95d15a170841 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '88ccb7e712eb4c9ca6f2beef9fda7a52'} {{(pid=101892) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:14:29.306594 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 1431/2886] 10.222.0.84 () {58 vars in 1223 bytes} [Wed May 25 15:14:28 2022] DELETE /identity/v3/users/88ccb7e712eb4c9ca6f2beef9fda7a52 => generated 0 bytes in 308 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 15:14:29.708906 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b22bf00f-b82a-4796-a327-36b6848411cb admin admin] Authenticating user token {{(pid=101893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:14:29.715644 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.fernet_utils [None req-b22bf00f-b82a-4796-a327-36b6848411cb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=101893) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:14:29.724169 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b22bf00f-b82a-4796-a327-36b6848411cb admin admin] Validating token access rules against request {{(pid=101893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:14:29.780585 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c94ed349-0173-4f81-a05d-18b2425b8b01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cec56f74b2fa4826a506dc7b919465be', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:14:29.781361 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94ed349-0173-4f81-a05d-18b2425b8b01 admin admin] REQUEST_METHOD: `DELETE` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:14:29.781637 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94ed349-0173-4f81-a05d-18b2425b8b01 admin admin] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:14:29.781906 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94ed349-0173-4f81-a05d-18b2425b8b01 admin admin] PATH_INFO: `/v3/projects/41cacee1acd24d25b7e4170c62eee7eb` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:14:29.783063 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c94ed349-0173-4f81-a05d-18b2425b8b01 admin admin] RBAC: Authorizing `identity:delete_project(project_id=41cacee1acd24d25b7e4170c62eee7eb)` {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:14:29.785013 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c94ed349-0173-4f81-a05d-18b2425b8b01 admin admin] RBAC: Authorization granted {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:14:29.786406 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG dbcounter [-] [101893] Writing DB stats keystone:SELECT=87,keystone:DELETE=11,keystone:INSERT=2 {{(pid=101893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:14:29.901401 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.notifications [None req-c94ed349-0173-4f81-a05d-18b2425b8b01 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '41cacee1acd24d25b7e4170c62eee7eb', 'request_id': 'req-c94ed349-0173-4f81-a05d-18b2425b8b01'} {{(pid=101893) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:14:29.907869 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.notifications [None req-c94ed349-0173-4f81-a05d-18b2425b8b01 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '41cacee1acd24d25b7e4170c62eee7eb', 'request_id': 'req-c94ed349-0173-4f81-a05d-18b2425b8b01'} {{(pid=101893) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:14:29.913382 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.notifications [None req-c94ed349-0173-4f81-a05d-18b2425b8b01 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '41cacee1acd24d25b7e4170c62eee7eb', 'request_id': 'req-c94ed349-0173-4f81-a05d-18b2425b8b01'} {{(pid=101893) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:14:30.038315 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.notifications [None req-c94ed349-0173-4f81-a05d-18b2425b8b01 admin admin] The token cache is being invalidate because project 41cacee1acd24d25b7e4170c62eee7eb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=101893) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 25 15:14:30.038518 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.notifications [None req-c94ed349-0173-4f81-a05d-18b2425b8b01 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=101893) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:14:30.039152 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.notifications [None req-c94ed349-0173-4f81-a05d-18b2425b8b01 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=101893) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:14:30.041298 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 1456/2887] 10.222.0.84 () {58 vars in 1232 bytes} [Wed May 25 15:14:29 2022] DELETE /identity/v3/projects/41cacee1acd24d25b7e4170c62eee7eb => generated 0 bytes in 333 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 15:14:30.047002 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83432e5-ce72-4338-ba5c-bdd736b71598 None None] REQUEST_METHOD: `POST` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:14:30.047469 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83432e5-ce72-4338-ba5c-bdd736b71598 None None] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:14:30.047593 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83432e5-ce72-4338-ba5c-bdd736b71598 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:14:30.075786 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.auth.core [None req-b83432e5-ce72-4338-ba5c-bdd736b71598 None None] MFA Rules not processed for user `05d87e87798e429aa1c10b24391f915e`. Rule list: `[]` (Enabled: `True`). {{(pid=101892) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:14:30.076969 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.fernet_utils [None req-b83432e5-ce72-4338-ba5c-bdd736b71598 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=101892) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:14:30.134020 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 1432/2888] 10.222.0.84 () {58 vars in 957 bytes} [Wed May 25 15:14:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 15:14:30.142058 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f15b14e-c6e1-4bd4-96b0-c315f87a148b None None] REQUEST_METHOD: `POST` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:14:30.142353 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f15b14e-c6e1-4bd4-96b0-c315f87a148b None None] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:14:30.142639 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f15b14e-c6e1-4bd4-96b0-c315f87a148b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:14:30.160897 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.auth.core [None req-4f15b14e-c6e1-4bd4-96b0-c315f87a148b None None] MFA Rules not processed for user `05d87e87798e429aa1c10b24391f915e`. Rule list: `[]` (Enabled: `True`). {{(pid=101893) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:14:30.162118 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.fernet_utils [None req-4f15b14e-c6e1-4bd4-96b0-c315f87a148b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=101893) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:14:30.170743 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 1457/2889] 10.222.0.84 () {58 vars in 957 bytes} [Wed May 25 15:14:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 15:14:30.174923 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b83432e5-ce72-4338-ba5c-bdd736b71598 None None] Authenticating user token {{(pid=101892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:14:30.185011 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b83432e5-ce72-4338-ba5c-bdd736b71598 None None] Validating token access rules against request {{(pid=101892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:14:30.189783 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7528aaf-dba8-4386-a450-8a0a81604249 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cec56f74b2fa4826a506dc7b919465be', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:14:30.190426 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7528aaf-dba8-4386-a450-8a0a81604249 admin admin] REQUEST_METHOD: `GET` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:14:30.190708 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7528aaf-dba8-4386-a450-8a0a81604249 admin admin] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:14:30.190981 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7528aaf-dba8-4386-a450-8a0a81604249 admin admin] PATH_INFO: `/v3/domains` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:14:30.191836 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7528aaf-dba8-4386-a450-8a0a81604249 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=101892) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 15:14:30.192142 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7528aaf-dba8-4386-a450-8a0a81604249 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:14:30.193722 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7528aaf-dba8-4386-a450-8a0a81604249 admin admin] RBAC: Authorization granted {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:14:30.205425 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 1433/2890] 10.222.0.84 () {58 vars in 1152 bytes} [Wed May 25 15:14:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 15:14:30.209662 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f15b14e-c6e1-4bd4-96b0-c315f87a148b None None] Authenticating user token {{(pid=101893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:14:30.219340 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f15b14e-c6e1-4bd4-96b0-c315f87a148b None None] Validating token access rules against request {{(pid=101893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:14:30.224125 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0a64f30-6804-4f0d-b0ac-7d3a28e88bfd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cec56f74b2fa4826a506dc7b919465be', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:14:30.225915 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a64f30-6804-4f0d-b0ac-7d3a28e88bfd admin admin] REQUEST_METHOD: `POST` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:14:30.225915 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a64f30-6804-4f0d-b0ac-7d3a28e88bfd admin admin] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:14:30.225915 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a64f30-6804-4f0d-b0ac-7d3a28e88bfd admin admin] PATH_INFO: `/v3/projects` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:14:30.226196 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0a64f30-6804-4f0d-b0ac-7d3a28e88bfd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:14:30.228685 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0a64f30-6804-4f0d-b0ac-7d3a28e88bfd admin admin] RBAC: Authorization granted {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:14:30.325033 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 1458/2891] 10.222.0.84 () {60 vars in 1152 bytes} [Wed May 25 15:14:30 2022] POST /identity/v3/projects => generated 375 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 15:14:30.329401 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7528aaf-dba8-4386-a450-8a0a81604249 admin admin] Authenticating user token {{(pid=101892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:14:30.339785 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7528aaf-dba8-4386-a450-8a0a81604249 admin admin] Validating token access rules against request {{(pid=101892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:14:30.393769 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b87d9d1c-d714-4dab-984a-de2595ac4241 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cec56f74b2fa4826a506dc7b919465be', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:14:30.394435 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87d9d1c-d714-4dab-984a-de2595ac4241 admin admin] REQUEST_METHOD: `POST` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:14:30.394725 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87d9d1c-d714-4dab-984a-de2595ac4241 admin admin] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:14:30.395000 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87d9d1c-d714-4dab-984a-de2595ac4241 admin admin] PATH_INFO: `/v3/users` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:14:30.395723 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b87d9d1c-d714-4dab-984a-de2595ac4241 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:14:30.397632 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b87d9d1c-d714-4dab-984a-de2595ac4241 admin admin] RBAC: Authorization granted {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:14:30.478614 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 1434/2892] 10.222.0.84 () {60 vars in 1143 bytes} [Wed May 25 15:14:30 2022] POST /identity/v3/users => generated 288 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 15:14:30.482717 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0a64f30-6804-4f0d-b0ac-7d3a28e88bfd admin admin] Authenticating user token {{(pid=101893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:14:30.492869 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0a64f30-6804-4f0d-b0ac-7d3a28e88bfd admin admin] Validating token access rules against request {{(pid=101893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:14:30.497576 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c894be4-498f-4c1c-b77f-c206939c727f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cec56f74b2fa4826a506dc7b919465be', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:14:30.498232 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c894be4-498f-4c1c-b77f-c206939c727f admin admin] REQUEST_METHOD: `GET` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:14:30.498520 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c894be4-498f-4c1c-b77f-c206939c727f admin admin] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:14:30.498799 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c894be4-498f-4c1c-b77f-c206939c727f admin admin] PATH_INFO: `/v3/roles` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:14:30.499580 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c894be4-498f-4c1c-b77f-c206939c727f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:14:30.501202 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c894be4-498f-4c1c-b77f-c206939c727f admin admin] RBAC: Authorization granted {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:14:30.511496 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 1459/2893] 10.222.0.84 () {58 vars in 1121 bytes} [Wed May 25 15:14:30 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 15:14:30.515398 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b87d9d1c-d714-4dab-984a-de2595ac4241 admin admin] Authenticating user token {{(pid=101892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:14:30.526022 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b87d9d1c-d714-4dab-984a-de2595ac4241 admin admin] Validating token access rules against request {{(pid=101892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:14:30.530744 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae819e1-c0ae-484e-b9fe-47c194b0f6ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cec56f74b2fa4826a506dc7b919465be', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:14:30.531398 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae819e1-c0ae-484e-b9fe-47c194b0f6ef admin admin] REQUEST_METHOD: `GET` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:14:30.531816 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae819e1-c0ae-484e-b9fe-47c194b0f6ef admin admin] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:14:30.532097 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae819e1-c0ae-484e-b9fe-47c194b0f6ef admin admin] PATH_INFO: `/v3/roles` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:14:30.532814 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ae819e1-c0ae-484e-b9fe-47c194b0f6ef admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:14:30.534412 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ae819e1-c0ae-484e-b9fe-47c194b0f6ef admin admin] RBAC: Authorization granted {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:14:30.545063 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 1435/2894] 10.222.0.84 () {58 vars in 1121 bytes} [Wed May 25 15:14:30 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 15:14:30.548900 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c894be4-498f-4c1c-b77f-c206939c727f admin admin] Authenticating user token {{(pid=101893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:14:30.559426 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c894be4-498f-4c1c-b77f-c206939c727f admin admin] Validating token access rules against request {{(pid=101893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:14:30.564421 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-071a3e9c-3202-4eff-89a3-5ed2ded92c34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cec56f74b2fa4826a506dc7b919465be', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:14:30.565300 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071a3e9c-3202-4eff-89a3-5ed2ded92c34 admin admin] REQUEST_METHOD: `PUT` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:14:30.565586 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071a3e9c-3202-4eff-89a3-5ed2ded92c34 admin admin] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:14:30.565867 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071a3e9c-3202-4eff-89a3-5ed2ded92c34 admin admin] PATH_INFO: `/v3/projects/fb94e988bf5b42b1b226a5fa5635f4c4/users/f788de624c3a44e99057bdb0e4d8f463/roles/ff664fa0db7e4262a5accde96c3df4c3` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:14:30.580273 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-071a3e9c-3202-4eff-89a3-5ed2ded92c34 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fb94e988bf5b42b1b226a5fa5635f4c4, user_id=f788de624c3a44e99057bdb0e4d8f463, role_id=ff664fa0db7e4262a5accde96c3df4c3)` {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:14:30.582882 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-071a3e9c-3202-4eff-89a3-5ed2ded92c34 admin admin] RBAC: Authorization granted {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:14:30.667178 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 1460/2895] 10.222.0.84 () {60 vars in 1482 bytes} [Wed May 25 15:14:30 2022] PUT /identity/v3/projects/fb94e988bf5b42b1b226a5fa5635f4c4/users/f788de624c3a44e99057bdb0e4d8f463/roles/ff664fa0db7e4262a5accde96c3df4c3 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 15:14:30.677215 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9270c6-8e79-4365-8e27-0d43253d7427 None None] REQUEST_METHOD: `POST` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:14:30.677638 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9270c6-8e79-4365-8e27-0d43253d7427 None None] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:14:30.677791 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9270c6-8e79-4365-8e27-0d43253d7427 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:14:30.704495 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.auth.core [None req-3a9270c6-8e79-4365-8e27-0d43253d7427 None None] MFA Rules not processed for user `f788de624c3a44e99057bdb0e4d8f463`. Rule list: `[]` (Enabled: `True`). {{(pid=101892) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:14:30.705688 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.fernet_utils [None req-3a9270c6-8e79-4365-8e27-0d43253d7427 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=101892) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:14:30.723139 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG dbcounter [-] [101892] Writing DB stats keystone:SELECT=93,keystone:DELETE=3,keystone:INSERT=4 {{(pid=101892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:14:30.770252 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 1436/2896] 10.222.0.84 () {58 vars in 957 bytes} [Wed May 25 15:14:30 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 15:14:30.781534 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-071a3e9c-3202-4eff-89a3-5ed2ded92c34 admin admin] Authenticating user token {{(pid=101893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:14:30.783186 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.fernet_utils [None req-071a3e9c-3202-4eff-89a3-5ed2ded92c34 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=101893) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:14:30.845207 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-071a3e9c-3202-4eff-89a3-5ed2ded92c34 admin admin] Validating token access rules against request {{(pid=101893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:14:30.848887 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d55f5a1e-c908-4c91-971f-69d40ae74bfb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e079f89a5e524ab6ad4183e4f690de07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a000829c658c4a7cab67f7b6353ba3fa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:14:30.849531 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55f5a1e-c908-4c91-971f-69d40ae74bfb service cinder] REQUEST_METHOD: `GET` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:14:30.849815 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55f5a1e-c908-4c91-971f-69d40ae74bfb service cinder] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:14:30.850092 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55f5a1e-c908-4c91-971f-69d40ae74bfb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:14:30.858285 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d55f5a1e-c908-4c91-971f-69d40ae74bfb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:14:30.859758 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d55f5a1e-c908-4c91-971f-69d40ae74bfb service cinder] RBAC: Authorization granted {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:14:30.868426 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 1461/2897] 10.222.0.84 () {60 vars in 1365 bytes} [Wed May 25 15:14:30 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 15:14:40.792532 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG dbcounter [-] [101892] Writing DB stats keystone:SELECT=19 {{(pid=101892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:14:40.864448 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG dbcounter [-] [101893] Writing DB stats keystone:SELECT=77,keystone:DELETE=7,keystone:INSERT=3 {{(pid=101893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:14:42.152664 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a9270c6-8e79-4365-8e27-0d43253d7427 None None] Authenticating user token {{(pid=101892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:14:42.215443 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a9270c6-8e79-4365-8e27-0d43253d7427 None None] Validating token access rules against request {{(pid=101892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:14:42.219862 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82b11c2d-fb62-4491-8802-3f671f54d736 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cec56f74b2fa4826a506dc7b919465be', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:14:42.220719 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b11c2d-fb62-4491-8802-3f671f54d736 admin admin] REQUEST_METHOD: `DELETE` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:14:42.221004 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b11c2d-fb62-4491-8802-3f671f54d736 admin admin] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:14:42.221275 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b11c2d-fb62-4491-8802-3f671f54d736 admin admin] PATH_INFO: `/v3/users/f788de624c3a44e99057bdb0e4d8f463` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:14:42.222433 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82b11c2d-fb62-4491-8802-3f671f54d736 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f788de624c3a44e99057bdb0e4d8f463)` {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:14:42.224462 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82b11c2d-fb62-4491-8802-3f671f54d736 admin admin] RBAC: Authorization granted {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:14:42.474343 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.notifications [None req-82b11c2d-fb62-4491-8802-3f671f54d736 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f788de624c3a44e99057bdb0e4d8f463'} {{(pid=101892) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:14:42.481743 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.notifications [None req-82b11c2d-fb62-4491-8802-3f671f54d736 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f788de624c3a44e99057bdb0e4d8f463'} {{(pid=101892) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:14:42.493583 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.notifications [None req-82b11c2d-fb62-4491-8802-3f671f54d736 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f788de624c3a44e99057bdb0e4d8f463'} {{(pid=101892) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:14:42.494322 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.notifications [None req-82b11c2d-fb62-4491-8802-3f671f54d736 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f788de624c3a44e99057bdb0e4d8f463'} {{(pid=101892) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:14:42.569220 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.notifications [None req-82b11c2d-fb62-4491-8802-3f671f54d736 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f788de624c3a44e99057bdb0e4d8f463'} {{(pid=101892) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:14:42.575508 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 1437/2898] 10.222.0.84 () {58 vars in 1223 bytes} [Wed May 25 15:14:42 2022] DELETE /identity/v3/users/f788de624c3a44e99057bdb0e4d8f463 => generated 0 bytes in 423 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 15:14:42.580162 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe41853-a9ea-4e3f-a7e2-83d719a02e9f None None] REQUEST_METHOD: `POST` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:14:42.580650 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe41853-a9ea-4e3f-a7e2-83d719a02e9f None None] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:14:42.580764 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe41853-a9ea-4e3f-a7e2-83d719a02e9f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:14:42.598222 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.auth.core [None req-cfe41853-a9ea-4e3f-a7e2-83d719a02e9f None None] MFA Rules not processed for user `05d87e87798e429aa1c10b24391f915e`. Rule list: `[]` (Enabled: `True`). {{(pid=101893) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:14:42.599431 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.fernet_utils [None req-cfe41853-a9ea-4e3f-a7e2-83d719a02e9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=101893) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:14:42.657310 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 1462/2899] 10.222.0.84 () {58 vars in 957 bytes} [Wed May 25 15:14:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 15:14:42.667414 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82b11c2d-fb62-4491-8802-3f671f54d736 admin admin] Authenticating user token {{(pid=101892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:14:42.668820 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.fernet_utils [None req-82b11c2d-fb62-4491-8802-3f671f54d736 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=101892) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:14:42.725130 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82b11c2d-fb62-4491-8802-3f671f54d736 admin admin] Validating token access rules against request {{(pid=101892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:14:42.728634 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fab48792-5515-4b29-9119-6bb1a1e4614d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ce28b25b907473588ccb87dc4acc06a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a000829c658c4a7cab67f7b6353ba3fa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:14:42.729272 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab48792-5515-4b29-9119-6bb1a1e4614d service neutron] REQUEST_METHOD: `GET` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:14:42.729553 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab48792-5515-4b29-9119-6bb1a1e4614d service neutron] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:14:42.729830 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab48792-5515-4b29-9119-6bb1a1e4614d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:14:42.739048 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fab48792-5515-4b29-9119-6bb1a1e4614d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:14:42.740501 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fab48792-5515-4b29-9119-6bb1a1e4614d service neutron] RBAC: Authorization granted {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:14:42.749780 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 1438/2900] 10.222.0.84 () {60 vars in 1365 bytes} [Wed May 25 15:14:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 15:14:43.154057 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfe41853-a9ea-4e3f-a7e2-83d719a02e9f None None] Authenticating user token {{(pid=101893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:14:43.155524 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.fernet_utils [None req-cfe41853-a9ea-4e3f-a7e2-83d719a02e9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=101893) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:14:43.167701 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfe41853-a9ea-4e3f-a7e2-83d719a02e9f None None] Validating token access rules against request {{(pid=101893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:14:43.172481 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38d0b282-4d15-445b-bd8d-c089b02a3f68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cec56f74b2fa4826a506dc7b919465be', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:14:43.173345 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d0b282-4d15-445b-bd8d-c089b02a3f68 admin admin] REQUEST_METHOD: `DELETE` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:14:43.173706 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d0b282-4d15-445b-bd8d-c089b02a3f68 admin admin] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:14:43.173910 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d0b282-4d15-445b-bd8d-c089b02a3f68 admin admin] PATH_INFO: `/v3/projects/fb94e988bf5b42b1b226a5fa5635f4c4` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:14:43.175096 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38d0b282-4d15-445b-bd8d-c089b02a3f68 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fb94e988bf5b42b1b226a5fa5635f4c4)` {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:14:43.177048 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38d0b282-4d15-445b-bd8d-c089b02a3f68 admin admin] RBAC: Authorization granted {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:14:43.277604 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.notifications [None req-38d0b282-4d15-445b-bd8d-c089b02a3f68 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fb94e988bf5b42b1b226a5fa5635f4c4', 'request_id': 'req-38d0b282-4d15-445b-bd8d-c089b02a3f68'} {{(pid=101893) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:14:43.283612 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.notifications [None req-38d0b282-4d15-445b-bd8d-c089b02a3f68 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fb94e988bf5b42b1b226a5fa5635f4c4', 'request_id': 'req-38d0b282-4d15-445b-bd8d-c089b02a3f68'} {{(pid=101893) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:14:43.289114 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.notifications [None req-38d0b282-4d15-445b-bd8d-c089b02a3f68 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fb94e988bf5b42b1b226a5fa5635f4c4', 'request_id': 'req-38d0b282-4d15-445b-bd8d-c089b02a3f68'} {{(pid=101893) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:14:43.345738 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.notifications [None req-38d0b282-4d15-445b-bd8d-c089b02a3f68 admin admin] The token cache is being invalidate because project fb94e988bf5b42b1b226a5fa5635f4c4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=101893) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 25 15:14:43.346030 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.notifications [None req-38d0b282-4d15-445b-bd8d-c089b02a3f68 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=101893) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:14:43.346655 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.notifications [None req-38d0b282-4d15-445b-bd8d-c089b02a3f68 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=101893) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:14:43.348274 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 1463/2901] 10.222.0.84 () {58 vars in 1232 bytes} [Wed May 25 15:14:43 2022] DELETE /identity/v3/projects/fb94e988bf5b42b1b226a5fa5635f4c4 => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 15:14:52.745725 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG dbcounter [-] [101892] Writing DB stats keystone:SELECT=79,keystone:DELETE=10,keystone:INSERT=1 {{(pid=101892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:14:53.342622 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG dbcounter [-] [101893] Writing DB stats keystone:SELECT=54,keystone:DELETE=7,keystone:INSERT=1 {{(pid=101893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:15:44.476291 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fab48792-5515-4b29-9119-6bb1a1e4614d service neutron] Authenticating user token {{(pid=101892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:15:44.477742 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.fernet_utils [None req-fab48792-5515-4b29-9119-6bb1a1e4614d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=101892) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:15:44.570935 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fab48792-5515-4b29-9119-6bb1a1e4614d service neutron] Validating token access rules against request {{(pid=101892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:15:44.631406 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58f73071-bc01-401e-ba0d-008b0757a41d service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd18c4a1d92b94c0087a203db4fed22f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a000829c658c4a7cab67f7b6353ba3fa', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:15:44.632124 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f73071-bc01-401e-ba0d-008b0757a41d service placement] REQUEST_METHOD: `GET` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:15:44.632414 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f73071-bc01-401e-ba0d-008b0757a41d service placement] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:15:44.632699 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f73071-bc01-401e-ba0d-008b0757a41d service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:15:44.634493 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.fernet_utils [None req-58f73071-bc01-401e-ba0d-008b0757a41d service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=101892) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:15:44.645846 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58f73071-bc01-401e-ba0d-008b0757a41d service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:15:44.647539 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58f73071-bc01-401e-ba0d-008b0757a41d service placement] RBAC: Authorization granted {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:15:44.657714 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 1439/2902] 10.222.0.84 () {60 vars in 1365 bytes} [Wed May 25 15:15:44 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 182 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 15:15:54.653307 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG dbcounter [-] [101892] Writing DB stats keystone:SELECT=67 {{(pid=101892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:16:26.776198 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1adf52-74d3-4e66-ae48-aac118682f49 None None] REQUEST_METHOD: `GET` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:16:26.776689 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1adf52-74d3-4e66-ae48-aac118682f49 None None] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:16:26.776791 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1adf52-74d3-4e66-ae48-aac118682f49 None None] PATH_INFO: `/` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:16:26.778141 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 1464/2903] 10.222.0.84 () {54 vars in 921 bytes} [Wed May 25 15:16:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 15:16:26.784399 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850fa55a-6dd1-41b1-a5b6-05d118f30408 None None] REQUEST_METHOD: `POST` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:16:26.784888 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850fa55a-6dd1-41b1-a5b6-05d118f30408 None None] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:16:26.785001 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850fa55a-6dd1-41b1-a5b6-05d118f30408 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:16:26.832767 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.auth.core [None req-850fa55a-6dd1-41b1-a5b6-05d118f30408 None None] MFA Rules not processed for user `9ce28b25b907473588ccb87dc4acc06a`. Rule list: `[]` (Enabled: `True`). {{(pid=101892) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:16:26.833967 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.fernet_utils [None req-850fa55a-6dd1-41b1-a5b6-05d118f30408 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=101892) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:16:26.884888 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 1440/2904] 10.222.0.84 () {58 vars in 1018 bytes} [Wed May 25 15:16:26 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 15:16:26.896872 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa1adf52-74d3-4e66-ae48-aac118682f49 None None] Authenticating user token {{(pid=101893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:16:26.898588 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.fernet_utils [None req-aa1adf52-74d3-4e66-ae48-aac118682f49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=101893) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:16:26.912329 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa1adf52-74d3-4e66-ae48-aac118682f49 None None] Validating token access rules against request {{(pid=101893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:16:26.915850 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a191e3ca-9665-4ecc-8880-a124ea451155 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ce28b25b907473588ccb87dc4acc06a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a000829c658c4a7cab67f7b6353ba3fa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:16:26.916487 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a191e3ca-9665-4ecc-8880-a124ea451155 service neutron] REQUEST_METHOD: `GET` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:16:26.916779 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a191e3ca-9665-4ecc-8880-a124ea451155 service neutron] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:16:26.917054 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a191e3ca-9665-4ecc-8880-a124ea451155 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:16:26.924774 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a191e3ca-9665-4ecc-8880-a124ea451155 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:16:26.928380 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a191e3ca-9665-4ecc-8880-a124ea451155 service neutron] RBAC: Authorization granted {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:16:26.934682 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 1465/2905] 10.222.0.84 () {60 vars in 1365 bytes} [Wed May 25 15:16:26 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 15:16:27.015573 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d72184-c56c-4d9d-92e0-cad9b9ecd2f4 None None] REQUEST_METHOD: `GET` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:16:27.016432 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d72184-c56c-4d9d-92e0-cad9b9ecd2f4 None None] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:16:27.016719 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d72184-c56c-4d9d-92e0-cad9b9ecd2f4 None None] PATH_INFO: `/` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:16:27.018071 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 1441/2906] 10.222.0.84 () {54 vars in 921 bytes} [Wed May 25 15:16:27 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 15:16:27.023324 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9893ef-a666-43ca-bce3-562c8a428ab1 None None] REQUEST_METHOD: `POST` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:16:27.023646 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9893ef-a666-43ca-bce3-562c8a428ab1 None None] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:16:27.023938 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9893ef-a666-43ca-bce3-562c8a428ab1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:16:27.054493 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.auth.core [None req-ed9893ef-a666-43ca-bce3-562c8a428ab1 None None] MFA Rules not processed for user `2aeb182e6a5b43cfb0cc347ec847c848`. Rule list: `[]` (Enabled: `True`). {{(pid=101893) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:16:27.055745 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.fernet_utils [None req-ed9893ef-a666-43ca-bce3-562c8a428ab1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=101893) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:16:27.141345 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 1466/2907] 10.222.0.84 () {58 vars in 1018 bytes} [Wed May 25 15:16:27 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 15:16:27.152229 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89d72184-c56c-4d9d-92e0-cad9b9ecd2f4 None None] Authenticating user token {{(pid=101892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:16:27.153896 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.fernet_utils [None req-89d72184-c56c-4d9d-92e0-cad9b9ecd2f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=101892) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:16:27.167196 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89d72184-c56c-4d9d-92e0-cad9b9ecd2f4 None None] Validating token access rules against request {{(pid=101892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:16:27.170701 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec3b0c2d-de30-4588-82cf-65b387985cd0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ce28b25b907473588ccb87dc4acc06a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a000829c658c4a7cab67f7b6353ba3fa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:16:27.171350 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3b0c2d-de30-4588-82cf-65b387985cd0 service neutron] REQUEST_METHOD: `GET` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:16:27.171677 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3b0c2d-de30-4588-82cf-65b387985cd0 service neutron] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:16:27.171961 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3b0c2d-de30-4588-82cf-65b387985cd0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:16:27.182449 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec3b0c2d-de30-4588-82cf-65b387985cd0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:16:27.184178 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec3b0c2d-de30-4588-82cf-65b387985cd0 service neutron] RBAC: Authorization granted {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:16:27.195342 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 1442/2908] 10.222.0.84 () {60 vars in 1365 bytes} [Wed May 25 15:16:27 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 15:16:27.257730 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed9893ef-a666-43ca-bce3-562c8a428ab1 None None] Authenticating user token {{(pid=101893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:16:27.259138 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.fernet_utils [None req-ed9893ef-a666-43ca-bce3-562c8a428ab1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=101893) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:16:27.273267 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed9893ef-a666-43ca-bce3-562c8a428ab1 None None] Validating token access rules against request {{(pid=101893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:16:27.278477 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58b3909a-bf0e-4db1-a86b-10c3cdaa4956 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd18c4a1d92b94c0087a203db4fed22f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a000829c658c4a7cab67f7b6353ba3fa', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:16:27.279119 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b3909a-bf0e-4db1-a86b-10c3cdaa4956 service placement] REQUEST_METHOD: `GET` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:16:27.279407 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b3909a-bf0e-4db1-a86b-10c3cdaa4956 service placement] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:16:27.279759 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b3909a-bf0e-4db1-a86b-10c3cdaa4956 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:16:27.281491 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.fernet_utils [None req-58b3909a-bf0e-4db1-a86b-10c3cdaa4956 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=101893) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:16:27.292853 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58b3909a-bf0e-4db1-a86b-10c3cdaa4956 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:16:27.294446 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58b3909a-bf0e-4db1-a86b-10c3cdaa4956 service placement] RBAC: Authorization granted {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:16:27.304980 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 1467/2909] 10.222.0.84 () {60 vars in 1365 bytes} [Wed May 25 15:16:27 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 15:16:27.682305 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec3b0c2d-de30-4588-82cf-65b387985cd0 service neutron] Authenticating user token {{(pid=101892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:16:27.684136 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.fernet_utils [None req-ec3b0c2d-de30-4588-82cf-65b387985cd0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=101892) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:16:27.701358 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec3b0c2d-de30-4588-82cf-65b387985cd0 service neutron] Validating token access rules against request {{(pid=101892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:16:27.707873 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-465e9629-ecfb-4635-810e-3debb7d1ec6f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2aeb182e6a5b43cfb0cc347ec847c848', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a000829c658c4a7cab67f7b6353ba3fa', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:16:27.708593 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465e9629-ecfb-4635-810e-3debb7d1ec6f service nova] REQUEST_METHOD: `GET` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:16:27.708946 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465e9629-ecfb-4635-810e-3debb7d1ec6f service nova] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:16:27.709287 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465e9629-ecfb-4635-810e-3debb7d1ec6f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:16:27.711119 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.fernet_utils [None req-465e9629-ecfb-4635-810e-3debb7d1ec6f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=101892) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:16:27.723759 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-465e9629-ecfb-4635-810e-3debb7d1ec6f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:16:27.725608 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-465e9629-ecfb-4635-810e-3debb7d1ec6f service nova] RBAC: Authorization granted {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:16:27.736665 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 1443/2910] 10.222.0.84 () {60 vars in 1365 bytes} [Wed May 25 15:16:27 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 15:16:37.301480 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG dbcounter [-] [101893] Writing DB stats keystone:SELECT=55 {{(pid=101893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:16:37.731855 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG dbcounter [-] [101892] Writing DB stats keystone:SELECT=45 {{(pid=101892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:18:22.014058 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58b3909a-bf0e-4db1-a86b-10c3cdaa4956 service placement] Authenticating user token {{(pid=101893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:18:22.023978 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58b3909a-bf0e-4db1-a86b-10c3cdaa4956 service placement] Validating token access rules against request {{(pid=101893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:18:22.027530 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a47828d1-a5fd-4167-b407-b10c1baeafef service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ce28b25b907473588ccb87dc4acc06a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a000829c658c4a7cab67f7b6353ba3fa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:18:22.028191 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47828d1-a5fd-4167-b407-b10c1baeafef service neutron] REQUEST_METHOD: `GET` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:18:22.028477 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47828d1-a5fd-4167-b407-b10c1baeafef service neutron] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:18:22.028755 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47828d1-a5fd-4167-b407-b10c1baeafef service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:18:22.030503 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.fernet_utils [None req-a47828d1-a5fd-4167-b407-b10c1baeafef service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=101893) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:18:22.088622 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a47828d1-a5fd-4167-b407-b10c1baeafef service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:18:22.090048 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a47828d1-a5fd-4167-b407-b10c1baeafef service neutron] RBAC: Authorization granted {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:18:22.099487 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 1468/2911] 10.222.0.84 () {60 vars in 1365 bytes} [Wed May 25 15:18:22 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 15:18:23.802062 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-465e9629-ecfb-4635-810e-3debb7d1ec6f service nova] Authenticating user token {{(pid=101892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:18:23.812377 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-465e9629-ecfb-4635-810e-3debb7d1ec6f service nova] Validating token access rules against request {{(pid=101892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:18:23.817294 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd101ed1-d867-489c-8428-95f1a29264f2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ce28b25b907473588ccb87dc4acc06a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a000829c658c4a7cab67f7b6353ba3fa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:18:23.817939 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd101ed1-d867-489c-8428-95f1a29264f2 service neutron] REQUEST_METHOD: `GET` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:18:23.818224 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd101ed1-d867-489c-8428-95f1a29264f2 service neutron] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:18:23.818504 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd101ed1-d867-489c-8428-95f1a29264f2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:18:23.820375 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.fernet_utils [None req-cd101ed1-d867-489c-8428-95f1a29264f2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=101892) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:18:23.836248 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd101ed1-d867-489c-8428-95f1a29264f2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:18:23.837684 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd101ed1-d867-489c-8428-95f1a29264f2 service neutron] RBAC: Authorization granted {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:18:23.849217 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 1444/2912] 10.222.0.84 () {60 vars in 1365 bytes} [Wed May 25 15:18:23 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 15:18:25.043919 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a47828d1-a5fd-4167-b407-b10c1baeafef service neutron] Authenticating user token {{(pid=101893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:18:25.052791 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a47828d1-a5fd-4167-b407-b10c1baeafef service neutron] Validating token access rules against request {{(pid=101893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:18:25.056739 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b5af83d-cf61-45c6-a7b8-11816c7f7771 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ce28b25b907473588ccb87dc4acc06a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a000829c658c4a7cab67f7b6353ba3fa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:18:25.057380 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5af83d-cf61-45c6-a7b8-11816c7f7771 service neutron] REQUEST_METHOD: `GET` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:18:25.057664 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5af83d-cf61-45c6-a7b8-11816c7f7771 service neutron] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:18:25.057942 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5af83d-cf61-45c6-a7b8-11816c7f7771 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:18:25.059707 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.fernet_utils [None req-3b5af83d-cf61-45c6-a7b8-11816c7f7771 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=101893) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:18:25.072987 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b5af83d-cf61-45c6-a7b8-11816c7f7771 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:18:25.074421 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b5af83d-cf61-45c6-a7b8-11816c7f7771 service neutron] RBAC: Authorization granted {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:18:25.085830 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 1469/2913] 10.222.0.84 () {60 vars in 1365 bytes} [Wed May 25 15:18:25 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 15:18:28.848322 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd101ed1-d867-489c-8428-95f1a29264f2 service neutron] Authenticating user token {{(pid=101892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:18:28.861759 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd101ed1-d867-489c-8428-95f1a29264f2 service neutron] Validating token access rules against request {{(pid=101892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:18:28.866286 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98473ad2-1167-4bd6-9115-98ee4a029ff7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ce28b25b907473588ccb87dc4acc06a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a000829c658c4a7cab67f7b6353ba3fa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:18:28.867068 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98473ad2-1167-4bd6-9115-98ee4a029ff7 service neutron] REQUEST_METHOD: `GET` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:18:28.867457 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98473ad2-1167-4bd6-9115-98ee4a029ff7 service neutron] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:18:28.867864 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98473ad2-1167-4bd6-9115-98ee4a029ff7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:18:28.869828 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.fernet_utils [None req-98473ad2-1167-4bd6-9115-98ee4a029ff7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=101892) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:18:28.937733 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98473ad2-1167-4bd6-9115-98ee4a029ff7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:18:28.939171 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98473ad2-1167-4bd6-9115-98ee4a029ff7 service neutron] RBAC: Authorization granted {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:18:28.948946 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 1445/2914] 10.222.0.84 () {60 vars in 1365 bytes} [Wed May 25 15:18:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 15:18:32.479086 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b5af83d-cf61-45c6-a7b8-11816c7f7771 service neutron] Authenticating user token {{(pid=101893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:18:32.480637 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.fernet_utils [None req-3b5af83d-cf61-45c6-a7b8-11816c7f7771 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=101893) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:18:32.495292 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b5af83d-cf61-45c6-a7b8-11816c7f7771 service neutron] Validating token access rules against request {{(pid=101893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:18:32.500591 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-736d1fa6-b851-4f11-8496-53dfa2bf3f46 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd18c4a1d92b94c0087a203db4fed22f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a000829c658c4a7cab67f7b6353ba3fa', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:18:32.501295 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-736d1fa6-b851-4f11-8496-53dfa2bf3f46 service placement] REQUEST_METHOD: `GET` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:18:32.501583 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-736d1fa6-b851-4f11-8496-53dfa2bf3f46 service placement] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:18:32.501863 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-736d1fa6-b851-4f11-8496-53dfa2bf3f46 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:18:32.504237 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.fernet_utils [None req-736d1fa6-b851-4f11-8496-53dfa2bf3f46 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=101893) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:18:32.516202 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-736d1fa6-b851-4f11-8496-53dfa2bf3f46 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:18:32.517799 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-736d1fa6-b851-4f11-8496-53dfa2bf3f46 service placement] RBAC: Authorization granted {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:18:32.528260 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 1470/2915] 10.222.0.84 () {60 vars in 1365 bytes} [Wed May 25 15:18:32 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 15:18:36.032331 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98473ad2-1167-4bd6-9115-98ee4a029ff7 service neutron] Authenticating user token {{(pid=101892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:18:36.044047 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98473ad2-1167-4bd6-9115-98ee4a029ff7 service neutron] Validating token access rules against request {{(pid=101892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:18:36.049226 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db41507-4dbe-477c-bc28-5d8de6d5fea8 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd18c4a1d92b94c0087a203db4fed22f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a000829c658c4a7cab67f7b6353ba3fa', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:18:36.050439 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db41507-4dbe-477c-bc28-5d8de6d5fea8 service placement] REQUEST_METHOD: `GET` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:18:36.050718 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db41507-4dbe-477c-bc28-5d8de6d5fea8 service placement] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:18:36.050990 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db41507-4dbe-477c-bc28-5d8de6d5fea8 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:18:36.052874 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.fernet_utils [None req-4db41507-4dbe-477c-bc28-5d8de6d5fea8 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=101892) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:18:36.065934 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4db41507-4dbe-477c-bc28-5d8de6d5fea8 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:18:36.067548 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4db41507-4dbe-477c-bc28-5d8de6d5fea8 service placement] RBAC: Authorization granted {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:18:36.077891 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 1446/2916] 10.222.0.84 () {60 vars in 1365 bytes} [Wed May 25 15:18:36 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 25 15:18:36.184134 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-736d1fa6-b851-4f11-8496-53dfa2bf3f46 service placement] Authenticating user token {{(pid=101893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:18:36.185579 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.fernet_utils [None req-736d1fa6-b851-4f11-8496-53dfa2bf3f46 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=101893) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:18:36.200875 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-736d1fa6-b851-4f11-8496-53dfa2bf3f46 service placement] Validating token access rules against request {{(pid=101893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:18:36.205709 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccee1bce-6c20-437f-bbe9-4b312a57f988 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cec56f74b2fa4826a506dc7b919465be', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:18:36.206585 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccee1bce-6c20-437f-bbe9-4b312a57f988 admin admin] REQUEST_METHOD: `DELETE` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:18:36.206865 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccee1bce-6c20-437f-bbe9-4b312a57f988 admin admin] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:18:36.207135 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccee1bce-6c20-437f-bbe9-4b312a57f988 admin admin] PATH_INFO: `/v3/users/4e3b076bde0145559e76d607a7d2cf81` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:18:36.208327 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccee1bce-6c20-437f-bbe9-4b312a57f988 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4e3b076bde0145559e76d607a7d2cf81)` {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:18:36.210333 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccee1bce-6c20-437f-bbe9-4b312a57f988 admin admin] RBAC: Authorization granted {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:18:36.394517 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.notifications [None req-ccee1bce-6c20-437f-bbe9-4b312a57f988 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4e3b076bde0145559e76d607a7d2cf81'} {{(pid=101893) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:18:36.401793 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.notifications [None req-ccee1bce-6c20-437f-bbe9-4b312a57f988 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4e3b076bde0145559e76d607a7d2cf81'} {{(pid=101893) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:18:36.414008 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.notifications [None req-ccee1bce-6c20-437f-bbe9-4b312a57f988 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4e3b076bde0145559e76d607a7d2cf81'} {{(pid=101893) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:18:36.414713 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.notifications [None req-ccee1bce-6c20-437f-bbe9-4b312a57f988 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4e3b076bde0145559e76d607a7d2cf81'} {{(pid=101893) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:18:36.415331 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.notifications [None req-ccee1bce-6c20-437f-bbe9-4b312a57f988 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4e3b076bde0145559e76d607a7d2cf81'} {{(pid=101893) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:18:36.506709 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 1471/2917] 10.222.0.84 () {58 vars in 1223 bytes} [Wed May 25 15:18:36 2022] DELETE /identity/v3/users/4e3b076bde0145559e76d607a7d2cf81 => generated 0 bytes in 323 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 15:18:36.753989 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db41507-4dbe-477c-bc28-5d8de6d5fea8 service placement] Authenticating user token {{(pid=101892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:18:36.765513 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db41507-4dbe-477c-bc28-5d8de6d5fea8 service placement] Validating token access rules against request {{(pid=101892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:18:36.822562 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce0eeab3-f5af-489c-95ba-9a196d0c6491 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cec56f74b2fa4826a506dc7b919465be', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:18:36.823418 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce0eeab3-f5af-489c-95ba-9a196d0c6491 admin admin] REQUEST_METHOD: `DELETE` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:18:36.823735 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce0eeab3-f5af-489c-95ba-9a196d0c6491 admin admin] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:18:36.824021 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce0eeab3-f5af-489c-95ba-9a196d0c6491 admin admin] PATH_INFO: `/v3/projects/62c74474b96744798313d5f901bd002c` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:18:36.825194 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce0eeab3-f5af-489c-95ba-9a196d0c6491 admin admin] RBAC: Authorizing `identity:delete_project(project_id=62c74474b96744798313d5f901bd002c)` {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:18:36.827092 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce0eeab3-f5af-489c-95ba-9a196d0c6491 admin admin] RBAC: Authorization granted {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:18:36.983032 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.notifications [None req-ce0eeab3-f5af-489c-95ba-9a196d0c6491 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '62c74474b96744798313d5f901bd002c', 'request_id': 'req-ce0eeab3-f5af-489c-95ba-9a196d0c6491'} {{(pid=101892) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:18:36.989319 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.notifications [None req-ce0eeab3-f5af-489c-95ba-9a196d0c6491 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '62c74474b96744798313d5f901bd002c', 'request_id': 'req-ce0eeab3-f5af-489c-95ba-9a196d0c6491'} {{(pid=101892) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:18:36.995072 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.notifications [None req-ce0eeab3-f5af-489c-95ba-9a196d0c6491 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '62c74474b96744798313d5f901bd002c', 'request_id': 'req-ce0eeab3-f5af-489c-95ba-9a196d0c6491'} {{(pid=101892) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:18:37.097138 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG dbcounter [-] [101892] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=101892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:18:37.102092 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.notifications [None req-ce0eeab3-f5af-489c-95ba-9a196d0c6491 admin admin] The token cache is being invalidate because project 62c74474b96744798313d5f901bd002c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=101892) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 25 15:18:37.102384 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.notifications [None req-ce0eeab3-f5af-489c-95ba-9a196d0c6491 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=101892) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:18:37.103008 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.notifications [None req-ce0eeab3-f5af-489c-95ba-9a196d0c6491 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=101892) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:18:37.104607 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 1447/2918] 10.222.0.84 () {58 vars in 1232 bytes} [Wed May 25 15:18:36 2022] DELETE /identity/v3/projects/62c74474b96744798313d5f901bd002c => generated 0 bytes in 351 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 15:18:37.108571 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccee1bce-6c20-437f-bbe9-4b312a57f988 admin admin] Authenticating user token {{(pid=101893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:18:37.109964 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.fernet_utils [None req-ccee1bce-6c20-437f-bbe9-4b312a57f988 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=101893) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:18:37.122864 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccee1bce-6c20-437f-bbe9-4b312a57f988 admin admin] Validating token access rules against request {{(pid=101893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:18:37.163969 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG dbcounter [-] [101893] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=101893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:18:37.178329 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7bcf379-50c0-4350-8fb3-bd5dbf76198d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cec56f74b2fa4826a506dc7b919465be', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:18:37.180569 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7bcf379-50c0-4350-8fb3-bd5dbf76198d admin admin] REQUEST_METHOD: `DELETE` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:18:37.180569 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7bcf379-50c0-4350-8fb3-bd5dbf76198d admin admin] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:18:37.180569 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7bcf379-50c0-4350-8fb3-bd5dbf76198d admin admin] PATH_INFO: `/v3/users/afd057de163243329131da8fac5a9d5b` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:18:37.181241 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7bcf379-50c0-4350-8fb3-bd5dbf76198d admin admin] RBAC: Authorizing `identity:delete_user(user_id=afd057de163243329131da8fac5a9d5b)` {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:18:37.183160 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7bcf379-50c0-4350-8fb3-bd5dbf76198d admin admin] RBAC: Authorization granted {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:18:37.527057 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.notifications [None req-e7bcf379-50c0-4350-8fb3-bd5dbf76198d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'afd057de163243329131da8fac5a9d5b'} {{(pid=101893) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:18:37.533764 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.notifications [None req-e7bcf379-50c0-4350-8fb3-bd5dbf76198d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'afd057de163243329131da8fac5a9d5b'} {{(pid=101893) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:18:37.545284 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.notifications [None req-e7bcf379-50c0-4350-8fb3-bd5dbf76198d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'afd057de163243329131da8fac5a9d5b'} {{(pid=101893) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:18:37.545948 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.notifications [None req-e7bcf379-50c0-4350-8fb3-bd5dbf76198d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'afd057de163243329131da8fac5a9d5b'} {{(pid=101893) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:18:37.546552 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.notifications [None req-e7bcf379-50c0-4350-8fb3-bd5dbf76198d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'afd057de163243329131da8fac5a9d5b'} {{(pid=101893) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:18:37.736408 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 1472/2919] 10.222.0.84 () {58 vars in 1223 bytes} [Wed May 25 15:18:37 2022] DELETE /identity/v3/users/afd057de163243329131da8fac5a9d5b => generated 0 bytes in 628 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 15:18:37.978517 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce0eeab3-f5af-489c-95ba-9a196d0c6491 admin admin] Authenticating user token {{(pid=101892) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:18:37.980396 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.fernet_utils [None req-ce0eeab3-f5af-489c-95ba-9a196d0c6491 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=101892) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:18:37.995519 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce0eeab3-f5af-489c-95ba-9a196d0c6491 admin admin] Validating token access rules against request {{(pid=101892) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:18:38.053380 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cb39e03-bc01-4c1c-aca3-793e859cf8ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05d87e87798e429aa1c10b24391f915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cec56f74b2fa4826a506dc7b919465be', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101892) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:18:38.054428 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb39e03-bc01-4c1c-aca3-793e859cf8ba admin admin] REQUEST_METHOD: `DELETE` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:18:38.054713 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb39e03-bc01-4c1c-aca3-793e859cf8ba admin admin] SCRIPT_NAME: `/identity` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:18:38.054993 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb39e03-bc01-4c1c-aca3-793e859cf8ba admin admin] PATH_INFO: `/v3/projects/f5a4e14d2b3e4882ac21c6cd84cff106` {{(pid=101892) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:18:38.056199 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cb39e03-bc01-4c1c-aca3-793e859cf8ba admin admin] RBAC: Authorizing `identity:delete_project(project_id=f5a4e14d2b3e4882ac21c6cd84cff106)` {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:18:38.058099 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cb39e03-bc01-4c1c-aca3-793e859cf8ba admin admin] RBAC: Authorization granted {{(pid=101892) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:18:38.188115 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.notifications [None req-2cb39e03-bc01-4c1c-aca3-793e859cf8ba admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f5a4e14d2b3e4882ac21c6cd84cff106', 'request_id': 'req-2cb39e03-bc01-4c1c-aca3-793e859cf8ba'} {{(pid=101892) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:18:38.194348 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.notifications [None req-2cb39e03-bc01-4c1c-aca3-793e859cf8ba admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f5a4e14d2b3e4882ac21c6cd84cff106', 'request_id': 'req-2cb39e03-bc01-4c1c-aca3-793e859cf8ba'} {{(pid=101892) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:18:38.199894 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.notifications [None req-2cb39e03-bc01-4c1c-aca3-793e859cf8ba admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f5a4e14d2b3e4882ac21c6cd84cff106', 'request_id': 'req-2cb39e03-bc01-4c1c-aca3-793e859cf8ba'} {{(pid=101892) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:18:38.301361 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.notifications [None req-2cb39e03-bc01-4c1c-aca3-793e859cf8ba admin admin] The token cache is being invalidate because project f5a4e14d2b3e4882ac21c6cd84cff106 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=101892) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 25 15:18:38.301642 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.notifications [None req-2cb39e03-bc01-4c1c-aca3-793e859cf8ba admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=101892) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:18:38.302259 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG keystone.notifications [None req-2cb39e03-bc01-4c1c-aca3-793e859cf8ba admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=101892) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:18:38.304145 dv-cinder-803823-9-smb devstack@keystone.service[101892]: [pid: 101892|app: 0|req: 1448/2920] 10.222.0.84 () {58 vars in 1232 bytes} [Wed May 25 15:18:37 2022] DELETE /identity/v3/projects/f5a4e14d2b3e4882ac21c6cd84cff106 => generated 0 bytes in 326 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 25 15:18:47.851049 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG dbcounter [-] [101893] Writing DB stats keystone:SELECT=33,keystone:DELETE=10,keystone:INSERT=1 {{(pid=101893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:18:48.298131 dv-cinder-803823-9-smb devstack@keystone.service[101892]: DEBUG dbcounter [-] [101892] Writing DB stats keystone:SELECT=52,keystone:DELETE=7,keystone:INSERT=1 {{(pid=101892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:20:51.395576 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7bcf379-50c0-4350-8fb3-bd5dbf76198d admin admin] Authenticating user token {{(pid=101893) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:20:51.397141 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.fernet_utils [None req-e7bcf379-50c0-4350-8fb3-bd5dbf76198d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=101893) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:20:51.469110 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7bcf379-50c0-4350-8fb3-bd5dbf76198d admin admin] Validating token access rules against request {{(pid=101893) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:20:51.527048 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-575f980e-a3ae-4558-a21b-122efcf0f9c9 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd18c4a1d92b94c0087a203db4fed22f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a000829c658c4a7cab67f7b6353ba3fa', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101893) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:20:51.527723 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575f980e-a3ae-4558-a21b-122efcf0f9c9 service placement] REQUEST_METHOD: `GET` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:20:51.528011 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575f980e-a3ae-4558-a21b-122efcf0f9c9 service placement] SCRIPT_NAME: `/identity` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:20:51.528288 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575f980e-a3ae-4558-a21b-122efcf0f9c9 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=101893) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:20:51.530078 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.fernet_utils [None req-575f980e-a3ae-4558-a21b-122efcf0f9c9 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=101893) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:20:51.541670 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-575f980e-a3ae-4558-a21b-122efcf0f9c9 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:20:51.543244 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-575f980e-a3ae-4558-a21b-122efcf0f9c9 service placement] RBAC: Authorization granted {{(pid=101893) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:20:51.553781 dv-cinder-803823-9-smb devstack@keystone.service[101893]: [pid: 101893|app: 0|req: 1473/2921] 10.222.0.84 () {60 vars in 1365 bytes} [Wed May 25 15:20:51 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 158 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 15:21:01.548866 dv-cinder-803823-9-smb devstack@keystone.service[101893]: DEBUG dbcounter [-] [101893] Writing DB stats keystone:SELECT=58 {{(pid=101893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}